I’m curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)
What do you consider the “best” model under ~30B parameters?
I’m curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)
What do you consider the “best” model under ~30B parameters?
I really liked Mistral-Nemo-Instruct for its allround capabilities. But it’s old and hardly the best any more. But I feel lots of newer models are sycophants and tuned more for question answering and assistant stuff, and their ability to write long-form prose or role play as a Podcast host hasn’t really improved substancially. These days I switch models. I’ll use something more creative if I want that, or switch to a model dedicated to coding if I want autocomplete. But to be honest, coding isn’t on my list of requirements any more. I’ve tried AI coding and it’s not really helping with what I do. I regularly waste some extra 30%-100% of time if I do it with AI, and that’s with the huge commercial services like AIstudio or ChatGPT.
Yeah a true Nemo successor is sorely overdue