I’m curious about what the consensus is here for which models are used for general purpose stuff (coding assist, general experimentation, etc)

What do you consider the “best” model under ~30B parameters?

  • hendrik@palaver.p3x.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    6 days ago

    I really liked Mistral-Nemo-Instruct for its allround capabilities. But it’s old and hardly the best any more. But I feel lots of newer models are sycophants and tuned more for question answering and assistant stuff, and their ability to write long-form prose or role play as a Podcast host hasn’t really improved substancially. These days I switch models. I’ll use something more creative if I want that, or switch to a model dedicated to coding if I want autocomplete. But to be honest, coding isn’t on my list of requirements any more. I’ve tried AI coding and it’s not really helping with what I do. I regularly waste some extra 30%-100% of time if I do it with AI, and that’s with the huge commercial services like AIstudio or ChatGPT.