• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    15 days ago

    FYI the ‘Le Chonk’ fat cat meme has been a thing in the localllama community, which I suppose Mistral is referencing. Its a nickname for giant models that only the insane would try to run locally.

    And this is supposedly a big deal because Mistral was… not great, for a long time. They basically pioneered the MoE models that got so popular, then faded into irrelevance for a while.

    • Mika@piefed.ca
      link
      fedilink
      English
      arrow-up
      4
      ·
      14 days ago

      Kimi k3 has 2.8T, so it’s not even the chonkiest open weights model now

    • punkibas@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      15 days ago

      That was very funny and interesting insight, thanks! I also tried running a model that had no sense running on my hardware, didn’t know there was a meme about it