I’ve tried coding and every one I’ve tried fails unless really, really basic small functions like what you learn as a newbie compared to say 4o mini that can spit out more sensible stuff that works.
I’ve tried explanations and they just regurgitate sentences that can be irrelevant, wrong, or get stuck in a loop.
So. what can I actually use a small LLM for? Which ones? I ask because I have an old laptop and the GPU can’t really handle anything above 4B in a timely manner. 8B is about 1 t/s!
So this wasn’t a post actually asking what a small LLM was good for, it was just an opportunity you could use to dump on LLM usage I take it. So this whole thing was made in bad faith?
With the comments about “vibe coding” and such, all it looks like you’re doing here is arguing the “merits” of how it’s being used, and you’re not interested in its actual usage at all.
Nobody is being pissy here except you. Small LLMs can be used for tasks such as this, and it doesn’t have to be twitch - It could be an assistant that you build for reminders in your personal life - using it on twitch is a minor detail that you seem to have latched onto because you just want to dump on LLM usage.
Go to /c/fuck_ai for that.
I gave you an example that it’s good for, and all you want to do is argue the merits of how I’m using it (even though it falls perfectly within Twitches TOS and use cases)
You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.