You’re conflating me asking how to use these tools with you who’s misusing them. I see you still don’t accept what you’re doing is wrong. But go you.

Please be very careful. The python code it’ll spit out will most likely be outdated, not work as well as it should (the code isn’t “thought out” as if a human did it.

If you want to learn, dive it, set yourself tasks, get stuck, and f around.

Yeah shell scripts are one of those things that you never remember how to do something and have to always look it up!

Was this system vibe coded? I get the feeling it was…

lol. Way to contradict yourself.

I haven’t actually found the coder-specific ones to be much (if at all) better than the generic ones. I wish I could have. Hopefully LLMs can become more efficient in the very near future.

Some questions and because you don’t actually understand, also, the answers.

• what does the LLM understand the context of, (other user’s data owned by Twitch)
• How is the LLM fed that data? (You store it and feed it to the LLM)
• Do you use Twitch’s data and its users data through an AI without their consent? (Most likely, yes)
• Do you have consent from the users to store ‘facts’ about them (You’re pissy, so obviously not)
• Are you then storing that processed data? (Yes, you are, written to a file)
• Is the purpose this data processing commercial (Yes, it is, designed to increase viewer count for the user of this system - and before you retort “OMG it helps twitch too”… Uhm no, Twitch has the viewers if not watching him, watching someone else)

I mean yeah, it’s a use case, but own up to the fact that you’re wrong. Or be pissy. I don’t care.

Doesn’t Twitch own all data that is written and their TOS will state something like you can’t store data yourself locally.

No, what is it? How do I try it?

Surely none of that uses a small LLM <= 3B?

But won’t this be a mish-mash of different docker containers and projects creating an installation, dependency, upgrade nightmare?

But its website is Chinese. Also what’s the github?

This looks interesting - do you have experience of it? How reliable / efficient is it?

Try the beta on the github repo, and use a smaller model!

I’m getting very-near real-time on my old laptop. Maybe a delay of 1-2s whilst it creates the response

I agree. it looks nice, explains the models fairly well, hides away the model settings nicely, and even recommends some initial models to get started that have low requirements. I like the concept of plugins but haven’t found a way to e.g. run python code it creates yet and display the output in the window

I’ve discovered jan.ai which is far faster than GPT4All, and visually a little nicer.

EDIT: After using it for an hour or so, it seems to crash all the time, I keep on having to reset it, and currently am facing it freezing for no reason.