

Looking forward to seeing your work - it’s always good to have competitors, and gpt4all is also very crashy. If you have a lead in stability, I’d definitely use yours over theirs.
Some other areas you could probably look into if you want to differentiate are:
-
Getting Started experience - recommend some high quality models and update the list as time goes on. Maybe include a good default one as part of the package.
-
Convenience - include a way to do what the modern chat interfaces do where asking it to do something other than text will call a different AI model built for that purpose and return the result (image generation, etc)
-
Voice conversations - Can we actually talk to the dang thing?
-
Assistant module - piggybacking off of the last one, can we invoke it with a wake-word or a button press and have it “always available” (similar to HomeAssistant with a Whisper plugin, but on-device).
Anyway, I wish you well in your endeavor and will keep an eye out.
EDIT: looks like the conversational bits are on your roadmap, and you do have some basic suggestions on startup.
As for voice, the OpenWhisper module might fit your project’s theme a bit closer than elevenlabs.
Are you using Pipelines in either github or another upstream source management platform? I don’t know if they have a free build plan or not, but you can have an entire pipeline that just spits out an executable for one or more platforms every time you commit to your main branch, depending on how you have compilation set up (you can have it use both a Linux and a Windows VM for different steps in the pipeline too). It can even handle publishing them to a website if youre handy with bash and/or powershell scripts (or python or JS or whatever you can call from the pipeline).
I use the Azure DevOps version at work and its amazingly useful, but very confusing to learn at first.