There will be times when the struggle seems impossible. Alone, unsure, dwarfed by the scale of the enemy. Freedom is a pure idea. It occurs spontaneously and without instruction. Random acts of insurrection are occurring constantly. There are whole armies, battalions that have no idea that they’ve already enlisted in the cause. And even the smallest act of insurrection pushes our lines forward. Tyranny requires constant effort. It breaks, it leaks. Authority is brittle. Oppression is the mask of fear.

  • 1 Post
  • 91 Comments
Joined 2 years ago
cake
Cake day: March 3rd, 2024

help-circle

  • Most models are going to require CUDA. There are some AMD ones out there, but it’s a totally different math and setup. As for the one I mentioned, it’s a pretty new idea so there are only a few out there, maybe just one (Qwen based). But I did get a 31B model to work on my 12GB, I just had to move from Ollama to llama.cpp to gain the control needed to set the parameters, and fine tune what it put on the CUDA to the max it would take. I had Claude help me along the way.

    It’s new enough that there aren’t any good abliterated/uncensored models yet.



  • It’s the best case scenario because then only the ones who causes this mess get punished. The realistic version is that we’re dragging most of the biosphere and millions of other species down with us, completely changing a stable Earth environment to something we’re not even sure about.

    And we can blame his work in part for that acceleration, but in truth it was already heading that direction for decades, longer than most of us have been alive. It just took a while to see the evidence of damage, and when we did, it was covered up, turned into propaganda for profit, lied about, and mostly just shrugged as someone’s future problem. Well, the future is now, and not much has changed, except the environment. Humans are stupid.






  • It can be, but it depends on how dependent one is on various applications and sources. I’m in the process of doing such a thing, but I’m taking the slow route so I don’t break everything. Meaning I’m moving one thing at a time off Snap, and then I’ll be closer to a Debian/Mint DE version in the switch over than if I did it right away with so much tied to it being Ubuntu.

    For a casual user it may not be that dramatic and just a matter of moving data and learning a new desktop look. I’d still suggest the Debian version of Mint over Debian if they went to Ubuntu for the easy use.



  • Meanwhile today we include everyone in the process.

    Sometimes. It depends on if the vote is for something in particular, or if it’s a vote for someone to act as a representative. The first is more democratic, the latter is less so, especially if that person ends up not actually representing well.

    Then there is the issue of whether or not “everyone” is truly included in either of these.


  • The key is how they introduce it. How many Ubuntu users (who are usually novice in Linux) read through an update notice? I’m guilty of just scanning through it. A vaguely named new thing isn’t going to be unchecked.

    I like Ubuntu’s “feel” vs. others. I can’t explain what that is, just know I test ran a few before I settled on it. I’m slowly weaning off Snap though, mainly because I’ve had many things be so out of date it made sense to go Flakpak or just find a .deb file. And Snap is obviously bloat if you watch what’s using CPU and mem regularly.

    I’ve also used some LLMs to diagnose computer issues, so I can see how a local version that walks through such thing would be helpful.

    I’ll give them rope, and I can always bounce to Mint if it gets too in my face.





  • The first you can control to some extent. Both local and public llms have ways to edit or add to the system prompt, which is what guides the overall behavior. I actually had a local llm do the opposite of what you are looking for - somehow the prompt had been changed to a very simple “You will answer short and concise” without me realizing it, and I couldn’t figure out why it had changed from a flowing, dynamic output to a few sentences.

    But it’s not perfect either. Sometimes you want a bit more than a simple sentence, or it might need more information and a short reply will cut off the important things.

    As for fixing the second one - to be right more often would mean they understand what they’re outputting, which is what we don’t have yet. I’d just rather have it admit when it doesn’t have enough to satisfactorily be sure on the answer. Which doesn’t happen because they are trained first and foremost to always have an answer, because that’s more marketable than a model that says it doesn’t know.


  • Audacious isn’t perfect, but it’s far better than the others that I tried. Had been using VLC forever in WIndows, but for whatever reason I kept running into issues that I couldn’t resolve, so began a search for alternatives.

    The only huge issue I have is when I add more songs to my music directory, I can’t refresh the existing playlist. I have to delete and add the directory again. Don’t do it a lot, so it’s more inconvenience, and everything else works so much better than other alternatives did.


  • I agree. This is feeding off of a new way to market and use people’s insecurities, selling them a fix that will do more damage. I think we’ve already seen this in the business world with adoption of AI for every damn thing, even forcing employees to enbrace it or leave. And the best ones aren’t even that good. And then there’s Co-pilot, which is worse. So adding another more personal version will pull in more people looking for answers to their problems (caused by a society that’s broken).

    The question of AGI and whether one can be personal with it is an interesting debate, and not one that people are happy to entertain in discussion or acceptance at this time. But we don’t have AGI, may never have it, and this is simply a money grab no different than OnlyFans and webcam girls, only there’s no human at the other end that has to get a small part of the profit.