After I made this unrelated post, I was informed by @MysticMushroom1776@lemmy.dbzer0.com that lemmy.dbzer0.com was a pro-genAI instance.
It was honestly shocking for me to hear that these two things can coexist and I would like to share the discussion which was correctly moved for being off topic from the above linked post.
I think we owe it to ourselves to discuss topics like this with an open mind.
Here is my statements in reply to MysticMushroom1776, I wasn’t able to record their reply before it was removed for being off topic bit I hope they can come here and we can continue the discussion.
Others, please also feel free to discuss with us.
'Wow, I didn’t know [that lemmy.dbzer0.com was a pro genAI instance] As an anarchist myself I have to say that is really disappointing.
Anarchist communities [especially in real life] need humans otherwise there is no community. GenAl is a stolen facsimile of a human who can never understand morals or praxis. It can never understand freedom or control. It will however poison our communities (look at what SpaceX/Anthropic is doing in Memphis, TN) make us more predictable (and thus easier to control) and isolate us from other humans within the community which is so important to us.
Even with the most moral genAl you can possibly have, one that is totally FOSS and self hosted on a single gaming GPU, a lot of this is still true.
Obviously, this is the wrong place but I have to ask,[prior to moving the discussion to this thread] what makes you think the extreme negatives of genAl (specifically to the anarchist community) can be excused?… [I do not have a copy of mushroom’s reply]
I pirate and seed. I’m also a fan of the megathread And for the most part, I think data is data. However there is a big difference between my pirating a book like the Lord of the Rings (which is credited and I can see the title of) and how Meta scraped Anna’s archive and funneled all that data into an approximation of all combined work.
If I pirate the book, the Lord of the Rings to read it. I might enjoy it, I might talk about it to others, quote it, share it with my daughter, I might use the ring of power an an allegory for authoritarian control with a powerful technology, I might even decide to buy my own copies of the book.
What Meta did and then released as open source, won’t allow a person the freedom to do any of that. The works were consumed and are used in silence to camouflage as human thought. No credit will ever be contributed. And so no one can even hope to appreciate the original works that was used in training.
The other concerns I have with (local) genAI that I think are deeply important to anarchists specifically.
- Isolation of humanity
- severing of our ties to community
- increasing predictability
- method of control
Photo is genAI made and sourced from the following article:
What do people actually use their local (FOSS) models for? That would be interesting to me because I generally dont visit AI communities and so dont see how other anarchists put these tools to practice.
Coding assistants and porn are the most common uses.
I don’t have one but if I did I would use it to generate images. Maybe also connect to the AI horde so other people who can’t afford their own can get the benefits when I’m not using it.
Mostly translation. Specifically:
- Checking homework between sessions with a (human) foreign language tutor. At his suggestion. Let’s him focus his time on the more interesting, less repetitive parts of teaching, and me get more out of our sessions. Sometimes it gets it wrong, but when that isn’t obvious my search for the right answer usually teaches me something anyway about the grammatical structure or words it chose.
- Translating e-mails and other written communications that I’ve tried but are beyond my vocabulary to manage yet. I write it by hand, ask it to translate, and then check every word. I slap my forehead a few times for words I actually_did_ know and just forgot, and look up anything it uses that I don’t know. Because of the way I picked up most of my vocabulary, I don’t always know the most common and natural sounding way to phrase things. I search unfamiliar phrases or idioms online to get a feel for context of use and level of formality, and rewrite anything it got wrong or had the wrong tone.
Outside of translation, when I’m trying to figure out where to buy something obscure that I don’t know the name of and can’t find it after repeated searching, asking a local LLM sometimes gives me the name of a vendor or two whose web site leads me to the right search term.
Similarly (and ironically), when I’m looking for information in how to do something oddly specific but can’t find information online due to the proliferation of vaguely related AI slop pages on closely related topics, sometimes throwing the question at the LLM leads me to the right phrase to search and find what I’m looking for.
Critically, I never trust the answer from the next-word-prediction-machine (which is essentially what an LLM is) gives me. All my current uses for it revolve around its original purpose - finding the right words.
I’ve used local models to do a bunch of different things, but the main ones are:
- Separate policy debate speech docs into component evidence ‘cards’, to create an online corpus of evidence for other debaters to use
- Write scripts to help manage my media library
- Help maintain my server stack
Removed by mod
GenAl is a stolen facsimile of a human
False. It’s literally just a computer program.
who can never understand morals or praxis. It can never understand freedom or control.
No computer program will ever understand this, nor should we expect that.
It will however poison our communities (look at what SpaceX/Anthropic is doing in Memphis, TN)
“AI” is not doing this. It’s being done by capitalists (spacex, anthropic). Stop letting them off the hook.
make us more predictable (and thus easier to control)
How does using a computer program do this?
and isolate us from other humans within the community which is so important to us.
How does using a computer program do this?
Even with the most moral genAl you can possibly have
Computers have no more “morality” than a calculator.
there is a big difference between my pirating a book like the Lord of the Rings (which is credited and I can see the title of) and how Meta scraped Anna’s archive
This is just your (self-serving) opinion. Many people might find a computer generated summary to be helpful, etc. People have been using Cliff’s notes for decades. The value of usage is in the eye of the user.
*
TBH this is just feeding the grift with more pseudo-scientific, anthropomorphic nonsense. There is no “AI”. We need to fight against problems that actually exist (eg. capitalism, surveillance, genocide, etc).
I can answer one of the questions.
How does using a computer program do this?
Maybe not in the way OP is thinking, but it does massively help control us and here is how:
Fascism always had one huge flaw that prevented it from ever fully working: data. 1920s Germany was quite efficient at this, but they still had literally thousands of people listening, spying, reporting on, and processing data into threats that the SS would deal with.
That is simply too much data for humans to sift through and not miss a fuck ton of things, leading to resistance movements gaining a lot of ground.
AI solves this problem in that a few data centers can process spying data (and much more of it from the surveillance devices almost every person has in their house right now) fairly close to real time. That is a game changer. That is why the technofascists are pushing AI so hard to speed up development. It is essentially the best large scale pattern recognizer in the world and the manpower it takes to run that system is extremely small. That is why palantir is getting its claws in everywhere. Governments want that, whether for good or evil.
AI is a game changer for authoritarians. Or course, they would have to use it well still to be effective, but for example Palantir is building AI-only kill chains where targets are identified based on large data ingest, located, and then drones can be sent to kill them. That can happen in minutes or hours instead of the weeks or months it would traditionally take and resistance leadership is a finite resource.
This applies to cameras as well. Cameras help fascists, fascists help target victims, cameras help track people, cameras help report where people are and what they are doing. Cameras make us easier to control.
Do you think all cameras are bad? or are they just a tool that is being mis-used by the fascists?
Who needs to process the camera data? Again, it is a very different technology from all of the comparisons because it is literally taking out the need for large bodies of human oversight. Data collection vs data processing.
A camera does not decide who lives and who dies. An LLM can (and has) decided who lives and who dies and can carry out the execution orders itself.
But I guess cameras aren’t starving people of water and power and a required prerequisite to their use at scale.
But you’re right. LLMs aren’t evil at all, they are just a tool. The next defining tool that fascists now need to subjugate everyone and eliminate resistance.
Who needs to process the camera data? Again, it is a very different technology from all of the comparisons because it is literally taking out the need for large bodies of human oversight. Data collection vs data processing.
I could say the same thing about spreadsheets. Is spreadsheet software, or databases bad?
A camera does not decide who lives and who dies. An LLM can (and has) decided who lives and who dies and can carry out the execution orders itself.
That’s a choice that is being made. That’s not the point of LLMs, it’s one of the many things that LLMs are being used for.
But I guess cameras aren’t starving people of water and power and a required prerequisite to their use at scale.
The same is also true of LLMs. Capitalism is doing that. We can make LLMs much more efficiently, but we choose not to, due to capitalism.
But you’re right. LLMs aren’t evil at all, they are just a tool. The next defining tool that fascists now need to subjugate everyone and eliminate resistance.
I’m against their use by facists, just like I’m against facists using cars, or bulldozers, or guns, or wheat. I just don’t see how LLMs are any different.
They’re only different because these people very strongly personally dislike them and they aren’t content with it just being their opinion. Which is why they make up some of the most pathetic bad faith arguments you’ll ever hear.
You know what else is a fascist tool by their logic? Internet, Television, Computers, Cars, Trains… Pretty much all technology in the hands of fascists will benefit fascists.
That’s why we need to fight fascists instead of doing this stupid culture war bullshit. I wonder if some of these anti-AI people are intentionally trying to distract from that. After all like most liberals they intentionally or unintentionally support fascist agendas.
I think people are upset by the legitimate problems that they see, but I think they typically mis-diagnose the cause of the problems.
People are scared to lose their jobs, and their livelihood, for good reason. Capitalism sucks, and it ties the two together.
I’m pro automation, because I want people to lose their jobs. What I don’t want is for them to lose their livelihood. I think people working on jobs that they don’t like just to pay the bills is dumb, but people working on jobs that they enjoy is awesome.
Probably is that for most people, amplified due to the culture war. I don’t think that excuse works for the people claiming to be anarchist and anti-copyright though. A lot of people in this thread seem to be doing it maliciously not out of ignorance.
THIS POST WAS GENERATED WITH AI
Please do elaborate
out of tokens
Removed by mod
Removed by mod
Removed by mod
Removed by mod
Removed by mod
Removed by mod
It does
Interesting, maybe I just don’t see it.
edit: what’s with the purge?
This whole comment chain is way off topic.
Lmao what are you talking about this is a post complaining about AI but it’s obviously generated by ai
Actually were are discussing using genAI content in a post about using genAI content.
I think the comments have been civil. I don’t see the reason to remove them personally.
You didn’t see it because it wasn’t edited. (I’m pretty sure atleast I’ve honestly been pretty busy so I forget if I corrected a typo)
The source to the image was definitely originally there.
I assure, you it was.
Removed by mod
Removed by mod
Removed by mod
Removed by mod
Removed by mod
Removed by mod
yall need to study some haiku or something, brevity is more necessary than ever
Is this a comment on the length of a relatively short post in an anarchist community?
I take it you’re not big on reading theory, huh?
It’s just a theory to far too many…
deleted by creator
I am also against genAI.
I’ve heard many arguments for it, mainly from tankies, but also from leftist spaces and anarchists. The ideological idea seems to be that it is a way to allow everyone to have access to things they weren’t skilled enough to do. Something like the “democratization” of labor.
I am obviously against that statement, mainly in 2 fronts.
First, we have skilled labor for a reason. Some people dedicated years of their life to perfect a skill or a trade, and they are trustworthy experts with experience in the matter. It would be unfair for those people if they got replaced by a sloppier version of themselves, after spending so much time and effort into their skills.
I would also not trust a machine like I would a human, because the machine has no experience and can’t make decisions. We’re removing the human value of a skill, while also reducing its quality, when we could promote collaboration between humans, and make them feel valued while getting a better result.
Second, AI was built on stolen labor. Even if you use a self hosted model, running on old hardware that was thrown away, using solar and wind energy, its usage is still morally wrong.
The truth is, all the current models were trained on databases of data mined without consent, in many cases to the detriment of its providers.
On top of that, even if the models are used locally (and even if they are tuned locally), the initial training happens on massive datacenters that consume lots of resources. And what you get isn’t the first attempt at making a model. For every successful model out there, thousands of other models were trained and abandoned.
AI is also currently making us dumber, and multiple studies have already shown it. A lot of pro-AI people have already become dependent on it, and because of that they will defend it. Even if it would have been against their morals. It’s normal, we as humans tend to get defensive in those cases. But it means a lot of pro-AI discussion in leftist spheres is driven by that.
I think we should be really careful of AI because of that. AI is like a drug, and once you become dependent, you can’t easily go back. Our brains are wired to offload their thinking to AI, and once they do that, picking it back up is a big effort.
I also haven’t gone into the artist rabbithole. Of course, genAI harms artists. All kinds of them. Writers, painters, photographers, musicians, etc. People are replacing human art with synthetic slop, to the detriment of artists.
Sometimes it’s because they don’t know better. Sometimes it’s because they feel like they couldn’t be able to create something without the “help” of AI. But art is not the end result, art is the process. And by using AI, you’re destroying the process to end up with and end result.
I feel like the same arguments above apply to genAI usage for “art”. People are replacing artists with the lower effort and lower quality versions of them, which wouldn’t even be possible without stealing the art of those artists in the first place.
This comment is already long and ranty enough, and it’s late at night, so I don’t expect it to be very coherent. So I won’t go deeper.
However, as an aside, I’ll mention that I’ve been blanket banned before from communities, genAI related and not, by MysticMushroom, for making anti AI comments somewhere else. I have asked another mod for an unban in a non genAI related community ( !europe@lemmy.dbzer0.com ). Afaik MysticMushroom unbanned me after asking, so credits for that.
First, we have skilled labor for a reason. Some people dedicated years of their life to perfect a skill or a trade, and they are trustworthy experts with experience in the matter. It would be unfair for those people if they got replaced by a sloppier version of themselves, after spending so much time and effort into their skills.
Is it “unfair” to bakers that I make my own bread at home with a bread machine? What about using a calculator? Or a dishwashing machine?
Second, AI was built on stolen labor. Even if you use a self hosted model, running on old hardware that was thrown away, using solar and wind energy, its usage is still morally wrong.
Well, it’s not all built on stolen labor. A lot of it is built on data that was given away freely. You also didn’t really provide a reason why it would still be morally wrong.
On top of that, even if the models are used locally (and even if they are tuned locally), the initial training happens on massive datacenters that consume lots of resources. And what you get isn’t the first attempt at making a model. For every successful model out there, thousands of other models were trained and abandoned.
They don’t have to use massive resources, we just choose to do them that way because of capitalism. Cities use massive amounts of resources, and many of them aren’t successfull on the first try. Should we stop building cities?
The rest of your post is more of a complaint about capitalism, and misunderstandings of how we choose to make AI models, not how they inherently have to be made.
The sloppers are gonna delete this. I posted something really similar earlier. Don’t talk to sloppers like they’re people. They’re not. Their brains are rotted and they’re incapable of honesty. Online they are very similar to fascists, though differences do come up in person.
Dehumanization is the tool of the enemy
dbzer0’s general tolerance for genAI is the main reason I will never create an account on that instance. This is ridiculous. These people rant about the environment, ethics, genocide, and Big Tech, and then happily devour AI slop.
EDIT: For those of you who are ready to comment about “wonderful” local LLMs, see this.
bzer0’s general tolerance for genAI
We dont have a “general” tolerance. We have a tolerance for local non-corporate models.
Ai isn’t killing the planet, people are
You lost me at stolen training data. You seem like yet another liberal for copyright. That is the primary thesis of your argument. Which is pathetic. I hope you are aware that most of us consider unlicensed usage of training material a feature not a bug. This is home of !piracy@lemmy.dbzer0.com don’t act so surprised we aren’t morally outraged like you are that someone pirated images or books to use in training data. Many of us would freely do it ourselves. Some of us do do it ourselves.
It’s probably a good thing you didn’t make an account here. Liberalism isn’t tolerated well.
How can one of the points from the link I provided to the general list of LLM issues be my main argument? Do you think I’m the one who compiled that list?
And to label me a liberal based on that sole baseless conclusion is absolutely ridiculous. I hate copyright and support piracy just as much as next person.
And to label me a liberal based on that sole baseless conclusion is absolutely ridiculous. I hate copyright and support piracy just as much as next person.
Somehow I’m not convinced because the only ones really relevant to local AIs are the copyright ones, and the other shit is about the AIs hosted and trained by the big tech companies like Anthropic and OpenAI. Like the majority of the shit in here is shit the AI companies are doing and you cite it as a reason why people on dbzer0 using their own home grown or even home built models are bad people?
Don’t tell me you aren’t trying to do that. You called out Local LLM users in your edit:
EDIT: For those of you who are ready to comment about “wonderful” local LLMs
only ones really relevant to local AIs are the copyright ones
No, it is about lack of consent. The open models are all trained through non-consential heavy web scraping, killing off smaller web servers by the thousands and driving server admins to despair by their use of (ususally non-consential) residential proxy bot networks.
The total lack of respect of any consential boundaries is the real problem. It is a pure strawman to claim that this is about copyright.
There are plenty of them that are not trained through non-consential scraping. Just because some of the people making AI models are assholes don’t mean everyone making AI models is an asshole.
Name one that is actually useful 🤷
You want me to do a basic internet search for you?
edit nvm i thought you meant web scrapers not model builders. theres plenty of useful llms not gonna bother listing them
Putting shit on the web is giving consent to scrape it
You haven’t heard people whine and complain about art theft as much as I have. I agree with what you’re saying about large companies scraping data but you are being too charitable to these people. People do indeed bitch and moan about art theft and I have no tolerance for that level of liberal apologia.
So it is fine to ignore the consent of artists? Sure, they usually talk about copyright, but what most mean is consent and not the legal construct.
Also, “bitch and moan” is pretty mysogynist language, especially in this context.
You’re right. I’m sorry about that. I should have known to avoid language like that. I changed it to something better.
As for the other thing though. I’m not on board with that either. That’s just a socially enforced version of Intellectual property. It all converges on the idea that people are allowed to own intangible stuff like ideas, or bits. It’s the same liberal idea and expectation as copyright law just with different enforcement. Not so different though, they both expect blind compliance and assume moral superiority.
Surprised you didn’t get banned without repeal for daring to say anything against AI
That’s what they do for most people who dare to
Very funny to post this in a post where vigorous debate on this subject is clearly visible.
We do ban extremely toxic people who can’t help themselves from reacting with outright bigotry and attempted bullying, but liars like you like to misrepresent that as us banning all dissent. It it is funny that you decided to post this in the face of all evidence.
A recent redderp graduate, no doubt.
There’s still time
Removed by mod
Nothing says good-faith participation like having a slur for people who politely disagree with you about computer programs.
Politely? lmao
Relative to self-professed haters throwing around absolutes and accusations, the apologists here are saints. In the face of people all-but declaring this technology the devil!, and referencing chattel slavery, and demanding a rending of garments for those killed by… chatbots… the other side of the debate is, it’s not that big a deal. I’m not even sure how someone can get excited about the position that ‘it’s probably fine, so long as it’s local.’
There are no boosters on Lemmy. No cult of AGI. No Roko’s basilisk horseshit. There’s the barest modicum of people insisting it’s great for people with disabilities, but usually in the first-person, which is hard to argue with. So what these ranting individuals and identarian communities are performatively mad about are tired randos trying to explain that scanning some books is not Fahrenheit 1984. Any focused response is usually met with posturing for not addressing every complaint at once, and any verbose response might be dismissed with ‘I bet you generated that.’
So yeah, politely. I don’t know how much more deferential you expect a response to be, when the framing is catastrophic finger-pointing.
Yeah sorry to confuse, I meant the folks in the FuckAI crowd who don’t seem to realize who their enemy really is. And big clue for them, it ain’t hobbyists who use local AI models for useful work. We weren’t paying anyone in the first place, so no jobs are lost. We are running on our own hardware so no datacentres were involved. Like FFS, why not target corpos instead of some rando on a niche website who might want to use an LLM as a tool to get some work done. It’s like blaming climate change on citizen consumption. It’s a complete misdirection from the root problems.
They’d still point to where those local models came from… even though rando hobbyists have recreated historic LLMs for pocket money, and at one point developed a frontier image model. We absolutely could have gotten here on consumer hardware, without the trillion-dollar infinite money glitch. Improvements will continue apace after the bubble bursts because the community of hackers and perverts has seen what’s possible on a goddamn telephone and know they can go even further.
In the meantime: if the cocaine-chewing lizard people want to give everything away, the common folk will say thank you, and then ignore their meaningless EULAs.
My background is that I am a PhD student in STEM. I’m not gonna doxx myself, but my research area is in mathematical systems theory. LLM systems are not my primary research area, but I have taken advanced coursework on classical machine learning, and LLMs will certainly affect my research area from a technical perspective. So I am obligated to understand LLMs, reinforcement learning systems, deep learning algorithms, classical machine learning systems, and basically the rest of “artificial intelligence” from a theoretical, mathematical point of view. In addition, I use LLMs extensively as a LaTeX assistant, to generate counterexamples, and to “fill in” proofs when I read math books.
I am also a lifelong anarchist.
Anarchist communities [especially in real life] need humans otherwise there is no community.
Absolutely. Anarchist users of LLMs do not intend to replace the human element. Literally the opposite.
GenAl is a stolen facsimile of a human who can never understand morals or praxis.
I don’t oppose proletarians “stealing” “copyrighted” work. Copyright is classically anti-anarchist rentier behavior. What I do oppose, and I believe you’re pointing to, are a few related but distinct problems with AI systems as they exist today:
- AI systems pretend to be anything other than tools. It’s in the name, unfortunately. And it’s capitalist horseshit, but its name is actually capitalist horseshit fixed by the people who actually invented classical AI systems in the fifties. I.e., academia has had a long time to correct this terminological mistake and failed spectacularly. To some extent, the tendency of AI systems to pretend to be human is a byproduct of its training data, because it’s trained on human outputs, and except for a few weirdos, humans typically assert our autonomy in our writing. However, AI companies really should be trying to counteract that tendency; they go in the opposite direction. For this reason, I reject the notion that AI systems are “intelligent” in any way that resembles intelligent biological creatures, i.e. I reject the notion that AI systems are converging towards AGI or that they are even capable of approximating general intelligence. Furthermore, I posit that the characterization of AI systems as intelligent beings is capitalist marketing. The logic is simple: if these systems are intelligent, we would need to give them rights. Since capitalists control these machines, such a move would ultimately amplify capitalist willpower.
- LLM companies have obtained basically all human knowledge without paying. Piracy is illegal for proletarians yet magically legal for the bourgeois when do it for some reason 🤔🤔🤔🤔. LLM companies then they paywall the sum of the world’s knowledge and refuse to even be open about the training data and resulting model weights.
- AI agents (bots driven by LLMs) driven by thoughtless or malicious users overload conventional websites and spin up unedited AI-generated content. The proliferation of AI slop feeds back into point (3).
- People use AI systems, like all other tools, to do heinous things. In particular, AI systems are used in the ongoing Gaza genocide, and are a critical part of ICE operations.
All of these problems are serious critiques of AI systems as tools. What you’ll notice about all four of these, however, is that they are primarily socially driven phenomena. These problems are contingent on the existence of hierarchical social relations. In fact, these problems have pre-AI counterparts:
- ((1) is the most novel IMO.) Capitalists hire and/or bribe actual proletarians to simply repeat capitalist talking points.
- The academic journal complex.
- Classical bot farms and human trolling operations.
- Basically the entire history of technology.
It can never understand freedom or control.
“AI” systems can’t understand anything. They are mathematical algorithms implemented on silicon-based computers.
It will however poison our communities (look at what SpaceX/Anthropic is doing in Memphis, TN)
This is not an inherent feature of the technology. We could have absolutely trained these models, albeit at a vastly slower sustainable pace, through the use of distributed and decentralized computing strategies. The issue is that the perverse incentivization structure of capitalism pushed AI companies to grow unsustainably, at great expense to the ecosystem and the people of the world. I.e.: capitalist interests of quick money and infinite expansion triumphed over proletarian interests of survival, dignity, freedom, and sustainability, as usual.
And it is my view, as an anarcho-communist, that by seizing the means of production from the capitalists, in particular their AI hardware, and distributing these systems more equitably around the world, we can remake these AI systems to some extent into sustainable systems at an ecologically appropriate scale. At least we would be able to try — capitalists, as monstrous as they are, never even try to do things correctly.
and isolate us from other humans within the community which is so important to us.
I cannot stress enough that I do not want to see AI replace humans in human-centered tasks. In particular, I am completely uninterested in AI-generated “drawings” or “music”. Art is an activity by sentient beings. Unedited AI “art” can be technically competent (or not), but it is ultimately just a product of a machine and therefore not tremendously compelling to me.
And I also agree that we are seeing a crisis of isolation, but my view is that:
- This crisis predates AI.
- It is caused by capitalism, specifically the gradual commercialization of previously free or low-cost activities and spaces.
- It is exacerbated by ecological destruction and encroachment by the State, which simply makes the world outside your home a worse place to gather.
Obviously, this is the wrong place but I have to ask,[prior to moving the discussion to this thread] what makes you think the extreme negatives of genAl (specifically to the anarchist community) can be excused?The extreme negatives of AI must not be excused.
They must be confronted and ruthlessly reversed. And in order to do this, we must conduct a holistic analysis of why AI technologies enable these heinous things. This is impossible to conduct, i.e. useless, without relating these technologies to the social relations that motivate these technologies to destroy for their masters. Anarchists who use AI systems do not, in general, excuse these systems or their users. To the best of our abilities, we use them with the care required not to replicate capitalist harms. And we must be held accountable for our failures on that front.
However there is a big difference between my pirating a book like the Lord of the Rings (which is credited and I can see the title of) and how Meta scraped Anna’s archive and funneled all that data into an approximation of all combined work.
Not really, no. I would have zero problems if you personally did that in a way that didn’t destroy the ecology, and then released your weights, model architecture, data, and training proces. In fact, in my view, you would be doing the world a great service. It is my personal hope that we live long enough (we as proletarians living in a world doomed by capitalists) so that I can someday train an AI on all of Anna’s Archive. I’m sorry if that’s offensive to you, but that would be so unbelievably fucking cool and useful.
What Meta did and then released as open source
* weight available, not open source. Huge difference: you cannot reasonably recreate Meta’s model weights on your own. In my view, besides being unethical, it’s bad data science because it’s not reproducible!
The works were consumed and are used in silence to camouflage as human thought. No credit will ever be contributed. And so no one can even hope to appreciate the original works that was used in training.
Yeah I can live that. E.g., I don’t cite my calculus textbook every time I use calculus in a paper. I cite the things that must be cited. And when I wrote my metal album ten years ago, I didn’t credit any artists, even though my work obviously draws from the work of dozens of metal bands. And I don’t expect to receive any credit if my work influences someone else’s music, or even if it gets sampled, and that thought doesn’t bother me at all. It would be neat if someone did shout out my work, I’d appreciate it, but really I’m just happy if someone listens to it. (Not gonna post my album here because that would insta-doxx me lol. You’re not missing out on much 😆.)
These are my views on AI systems:
- “AI” and “artificial intelligence” are capitalist buzzwords and should not be used. I prefer the term “statistical learning*” systems, where the asterisk is used to remind the reader that “learning” is a series of technical mathematical termd that are distinct from what people in social sciences mean by “learning”, in particular when applied to biological creatures. (See Vidyasagar’s book and Vapkis’s book for technical definitions.) I am open to terminological suggestions, as I’m not completely comfortable with the “learning*” terminology.
- AI systems can be useful tools. But that being said, not everyone is going to have a use for them, and their adoption must, like any tool, be voluntary with respect for the user’s autonomy. And that autonomy has been systematically ignored and violated by the capitalists who foist their AI products on us.
- Large language models have utility beyond auto complete for reasons we do not yet fully understand. Basically, the logic is this: they train LLMs to do tasks A, B, and C. You train a language model to do tasks A, B, and C, all well and good…but then you shove some completely different tasks X, Y, and Z into the machine. And the weird thing is, for some reason, the machine can do (say) task X. We cannot mathematically prove yet why this is the case, but this was practically seen to be the case. I personally suspect that natural language has some deep underlying structure that we cannot see yet, but informs both the AI’s ability to learn*, and our ability as humans to learn. (Anecdotally, as an autistic person, verbal language has been the key to my ability to survive for this long. Frankly, I simply lack a bunch of social skills that I can make up for by using language to read books and watch videos and just…not have to spend as much energy on being a social animal.)
- More on mathematics: classical machine learning has extremely good theory. In particular, you can use probabilistic inequalities as design tools to pick algorithms, compute asymptotic bounds as the number of samples increases, and (less classically) compute finite-sample bounds on error probabilities. The mathematical community is currently porting these tools over to deep learning algorithms and LLM systems…but it’s tough work! Even classical machine learning theory books require some measure theory and functional analysis background. It’s a lot of fun! But it’s also really really hard.
- Your understanding of AI systems and their capabilities is probably out of date. The capitalists are obviously overselling it, but there is a rapid increase in the capabilities of these systems.
- Pursuant to the previous point, commercial AI products are rarely “just” a LLM anymore. In particular, a lot of these products have access to Python environments, in particular with SymPy, compilers (e.g. they typically have access to a LaTeX compiler), and even a Linux container. Really, if you hear the phrase “agentic AI”, it basically means a bot or family of bots “driven” by LLMs. (Pursuant to my first point, agentic AI bots do not have “agency” like sentient biological creatures do! The responsibility for what these bots do lies with their human operators.) I highlighted SymPy, a Python library that does symbolic mathematics. LLMs used to be completely incapable of symbolic mathematics. While they still often make mistakes that are hard to spot, AI systems are capable of driving a Linux container. In particular, they are capable of crapping out SymPy code and running it, where SymPy does the mathematics in the background. However, the really interesting development is that AI systems can crap out Lean code. Lean is a formal proof verification programming language. It is basically the best you can get in terms of proving that a mathematical theorem is correct. (Disclaimer: I am absolutely not an expert on formal verification! My formal understanding of Lean is quite limited right now.) This will absolutely revolutionize mathematics.
- As anarchists, we ought to have sufficient technical training to be able to back up our sociopolitical ideas. You obviously don’t have to go the full PhD route like me (and I don’t recommend it lol, I’m just fucked in the head in the exact ways that make me a good PhD student 😆), but I think it would help if you tried out the HuggingFace tutorials, or if you pirated Sebastian Raschka’s book and did the exercises, to calibrate your expectations about AI. (Both of these should be completely free and open source, and doable on reasonable hardware…or Google 🤢 CoLab 🤮 if your hardware can’t handle it.) I suspect that a lot of people who are (rightly!) disgusted with the excesses of capitalist AI proliferation are not proficient in using AI systems because they haven’t practiced with it as an assertion of their rightful disgust at capitalists’ excesses. As I have said above, a lot of people will simply never have a use for AI systems, in particular if you don’t do technical work…but if you do technical work, it makes sense to at least try self-hosting these systems, and maybe putting in a little bit of time every couple months to see what the state of the art…for the times, they are a-changin’.
Lastly, this comment was written by a real autistic human on a cell phone with zero AI assistance, as are all my comments. Yes I actually write like this 😆
Wow, just wow. I love your comment and fully agree with what you say based on what I know as a software dev with a deep background in math and cumputer vision (my master’s thesis was on facial recognition). The thing is that you explain incredibly well. And I had to say that this point you make is specially interesting and is making me think a lot:
“We cannot mathematically prove yet *why* this is the case, but this was practically seen to be the case. I personally suspect that natural language has some deep underlying structure that we cannot see yet, but informs both the AI’s ability to learn\*, *and* our ability as humans to learn.”
Thanks for sharing your thoughts and knowledge.
You’re very welcome, and thank you for reading!
cumputer vision
Please I beg you do not change this typo 😆
If we’re all being honest, this spelling is more accurate. xD
Thank you for this! It really put a lot of my thoughts into words along with some deeper insight. I think if we are going to push for a better society then we need to pay attention to people like you who are experts in the field and can really tease apart the pros and cons of things like this.
I see a bit of a panic in current anti-AI sentiment at the moment, and honestly rightfully so, as it is being weaponized against us. But to outright dismiss it or to try to put the genie back in the bottle could be shooting ourselves in the foot. If we can take control of it ourselves and push out the capitalists we could have something that is genuinely useful, and most importantly, ours.
First, thank you for writing this well thought out reply. I do have some things I’d like to clarify or ask.
We could have absolutely trained these models, albeit at a vastly slower sustainable pace, through the use of distributed and decentralized computing strategies. The issue is that the perverse incentivization structure of capitalism pushed AI companies to grow unsustainably, at great expense to the ecosystem and the people of the world. I.e.: capitalist interests of quick money and infinite expansion triumphed over proletarian interests of survival, dignity, freedom, and sustainability, as usual.
If the issue of resources required nfor training is purely corporate, then why did deepseek use the resources it did for training? It is true they were able to train the model much cheaper than the corporate models, but the scale of the training and amount of resources used was still much larger than one might have expected if the issue was purely a corporate one. Although there is something to be said about geopolitics and Chinese state influence (which is extremely capitalist)
And I also agree that we are seeing a crisis of isolation, but my view is that:
This crisis predates AI. It is caused by capitalism, specifically the gradual commercialization of previously free or low-cost activities and spaces. It is exacerbated by ecological destruction and encroachment by the State, which simply makes the world outside your home a worse place to gather.
Totally agree, the issue is not caused by genAI, but this issue is something that in my opinion prevents us from forming the societies we want to live in. It is something I have been giving a lot of thought too before the wide-spread adoption of gen-ai and it is something I keep seeing in the people that use it as a tool to get something important to them done. So many would rather hope an AI translation app works then to ask a friend to help them translate. Or to ask a neighbor to help them with planning a garden. I think using genAI as a convenience limits us from building solidarity with eachother.
It is my personal hope that we live long enough (we as proletarians living in a world doomed by capitalists) so that I can someday train an AI on all of Anna’s Archive. I’m sorry if that’s offensive to you, but that would be so unbelievably fucking cool and useful.
I’m not offended by this, but I do think the current iteration of genAI not being able to credit creators means that information is siloed and harder to extract. Maybe that changes in the future?
Your understanding of AI systems and their capabilities is probably out of date.
Yeah, I can cop to that. Im not an expert and I don’t claim to be.
I think it would help if you tried out the HuggingFace tutorials, or if you pirated Sebastian Raschka’s book and did the exercises, to calibrate your expectations about AI.
I’ve actually ran models locally that I converted to gguf from huggingface before, I’ve also fine tuned and but a rag system before, but I’ll check out the book. Thanks for the recommendation.
Lastly, this comment was written by a real autistic human on a cell phone with zero AI assistance, as are all my comments. Yes I actually write like this 😆
Thank you.
If the issue of resources required nfor training is purely corporate, then why did deepseek use the resources it did for training?
So first of all, there is a difference between using X total resources over three years versus using X total resources over three decades. A more extreme example is the difference between burning a full tank of gas over a few days of driving versus burning all that gas at once by lighting it on fire.
China’s contributions to the AI race are, in my view, tarnished by many of the same problems as Western AI systems, since China is (state) capitalist. (That being said, Chinese companies do usually make their models weight-available, which is commendable, but not enough.)
While I suspect that we have not thrown enough theoretical math at the problem of LLM training (we have thrown lots of empirical math at them; useful for guiding the development of theory, but not theory itself), I also suspect (frankly based on my limited experience training and using these things) that the useful structural properties of LLMs only manifest themselves when you train with large datasets.
So the problem of large datasets is, in fact, an inherent part of the technology. My view is that we have to tackle these things head on.
-
Distributed computing. Internally, LLM companies are computing at such a scale that they already must use distributed computing technologies to spread the load out amongst many machines. My vision would be something like BOINC, where people and collectives who benefit from AI systems can give limited access to the computing power of their systems. Note that AI Horde does something like this for inference. Hence why it is so important to seize the means of production from the capitalist class. Not ask, take! They have the tools and power to do this sustainably, but they chose to do it wrong so they could make a quick bag.
-
Leverage existing resources sustainably. The logic here is that individuals and collectives spreading out the effort won’t necessarily save resources or energy integrated over the whole planet. In fact, as a planet, we might spend more energy on a geographically distributed system if it is done at the scale AI companies are doing it. However, the issue is not just "we’re spending too much energy "; it’s “we’re spending too much energy, too fast, and we are overloading and obliterating local ecosystems, and we are doing it in a way that exacerbates existing climate”. I.e., it’s not just quantity, but also space and computing time whose distribution is mismatched.
Like what the capitalists have pushed on us in basically three years…it really should have taken at least a decade.
So many would rather hope an AI translation app works then to ask a friend to help them translate.
Depends on what I need help translating. Basic Spanish? I’ll ask my mom. Farsi? I don’t know anyone personally who speaks Farsi, to the best of my knowledge. Advanced Spanish? Ain’t no way my mom’s gonna beat a machine, even a pre-2023 AI translator. I could go hire a translator, but I suspect that they have more important things to translate. I.e., translation is usually a routine task, and human translators can show up for the fun stuff (translations that require human supervision).
Or to ask a neighbor to help them with planning a garden.
I wouldn’t ask AI personally. I would probably look on LibGen for botany books, or drop a post on Lemmy since I’m sure there are a few botanists lurking around.
I think using genAI as a convenience limits us from building solidarity with eachother.
It can, but it doesn’t have to. And I think that a lot of those examples are people misusing the tech. In particular, people are using the tech to “solve” problems with simple, well-understood solutions. LLM systems are suited for problems without algorithmic solutions, where either a partial and/or approximate solution is better than none at all.
I do think the current iteration of genAI not being able to credit creators means that information is siloed and harder to extract. Maybe that changes in the future?
I would argue that at least for math, you can actually get really far by telling the AI to cite its sources in the system prompt and giving the harness access to your PDF library (I do this in a virtual machine with a subset of my actual library that I have backed up in case I lose it). (And of course you triple check the citation it gives you.)
Also, the thing about math in particular is that we do not particularly disagree with the capitalists about mathematics. We all agree that 2+2=4 and the indefinite integral of cos(t) is sin(t) + C. And we also widely agree on how to typeset mathematics, namely “rewrite unreadable spaghetti code in LaTeX until the rendered PDF looks gorgeous.” So a LLM with a capitalist bias… isn’t really a problem for math typesetting questions. Conversely, I would never ask a capitalist LLM to, say, summarize the contents of Mutual Aid by Kropotkin, even if I give the system the PDF. (Most capitalist LLMs probably do recall the broad contents of Mutual Aid and the most important texts in anarchist theory, simply because they sucked up all our literature too.) I think there are other walks of life where anarchists and other class-conscious proletarians do not disagree with the capitalists, although personally my disagreements with capitalists are extremely broad, almost universal, so I understand if people have trouble finding common ground with them!
Your understanding of AI systems and their capabilities is probably out of date.
Yeah, I can cop to that. Im not an expert and I don’t claim to be.
That wasn’t just aimed at you … that holds for everyone, myself included. Again, the capitalists are overselling the convergence to AGI specifically…but things are moving incredibly fast. So if you’re not using the systems regularly, it’s honestly going to be very difficult to keep up with the development of the tech. (I’m not saying that you should necessarily start using AI systems regularly just to keep up; it will suffice to just remember that your knowledge might be out of date by the time you finish your argument.)
-
Thank you for the lovely post, as I am also working to grapple with the impacts of AI from an Anarchist perspective
A bit off-topic: I’m looking to de-rust my calculus and linear algebra skills. I have taken courses on Machine Learning and Deep Learning but they were mostly applied rather than theory. I could explain most operations and phenomena like exploding/diminishing gradient but I’m not sure if I could explain it in a formulaic way. I tried taking RL course, and while I understand the concepts, when it comes to understanding the formulas I found myself quite lost. I feel like I have forgotten some of the foundations.
Any book / course you’d recommend for this? I even thought about paying for something like Brilliant but I’m very hesitant about that.
“AI” and “artificial intelligence” are capitalist buzzwords and should not be used
proceeds to exclusively refer to LLMs as AI
proceeds to exclusively refer to LLMs as AI
No, I did not exclusively refer to LLMs as “AI”, I referred to them as LLMs. (My view is that LLM (large language model) is a reasonable and accurate name for that class of algorithms.)
I referred to systems using various “artificial intelligence” algorithms, often including LLMs, as “AI systems”. Admittedly, I sometimes forgot to use the scare quotes around “AI” and “artificial intelligence” because I thought it would be clear from the content how I feel about these terms…and I was writing this from my bed with my cellphone, so Ctrl+F and Ctrl+R weren’t available. My preferred terminology would be “systems driven by statistical learning algorithms”, but I decided to write that comment using the popular terminology because otherwise, I would have to begin my comment with a list of definitions. In academic work, this is actually what I would do, but in a casual online forum, beginning with a list of definitions would likely be seen as “word games”.
I think that you can understand that even though I don’t agree with the popular terminology, I found it more accessible to communicate my point using the popular terminology…part of which includes my disagreement with the terminology and why.
Have you ever considered writing theory?
Yes lol, but I currently don’t think I’m up to the task (yet) of writing anarchist theory. Mathematical theory yes, oh God yes 😆
Some people think anarchism is doing whatever you want with no regard for others.
Which is funny because anarchism is fundamentally built on empathy
Empathy is to compassion as square is to rectangle. Please don’t forget the other rectangles.
Fair!
Removed by mod
The “Palestinians are not people” guys?
I find a lot of them have very thin skin.
Especially when you downvote a single post on their slop communities so they ban you from every community they mod.
Not talking about anyone specific tho.
Or when you’ve never seen their slop communities and get banned from the one real community they moderate with their delusions cited in a mass ban from everything they moderate. Obnoxious.
Lol
Including after never interacting with them. Fucking sloppers man istf, they’re so conditioned by the mechanical sycophant that just letting your gaze wander by them without getting on your knees and tearing their pants off is a grave insult. They seriously aren’t even people.
Removed by mod
okay you need to calm the fuck down
Well, I guess you are seeing the shit we deal with daily. This shit is the reason some of us pull out our ban-hammers so fast.
His account is 17 minutes old. Probably the same guy who started an account this morning and got banned in PTB community, for saying the stuff.
Removed by mod
Some people think anarchism is doing whatever you want with no regard for
otherscapitalists.Fixed it for you. Yes a lot of anarchists are more than happy to step on capitalists claiming to own ideas or concepts. Copyright and intellectual property are capitalist constructs and despite being Fuck_AI’s favorite talking point are not something we consider valid or worthy of following. Though we host !piracy@lemmy.dbzer0.com so that shouldn’t be a surprise to you.
“Everyone I disagree with is a capitalist” and other arguments by the mentally numbed.
disengage
Removed by mod
These idiots just want to steal from artists! These pieces of shit think anarchism entitles them to steal other people’s work! Some of them deserve to be swatted!
We’re not indiscriminately pro-genai. We don’t promote corporate genai. Here’s our actual stance. https://wiki.dbzer0.com/divisions-by-zero/the-genai-tag/
Thank you, this is helpful
















