Yesterday Cory Doctorow argued that refusal to use LLMs was mere "neoliberal purity culture".
-
Yesterday Cory Doctorow argued that refusal to use LLMs was mere "neoliberal purity culture". I think his argument is a strawman, doesn't align with his own actions and delegitimizes important political actions we need to make in order to build a better cyberphysical world.
Acting ethically in an imperfect world
Life is complicated. Regardless of what your beliefs or politics or ethics are, the way that we set up our society and economy will often force you to act against them: You might not want to fly somewhere but your employer will not accept another mode of transportation, you want to eat vegan but are […]
Smashing Frames (tante.cc)
@tante People like Cory who mock others for their disabilities are not worth paying attention to.
-
@prinlu @FediThing @pluralistic @tante I agree with most things said in this thread, but on a very practical level, I'm curious what training data was used for the model used by @pluralistic 's typo-checking ollama?
for me, that training data is key here. was it consensually allowed for use in training?
because as I understand, LLMs need vast amounts of training data, and I'm just not sure how you would get access to such data consensually. would love to be enlightened about this
@bazkie @prinlu @FediThing @tante
I do not accept the premise that scraping for training data is unethical (leaving aside questions of overloading others' servers).
This is how every search engine works. It's how computational linguistics works. It's how the Internet Archive works.
Making transient copies of other peoples' work to perform mathematical analysis on them isn't just acceptable, it's an unalloyed good and should be encouraged:
-
@mastodonmigration
it's the "copyright" issue, the outlook that unless everyone who posted anything that was used receives a check for a hefty sum then it's unethical.Copyright is in quotes because it's not really a violation of copyright (the LLMs are not producing whole copies of copywritten materials without basically being forced) nor is it a violation of the intent of copyright (people are confused, copyright was never intended to give artists total control, it's just to ensure new art continues to be created).
-
Yesterday Cory Doctorow argued that refusal to use LLMs was mere "neoliberal purity culture". I think his argument is a strawman, doesn't align with his own actions and delegitimizes important political actions we need to make in order to build a better cyberphysical world.
Acting ethically in an imperfect world
Life is complicated. Regardless of what your beliefs or politics or ethics are, the way that we set up our society and economy will often force you to act against them: You might not want to fly somewhere but your employer will not accept another mode of transportation, you want to eat vegan but are […]
Smashing Frames (tante.cc)
@tante
I partly agree with Cory and partly not.
Refusing to use resource-gobbling datacenter-hosted LLMs makes perfect sense. I'd just as soon heat my house by burning kittens. It is also a rational political statement.Refusing to use an LLM hosted on my own iron is also a political statement, as well as a personal choice. I don't give a hoot about ideological purity; I just distrust clankers, and don't want to get into the habit of depending on them. (Besides, they offer me nothing I cannot as easily do for myself.)
-
@pluralistic I don't think mink fur or LLMs are comparable to criticizing the origins of the internet or transistors. It's the process that produced mink fur and LLMs that is destructive, not merely that it's made by bad people.
For example, LLM crawlers regularly take down independent websites like Codeberg, DDoSing, threatening the small web. You may say "but my LLM is frozen in time, it's not part of that scraping now", but it would not remain useful without updates.
@skyfaller@jawns.club @pluralistic@mamot.fr @FediThing@social.chinwag.org @tante@tldr.nettime.org This is precisely it; it's about the process, not their distance from Altman, Amodei, et al. (which the Ollama project and those like it achieve).
The LLM models themselves are, per this analogy, still almost entirely of the mink-corpse variety, and I think it's a stretch to scream "purity!" at everyone giving you the stink eye for the coat you're wearing.
It's not impossible to have and use a model, locally hosted and energy-efficient, that wasn't directly birthed by mass theft and human abuse (or training directly off of models that were). And having models that aren't, that are genuinely open, is great! That's how the wickedness gets purged and the underlying tech gets liberated.
Maybe your coat is indeed synthetic, that much is still unclear, because so far all the arguing seems to be focused on the store you got it from and the monsters that operate the worst outlets. -
@clintruin @simonzerafa @tante
OK, sorry, i was under the impression that I was having a discussion with someone who understands this issue.
You are completely, empirically, technically wrong.
Checking the punctuation on a document on your laptop uses less electricity than watching a Youtube video.
@pluralistic @simonzerafa @tante
Fair enough, Cory. You're gonna do what you want regardless of my accuracy or inaccuracy anyway. And maybe I've misunderstood this. The same way many many will.
But visualize this:
"Hey...I just read Cory Doctrow uses an LLM to check his writing."
"Really?"
"Yeah, it's true."
"Cool, maybe what I've read about ChatGPT is wrong too..." -
I'd actually take this a step further and say that technologies ARE social arrangements.
@lrhodes I agree, I believe that we do encode our values into our technology. Particularly with what we code and what we use to code or write.
-
@bazkie @prinlu @FediThing @tante
I do not accept the premise that scraping for training data is unethical (leaving aside questions of overloading others' servers).
This is how every search engine works. It's how computational linguistics works. It's how the Internet Archive works.
Making transient copies of other peoples' work to perform mathematical analysis on them isn't just acceptable, it's an unalloyed good and should be encouraged:
@pluralistic @prinlu @FediThing @tante I think the difference to search engines is how LLM reproduces the training data..
as a thought experiment; what if I'd scrape all your blogposts, then start a blog that makes Cory Doctorow styled blogposts, which would end up more popular than your OG blog since I throw billions in marketing money at it.
would you find that ethical? would you find it acceptable?
further thought experiment; lets say you lose most of your income as a result and have to stop making blogs and start flipping burgers at mcDonalds.
your blog would stop existing, and so, my copycat blog would, too - or at least, it would stop bringing novel blogposts.
this kind of effect is real and will very much hinder cultural development, if not grind it to a halt.
that is a problem - this is culturally unsustainable.
-
@pluralistic @simonzerafa @tante
Fair enough, Cory. You're gonna do what you want regardless of my accuracy or inaccuracy anyway. And maybe I've misunderstood this. The same way many many will.
But visualize this:
"Hey...I just read Cory Doctrow uses an LLM to check his writing."
"Really?"
"Yeah, it's true."
"Cool, maybe what I've read about ChatGPT is wrong too..."@clintruin @simonzerafa @tante
This is an absurd argument.
"I just read about a thing that is fine, but I wasn't paying close attention, so maybe something bad is good?"
Come.
On.
-
@tante Since I assume all the #Epstein documents have been scraped into all the LLM models by now, I'd love to see an example of LLM tech being used for good.
Show me the list of Epstein co-conspirators.
Show me names of who helped them escape accountability, and how they did it.
Show me who raped children. Their names, addresses, passport photos.
Then I will believe LLMs and "AI" have delivered a benefit. -
@clintruin @simonzerafa @tante
This is an absurd argument.
"I just read about a thing that is fine, but I wasn't paying close attention, so maybe something bad is good?"
Come.
On.
@pluralistic @simonzerafa @tante
Maybe...
Maybe not.You have a good day.
-
@FediThing @bazkie @prinlu @tante
There are tons of private search engines, indices, and analysis projects that don't direct text to other works.
I could scrape the web for a compilation of "websites no one should visit, ever." That's not "labor theft."
-
@skyfaller@jawns.club @pluralistic@mamot.fr @FediThing@social.chinwag.org @tante@tldr.nettime.org This is precisely it; it's about the process, not their distance from Altman, Amodei, et al. (which the Ollama project and those like it achieve).
The LLM models themselves are, per this analogy, still almost entirely of the mink-corpse variety, and I think it's a stretch to scream "purity!" at everyone giving you the stink eye for the coat you're wearing.
It's not impossible to have and use a model, locally hosted and energy-efficient, that wasn't directly birthed by mass theft and human abuse (or training directly off of models that were). And having models that aren't, that are genuinely open, is great! That's how the wickedness gets purged and the underlying tech gets liberated.
Maybe your coat is indeed synthetic, that much is still unclear, because so far all the arguing seems to be focused on the store you got it from and the monsters that operate the worst outlets.@correl @skyfaller @FediThing @tante
More fruit of the poisoned tree.
"This isn't bad, but it has bad things in its origin. The things I use *also* have bad things in their origin, but that's OK, because those bad things are different because [reasons]."
This is the inevitable, pointless dead-end of purity culture.
-
@lrhodes I agree, I believe that we do encode our values into our technology. Particularly with what we code and what we use to code or write.
@onepict Yeah, code is a pretty literal manifestation of that principle, right?
And one of the major advantages of AI from an ideological point of view is that it allows the provider to write their values into *other people's code*.
-
Because there are no slaves in this instance. Because no one is being harmed or asked to do any work, or being deprived of anything, or adversely affected in *any articulable way*.
But yeah, in every other regard, this is exactly that enslaving people.
Sure.
-
@clintruin @simonzerafa @tante
You are laboring under a misapprehension.
I will reiterate my question, with all caps for emphasis.
Which "couple million people" suffer harm when I run a model ON MY LAPTOP?
@pluralistic @clintruin @simonzerafa @tante
Which "couple million people" suffer harm when I run a model ON MY LAPTOP?
Anyone who's hosting a website, and is getting hammered by the bots that seek content to train the models on. Those of us are the ones who continue getting hurt.
Whether you run it locally or not, makes little difference. The models were trained, and training very likely involved scraping, and that continues to be a problem to this day. Not because of ethical concerns, but technical ones: a constant 100req/sec 24/7, with over 2.5k req/sec waves may sound little in this day and age, but at around 2.5k req/sec (sustained for about a week!), my cheap VPS's two vCPUs are bogged down trying to deal with all the TLS handshakes, let alone serving anything.
That is a cost many seem to forget. It costs bandwidth, CPU, and human effort to keep things online under the crawler DDoS - which often will require cold, hard cash too, to survive.
Ask Codeberg or LWN how they fare under crawler load, and imagine someone who just wants to have their stuff online having to deal with similar abuse.
That is the suffering you enable when using any LLM model, even locally.
-
@onepict Yeah, code is a pretty literal manifestation of that principle, right?
And one of the major advantages of AI from an ideological point of view is that it allows the provider to write their values into *other people's code*.
@lrhodes Yes.
There's a desperation as well for some enthusiastic folks to justify this and impose their view on the rest of us. It's what disquieted me. The defensive attitude anticipating us stating and enforcing our boundaries.
But it's our culture in Tech and I wish as a whole Tech would step back and like take a minute, rather than reacting and negging.
AI and that Guy at the bar
In tech we've always had evangelists, weither it's for FOSS, or Blockchain or now AI. It's a natural thing to do. You have a tech you'r...
cobbles (dotart.blog)
-
@mastodonmigration
it's the "copyright" issue, the outlook that unless everyone who posted anything that was used receives a check for a hefty sum then it's unethical.Copyright is in quotes because it's not really a violation of copyright (the LLMs are not producing whole copies of copywritten materials without basically being forced) nor is it a violation of the intent of copyright (people are confused, copyright was never intended to give artists total control, it's just to ensure new art continues to be created).
@shiri @pluralistic @mastodonmigration @tante Also it's incredibly unclear to me how a LLM is a good use case for punctuation and grammar checking,. something regular document editors have done incredibly well since the late 90's or so. Like that's your use case? Not promoting Microsoft here but Word has been fantastic at that since at least 2003.
Seems weird to use that as the case for an energy sucking plagiarism machine.
-
@pluralistic @prinlu @FediThing @tante I think the difference to search engines is how LLM reproduces the training data..
as a thought experiment; what if I'd scrape all your blogposts, then start a blog that makes Cory Doctorow styled blogposts, which would end up more popular than your OG blog since I throw billions in marketing money at it.
would you find that ethical? would you find it acceptable?
further thought experiment; lets say you lose most of your income as a result and have to stop making blogs and start flipping burgers at mcDonalds.
your blog would stop existing, and so, my copycat blog would, too - or at least, it would stop bringing novel blogposts.
this kind of effect is real and will very much hinder cultural development, if not grind it to a halt.
that is a problem - this is culturally unsustainable.
@bazkie @prinlu @FediThing @tante
First: checking for punctuation errors and other typos *in my own work* in a model running on *my own laptop* has nothing - not one single, solitary thing - in common with your example.
Nothing.
Literally, nothing.
But second: I literally license my work for commercial republication and it is widely republished in commercial outlets without any payment or notice to me.
-
@FediThing @bazkie @prinlu @tante
No one is defending "creating knock offs of works." Why would you raise it here? Who has suggested that this is a good way to use LLMs or a good outcome from scraping?
