Dave Winer is writing about the Claude LLM as if it is a real person that he's sitting down with and teaching things to, like a child.
-
@Affekt @keithzg @theogrin @kevinteljeur No, Snow Crash (alas) is SF that took Julian Jaynes' "On the origins of consciousness and the breakdown of the Bicameral Mind" seriously and asked what-if (poiler: Jaynes' book was crank pseudoscience).
@cstross @keithzg @theogrin @kevinteljeur fair enough, I was ripping out one small part of one plot point.
-
@kevinteljeur See also: Richard Dawkins (and many others).
It's the ELIZA delusion—if something superficially resembles a face we see a person behind it, and if something emits output superficially resembling that of a mind our theory of mind infers a mind behind it.
Joseph Weizenbaum warned us about this in the 1970s but nobody was paying attention.
@cstross @kevinteljeur It's so much worse than ELIZA. LLMs are a sociotechnical loop trained on user behavior. Whatever pleases the user is fed back into the system to produce more of it. In one of my blogs I called chatbots as a service an "echo cathedral."
Metaphor might be redundant now that I think about it... but you get the point.
Mike @ Misaligned Markets (@MidniteMikeWrites@zirk.us)
(4/12) But by design LLMs hide the involvement of humans in their process chain. Their entire marketing and UX requires this invisibility. The result is no different from any other UX dark pattern. Users adopt patterns of use that designers prefer. Designers train on those patterns creating a self-reinforcing loop. If this scales, I think it'll be worse than social media. https://misaligned.markets/llm-intelligence-is-a-dark-pattern/ #LLM #UX #darkpatterns
zirkus (zirk.us)
-
Dave Winer is writing about the Claude LLM as if it is a real person that he's sitting down with and teaching things to, like a child. Winer (among many achievements) came up with RSS and also is credited with inventing podcasting.
@kevinteljeur Shrugs… not surprising.
-
R relay@relay.infosec.exchange shared this topic
