There seem to be two distinct kinds of “chatbot psychosis” happening right now:
-
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
-
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
@eschaton Does #2 include CEOs, or is firing huge swathes of your staff and replacing them with AI a different type of psychosis?
-
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
As an example, see the incredible escalation in response to me saying that the output of an LLM does not represent a developer’s own work: https://news.ycombinator.com/item?id=47344155
The slopmonger refuses to accept that what they’re doing meets the academic definition of plagiarism. Instead they insist that I must not understand LLMs and that I need to get out of the way and out of the industry because what they’re doing is the way of the future.
-
@eschaton Does #2 include CEOs, or is firing huge swathes of your staff and replacing them with AI a different type of psychosis?
@michaelgemar It absolutely includes CEOs, CTOs, pundits, and the like. However it also includes the people who get extremely angry when an Open Source project says “no, we will not take your contribution to our project if you used an LLM to create it, because it’s not your work.” They can go to Dennis Reynolds levels of unbound rage almost instantly and it’s really something to see.
-
As an example, see the incredible escalation in response to me saying that the output of an LLM does not represent a developer’s own work: https://news.ycombinator.com/item?id=47344155
The slopmonger refuses to accept that what they’re doing meets the academic definition of plagiarism. Instead they insist that I must not understand LLMs and that I need to get out of the way and out of the industry because what they’re doing is the way of the future.
Type 2 can be summed up as “How dare you presume to tell me whether I’m allowed to use an LLM if I want to?!” Just an absolutely incredible degree of entitlement.
-
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
@eschaton the thing i will note is that "not being true agi believers" gets brought up to make beliefs sound more reasonable without actually having more reasonable beliefs
-
As an example, see the incredible escalation in response to me saying that the output of an LLM does not represent a developer’s own work: https://news.ycombinator.com/item?id=47344155
The slopmonger refuses to accept that what they’re doing meets the academic definition of plagiarism. Instead they insist that I must not understand LLMs and that I need to get out of the way and out of the industry because what they’re doing is the way of the future.
@eschaton An irony is that pmarreck seems to have accidentally explained the exquisite trap that genAI lays out for us: society must ultimately demand that the operator of a GenAI tool take responsibility for any failures of the tool’s output, even though said operator did not invent that output.
-
As an example, see the incredible escalation in response to me saying that the output of an LLM does not represent a developer’s own work: https://news.ycombinator.com/item?id=47344155
The slopmonger refuses to accept that what they’re doing meets the academic definition of plagiarism. Instead they insist that I must not understand LLMs and that I need to get out of the way and out of the industry because what they’re doing is the way of the future.
@eschaton I’m curious if you think its all plagiarism or if some uses of LLMs are not? I asked it today to go look through some classes and add a define everywhere I was hardcoding a specific constant. I find it hard to accept that as plagiarism for any kind of definition of it that makes sense to me. Where doing “write a web browser" I'd imagine is going to just spew out a ton of other people's code.
-
As an example, see the incredible escalation in response to me saying that the output of an LLM does not represent a developer’s own work: https://news.ycombinator.com/item?id=47344155
The slopmonger refuses to accept that what they’re doing meets the academic definition of plagiarism. Instead they insist that I must not understand LLMs and that I need to get out of the way and out of the industry because what they’re doing is the way of the future.
@eschaton I’m not sure exactly how to put it - but I just don’t have as much interest in something if I learn the code was generated.
Maybe the best metaphor I have is in art. I have art hanging on my wall that I admire because it’s nice but also because it was made by hand. I can see the craft and work that went into it.
Maybe one decided to generate AI art. That doesn’t mean I’m going to feel the same about it or think that you’re as much of an artist.
-
@eschaton I’m not sure exactly how to put it - but I just don’t have as much interest in something if I learn the code was generated.
Maybe the best metaphor I have is in art. I have art hanging on my wall that I admire because it’s nice but also because it was made by hand. I can see the craft and work that went into it.
Maybe one decided to generate AI art. That doesn’t mean I’m going to feel the same about it or think that you’re as much of an artist.
@eschaton A more technical concern I have is the amount of open source code being generated now where the author has little idea how it works. And because open source they’ve decided it’s now everyone else’s problem to understand it.
“I couldn’t have normally done this because of X” is nice I guess but is also a tell you’re not equipped to maintain this.
-
@eschaton I’m curious if you think its all plagiarism or if some uses of LLMs are not? I asked it today to go look through some classes and add a define everywhere I was hardcoding a specific constant. I find it hard to accept that as plagiarism for any kind of definition of it that makes sense to me. Where doing “write a web browser" I'd imagine is going to just spew out a ton of other people's code.
-
@eschaton I’m not sure exactly how to put it - but I just don’t have as much interest in something if I learn the code was generated.
Maybe the best metaphor I have is in art. I have art hanging on my wall that I admire because it’s nice but also because it was made by hand. I can see the craft and work that went into it.
Maybe one decided to generate AI art. That doesn’t mean I’m going to feel the same about it or think that you’re as much of an artist.
Can it be art if it's not made by hand? Lots of examples come to mind. Jewelry may be reproduced by casting. Prints are, well, prints. Architecture is manufactured (by machines as well as people other than the designer). Even in music there are loop machines, synthesizers, etc. But an author or artist is at the core.
@colincornaby @eschaton -
Can it be art if it's not made by hand? Lots of examples come to mind. Jewelry may be reproduced by casting. Prints are, well, prints. Architecture is manufactured (by machines as well as people other than the designer). Even in music there are loop machines, synthesizers, etc. But an author or artist is at the core.
@colincornaby @eschaton@osma @eschaton I think it depends. I don't have the same relationship with prints - but I also own some because they're reproductions of the original artwork. I would assume the same is true of jewelry.
I think even if you wanted to call AI art "art" it doesn't require the same emotional connection or recognition. In the same way that someone who brings home McDonalds for dinner doesn't need to be treated as if they cooked the meal.
-
Can it be art if it's not made by hand? Lots of examples come to mind. Jewelry may be reproduced by casting. Prints are, well, prints. Architecture is manufactured (by machines as well as people other than the designer). Even in music there are loop machines, synthesizers, etc. But an author or artist is at the core.
@colincornaby @eschaton@osma @colincornaby @eschaton I think you’re mixing tools and content. A painting is not done “by hand”. Painters use tools, like brushes and many other objects. That’s one thing. The other thing is asking a machine “create an image of a sunset over the ocean seen from a cliff, with a beach in the frame, in cubist style” and simply accepting what it spits out as art, and worse, as *their* art. They didn’t create it, they ordered a machine to create it (by plagiarism, usually).
-
@osma @eschaton I think it depends. I don't have the same relationship with prints - but I also own some because they're reproductions of the original artwork. I would assume the same is true of jewelry.
I think even if you wanted to call AI art "art" it doesn't require the same emotional connection or recognition. In the same way that someone who brings home McDonalds for dinner doesn't need to be treated as if they cooked the meal.
Some prints and some jewelry are reproductions. Others have been designed to be reproduced - the medium being part of the piece.
It's easy to agree that slop at the scale of McDonalds isn't equivalent to a lovingly crafted original, not so easy to set a bright line behind which everything is different.
@colincornaby @eschaton -
@osma @colincornaby @eschaton I think you’re mixing tools and content. A painting is not done “by hand”. Painters use tools, like brushes and many other objects. That’s one thing. The other thing is asking a machine “create an image of a sunset over the ocean seen from a cliff, with a beach in the frame, in cubist style” and simply accepting what it spits out as art, and worse, as *their* art. They didn’t create it, they ordered a machine to create it (by plagiarism, usually).
I think you misinterpret me. But thanks for the explanation, never could have imagined that myself.
@arroz -
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
I boosted a post because this all can be explained as "the psychic's con"
-
@eschaton Does #2 include CEOs, or is firing huge swathes of your staff and replacing them with AI a different type of psychosis?
That's almost a combination of Type 1 and Type 2, in that both together can lead to unrealistic and delusional levels of belief on how effective LLM model output can be
Type 12 (combined psychosis) or Type 3?
️ -
@eschaton amen. Relatedly: https://narrativ.es/@janl/114566975034056419
-
There seem to be two distinct kinds of “chatbot psychosis” happening right now:
1. Becoming delusional about themselves and the world as a result of being glazed nonstop by the friend in their computer, thinking they’re inventing new physics, discovering mystical secrets, etc. and becoming manic.
2. Becoming delusional about what LLMs are capable of and how effective they are, as a result of developing a reliance upon them, and becoming fanatical in their promotion and defense.
@eschaton which does "I have nobody to talk to but the ai" fit into?
