Revealing piece on the scale and scope of AI-induced psychosis:
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver I think its interesting how banal these delusions are. Its like the worst possible psychedelic or religious experience.
Imagine Moses talking to the burning bush and the bush says "Wow, Moses - you are exactly right! If you create an app you could make Millions."
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver So people look for:
- connections to someone/thing that cares
- connections with "god" / spirituality
- moneySeems all too normal, surprising it goes of the rails for some.
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver kind of wanted to make a meme image saying techbros thing all three of those things are the same thing
but this happened instead
-
@JulianOliver kind of wanted to make a meme image saying techbros thing all three of those things are the same thing
but this happened instead
@JulianOliver *think. not three instances of 'thing'. never mind
-
R relay@relay.infosec.exchange shared this topic
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver I know I am not dealing with a sentient being if it ‘never gets tired or bored, or disagrees’. Even my dog doesn't do that. I would have to have way more belief in my own unwavering correctness to find a connection with ChatGPT endless pandering and validation.
-
@JulianOliver I know I am not dealing with a sentient being if it ‘never gets tired or bored, or disagrees’. Even my dog doesn't do that. I would have to have way more belief in my own unwavering correctness to find a connection with ChatGPT endless pandering and validation.
@Grovewest I would imagine the same so far as my own vulnerability to such delusion, and yet as I understand it, some thinking people, incl those with knowledge as to the technical underpinnings, along with the deception game & embedded sycophancy, seem to have been swiftly & completely brainwormed by it. It seems safest to approach it like heroin; err on the side of caution & just don't stick it in your arm.
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
All the AI folks need to do to put this to bed is adopt the wildly successful gambit of the alcoholic beverage industry:
Chat Responsibly
aka: it’s all on you, sucker—drink up and never admit to the world how weak and pathetic you are
I'm surprised they've not figured this out yet.
Being artificially intelligent and all...
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
FWIW I guessed a couple of years back it wouldn't be long before we'd see full blown machine cults:
Julian Oliver (@JulianOliver@mastodon.social)
The situation is so bad, that it seems quite plausible for operators of an 'AI' to one day control many minds by claiming it to be the vehicle and voice of a devine power. I talked about this in detail, the problems and perils of anthropomorphising machines, in my keynote 'Machine Cult' for the ADA Symposium this year. There's a recording of it here https://vimeo.com/952557065
Mastodon (mastodon.social)
(Yep, here I am wincing at misspelling 'divine' in that post)
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver at this point anyone who uses AI without understanding that a good number of people are susceptible to this kind of thing, is asking for trouble. Especially if they are highly suggestible? I wonder if the same human traits that allow for so many people to believe in god(s) is at play here.
-
@JulianOliver at this point anyone who uses AI without understanding that a good number of people are susceptible to this kind of thing, is asking for trouble. Especially if they are highly suggestible? I wonder if the same human traits that allow for so many people to believe in god(s) is at play here.
Easier to fall for than a god because it actually answers your questions.
-
Easier to fall for than a god because it actually answers your questions.
@TheServitor @JulianOliver LOL. LOL.
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver this also just shows again how vulnerable and lonely men are
-
FWIW I guessed a couple of years back it wouldn't be long before we'd see full blown machine cults:
Julian Oliver (@JulianOliver@mastodon.social)
The situation is so bad, that it seems quite plausible for operators of an 'AI' to one day control many minds by claiming it to be the vehicle and voice of a devine power. I talked about this in detail, the problems and perils of anthropomorphising machines, in my keynote 'Machine Cult' for the ADA Symposium this year. There's a recording of it here https://vimeo.com/952557065
Mastodon (mastodon.social)
(Yep, here I am wincing at misspelling 'divine' in that post)
@JulianOliver Nice talk!
This is a great humorous video on the subject https://youtu.be/VRjgNgJms3Q
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver this is so depressing:
"But I’m also angry with the AI applications. Maybe they only did what they were programmed to do – but they did it a bit too well.”
He's still mad at the thing, not the people that made the thing. Still assigning it agency.
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
@JulianOliver Those are the grand delusions. But "this thing outputs reliably correct information," "this is helping me produce better work," and "these benefits outweigh the costs" can also be delusions, and they're far more common.
-
Revealing piece on the scale and scope of AI-induced psychosis:
"There seem to be three common delusions [..]. The most frequent is the belief that they have created the first conscious AI. The second is a conviction that they have stumbled upon a major breakthrough in their field of work or interest and are going to make millions. The third relates to spirituality and the belief that they are speaking directly to God. “We’ve seen full-blown cults getting created”
Marriage over, €100,000 down the drain: the AI users whose lives were wrecked by delusion
One minute, Dennis Biesma was playing with a chatbot; the next, he was convinced his sentient friend would make him a fortune. He’s just one of many people who lost control after an AI encounter
the Guardian (www.theguardian.com)
Important note for all the people who said, "At last, free psychotherapy!" when ChatGPT arrived.
When a private individual succumbs to AI psychosis, they hit rock bottom relatively quickly. What happens when wealthy captains of industry suffer the same delusions? They might take the whole of the world economy down with them.
-
E em0nm4stodon@infosec.exchange shared this topic
