@jacqueline 100%
-
@ErikJonker @jacqueline Well, with the ways I've seen these sites reacting to people, even just praising the writing and thoughts of people about articles they uploaded/feeded where it later came out the AI somehow couldn't read the article and just hallucinated superlatives.
Basically, an AI working like that is basically only geared to work using people their ego.
That in the end will result in the AI mirroring the ego of the 'user' (user, or abused is an interesting discussion).
And, as >2@ErikJonker @jacqueline 2) people often are very easy influenced, they will just as much become like their chatbot as well as the clatbot reflecting on them.
The worst outcome of that is that the people basically become zombies of their chatbot.
Obviously we are all so strong that this will never happen to us... -
@AngelaScholder @jacqueline ...playing and experimenting is a good way to learn about (new) technology, it is also very human, the way we develop, find out what works and what does not.
@ErikJonker @AngelaScholder hi erik. any thoughts on the article linked here? https://chaos.social/@jacqueline/116089817252419868
-
@ErikJonker @AngelaScholder hi erik. any thoughts on the article linked here? https://chaos.social/@jacqueline/116089817252419868
@jacqueline @AngelaScholder terrible and completely wrong way of using this technology, by both companies and the people that use it... BigTech is not responsible in how they employ this technology. But that is not the same that the technology in itself is evil.
-
i feel like i don't have the words to properly describe how it feels to see people who opinions i respected and valued slowly fall into ai psychosis. it's so slow and so subtle at first. "i'm just experimenting! i'm not an ai booster!"
then wait a few months, and they start explaining with the usual flawed, incoherent reasoning how actually it's all very interesting and thought-provoking, whilst pointing at an LLM that is so obviously just a reflection of their own ego.
@jacqueline I believe it is way more common than we know - something about this stuff hammers people's brains in a way that we (society) are not prepared for. And these are folks who should know better! They work with computers, they know it's just matrix multiplication in there! But knowing about it, I guess, provides to immunization to being taken in by its sycophantic mirroring language.
-
@jacqueline I believe it is way more common than we know - something about this stuff hammers people's brains in a way that we (society) are not prepared for. And these are folks who should know better! They work with computers, they know it's just matrix multiplication in there! But knowing about it, I guess, provides to immunization to being taken in by its sycophantic mirroring language.
@jacqueline r/MyBoyfriendIsAI is a cautionary tale, but I have a friend mentioned seeing a girl on the bus asking ChatGPT to give her a pep talk before going on a date. Just, everyday random people, getting taken in by the illusion that the computer is giving of being more than a computer. I truly think we're not aware of how many people are being swayed by all this. It's gotta be more insidious than just the worst cases we see in the news.
-
@jacqueline r/MyBoyfriendIsAI is a cautionary tale, but I have a friend mentioned seeing a girl on the bus asking ChatGPT to give her a pep talk before going on a date. Just, everyday random people, getting taken in by the illusion that the computer is giving of being more than a computer. I truly think we're not aware of how many people are being swayed by all this. It's gotta be more insidious than just the worst cases we see in the news.
@greg r/MyBoyfriendIsAI is scary
-
@jacqueline Well you did mention you couldn't describe it properly, so that was a risk I considered while replying.
Can you elaborate on the "unusual flawed, incoherent reasoning" ?
@dynom @jacqueline usual.
-
i feel like i don't have the words to properly describe how it feels to see people who opinions i respected and valued slowly fall into ai psychosis. it's so slow and so subtle at first. "i'm just experimenting! i'm not an ai booster!"
then wait a few months, and they start explaining with the usual flawed, incoherent reasoning how actually it's all very interesting and thought-provoking, whilst pointing at an LLM that is so obviously just a reflection of their own ego.
@jacqueline It's shocking how convinced people are by simplistic demos and snake oil salespeople. It's like an evangelical religion. The Eliza Effect is known for almost sixty years, yet people are lapping up LLM/GPT use without realising how wrong, imperfect and downright dangerous these tools can be.
-
@jacqueline Well you did mention you couldn't describe it properly, so that was a risk I considered while replying.
Can you elaborate on the "unusual flawed, incoherent reasoning" ?
@dynom @jacqueline give me a salad recipe
-
i feel like i don't have the words to properly describe how it feels to see people who opinions i respected and valued slowly fall into ai psychosis. it's so slow and so subtle at first. "i'm just experimenting! i'm not an ai booster!"
then wait a few months, and they start explaining with the usual flawed, incoherent reasoning how actually it's all very interesting and thought-provoking, whilst pointing at an LLM that is so obviously just a reflection of their own ego.
@jacqueline Oh, interesting - it's a mirror and they're all transfixed like Narcissus!
-
R relay@relay.infosec.exchange shared this topic
