There is a scene in "The Algebraist" (2004, Ian M. Banks) the leader of the invading space army (who is ruthless and petty) makes a demand for information of the gas giant aliens known as "the dwellers."
-
@michaelgemar @futurebird I’ve always thought the Minds treat humans as pets. I never had much of a shared interest with Twitter the Sugar Glider, but I would let her lick yogurt off my finger because she made such charming “this is *so* good” noises.
Jinx the Red-Eared Slider (turtle) became increasingly tiresome as he aged, but we couldn’t just throw him away. That’s not what a respectable person in my culture would do. Same for Minds?
@marick @futurebird That’s a possibility, but it makes the Culture much less attractive.
-
IDK. To me the "Chinese Room" is about something else. Maybe the irrelevance of the inner-workings of a system. Maybe about how so much of our perception of "living" and "thinking" is tied to a particular pace of time.
This isn't the Chinese room, it's a magic 8 ball. But this magic 8 ball is the pastor of our church. Our savior and our guide and HOW DARE you disrespect him!
@futurebird @tshirtman that's Oz, right? You're talking about Oz. And so in Searle's story, there *is* no man behind the curtain. The wizard isn't a charlatan, instead he doesn't actually exist! We're just talking to a great head that echoes what other people have told it. We hear echoes that sound like answers. If people say that there is no wizard, we laugh it off or indeed get angry, refuse to look. Even if we agree there isn't any wizard, we may still say "the wizard told me"...
-
There is a scene in "The Algebraist" (2004, Ian M. Banks) the leader of the invading space army (who is ruthless and petty) makes a demand for information of the gas giant aliens known as "the dwellers."
He proceeds to shoot living people, (just random ordinary people) out of his ship's gun like bullets to suffocate in space.
A decade ago I thought this was a little silly and over the top. "Come on Mr. Banks, I understand you want to lampoon warmongers, but this is too much."
I get it now.
@futurebird Another Ian Banks fan? Yay, Team!
-
The exploration of AI we need is the one that grapples with the way that people will ascribe life, agency, trust to the obviously inanimate.
Think about the movie "Castaway" Chuck Noland (Tom Hanks) is so alone that he makes himself a friend/god out of a volleyball with a bloody hand-print on it. He talks to it. He prays. He needs it to limit his creeping madness in isolation.
@futurebird
Reminds me of a study I read years ago wherein researchers showed preverbal toddlers animated geometric figures “interacting” on a screen and reported that the youngsters reacted to the figures in ways that suggested they were ascribing agency and intentionality to the figures. -
There is a scene in "The Algebraist" (2004, Ian M. Banks) the leader of the invading space army (who is ruthless and petty) makes a demand for information of the gas giant aliens known as "the dwellers."
He proceeds to shoot living people, (just random ordinary people) out of his ship's gun like bullets to suffocate in space.
A decade ago I thought this was a little silly and over the top. "Come on Mr. Banks, I understand you want to lampoon warmongers, but this is too much."
I get it now.
@futurebird Banks got a LOT. I remember being horrified by some of the things he would write, and then looking around at the world and thinking that he might have been an optimist in some ways.
-
The LLMs are not "mad" ... the people who are using them in mad ways are.
@futurebird @meuwese @tshirtman
I equate LLM's and AI to the Rumanian Box. part of the scam was marks trying the box before the allotted time and assuming they'd broken it. Victor would explain how they'd "broken" it and sell them another one.
How Lustig’s Money Machine Scam Worked – Casino.org Blog
Our scams and cheating expert explains how the greatest con artist of all time used his money machine to scam thousands of people out of a LOT of money.
Casino.org Blog (www.casino.org)
-
R relay@relay.an.exchange shared this topic
-
@futurebird I love Banks’ Culture novels, and that society is closest to my sci-fi ideal, but I’m *very* dubious that humans could have much shared interests with miles-long AI-powered warships (however cool their names may be).
@michaelgemarI always had a problem with his concept of AI's unilaterally plotting the course leaving it's captain to announce "Party!" to the crew. Can't remember which novel it was way back when. The one with a blonde Culture woman watching atop a dune ridge while her missile-knife decimates an oncoming army. The knife-missile idea to me was fascinating and science hadn't advanced enough to rule out it's conceivability. There's still the chance science could advance to a Type 2 Civilization. Will our cell phones become, a personel drone.
-
That inability to simply be alone is very real and very human. When you talk to a chatbot you are talking to a rubber duck, a volleyball, yourself.
But it isn't a self help exercise. It is a prescribed job requirement. It is a solution looking for a problem.
The "AI" SF story would not have amazing thinking computers who scare people who don't want to recognize they are human. It would have wooden dolls and people that get mad at you if you don't say "hello" and play along.
It’s late and I should go to bed, you just made me worry that all of my nice pocket friends are AI.
Although I did meet two of you IRL, so maybe I’m ok for now.
I should probably get more IRL friends.
-
There is a scene in "The Algebraist" (2004, Ian M. Banks) the leader of the invading space army (who is ruthless and petty) makes a demand for information of the gas giant aliens known as "the dwellers."
He proceeds to shoot living people, (just random ordinary people) out of his ship's gun like bullets to suffocate in space.
A decade ago I thought this was a little silly and over the top. "Come on Mr. Banks, I understand you want to lampoon warmongers, but this is too much."
I get it now.
Just finished that last week as an audiobook and posted the quote where Fassim first discovers that the twin Dweller is an AI and is terrified by being in a confined space with it. On the one hand, it's a lesson in breaking stereotypes. On the other, I'm not sure I believe the AI's claim that they were set up and were actually victims. It's a complex story and I may have missed it, but I don't recall a whole lot of reason to believe them.
It was definitely a departure from his Culture worlds where AIs are almost universally seen as benevolent. I find myself amused by the fact that I can suspend disbelief for faster than light travel and continent-sized orbiting space habitats, but have a much harder time believing in some future, super intelligent yet benevolent AI
️ -
Just finished that last week as an audiobook and posted the quote where Fassim first discovers that the twin Dweller is an AI and is terrified by being in a confined space with it. On the one hand, it's a lesson in breaking stereotypes. On the other, I'm not sure I believe the AI's claim that they were set up and were actually victims. It's a complex story and I may have missed it, but I don't recall a whole lot of reason to believe them.
It was definitely a departure from his Culture worlds where AIs are almost universally seen as benevolent. I find myself amused by the fact that I can suspend disbelief for faster than light travel and continent-sized orbiting space habitats, but have a much harder time believing in some future, super intelligent yet benevolent AI️I also noted, either in that post or in another one, that the way the Culture AIs talk sounds so much like the way current chatbots talk, that I can't help but wonder if our tech bro overlords were influenced by that when programming them.
Either way, to the extent that I ever have to deal with any of these robotic parrots, I'm going to take a cue from Culture characters and insult them by calling them "machine."
To be honest, I'm just waiting for the chance to say "shut up, machine," to a chatbot.
-
@marick @futurebird That’s a possibility, but it makes the Culture much less attractive.
@michaelgemar It's pretty clear Banks wasn't writing a utopia. @marick @futurebird
-
@michaelgemar It's wrapped in a wee load of Omelas. @marick @futurebird
-
@michaelgemar It's wrapped in a wee load of Omelas. @marick @futurebird
@michaelgemar Or less obliquely "what is a special circumstance?" @marick @futurebird
-
@futurebird In a recent story of mine, “Death and the Gorgon”, a sheriff’s deputy bonds a little too strongly with his very much non-sentient AI tool and it ... does not go well.
For a moment reading that, I thought that it might have gone a lot worse than it actually did.
-
That inability to simply be alone is very real and very human. When you talk to a chatbot you are talking to a rubber duck, a volleyball, yourself.
But it isn't a self help exercise. It is a prescribed job requirement. It is a solution looking for a problem.
The "AI" SF story would not have amazing thinking computers who scare people who don't want to recognize they are human. It would have wooden dolls and people that get mad at you if you don't say "hello" and play along.
@futurebird this is an interesting and thought provoking point. It occurred to me that the devil's advocate argument here is that if what we desire as humans is an answer to loneliness, then at what point does it matter if we get the chemical endorphins to the brain where it came from real or simulated companionship? We do this with so many other things in the world - from pharma, to simulated meat, to video games and movies...
The future I gonna be weird.
-
More interesting to me on this re-read were the bits of the book about artificial intelligences. I don't think many SF writers have hit the mark on the real issues that AI might raise. But it's understandable. Writers care about characters so they want AI to be a character, and they want to wrestle with questions of humanity and discrimination. All very interesting.
Not relevant to the thing that is being called AI right now.
@futurebird
> Writers care about characters so they want AI to be a character, and they want to wrestle with questions of humanity and discriminationhttps://en.wikipedia.org/wiki/A_Fire_Upon_the_Deep gas artificial (super)intelligence that's not a character.
Ironically that's a book many current AI boosters were inspired by (as in "yay, we're finally building the Torment Nexus as described in a book 'Don't Build the Torment Nexus'"), except that of course it too is irrelevant to the thing that is being called "AI" right now.
-
Just finished that last week as an audiobook and posted the quote where Fassim first discovers that the twin Dweller is an AI and is terrified by being in a confined space with it. On the one hand, it's a lesson in breaking stereotypes. On the other, I'm not sure I believe the AI's claim that they were set up and were actually victims. It's a complex story and I may have missed it, but I don't recall a whole lot of reason to believe them.
It was definitely a departure from his Culture worlds where AIs are almost universally seen as benevolent. I find myself amused by the fact that I can suspend disbelief for faster than light travel and continent-sized orbiting space habitats, but have a much harder time believing in some future, super intelligent yet benevolent AI️@Mikal @futurebird
Maybe the Minds are benevolent, maybe they keep colonies of humans the way humans keep colonies of ants
️ -
There is a scene in "The Algebraist" (2004, Ian M. Banks) the leader of the invading space army (who is ruthless and petty) makes a demand for information of the gas giant aliens known as "the dwellers."
He proceeds to shoot living people, (just random ordinary people) out of his ship's gun like bullets to suffocate in space.
A decade ago I thought this was a little silly and over the top. "Come on Mr. Banks, I understand you want to lampoon warmongers, but this is too much."
I get it now.
@futurebird Iain was ahead of his time in terms of political consciousness. Alas.
-
@futurebird @tshirtman that's Oz, right? You're talking about Oz. And so in Searle's story, there *is* no man behind the curtain. The wizard isn't a charlatan, instead he doesn't actually exist! We're just talking to a great head that echoes what other people have told it. We hear echoes that sound like answers. If people say that there is no wizard, we laugh it off or indeed get angry, refuse to look. Even if we agree there isn't any wizard, we may still say "the wizard told me"...
@futurebird @tshirtman it was very late at night here when I wrote this. In the light of day I see it owes a lot to https://bsky.app/profile/joles.bsky.social/post/3logjuqggkk2q
-
@marick @futurebird That’s a possibility, but it makes the Culture much less attractive.
@michaelgemar @marick @futurebird
> That’s a possibility
I always thought that was very clear. I love Banks' SF and read it all as it was published -- I chose _The Wasp Factory_ to write about as part of my Eng Lit 'A' level and so was very interested when that guy announced he was doing an SF novel.
I was instantly hooked by _Consider Phlebas_, and met Banksie several times -- he was a wonderfully entertaining public speaker.
So, yes, _long_ exposure to the Culture, and it was always apparent the human(oid)s were essentially pets. _Excession_ spelled out that the Minds' real attention lay elsewhere anyway.
