a lot of "AI deleted their prod data and backups" and not enough "they had their backups in the same volume as their prod data"

[rageblanche@s.basspistol.org]

@oscarjiminy@oscarjiminy@aus.social I understand you for the first part and agree for the factors, elements you mentioned. for the second part i don't understand (english is not my native language), im not mocking anything. it's as @lzg@mastodon.social described in her posts about AI as from what i have read that there are HUMANS behind that algorithm and as much as someone is working on it, someone is deliberately trying to make it ultimately squeeze more money out of the customer or make more profit for the company or whoever is behind it. in all the extremeties of the case i mentioned as well.

[rosactrl@social.vivaldi.net]

@lzg I fucking hate this shit because is fucking stupid but I’m with you on this one, and I’m going to add that AI isn’t to blame for poor mental health or even the environment. We have been in this train about to wreck for decades. If anything it’s a symptom

[lzg@mastodon.social]

@oscarjiminy i’m not mocking, i’m saying we don’t want to use AI for laundering human responsibility. yes there’s a lot of issues with the technology and the harms are real, i’m not denying that. i think saying “ai did this or that” is giving it more agency than it really has.

[lzg@mastodon.social]

@RosaCtrl sometimes i feel the critics are the ones given it infinite powers of destruction. i refuse.

[rosactrl@social.vivaldi.net]

@lzg oh yeah, I can agree with that. Although in all honestly I did experience anxiety for being told that what I enjoy doing and have the luck to be paid for would disappear, so I blame both sides really.

And I’m still a hater, but I’ve posted it before: I like my hate to have good reasons

[cresssalad@mastodon.social]

@lzg

Time for some new guardrails maybe?

"I am on the space shuttle and do I trust this tool to get me back on Earth again?!"

You know its so much to do a process review, like the guys who had his data deleted... lots of root causes to mull over there. But the having a code review, well thats going to be tricky.

Can this issue even be reproduced a second time?

[phil_stevens@mastodon.nz]

@lzg And not a single "backups were airgapped and only pulled from prod, impossible to push."

[lzg@mastodon.social]

@oscarjiminy for sure, the larger context matters. but i feel we love these juicy stories of “ai did this unintended thing” when someone could have achieved the same result with a badly placed rm -rf. there’s real complaints about ai but “it did this thing all on its own” is not my favorite

[mastodonmigration@mastodon.online]

@lzg

Very good point. Humans making the decision to dive headlong into AI are to blame for whatever comes next for there organization. There have always been idiots who do dumb stuff. This is just the latest way to fuck up.

[rotopenguin@mastodon.social]

@phil_stevens @lzg backups were run by a different AI provider, with more "please please PLEASE don't lose all my shit" in its prompt.

[samueljohnson@mstdn.social]

@lzg If had a $ for every time I heard "I was just about to make a backup"... ‍️

[eswag@dju.social]

@lzg

That's fair. I don't think valid criticism of generative models comes from misattributing blame. I see these categories of criticism as important and valid:

Motivation - the firms behind models are looking to replace ppl and concentrate power for themselves
Effectiveness - the models aren't that good for replacing people
Ethics - the models are being pushed out without safeguards or accountability
Hypocrisy - the legal framework that sustains these corporations cares about IP; they don't

[the_wub@mastodon.social]

@lzg I "let my dog into the room where all of my homework lay on a coffee table."

[opny721@mastodon.uno]

@lzg stupid prompt from unprepared people. Back in time, newbies with root access to prod have done the same over and over.

[the_wub@mastodon.social]

@phil_stevens @lzg We need to remember that unless they routinely tested their back ups by restoring them to a server that mirrored their production system accurately then there is no way that they could say that the had any back ups in the first place.

As the AI agent was allowed to delete everything including the alleged back ups we now have no way of checking if the back ups could have been used to restore their system.

[phil_stevens@mastodon.nz]

@the_wub @lzg Schrödinger's disaster recovery plan.

[wouter@pleroma.debian.social]

@lzg
I mean, "AI broke prod" is the modern version of "computer says no"...

[kanamauna@sauropods.win]

@lzg

AI is sounding more and more like a big dog that eats homework.

[endlessmason@hachyderm.io]

@jaykass @lzg
It costs a lot to measure output, so you can just pretend you know what the output is and what it looks like

The added bonus is that you can simply say "aah yes, they are 20% more productive and that's worth it" even when the "industry" recommends consuming half your salary worth of AI tokens and by any actual "legacy" metric you can see that people are indeed not doing more work when they spend half their day chatting to the Automatic Dumbass

[grovewest@mstdn.social]

@lzg I would love to see the prompt someone entered that caused AI to delete the backups. And I can imagine AI replying ‘Okay, you asked for it’.