Found myself wincing while reading this story about how Ars Technica fired a reporter over fabricated quotations generated by an AI tool.

[theodoraward@mastodon.social]

RE: https://infosec.exchange/@briankrebs/116165825763346603

this is a bummer too bc i always liked benj's non-AI-related work a lot -- his retronauts episodes are always great, and he's a treat to read/listen to on Old Computer Stuff. i sometimes wondered why he was even on the AI beat

[briankrebs@infosec.exchange]

@nirak @screwturn Spot on. If you have to redo someone else's work all the time because you're not sure if it's right, why not just do that work yourself from the get-go?

[nirak@carhenge.club]

@briankrebs So why is he saying “I should have taken a sick day”? If he’s not allowed to take sick days, why wouldn’t he say “I can’t take sick days, so…”

It’s a rhetorical question, because I know the answer is we’re trained to simp for companies no matter what, but I just don’t get it

[rootwyrm@weird.autos]

@briankrebs I would be VERY deeply concerned about anybody claiming to be a journalist and using the incorrect plagiarism machine for literally anything.
If you are in the minority and not a 99%+ majority, the entirety of journalism is irreparably broken.
Doing it right is hard work. It absolutely should be better paid. And it is vitally important work, even when it seems not to be.

[michael@westergaard.social]

"We always write things by hand and never use AI, except for this one small case where you caught us. And the next time you catch us. But there's no general tendency. You're just very good at catching exactly the cases where we use AI."

[bitzero@corteximplant.net]

@briankrebs
I do not use AI when I write tech articles for business IT magazines (it’s my main job at the moment). The reason: I cannot trust LLMs in any way, as the Ars story proves, and therefore I’d lose more time checking their output than doing things myself.

I tried to use ChatGpt to summarize long research papers or industry reports, but it’s mostly useless. I have to read papers and reports anyway - to learn what’s happening - and LLMs’ summaries are unreliable.

In one of my first attempts with LLMs, I asked ChatGPT to summarize some report’s data about a specific county, knowing that it wasn’t even mentioned in the study. Nonetheless, chat created a summary - with tables - based on non existing data.

For me, now, the inability of getting context is a definitive big no.

[scotty86@mastodon.social]

@briankrebs @nirak @screwturn That's the AI Trap. When 80% of the work feels like done by magic, but fixing the remaining 20% - plus the prep to get the AI there - ends up taking longer than doing it yourself.

[ct@app.wafrn.net]

Two-fold failure here. This guy should have taken a sick day (and possibly was incentivized not to do so? We don't know), and under no circumstances is "using AI to mine sources" an error you get to bounce back from as a journalist. Unforgivable - you understood the risks!

[ct@app.wafrn.net]

Ars Technica's credibility is forever marred by this event, however fair you think that is. And it's this dude's fault!

[alessandro@mstdn.ca]

@michael

Also we only use it when we're sick - we'd definitely never do this when we're feeling fine, no sirree.

@briankrebs

[screwturn@mastodon.social]

@nirak

Wrong in what way?
Yes, in most cases I'm reading the entire text, but sometimes the AI captures something I missed, and other times it confirms what I already got.

Time saving does feature, but the bigger issue is that using it improves validity, because of catching the missed topics

@briankrebs

[screwturn@mastodon.social]

@briankrebs

In qualitative research we routinely redo each other's work and our own.
Having an AI do that too increases construction validity and reliability.

@nirak

[chicob@mstdn.social]

@briankrebs
AI in journalism is Farse Technica

[briankrebs@infosec.exchange]

@chicob Arse. It was right there, dude.

[colo_lee@mstdn.social]

@briankrebs well, at least he only did it once.
er, correction ...
he only got *caught* doing it once

[stumpythemutt@social.linux.pizza]

@screwturn @nirak @briankrebs Even a blind pig will find the occasional acorn.

[kennethbousquet@mastodon.social]

@briankrebs He's not at fault here. Even after explanations, he souldn't have been fired. The person has not intentionaly take credit for others work. That person should be reinstated, have his job back.

[reflex@retrogaming.social]

@briankrebs I learned not to trust Ars reporting after the Hacker X story, which they have still declined to retract.

[teriradichel@infosec.exchange]

@briankrebs you 100% cannot trust it. Like Google search results and Wikipedia. But it still might give you some idea or thought or resource you hadn’t seen yet that you can go research further. It can help you think of new questions and point you in new directions (which can be good or bad). I use it to explore ideas and if I do copy something written by AI I write “from Google AI:” or whatever so people can take it with a grain of salt and can back that up with links to other sources. It’s usually something I know is right but I like the way it wrote it and saves me some time. Sometimes I call out when it is wrong to demonstrate why you can’t always trust it. But I’m researching and writing about AI not the kind of things you write about so it’s a bit different. I generally just cite sources if I’m writing something about a data breach like you (and nowhere near the deep dive you do!)

[briankrebs@infosec.exchange]

@screwturn @nirak There are some pretty decent and recent studies showing AI substantially misses or misrepresents the point or summary of a story about 40-50 percent of the time.