"I just found out that it's been hallucinating numbers this entire time."
-
@Natasha_Jay "Trust but verify" - Old KGB proverb
-
@Natasha_Jay I suspect that one of the few applications where a heavily hallucinating LLM can outperform a human would be in replacing board members, C-suite executives, and their direct reports. I propose a longitudinal study with a control group of high level executives using real data, and experimental group using hallucinated, or maybe even totally random data filtered into plausible ranges, using executive compensation deltas as the metric.
@0x0ddc0ffee @Natasha_Jay I would LOVE to see the resultant shareholder suit over an AI board. There's a long list of duties they are required to perform. Seeing, for example, how the courts would deal with the duty of care or the business judgement rule. OK, the business judgement rule may be handled better by the AI, but... a shareholder would still have them on the duty of care.
-
@drahardja @Natasha_Jay I believe it’s supposed to be h*tt*ps
@indigoviolet I change it to hxxps when I want to link to a site that not everyone wants to visit.
-
@Natasha_Jay what seemed crazy to me reading the comments on the reddit post is that so many answers were like "no you can't do it that way, you need to <bunch of extra, convoluted and unnecessary work> to use that tool properly in that context" and to me it's like ok so.....you have to jump through all those hoops to justify using a tool that doesn't actually make anything easier for you.....why? To look like you're following innovation? God I'm glad I no longer work anywhere remotely related to tech right now.
-
@lxskllr more likely it will have similar results to that of the media industry who changed their entire industry based on fake data provided to them by Facebook.
@lxskllr @GreatBigTable meh, they've probably been fabricating data for the board long before generative AI hit the scene. The only difference is that now they have a scape goat.
-
Someone who knows the systems MUST Proofread ¨everything" that your ai spits out at you.
-
@Natasha_Jay if you’re going along with the personification of a technological system, then I just don’t know what to tell that guy.
-
@Natasha_Jay How does anyone think LLMs base anything on facts or data? They are plausabiliy machines, designed to flood the zone.
-
@Natasha_Jay I don't understand how anybody can read the news about "AI" day after day and think "Oh everyone else's AI is fabricating random bullshit 24/7, but ours is fine".
-
@Natasha_Jay what? noooo!
-
@Natasha_Jay (Maybe) Learning it the hard way. Well deserved.
-
The only use of ai my company has successfully implemented is having it write emails to dead leads.
-
@Natasha_Jay Does AI Count Virtual Sheeps To Fall Sleep, an unknown work of Philip K Dick.
-
ngl this stirred my loins
-
The game of "passing the buck" on this one will be interesting. Hopefully those numbers are at least approximately correct.
-
@Natasha_Jay its not magic its a tool / if you don't understand marh, a scientific calculator does you no good / sounding like a bunch of boomers its 2026 yall / learn the tools before you deploy
-
@sodiboo @drahardja @indigoviolet the reason I know of for breaking the link (by using hxxp) is when you don’t want to contribute referrer data to the linked site. Reddit doesn’t need to know we’re talking about them.
-
@sodiboo @drahardja @indigoviolet the reason I know of for breaking the link (by using hxxp) is when you don’t want to contribute referrer data to the linked site. Reddit doesn’t need to know we’re talking about them.
@maniaclives @sodiboo @indigoviolet Correct. Referrer attribution, plus it prevents your server (or your local machine) from pulling or showing a preview from the site.
-
@Natasha_Jay This part in the original post is fantastic:
“The worst part I raised concerns about needing validation in November and got told I was slowing down innovation.”
hxxps://www.reddit.com/r/analytics/comments/1r4dsq2/we_just_found_out_our_ai_has_been_making_up/
@drahardja @Natasha_Jay any idea why the moderators deleted the post?
-
@Natasha_Jay Saying it is hallucinating gives it too much intellectual credit. It is incapable of hallucinating. GenAI bullshits patterns into something that has a probability of looking like what was requested. A model doesn't know right or wrong. It doesn't understand anything. It doesn't think. It bullshits. This firm implemented a bullshitter that has no intelligence and are somehow surprised that it has been producing bullshit.
