The part of me that used to work for a survey research nonprofit is screaming into a pillow
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah what the fuck
-
Our innovative approach: instead of doing something, we simply do not do it. at a fraction of the cost
@hannah the federal government has been doing this for decades
-
Our innovative approach: instead of doing something, we simply do not do it. at a fraction of the cost
@hannah obviously the model needs to be trained on a sample of typical responses from the specific population(s) to be surveyed.
... so, thats it, AI something something magically gets more precision out of the same dataset, by adding simulated data? They're saying the simulated responses are more accurate than the real responses???
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah what the actual fuck is this
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah I have this same instinctive response every time I've seen reference to "synthetic data." People have been (successfully!) selling this crap for almost a decade!
There is no way to synthesize data that meaningfully replicates a real world investigation. Simulate volume? Sure. Test specific scenarios or fuzz inputs? Yep, I'll buy that. But there is no expositive value in synthetic data - by definition. It's synthetic! It reflects only the algorithms used to synthesize it!
-
@hannah what the actual fuck is this
10/10 LLMs think that this is a tremendous idea.
-
@hannah obviously the model needs to be trained on a sample of typical responses from the specific population(s) to be surveyed.
... so, thats it, AI something something magically gets more precision out of the same dataset, by adding simulated data? They're saying the simulated responses are more accurate than the real responses???
@hannah Wait, I've got a better idea that will still cut their polling costs in half: we survey people but with half the standard sample size, then we run it all through a photo copier and tabulate the results. We'll get the normal sample size and accuracy!
Also, copy machines use a lot less power than AI, its win-win!
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah "we're going to make up numbers now instead of polling" is a hell of A Choice
️ -
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah hello? I’d like to return my psychology degree for a full refund. I guess I don’t need all that statistics and test theory and construction any more. I was fun while it lasted though. (It wasn’t.) /s
-
@hannah
️ They can’t possibly be that dumb can they?(Yes I know)
@foobarsoft @hannah I bet they are hip deep in "digital twin" kool-aid.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
"we don't need to get actual data to get an accurate average. we'll just average up all the already averaged data. it will be just as good."
narrator: "someone flunked their stats 101 course..."
-
R relay@relay.infosec.exchange shared this topic
-
@foobarsoft @hannah I bet they are hip deep in "digital twin" kool-aid.
@andygates @foobarsoft bingo, those are mentioned later in the article
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah this truly is the death of all information integrity everywhere.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Aaaaaaah.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Feeding the dog it's own vomit. Force-feeding.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah qualtrics floated this (and maybe went through with it idk) right after chatgpt first went live
What hilarious is that this agentic things is plausibly *worse* since you're having simulations fill out the survey instead instead of using an llm to generate a bazillion responses. The responses will still be just as bad, but at a huge markup of energy costs
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
nothing is real
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Wow, sock-puppeting at scale.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
-
10/10 LLMs think that this is a tremendous idea.
I have a hard time getting over this.
I tried irony. Sarcasm. I duckduckgoed the word.
Maybe the article misunderstood something? No, doesn't look that way.
Sure, there is bias in any sort of polling or study. The way you phrase things can influence how they are answered.
But this is just a dice roll with more words.
No wait, dice rolls can't be manipulated that easily to skew opinion.
