The part of me that used to work for a survey research nonprofit is screaming into a pillow
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Well, shit, I can make old-school Markov chainbots that will answer your poll questions that will emulate human answers too. This is literally less than useless.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah oh this is going to fuck up so many things in an election year
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah oh my GOD
-
Our innovative approach: instead of doing something, we simply do not do it. at a fraction of the cost
@hannah millennials kill yet another industry! *adds a notch*
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah what the fuck
-
Our innovative approach: instead of doing something, we simply do not do it. at a fraction of the cost
@hannah the federal government has been doing this for decades
-
Our innovative approach: instead of doing something, we simply do not do it. at a fraction of the cost
@hannah obviously the model needs to be trained on a sample of typical responses from the specific population(s) to be surveyed.
... so, thats it, AI something something magically gets more precision out of the same dataset, by adding simulated data? They're saying the simulated responses are more accurate than the real responses???
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah what the actual fuck is this
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah I have this same instinctive response every time I've seen reference to "synthetic data." People have been (successfully!) selling this crap for almost a decade!
There is no way to synthesize data that meaningfully replicates a real world investigation. Simulate volume? Sure. Test specific scenarios or fuzz inputs? Yep, I'll buy that. But there is no expositive value in synthetic data - by definition. It's synthetic! It reflects only the algorithms used to synthesize it!
-
@hannah what the actual fuck is this
10/10 LLMs think that this is a tremendous idea.
-
@hannah obviously the model needs to be trained on a sample of typical responses from the specific population(s) to be surveyed.
... so, thats it, AI something something magically gets more precision out of the same dataset, by adding simulated data? They're saying the simulated responses are more accurate than the real responses???
@hannah Wait, I've got a better idea that will still cut their polling costs in half: we survey people but with half the standard sample size, then we run it all through a photo copier and tabulate the results. We'll get the normal sample size and accuracy!
Also, copy machines use a lot less power than AI, its win-win!
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah "we're going to make up numbers now instead of polling" is a hell of A Choice
️ -
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah hello? I’d like to return my psychology degree for a full refund. I guess I don’t need all that statistics and test theory and construction any more. I was fun while it lasted though. (It wasn’t.) /s
-
@hannah
️ They can’t possibly be that dumb can they?(Yes I know)
@foobarsoft @hannah I bet they are hip deep in "digital twin" kool-aid.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
"we don't need to get actual data to get an accurate average. we'll just average up all the already averaged data. it will be just as good."
narrator: "someone flunked their stats 101 course..."
-
R relay@relay.infosec.exchange shared this topic
-
@foobarsoft @hannah I bet they are hip deep in "digital twin" kool-aid.
@andygates @foobarsoft bingo, those are mentioned later in the article
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah this truly is the death of all information integrity everywhere.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Aaaaaaah.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah Feeding the dog it's own vomit. Force-feeding.
-
The part of me that used to work for a survey research nonprofit is screaming into a pillow
@hannah qualtrics floated this (and maybe went through with it idk) right after chatgpt first went live
What hilarious is that this agentic things is plausibly *worse* since you're having simulations fill out the survey instead instead of using an llm to generate a bazillion responses. The responses will still be just as bad, but at a huge markup of energy costs
