But like.. this is also why even assuming they're true, the "single query is like running your microwave for a second" shit is so disingenuous. No one is doing a single query.

They are leaving the microwave running 24x7, which turns out is actually quite bad for the environment!

We are so unbelievably fucked, none of this can be used in a sensitive environment.

And the overwhelming consensus from researchers is that this is impossible to solve, all you can do is beg for the computer not to fuck everything up in increasingly desperate ways.

4 years ago I was arguing with programmers about this and they were like "well by the time it gets access to your emails, this will be fixed."

It was not fixed.

I have been yelling about this in different places for 4 years. Before they really took off I used to do hobby red-teaming around GPT-3 and 4, and there was this moment of realizing that none of the security for this stuff fucking works, at all, and yet no one wanted to admit that, it was just layers of programmers going "what if there's a second LLM though", and stuffing their heads in the sand, and NOTHING HAS CHANGED.

Pretty accurate.

But yeah. They have no control over this thing and they've just been hawking a really elaborate Wizard Of Oz that sometimes breaks GitHub.