“Your LLM Doesn't Write Correct Code.
-
“Your LLM Doesn't Write Correct Code. It Writes Plausible Code.”
Hey guys I found another one that thinks humans write correct code!
-
“Your LLM Doesn't Write Correct Code. It Writes Plausible Code.”
Hey guys I found another one that thinks humans write correct code!
@schwa I mean, I can believe that the humans who write sqlite actually DO write correct code. So if that's the thing you are choosing to compare to...
But you're not wrong, and part of the tragedy of the present moment is that so few humans who code are in a position to be able to write it correctly. So much of what we do as an industry is built upon the shifting sands of someone else's frameworks, and the sands move underneath us for reasons we don't know, and our stuff falls down, and we prop it back up again.
In that sort of environment, more and more of what you write (by hand or otherwise) becomes just plausible and it's harder and harder to say whether any of it is correct.
-
@schwa I mean, I can believe that the humans who write sqlite actually DO write correct code. So if that's the thing you are choosing to compare to...
But you're not wrong, and part of the tragedy of the present moment is that so few humans who code are in a position to be able to write it correctly. So much of what we do as an industry is built upon the shifting sands of someone else's frameworks, and the sands move underneath us for reasons we don't know, and our stuff falls down, and we prop it back up again.
In that sort of environment, more and more of what you write (by hand or otherwise) becomes just plausible and it's harder and harder to say whether any of it is correct.
@gregtitus @schwa it's possible and hard for humans to write correct code, all things being equal.
It gets hard under the typical resource constraints of an organization in capitalism.
It gets impossible when it is the ludicrous speed, anti-human parameters of late capitalism.
-
R relay@relay.infosec.exchange shared this topic