“The LLM generated what was described, not what was needed.”
Uncategorized
2
Posts
2
Posters
0
Views
-
“The LLM generated what was described, not what was needed.”
Your LLM Doesn't Write Correct Code. It Writes Plausible Code.
One of the simplest tests you can run on a database:
(blog.katanaquant.com)
-
“The LLM generated what was described, not what was needed.”
Your LLM Doesn't Write Correct Code. It Writes Plausible Code.
One of the simplest tests you can run on a database:
(blog.katanaquant.com)
There's one line there that would be valuable in a broader discussion (beyond coding):
"This is not a syntax error. It is a semantic bug:"Given that LLMs don't even have a semantic component, this seems foreseeable. But outside the specific context of coding I see people struggling to formulate the point cogently.
This would be relevant to contexts like technical writing, etc., but I don't think the vocabulary exists for expressing it neatly in such cases.
-
R relay@relay.an.exchange shared this topic
