google is broken...

[s_ol@merveilles.town]

@liaizon
the sad thing is that they can (and might) fix this, but the fix will be one of these two:

1. have the model run much longer, then have another model read that output and summarize: "reasoning" (aka maximize resource burning)
2. give the AI a traditionally-implemented "count characters in word" tool (address the symptom, aka admit defeat.

[liaizon@social.wake.st]

@s_ol it should be doing tool calls anyway for many questions. Like Google search used to do basic math and equations inline without searching.

[s_ol@merveilles.town]

@liaizon
i was under the impression that other general-purpose models have solved this and would've guessed they implemented option 2 but actually chatgpt is still confidently wrong (now with sources!)

[liaizon@social.wake.st]

@s_ol I love how all these companies are completely ruining the concept of souces and citations

[mntmn@mastodon.social]

@s_ol @liaizon last night when i tried exactly this, it was already using python to count chars, but only sometimes. when i asked "how many p in paraphernalia" it said 3. so it's just very random

[liaizon@social.wake.st]

@mntmn @s_ol how many pythons does it take to change a lightbulb?