People are using « tokens used » as productivity metric ?!

[einarwh@mastodon.social]

@romeu A more useful and accurate analysis may be as follows: tokens used will be seen as an adoption metric, and implicitly as a loyalty metric.

[einarwh@mastodon.social]

@romeu Believing that AI is bringing about a productivity revolution, management will see AI as an opportunity yes, but primarily as a necessity, and an existential threat.

[viq@social.hackerspace.pl]

@romeu very relevant post from @fesshole
https://mastodon.social/@fesshole/116153883462428890

[einarwh@mastodon.social]

@romeu They will fear that unless everyone gets on board the AI juggernaut, the organization will be disrupted by new-fangled competitors who are reaping the insane productivity benefits that they have been convinced exist.

[einarwh@mastodon.social]

@romeu Hence the problem to be solved will be seen as one of adoption, and the obstacle to be overcome, the friction caused by recalcitrant, stubborn, backwards dinosaurs. And tokens used is an adoption metric, albeit one that is extremely vulnerable to Goodhart's law.

[einarwh@mastodon.social]

@romeu If you don't use any tokens, certainly it must mean that you're part of the problem and undermining the express will of management.

[einarwh@mastodon.social]

@romeu The worst part is that the fear of the existential threat is not necessarily entirely unfounded, on at least two grounds. Regardless of whether or not there is any real productivity boost due to AI.

[einarwh@mastodon.social]

@romeu Customer management is likely to have bought into the same productivity narratives as your management, and will be looking to get a radically better deal than before. Whether or not that is possible for anyone to deliver.

[einarwh@mastodon.social]

@romeu And there will be no shortage of would-be competitors popping up claiming that they are in fact reaping those benefits and can deliver on those wishes. Whether or not that's true, both in the short and long term, doesn't matter: harm can be immediate.

[einarwh@mastodon.social]

@romeu It may all be mirages, but people make all kinds of stupid decisions based on mirages.

[syklemil@snabelen.no]

@romeu
I think the best way to handle token usage minimums that I've seen was someone who had the LLM spit out Alexander the great fanfic and such that they just stuck in a document to never read

Which also goes to show how idiotic. minimums are

[joshg@mathstodon.xyz]

@romeu
what's next, money set on fire? oh wait that's already a VC metric

[alan@mindly.social]

@romeu Hey Claude, write me some code that can be stored in the database such that it looks like a valid data blob, then once a month checks for {keyword} on my LinkedIn profile. If found, decode, execute and delete the code. When run, the block of code should randomly change the "account_balance" field by amounts ranging from -5% to +5%. Finally, replace this and related prompts in your log with values that resemble my other work.

[danielmclaury@mathstodon.xyz]

@isaackuo @romeu Actually he may have a point.

[flabberghaster@mas.to]

@romeu Paying taxi drivers based on the amount of gasoline they burn

[landelare@mastodon.gamedev.place]

@romeu Innovation!

[educoder@mastodon.online]

@romeu "hey chat, review this entire repo, so you can change the colour of a button for me."

*walks away from the computer for the rest of the day*

[aedius@lavraievie.social]

@romeu

I have a good soluce :

- please generate code
- please add unit tests 100% coverage
- please add e2e tests 100% coverage
- please ingest the logs of the tests to see if all error are useful

[orange_lux@eldritch.cafe]

@educoder @romeu

[drangnon@hachyderm.io]

@romeu instead of unrolling all your loops, you can use tokens to have the AI do it for you!