<![CDATA[Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time.]]>Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time.

Many smart people struggle with this because they either
1. Get frustrated with a non-deterministic tool whose output they can’t trust.
2. Decide to blindly trust it because “Claude/ChatGPT said so”

Both are failure patterns and quite common.

]]>https://board.circlewithadot.net/topic/710a9584-9cd4-46e1-9ff3-b47cffe6a5d9/gettting-good-at-using-generative-ai-means-being-effective-at-working-with-a-tool-that-makes-things-up-10-50-of-the-time.RSS for NodeFri, 15 May 2026 01:51:56 GMTSun, 10 May 2026 13:28:41 GMT60<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 21:26:08 GMT]]>@carnage4life I think you missed 3., having SMEs who can identify and fix hallucinations and errors because for them AI is an accelerator, not a replacement.

]]>https://board.circlewithadot.net/post/https://mstdn.ca/ap/users/116213082989216869/statuses/116552392275598103https://board.circlewithadot.net/post/https://mstdn.ca/ap/users/116213082989216869/statuses/116552392275598103Sun, 10 May 2026 21:26:08 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 18:23:36 GMT]]>@damageboy This is an uncomfortable truth that isn’t discussed much.

I’m definitely in this bucket.

]]>https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116551674499444905https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116551674499444905Sun, 10 May 2026 18:23:36 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 18:21:33 GMT]]>@carnage4life @davidnjoku #1 is a success, not a failure. It’s the same reason I unfollow LLM apologists — I don’t like tools who make things up

]]>https://board.circlewithadot.net/post/https://tilde.zone/users/fivetonsflax/statuses/116551666436665730https://board.circlewithadot.net/post/https://tilde.zone/users/fivetonsflax/statuses/116551666436665730Sun, 10 May 2026 18:21:33 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 17:26:20 GMT]]>@carnage4life I think you are discounting LLM users who are also in the habit of distrusting human quality of work. I think for some people it's easier/in their bones to setup LLMs in a verifiable harness/loop which dramatically reuces the 10-50% -> 1-5%...

But yeah, most people aren't like that, and this generally tracks with poor critical thinking in humans

]]>https://board.circlewithadot.net/post/https://hachyderm.io/ap/users/116438281615427055/statuses/116551449328606343https://board.circlewithadot.net/post/https://hachyderm.io/ap/users/116438281615427055/statuses/116551449328606343Sun, 10 May 2026 17:26:20 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 15:18:53 GMT]]>@carnage4life genuinely curious:

can 2. be - even partly - delegated to LLMs or does it necessarily require human involvement?

]]>https://board.circlewithadot.net/post/https://mastodon.social/users/performat/statuses/116550948177931388https://board.circlewithadot.net/post/https://mastodon.social/users/performat/statuses/116550948177931388Sun, 10 May 2026 15:18:53 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 14:53:01 GMT]]>@itgrrl As you point out, they aren’t reasonable positions today. 😊

]]>https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116550846469835696https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116550846469835696Sun, 10 May 2026 14:53:01 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 13:52:18 GMT]]>@carnage4life an alternate framing:

Getting good at using generative AI means using a tool that produces incorrect output 10% - 50% of the time. Such tools used to be rejected as not fit-for-purpose / not production-ready.

Many smart people struggle with this because they either

1 Get frustrated with being required to use a tool that’s not fit-for-purpose and having to expend time & energy fixing its incorrect outputs.

2 Decide to say “fuck it” and use it anyway because “management said so” and they have no genuine agency to stop or derail the train.

Both would have been considered reasonable positions only a few years ago and quite common.

]]>https://board.circlewithadot.net/post/https://infosec.exchange/users/itgrrl/statuses/116550607761547027https://board.circlewithadot.net/post/https://infosec.exchange/users/itgrrl/statuses/116550607761547027Sun, 10 May 2026 13:52:18 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 13:43:09 GMT]]>@carnage4life underneath, an assumption that there is a way to use it 'well' and that this is desirable.
And a willingness to dismiss all ethical concerns in doing so.

]]>https://board.circlewithadot.net/post/https://mstdn.games/ap/users/115798900176839373/statuses/116550571725345522https://board.circlewithadot.net/post/https://mstdn.games/ap/users/115798900176839373/statuses/116550571725345522Sun, 10 May 2026 13:43:09 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 13:37:34 GMT]]>@carnage4life 1. Is an ability to consciously shape your language usage to be that of the community whose info you seek, and 2. Is an ability to use logic to build determinism. So the mythical analytical person who intimately understands human language communities 🙂

]]>https://board.circlewithadot.net/post/https://mastodon.online/users/jayalane/statuses/116550549827856934https://board.circlewithadot.net/post/https://mastodon.online/users/jayalane/statuses/116550549827856934Sun, 10 May 2026 13:37:34 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 13:35:29 GMT]]>@carnage4life I find #2 is skipped a lot. Modern software engineering is all about measuring eval'ing the quality of your outputs. We should be doing the same with our agents.

]]>https://board.circlewithadot.net/post/https://sfba.social/users/zenkat/statuses/116550541635401465https://board.circlewithadot.net/post/https://sfba.social/users/zenkat/statuses/116550541635401465Sun, 10 May 2026 13:35:29 GMT<![CDATA[Reply to Gettting good at using generative AI means being effective at working with a tool that makes things up 10% - 50% of the time. on Sun, 10 May 2026 13:29:40 GMT]]>Being good at using LLMs includes

1. Being able to provide context and craft prompts that limit the risk of hallucinations AND
2. Having processes and frameworks to vet the quality of the output from the LLM instead of blindly trusting it.

]]>https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116550518722830549https://board.circlewithadot.net/post/https://mas.to/users/carnage4life/statuses/116550518722830549Sun, 10 May 2026 13:29:40 GMT