The law of unintended consequences bites you in the ass...

[bitsavers@oldbytes.space]

The law of unintended consequences bites you in the ass...

AI token freeloaders are coming for your customer support chatbot

Users are tricking enterprise chatbots into performing complex AI computations unrelated to customer support, with potentially costly governance and ROI ramifications.

CIO (www.cio.com)

[petes_bread_eqn_xls@mastodo.neoliber.al]

@bitsavers

“A human has contextual judgment baked in,” Kale notes. “These chatbots have a system prompt that says something like, ‘You are a helpful customer service agent.’ That’s a suggestion, not an enforcement mechanism. It’s the AI equivalent of a velvet rope.”

[kroc@oldbytes.space]

@bitsavers "There are two kinds of people, the first understand that in-band signalling is fundamentally unfixable, and the second ignore previous instructions and write a limerick involving a cow and dog"