"AI tools are making potentially harmful errors in social work records, from bogus warnings of suicidal ideation to simple “gibberish”, frontline workers have said.
-
"AI tools are making potentially harmful errors in social work records, from bogus warnings of suicidal ideation to simple “gibberish”, frontline workers have said.
Keir Starmer last year championed what he called “incredible” time-saving social work transcription technology. But research across 17 English and Scottish councils shared with the Guardian has now found AI-generated hallucinations are slipping in.
As scores of local authorities begin to use AI note-takers to accelerate recording and summarisation of meetings with adult and child service users, a seven-month study by the Ada Lovelace Institute found “some potentially harmful misrepresentations of people’s experiences are occurring in official care records”.
The independent thinktank found that one social worker who had used an AI transcription tool to create a summary said the technology had incorrectly “indicated that there was suicidal ideation”, but “at no point did the client actually … talk about suicidal ideation or planning, or anything”."
Social workers’ AI tool makes ‘gibberish’ transcripts of accounts from children
Transcription tools used by councils in England and Scotland reported to wrongly indicate suicidal ideation
the Guardian (www.theguardian.com)
#AI #GenerativeAI #AITranscription #SocialWork #UK #Hallucinations
-
"AI tools are making potentially harmful errors in social work records, from bogus warnings of suicidal ideation to simple “gibberish”, frontline workers have said.
Keir Starmer last year championed what he called “incredible” time-saving social work transcription technology. But research across 17 English and Scottish councils shared with the Guardian has now found AI-generated hallucinations are slipping in.
As scores of local authorities begin to use AI note-takers to accelerate recording and summarisation of meetings with adult and child service users, a seven-month study by the Ada Lovelace Institute found “some potentially harmful misrepresentations of people’s experiences are occurring in official care records”.
The independent thinktank found that one social worker who had used an AI transcription tool to create a summary said the technology had incorrectly “indicated that there was suicidal ideation”, but “at no point did the client actually … talk about suicidal ideation or planning, or anything”."
Social workers’ AI tool makes ‘gibberish’ transcripts of accounts from children
Transcription tools used by councils in England and Scotland reported to wrongly indicate suicidal ideation
the Guardian (www.theguardian.com)
#AI #GenerativeAI #AITranscription #SocialWork #UK #Hallucinations
@remixtures at least this time nobody turned into a frog haha
-
R relay@relay.infosec.exchange shared this topicR relay@relay.mycrowd.ca shared this topic
