Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit?

[joblakely@mastodon.social]

@emilymbender yes. I said no. Said I was very against it.

[joblakely@mastodon.social]

@emilymbender yes. I said no. That I was very much against it.

[drangnon@hachyderm.io]

@emilymbender yesterday, and I said no.

thanks for putting out a newsletter talking about it

[emilymbender@dair-community.social]

@Bette Woof.

[boydstephensmithjr@hachyderm.io]

@emilymbender I agree. I didn't feel like fighting it. Healthcare in the U.S. is tiring for everyone.

[whitecattamer@mastodon.online]

@emilymbender THANK YOU for point 9. It drives me batty how poorly people (read: management) rate the importance of mental review, slower moments, and backburner thinking for improving or maintaining skills. Something something working out is 10% active work and 90% fueling/rest.

Not to mention that a rushed/stressed provider makes ME stressed and less likely to be candid or “be complicated”, which is not the point of a visit!

[meltedcheese@c.im]

@emilymbender Yes. I think this is becoming quite common. Medical groups are providing this service through enterprise-wide medical information systems. I was grateful to be asked. I’ll just add that doctors do not like lectures from patients.

[emilymbender@dair-community.social]

@meltedcheese Nowhere am I suggesting that patients lecture their doctors, though?

This information can help patients make decisions for themselves about this. If consent is being requested (as it should be), then 'no' is a complete sentence.

[deborahh@cosocial.ca]

@JoBlakely @emilymbender I asked a therapist: was our session being used to train the AI? Because I did not want that.

She said she didn't know, and said she wouldn't record any more until she had the answer.

#noAI

[crowbriarhexe@tech.lgbt]

@BoydStephenSmithJr @emilymbender Brought to you by the Consently(TM) platform

[joblakely@mastodon.social]

@deborahh @emilymbender I just forwarded this article to my doctors office. Hopefully those using it will read it.

[meltedcheese@c.im]

@emilymbender Great article. The privacy of my protected health information is my immediate concern. There are many ways it can and does leak. It’s not the provider’s fault, it is in the whole chain of info systems backing them up. Using an LLM multiplies the risk. Training data is EXTREMELY valuable. There is no way the recording or transcript are getting deleted. It’s getting sold. The incentives are all wrong to ensure HIPAA compliance.

[sprucepapoose@infosec.exchange]

Yes, and by a couple of specialists who it has taken a lot of time/money to get in to see, so I've felt almost coerced into agreeing as I didn't want to risk them declining to see me so I consented against my better judgement.

Do you think there are other ways we can fight this outside of directly declining consent in these situations? One of the providers I see who has been using one for ~2 years now is the only person I've been able to see locally who can prescribe a tightly controlled medication, so I'm quite reluctant to risk the (tenuous) relationship I have established (I already don't feel like I can be completely open and honest with her, and fear what may happen if I decline the use of the scribe).

[huntingdon@mstdn.social]

@emilymbender

Refuse! Don't do the doctor's job of taking notes, let alone support their choice to have AI transcribe notes for them. The accuracy rate is poor, but incorrect notes would still be used to treat you.

[radioclash@retro.pizza]

@meltedcheese given my frankly dreadful and queerphobic/allistic centric medical experience in the supposedly 'better' NHS in the UK - I don't care for doctor's fee-fees about being 'lectured'.

At least 2-3 cases in my life where doctor's egos over a patient daring to contradict them cos 'I'm the trained medical professional here' has meant they refused to accept something that down the line was proven scientifically to be 100% correct.

Like my NCGS, apparently all in my head...until someone did a double blind study and it was grudging acceptance that I wasn't lying about my gluten issues...they totally missed my neurodivergence even with me being taken as a child to the GP with classic issues over hyperfocus and not hearing my parents. Putting me on child doses of my inhaler as an adult cos I argued over them removing steroidal drugs from repeats without asking.

Have been gaslit by other doctors over THEIR COLLEAGUES diagnoses as well.

So yeah...fuck them. Lectures kept me alive so far. Do not trust.

[meltedcheese@c.im]

@emilymbender Agreed. I’m sorry that I miscommunicated. => I am the one who “lectured” and only because AI is my area of deep expertise. If I can convince a doctor or two to at least ask the right questions and consult with other doctors before simply accepting the use of LLM technology, that’s a good thing. Patients should have the info, as you say, to make their own decisions.

[meltedcheese@c.im]

@radioclash You are a good example of being your own best advocate. Good health to you.

[marbletravis@mastodon.world]

@emilymbender I've been asked multiple times, and I always chicken out when they ask and say yes, I think it's the power imbalance, and I don't think it's fair.

[natematias@social.coop]

@emilymbender I have been asked multiple times by medical providers this year if I would consent to AI transcription, and I have said no every time. I'm tempted to ask next time if they have information from an independent audit of the system performance and privacy policy

[wcbdata@vis.social]

@emilymbender I've spotted medically significant errors in the transcription during the session. It's galling.