Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit?
-
@emilymbender Agreed. I’m sorry that I miscommunicated. => I am the one who “lectured” and only because AI is my area of deep expertise. If I can convince a doctor or two to at least ask the right questions and consult with other doctors before simply accepting the use of LLM technology, that’s a good thing. Patients should have the info, as you say, to make their own decisions.
@meltedcheese @emilymbender It’s very likely this feature was introduced into the medical office patient management software. It’s likely being pushed hard by the developers. It might even offer a kickback scenario for the doctors who record the most. Doctors are not going to argue with free money, but they will argue with patients if they stand to lose that kickback money.
This suggests a deeper journalistic dive into that patient mgmt. software might be justified.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender Im fortunate my gp doesn't even trust the national health database.
-
@anne_twain @emilymbender I agree, but I imagine it will limit their liability if something happens to my data, intended or not.
I was too "invested" / tired to resist. I don't have an excuse. I will try to do better.
-
@DrSarahHolstein @emilymbender
I’m going to have to start asking. Ugh. -
@emilymbender my visit notes for one doctor said that I verbally consented to having the appointment recorded. I did not, nor was I ever asked. Not happy about that.
-
@Mikal @jrdepriest @emilymbender Unfortunately, it’s likely to get to the point that it’s too much of a hassle to ask and they stop asking. They’ll simply collect it without your knowledge or consent.
@randocity @jrdepriest @emilymbender
I think that kind of depends on things like state laws. California for example is a two party consent state so I think recording someone without asking might actually be a criminal offense. Plus they have to have some sort of device and that is likely to be visible. Either way, I think that's why we need to push back immediately and make sure they understand that this is not acceptable.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender Yes, I was asked to sign a consent (stuck in with the other standard consents) authorizing the doctor’s practice to use an AI scribe. I left the room, went up to the front desk and told them I would not sign the consent under any circumstances. They looked a little surprised, but agreed to have one of the techs act as a scribe as normal. Glad I stood my ground - there is no way in Hell I would let a Doc use AI for anything medical related
-
@emilymbender my visit notes for one doctor said that I verbally consented to having the appointment recorded. I did not, nor was I ever asked. Not happy about that.
@wwahammy @emilymbender
I’ve suspected this at the vet office, too. At first, they asked (and I declined). Then at subsequent visits they didn’t ask, but I could see the waves jumping on their monitor which made me wonder….
Anyway, our sweet Sydney passed this week so that won’t be an issue anymore….
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender
My (now former) therapist sprang this on me.Your points about the note taking being part of the care rang very true. Also, the what might be missed.
It also changed the interaction significantly. I was not overly concerned about the privacy of the contents, but the pauses where the therapist had to think for a moment and write notes gave me a quiet space and time to think. That disappeared.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
yes i was a declined. when she asked, i said because
1. the companies used sites with CSAM and other abuses
2. it’s spyware. each prompt acts like a honey-pot. since you are giving them the info, it by-passes HIPPA. in turn they get to use and sell that info however they please
3. as an antifascist activist, it puts my life in danger by giving companies ran by fascists access to my whole medical history.
my MD was shocked. they had no idea about the spyware angle or CSAM
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender I opted out at my physical therapist last week. They told me all their patients who work in tech have opted out.
-
@wwahammy @emilymbender
I’ve suspected this at the vet office, too. At first, they asked (and I declined). Then at subsequent visits they didn’t ask, but I could see the waves jumping on their monitor which made me wonder….
Anyway, our sweet Sydney passed this week so that won’t be an issue anymore….@kimgadsdon @emilymbender I'm so sorry about Sydney's passing. I lost my Yorkie, Penelope, in 2024 so I know the wonderful joy that a Yorkie provides and the seemingly unbearable loss when they're gone.
I hope the happy memories give you a bit of comfort.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender
Evidence shows litigation decrease if Drs have scribes. A Dr isn’t allowed to remember things in defence. It’s said “If it is not documented, it didn’t happen” even if it did happen & recall can be verified.The direct effect:
1: more litigation = more insurance cost for the Dr & thus higher consult fees.
2: Drs who have psychological & emotional injury from spurious claims reduce/stop practice.So there is high motivation for having a scribe.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender Really helpful. Thanks for sharing.
I often reason about it this way. There are very few things like this where, if you opt out this time, you can’t opt in next time. On the other hand, there are LOTS of situations, this being a good example, where opting out after you opted in is substantially more effort (or even impossible).
Opting out by default is usually a safe thing to do. You can always opt in later if you change your mind.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender multiple times in fact. And I hate it.
-
Yep. And I said no. She initially said not to worry because it's all deleted afterwards. I said that, no, it is not. That's not how LLM's work. All that data remains in there somewhere and can be hacked, plus I don't want anything about me used to train those things on principal. She didn't argue.
@Mikal @emilymbender
It's pinky promised by LLM vendors to the healthIT vendors selling to hospitals that data sent to their servers for the purpose of LLM input is not retained or used outside of inference.HealthIT vendors are then happy to believe this at face value so they can sell AI hype to hospital execs desperate to force their clinicians to shove more patients through at any cost and slash labor costs.
Docs are told it's fine by IT who was told it's fine by the CIO who was told...
-
@emilymbender I do share a lot of AI skepticism, but physician perspective (I use it about 25-30% of visits), there are many highly speculative aspects of this take:
🧵 1/5
1) Point #1 is valid, however, the same data safety questions can be asked regarding other integrated systems. Like where is your EMR data stored, how does your radiology data integrate (reviewed in 3rd party software), etc.
2) Consent: valid concern, but the fullest version would be a long EULA-like text with a checkbox...@P__X Your experience is your experience, but I am **appalled** at what you're saying about consent here. The fullest version would be too long, so we're not actually doing informed consent? No thank you.
-
@Mikal @emilymbender
It's pinky promised by LLM vendors to the healthIT vendors selling to hospitals that data sent to their servers for the purpose of LLM input is not retained or used outside of inference.HealthIT vendors are then happy to believe this at face value so they can sell AI hype to hospital execs desperate to force their clinicians to shove more patients through at any cost and slash labor costs.
Docs are told it's fine by IT who was told it's fine by the CIO who was told...
@Mikal @emilymbender
Just to add a little more here: I listened to the R&D head of a large allegedly monopolistic EHR vendor tell a room full (1000s) of physicians and hospital CXOs they need to be less cautious and go full speed ahead in their adoption of AI.It's being pushed really, really hard in healthcare software.
-
@meltedcheese @emilymbender It’s very likely this feature was introduced into the medical office patient management software. It’s likely being pushed hard by the developers. It might even offer a kickback scenario for the doctors who record the most. Doctors are not going to argue with free money, but they will argue with patients if they stand to lose that kickback money.
This suggests a deeper journalistic dive into that patient mgmt. software might be justified.
@randocity @meltedcheese @emilymbender my medical defence insurer encourages its use because evidence shows lower litigation rates in consultations with scribes. The study was done using human scribes, predates the AI era.
-
Have you been asked by a medical provider recently for consent to have an "AI" scribe record your visit? Us, too. And we have **thoughts**
Why you should refuse to let your doctor record you
By: Emily M. Bender and Decca Muldowney At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started,...
(buttondown.com)
@emilymbender for a doctors perspective on the more profound side effects of “efficiency”
I Was an Enthusiastic Early Adopter of AI Scribes. Here’s Why I Stopped
A GP reflects on what eighteen months of ambient scribing taught them about the consultation they thought they already understood.
(benngooch.substack.com)
“I felt myself becoming a passive observer in encounters where I had previously been an active architect. I felt my clinical memory, my narrative identity, and my sense of connection to my patients beginning to erode at the edges.”
