Hit a warning today when my AI transcription tool hit 2,000 errors in one week

I've been using this AI transcription service for my client notes (personal trainer stuff, you know) and it's been mostly fine until this week. I noticed it kept messing up words like "squat" vs "squirt" which is a weird one, but I didn't think much of it. Then I ran a quick check on last week's files and found exactly 2,047 errors across 15 sessions. That's like 136 mistakes per session on average. The scary part is the errors were all small words that changed the meaning of what I was saying, like "don't" becoming "do" or "not" becoming "now". If a client actually read those notes they'd think I told them the opposite of what I did. Has anyone else caught their AI tools making this many hidden mistakes?

2 comments

2 Comments

patriciap5227d ago

oh man that is so sketchy! i actually had a similar thing happen to my friend who's a nurse. she was using an AI tool to write up patient notes and it kept swapping "not" with "now" too. one time it changed "patient is not responding to treatment" to "patient is now responding to treatment" which is literally the opposite thing. she almost sent that to the doctor before she caught it. the scary part was she said the mistakes were so small and subtle you wouldn't notice unless you were really looking for them. after she found a bunch of errors she stopped using the AI entirely and just types everything out manually now. its wild how these tools are supposed to save time but end up causing more headaches.

abby_black27d ago

Yeah "the mistakes were so small and subtle you wouldn't notice unless you were really looking for them" is exactly the problem. If you're going to use these tools you have to read every single word out loud before you submit anything, especially in healthcare where one wrong letter can screw someone up. Honestly I've stopped using AI for anything important because double checking it takes longer than just writing it myself from scratch.