← All topics
Industry
AI incidents in health & medicine
Headlights has documented 14 AI incidents in health & medicine, 6% of the library, from 2018 to 2026. The behaviour most often in the record is overconfidence (6). Most are from the United States (10), Canada (2), Kenya (1).
14 incidents, newest first
HD-INC-227Kenyan MPs Found an AI Claims System Led to Unjust Denials of Hospital ClaimsKenya · 2025HD-INC-196An Otter.ai Transcription Tool Joined Hospital Rounds Through a Former Doctor's Old InviteCanada · 2024HD-INC-189A clinical AI vendor advertised hallucination rate figures of <.001% and <1 per 100,000, and Texas alleged its representations may have violated the Texas Deceptive Trade Practices and Consumer Protection Act because they were false, misleading or deceptiveUnited States · 2024HD-INC-188Ontario's auditor found that nine of twenty AI Scribe systems fabricated information in the government's own procurement testing, and that all twenty vendors were approvedCanada · 2026HD-INC-174The FDA told a company its AI app was an unapproved medical device after it advertised a five minute gaze test to detect early signs of Alzheimer's diseaseUnited States · 2025HD-INC-158A US drug manufacturer told inspectors it had used AI agents to write the documents that define how its products are made, and said it had not known about a validation requirement because the AI had not raised itUnited States · 2026HD-INC-145An NHS-partnered health app's AI checker was flagged for missing serious conditions, and the regulator shared the concernsUnited Kingdom · 2020HD-INC-121A widely used US healthcare algorithm judged how sick patients were by what had been spent on their care, so patients the system had historically spent less on were rated healthier and passed over for extra help, and researchers found the bias cut those referrals by more than halfUnited States · 2019HD-INC-073An AI transcription tool used by clinicians invented text no one said, researchers reported, and the audio that could have proved it was deletedUnited States · 2024HD-INC-064Cigna's 'PxDx' let its doctors reject 300,000 claims in two months, about 1.2 seconds each, without opening the fileUnited States · 2023HD-INC-055Epic's sepsis-warning model ran in hundreds of hospitals, and an external test found it missed about two-thirds of cases while flooding clinicians with false alarmsUnited States · 2021HD-INC-049IBM sold Watson as a revolution in cancer care, then its own documents showed it recommending unsafe treatments it had learned from invented patientsUnited States · 2018HD-INC-033An Eating Disorder Charity's Chatbot Gave Dieting Advice Just as Its Human Helpline ClosedUnited States · 2023HD-INC-007UnitedHealth allegedly used an algorithm with a 90% error rate to deny post-acute care to elderly Medicare Advantage patientsUnited States · 2022
Related topics
Cite this page: Harris, E. (2026). AI incidents in health & medicine. Headlights. https://useheadlights.com/topics/industry/health/