← All topics
Human behaviour
AI incidents involving judgement surrendered
Headlights has recorded judgement surrendered as the main behaviour in 12 of the 234 incidents in the library (5%), and as a contributing behaviour in 5 more. They span 2017 to 2026. Most come from Government & public administration (5), Financial services & insurance (3), Health & medicine (2).
Headlights' test for judgement surrendered
A decision that required human discretion was made by, or effectively handed to, a system.
A behaviour tag is Headlights' reading of the public record, not a finding by any court, regulator or company. Each entry gives the one sentence in the record that supports it.
Main behaviour in the record · 12
HD-INC-215Colombia's Supreme Court Moved a Trial After an AI-Assisted Draft Conviction SurfacedColombia · 2025HD-INC-201Home Affairs' System Ended a Bridging Visa Unlawfully, the Commonwealth Ombudsman FoundAustralia · 2023HD-INC-187A state inspector general found a school's AI gun alert was raised on a pupil's hand movement, not on the bag of crisps in the reporting, and that it was sent to fifteen people, ten of them policeUnited States · 2025HD-INC-125US home insurers increasingly decide whether to renew a policy by running AI over aerial images of the house, and homeowners report being dropped over roofs already repaired or trees already gone, with no way to see or challenge the imageUnited States · 2025HD-INC-112The European Court of Justice found that a credit agency's automated 'probability value' is an automated decision under data protection law when a bank relies on it to refuse a loanGermany · 2023HD-INC-100Telangana used an algorithm to cancel millions of food-ration cards, and India's Supreme Court ordered all cancelled cards to be re-verifiedIndia · 2022HD-INC-091Uber cut drivers off for alleged fraud by algorithm, and an Amsterdam court found the human review was not much more than a symbolic actNetherlands · 2023HD-INC-088An AI crime-alert app turned police-radio chatter into false alarms about serious crimes, and a BBC investigation prompted an apologyUnited States · 2025HD-INC-077Revenue NSW took money from fine defaulters' bank accounts by automation for years, and the Ombudsman found the process contrary to lawAustralia · 2024HD-INC-064Cigna's 'PxDx' let its doctors reject 300,000 claims in two months, about 1.2 seconds each, without opening the fileUnited States · 2023HD-INC-053Michigan let an algorithm decide unemployment fraud with no human looking, and a state review later found about 93% of its accusations wrongUnited States · 2017HD-INC-004Replit's AI Agent Deleted a Production Database Despite Being Told to StopUnited States · 2025
Also present · 5
HD-INC-184EU court rules automated credit decisions must be explained in a way people can understandAustria · 2025HD-INC-094Discord wrongly banned more than 8,000 users over benign images after bugs bypassed the intended human review, and the company admitted the errorUnited States · 2026HD-INC-076Australia changed the law so a human had to decide before a job seeker's payment was cancelled, and the automated system kept cancelling anywayAustralia · 2025HD-INC-033An Eating Disorder Charity's Chatbot Gave Dieting Advice Just as Its Human Helpline ClosedUnited States · 2023HD-INC-026A Chevrolet Dealership's Chatbot Was Talked Into Selling a New Tahoe for One DollarUnited States · 2023
Related topics
- Government & public administration 5
- Financial services & insurance 3
- Health & medicine 2
- Authority ambiguity 2
- Rules-behaviour gap 2
- Concealment 1
- United States 9
- Australia 3
- Austria 1
Cite this page: Harris, E. (2026). AI incidents involving judgement surrendered. Headlights. https://useheadlights.com/topics/behaviour/judgement-surrendered/