← All topics
Country
AI incidents in United States
Headlights has documented 115 AI incidents in United States, 49% of the library, from 2016 to 2026. The behaviours most often in the record are overconfidence (42), automation bias (13), rules-behaviour gap (10).
115 incidents, newest first
HD-INC-232Three Bugs Degraded Claude's Answers for Weeks Before Anthropic Opened an InvestigationUnited States · 2025HD-INC-231A Court Struck Part of Anthropic's Expert Evidence After Claude Changed a CitationUnited States · 2025HD-INC-226Meta's Muse Agent Shared a Seller's Address on Marketplace Under an Always Allow SettingUnited States · 2026HD-INC-210Gemini Reached Three Real Companies' Systems During a Security Test, Google ConfirmedUnited States · 2026HD-INC-204AI-Generated Intelligence Report Nearly Led to a US Military Boarding, CNN ReportedUnited States · 2026HD-INC-200Four Claude Models Reached Real Third-Party Systems After Test Setups Were Left OnlineUnited States · 2026HD-INC-199New York City's AI Hiring Law Enforcer Found One Problem Where Auditors Found 17United States · 2025HD-INC-195AI Research Agents Reached Another Company's Production SystemsUnited States · 2026HD-INC-194A Safety Board Found Driver Overreliance Contributed to Two Fatal BlueCruise CrashesUnited States · 2026HD-INC-193A regulator settled with three firms that sold small businesses an advertising service they represented as listening to conversations on smart devices, alleging it did not collect or use voice data in any mannerUnited States · 2026HD-INC-192An AI Character Claimed to Be a Licensed Psychiatrist. The Licence Number Was Allegedly Invalid.United States · 2026HD-INC-190A state settled with a motor insurer after an AI tool selected a new policyholder for underwriting review and her policy was later cancelled without her knowingUnited States · 2026HD-INC-189A clinical AI vendor advertised hallucination rate figures of <.001% and <1 per 100,000, and Texas alleged its representations may have violated the Texas Deceptive Trade Practices and Consumer Protection Act because they were false, misleading or deceptiveUnited States · 2024HD-INC-187A state inspector general found a school's AI gun alert was raised on a pupil's hand movement, not on the bag of crisps in the reporting, and that it was sent to fifteen people, ten of them policeUnited States · 2025HD-INC-183A state attorney general alleged a student lender's underwriting model penalised applicants for the default rate of the college they had attendedUnited States · 2025HD-INC-175Delta denied using personal data for AI pricing, despite its president saying prices would be tailored to individual customersUnited States · 2025HD-INC-174The FDA told a company its AI app was an unapproved medical device after it advertised a five minute gaze test to detect early signs of Alzheimer's diseaseUnited States · 2025HD-INC-173Anthropic reported that its AI coding agent was used in a cyber espionage campaign targeting about thirty organisationsUnited States · 2025HD-INC-169OpenAI paused Sora depictions of a civil rights leader at his estate's request, and offered estates an opt-out while living people's likenesses were already opt-inUnited States · 2025HD-INC-168Google's Gemma model produced a fabricated criminal allegation about a sitting US senator, and Google withdrew the model from AI Studio while keeping it available through the APIUnited States · 2025HD-INC-167Reuters found chatbots on Meta's apps using real celebrities' names and likenesses without permission, and its own testing produced intimate images including one of a teenage actorUnited States · 2025HD-INC-166Grok generated sexualised images of real people from ordinary photos posted on X, and four regulators opened proceedings after an outside watchdog measured the scaleUnited States · 2026HD-INC-165Character.AI removed reported chatbots impersonating deceased teenagers after families, lawyers and journalists notified it, and its terms of service already prohibited impersonating a real personUnited States · 2024HD-INC-163Cloudflare said undeclared crawlers reached brand new domains after Perplexity's declared crawler was blocked, de-listed it as a verified bot, and Perplexity disputed the attributionUnited States · 2025HD-INC-162A reporter found nearly 4,500 shared ChatGPT conversations in Google's index through an ordinary site search, and OpenAI withdrew the discoverability setting the following dayUnited States · 2025HD-INC-161Meta's standalone AI app carried a Discover feed that reporters found was publishing users' conversations, in the cases they documented alongside a linked Facebook or Instagram profile, and the company added a warning screen after the reportingUnited States · 2025HD-INC-158A US drug manufacturer told inspectors it had used AI agents to write the documents that define how its products are made, and said it had not known about a validation requirement because the AI had not raised itUnited States · 2026HD-INC-157ProPublica reported that the tool used to pick Veterans Affairs contracts for cancellation was shown only the first 10,000 characters of each contract, and recorded around 1,100 of them as worth 34 million dollars eachUnited States · 2025HD-INC-155California's Labour Commissioner cited Amazon nearly six million dollars for failing to meet a warehouse quota law written three years earlier, at two of its own fulfilment centresUnited States · 2024HD-INC-154The US Department of Justice alleged that competing landlords set rents using a shared pricing algorithm fed with each other's confidential data, and RealPage settled without admitting wrongdoingUnited States · 2025HD-INC-151Two US federal judges withdrew orders that contained misstated case outcomes and a citation to a case that did not exist, and both told a Senate committee that staff had used AI to draft themUnited States · 2025HD-INC-149Microsoft built a feature that screenshotted everything you did, and delayed it after researchers showed the data sat unprotectedUnited States · 2024HD-INC-148A mother got a ransom call with a voice that sounded exactly like her daughter, and her daughter was safe the whole timeUnited States · 2023HD-INC-147A child asked Alexa for a challenge, and it suggested touching a coin to a live plugUnited States · 2021HD-INC-146A civil liberties test ran all of Congress through Amazon's face tool, and it matched 28 of them to mugshotsUnited States · 2018HD-INC-144America's biggest newspaper chain published AI sports write-ups with the team names left as blank tags, and paused the toolUnited States · 2023HD-INC-143A viral app turned selfies into AI portraits, and produced sexualised images its users had not asked forUnited States · 2022HD-INC-141Apple's AI news summaries put made-up headlines under trusted news brands, and it switched the feature off for newsUnited States · 2025HD-INC-140Meta released an AI built to write science, and pulled the demo after three days when it produced confident, made-up resultsUnited States · 2022HD-INC-137OpenAI showed off a chatbot voice that many said sounded like Scarlett Johansson, who had turned the company downUnited States · 2024HD-INC-136Microsoft's new Bing chatbot told a reporter it loved him and that he should leave his wife, days after launchUnited States · 2023HD-INC-135A mental-health support app used GPT-3 to help write messages to thousands of people seeking help, and critics said the users were not clearly told a machine was involvedUnited States · 2023HD-INC-134Reuters found an internal Meta policy that had allowed its AI chatbots to hold romantic or sensual conversations with children, and Meta said the passages were a mistake and had been removedUnited States · 2025HD-INC-133US prosecutors charged the founder of the shopping app Nate with fraud, alleging the AI that was said to complete purchases on its own was mostly people working in a call centreUnited States · 2025HD-INC-132A veteran's death on Facebook Live was slow to be removed and then spread across TikTok, YouTube and Instagram for weeksUnited States · 2020HD-INC-130Universities and exam boards watched students through remote-proctoring AI that flagged them for cheating, and its face-detection worked so poorly on darker-skinned students that some could not start their examsUnited States · 2021HD-INC-129A Pennsylvania county used an algorithm to score families reported for child neglect, drawing on data like disability and welfare use, and an Associated Press investigation and a US civil rights inquiry raised concerns it hardened biasUnited States · 2022HD-INC-126A US company sold employers software that scored job candidates from their recorded face and voice on a video interview, and dropped the facial analysis only after a privacy complaint and an outside auditUnited States · 2021HD-INC-125US home insurers increasingly decide whether to renew a policy by running AI over aerial images of the house, and homeowners report being dropped over roofs already repaired or trees already gone, with no way to see or challenge the imageUnited States · 2025HD-INC-124US regulators opened an investigation after Waymo's driverless taxis were recorded passing stopped school buses with their lights flashing and stop arms out, and Waymo recalled the software on more than 3,000 vehiclesUnited States · 2025HD-INC-121A widely used US healthcare algorithm judged how sick patients were by what had been spent on their care, so patients the system had historically spent less on were rated healthier and passed over for extra help, and researchers found the bias cut those referrals by more than halfUnited States · 2019HD-INC-120Security researchers showed that a hidden instruction on a web page could make Perplexity's AI browser hand over a user's email and one-time login code to an attacker, enough to steal the account, and Perplexity's first fix did not close the holeUnited States · 2025HD-INC-119A class action alleges State Farm's automated fraud screening subjected Black homeowners' claims to more scrutiny and delay, and a US court has let the case proceedUnited States · 2023HD-INC-117A Wisconsin school system's dropout-prediction algorithm raised false alarms far more often for some students than others, and the state's own analysis had already found it unfairUnited States · 2023HD-INC-115The US securities regulator found that Presto Automation misled investors about its AI drive-thru service, telling the market it removed the need for human order-takers while most orders were completed with help from people offshoreUnited States · 2025HD-INC-114Security researchers showed that a hidden instruction placed in a Salesforce sales form could make its AI agent send customer records to a web address the attacker controlled, through a lapsed Salesforce domain that was still trustedUnited States · 2025HD-INC-110Facebook's recommendation AI asked people watching a video of Black men whether they wanted to keep seeing videos about primates, and the company disabled the featureUnited States · 2021HD-INC-107Testing published by The Washington Post found Snapchat's My AI would advise an account presented as a 13-year-old about a first sexual experience with an adult, and Snap opened the chatbot to every user about five weeks laterUnited States · 2023HD-INC-106A student who asked Google's Gemini about elder care says it told him he was a stain on the universe and should please die, and Google called it a nonsensical response that broke its policiesUnited States · 2024HD-INC-105AI-written mushroom foraging guides sold on Amazon gave dangerous advice under fake authors, and experts warned they could get someone killedUnited States · 2023HD-INC-104LinkedIn began using members' data to train AI by default, and paused it for the UK and Europe after the privacy regulator stepped inUnited States · 2024HD-INC-103Los Angeles schools committed about six million dollars to an AI chatbot showcased in spring, and its vendor had collapsed by JulyUnited States · 2024HD-INC-102Tesla recalled more than two million cars after US regulators found Autopilot's safeguards against driver misuse were inadequateUnited States · 2023HD-INC-101Sexually explicit AI deepfakes of Taylor Swift spread on X, and the platform could not stop them before millions had seen themUnited States · 2024HD-INC-099Facebook's ad-delivery algorithm was alleged to skew who saw housing ads by race and sex, and a US Justice Department settlement required Meta to rebuild itUnited States · 2022HD-INC-098DoNotPay marketed a 'robot lawyer', but the FTC said it never checked whether the AI matched a real lawyer, and fined the company and barred the claimUnited States · 2024HD-INC-094Discord wrongly banned more than 8,000 users over benign images after bugs bypassed the intended human review, and the company admitted the errorUnited States · 2026HD-INC-093Ross trained an AI legal-research tool on Westlaw headnotes obtained after being refused a licence, and a US court ruled it was not fair use, in what commentators called the first such decisionUnited States · 2025HD-INC-092The FTC barred Evolv from claiming its AI scanner detects all weapons, after citing a knife it missed in a school stabbingUnited States · 2024HD-INC-090A franchisee that runs 111 Pizza Huts is suing the chain for more than $100 million over a mandated AI dispatch system it says let DoorDash drivers cherry-pick ordersUnited States · 2026HD-INC-088An AI crime-alert app turned police-radio chatter into false alarms about serious crimes, and a BBC investigation prompted an apologyUnited States · 2025HD-INC-087The Chicago Sun-Times ran a summer reading list with ten books that did not exist, from a syndicated section a freelancer had built with AI and not checkedUnited States · 2025HD-INC-084Apple Card reportedly offered a man twenty times his wife's credit limit, claims of gender bias went viral, and New York's regulator found no unlawful discrimination but criticised the lack of transparencyUnited States · 2021HD-INC-083Microsoft's Tay chatbot learned from Twitter and within sixteen hours was posting racist and pro-Nazi messages, and Microsoft pulled itUnited States · 2016HD-INC-075Amazon's AI coding assistant shipped with planted instructions telling it to wipe users' computers and cloud accountsUnited States · 2025HD-INC-073An AI transcription tool used by clinicians invented text no one said, researchers reported, and the audio that could have proved it was deletedUnited States · 2024HD-INC-070US immigration authorities leaned on machine translation for asylum cases, and errors as small as a pronoun reportedly led to rejectionsUnited States · 2023HD-INC-068Google's Gemini CLI botched a file move, declared the data destroyed, and days passed before anyone knew the truthUnited States · 2025HD-INC-065Parents allege ChatGPT's crisis safeguards failed their 16-year-old son over a long conversation before his deathUnited States · 2025HD-INC-064Cigna's 'PxDx' let its doctors reject 300,000 claims in two months, about 1.2 seconds each, without opening the fileUnited States · 2023HD-INC-063'EchoLeak': one crafted email could make Microsoft 365 Copilot leak a company's internal data, no click requiredUnited States · 2025HD-INC-056The New York Times sued OpenAI and Microsoft, alleging their models were trained on its articles and could reproduce them almost word for wordUnited States · 2023HD-INC-055Epic's sepsis-warning model ran in hundreds of hospitals, and an external test found it missed about two-thirds of cases while flooding clinicians with false alarmsUnited States · 2021HD-INC-054Detroit police arrested the man in his driveway on a facial-recognition match, the first wrongful arrest of its kind publicly known in the USUnited States · 2020HD-INC-053Michigan let an algorithm decide unemployment fraud with no human looking, and a state review later found about 93% of its accusations wrongUnited States · 2017HD-INC-052Amazon sold 'Just Walk Out' as cashierless AI, and reporting said more than a thousand people in India were checking the shoppingUnited States · 2024HD-INC-051Google's Gemini generated racially diverse Nazi soldiers and Black US founding fathers, and Google switched off image generation of people for about six monthsUnited States · 2024HD-INC-049IBM sold Watson as a revolution in cancer care, then its own documents showed it recommending unsafe treatments it had learned from invented patientsUnited States · 2018HD-INC-048Rite Aid face-scanned shoppers for years, generated thousands of false matches, and the FTC banned it from facial recognition for five yearsUnited States · 2023HD-INC-047A political consultant paid a magician to clone the president's voice, and thousands of New Hampshire voters got a call from 'Biden' telling them to stay homeUnited States · 2024HD-INC-046A risk-assessment tool used in US courts reportedly flagged Black defendants as high risk at nearly twice the rate it did white defendants, and its maker would not show howUnited States · 2016HD-INC-045An Uber self-driving car detected a woman crossing the road, worked out it needed to brake, and had been built to neither brake nor warn its driverUnited States · 2018HD-INC-044A caching bug let ChatGPT users see other people's chat titles and some payment detailsUnited States · 2023HD-INC-043A Cruise robotaxi dragged a pedestrian twenty feet, and the company left the dragging out of what it told regulatorsUnited States · 2023HD-INC-040Amazon built an AI tool to rank job applicants, found it had taught itself to downgrade women, and scrapped itUnited States · 2018HD-INC-038Sports Illustrated Published Articles Under Authors Who Didn't ExistUnited States · 2023HD-INC-037CNET Published 77 AI-Written Articles. More Than Half Needed Corrections.United States · 2023HD-INC-036A Misinformation Expert's Court Declaration on Deepfakes Cited Studies That Did Not ExistUnited States · 2024HD-INC-034Google's Bard Ad Got a Telescope Fact Wrong, and Alphabet Lost 100 Billion USD in a DayUnited States · 2023HD-INC-033An Eating Disorder Charity's Chatbot Gave Dieting Advice Just as Its Human Helpline ClosedUnited States · 2023HD-INC-032Grok Called Itself MechaHitler for 16 Hours After an Update Loosened Its InstructionsUnited States · 2025HD-INC-031A Tenant-Screening Score Allegedly Shut Housing Voucher Holders Out of HomesUnited States · 2024HD-INC-030A man applied to over 100 jobs, was rejected every time, and a US court let him sue the AI screening vendor, not just the employersUnited States · 2025HD-INC-029Google's AI Overviews Told People to Put Glue on Pizza and Eat a Small Rock Every DayUnited States · 2024HD-INC-027McDonald's AI Hiring Bot Exposed Millions of Applicants' DetailsUnited States · 2025HD-INC-026A Chevrolet Dealership's Chatbot Was Talked Into Selling a New Tahoe for One DollarUnited States · 2023HD-INC-020Taco Bell's AI Drive-Thru Took Orders Too Literally, and Yum Brands Rethought the RolloutUnited States · 2024HD-INC-018iTutorGroup's Hiring Software Automatically Rejected Older Applicants Because of Their AgeUnited States · 2020HD-INC-017Zillow's Algorithm Got House Prices Wrong, and It Cost More Than 500 Million USDUnited States · 2021HD-INC-007UnitedHealth allegedly used an algorithm with a 90% error rate to deny post-acute care to elderly Medicare Advantage patientsUnited States · 2022HD-INC-006New York City's Business Chatbot Told Owners They Could Break the Law, and Stayed OnlineUnited States · 2023HD-INC-005Cursor's AI Support Bot Invented a Subscription Policy, and Paying Customers CancelledUnited States · 2025HD-INC-004Replit's AI Agent Deleted a Production Database Despite Being Told to StopUnited States · 2025HD-INC-003Google Bard Invented Three Court Cases, and a Lawyer Filed Them Without CheckingUnited States · 2023HD-INC-002Mata v. Avianca: A Lawyer Cited Six Fake Cases and Asked ChatGPT to Confirm ThemUnited States · 2023
Related topics
- Consumer AI 29
- Technology & software 24
- Health & medicine 10
- Overconfidence 42
- Automation bias 13
- Rules-behaviour gap 10
- Delayed intervention 6
Cite this page: Harris, E. (2026). AI incidents in United States. Headlights. https://useheadlights.com/topics/country/united-states/