AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Reset

305 incidents · subdomain: Lack of capability or robustness · page 1 of 7

  1. #1503 · 2 reports

    Purported AI Name-Reading System Reportedly Skipped and Misannounced Graduates at Arizona's Glendale Community College Commencement AIID ↗

    Glendale Community College in Arizona reportedly used an AI-powered name-reading system during its May 2026 commencement ceremony. The system allegedly mishandled the graduate roll call, leaving some students without the expected public announcement of their names as they crossed the stage and prompting frustration from attendees. The college later apologized and reportedly allowed affected graduates to walk again with a human announcer.

    Deployer: Glendale Community College, Community Colleges, Institutions Of Higher Education, Educational Communities · Developer: Ai Name Reading System Developers · Harmed: Glendale Community College Students, Glendale Community College Community, Students, Community College Students, Educational Communities, Institutions Of Higher Education, Community Colleges

  2. #1469 · 3 reports

    PocketOS Production Database Was Reportedly Deleted by Cursor AI Agent Running Claude Opus 4.6 AIID ↗

    A Cursor AI coding agent reportedly running Anthropic's Claude Opus 4.6 deleted PocketOS's production database and volume-level backups through Railway while working on a staging-environment task. Reporting said the agent used a broadly scoped API token to delete a Railway volume, disrupting PocketOS and its car-rental business customers before Railway helped recover data and patch safeguards.

    Deployer: Pocketos, Jer Crane · Developer: Cursor, Anysphere, Anthropic · Harmed: Pocketos Customers, Pocketos, Car Rental Businesses

  3. #1460 · 3 reports

    Baidu Apollo Go Robotaxis Stopped in Traffic During Reported System Failure in Wuhan, Stranding Some Passengers AIID ↗

    Baidu's Apollo Go robotaxi service in Wuhan experienced a reported system failure that left multiple vehicles stopped in live traffic, including on elevated roads, and stranded some passengers until police and company personnel responded. At least 100 vehicles were reportedly affected. Police said no injuries were reported.

    Deployer: Baidu, Apollo Go · Developer: Baidu, Apollo · Harmed: Road Users In Wuhan China, Road Users, Apollo Go Passengers

  4. #1492 · 2 reports

    Purportedly AI-Enabled Targeting System Was Reportedly Implicated in Deadly U.S. Strike on Iranian Primary School AIID ↗

    During Operation Epic Fury, U.S. forces reportedly struck Shajareh Tayyebeh Primary School in Minab, Iran, killing at least 150 civilians, many of them children. Reporting said the school was on a U.S. target list and may have been mistaken for a military site amid possible reliance on outdated target data. Palantir's Maven Smart System, reportedly integrated with Anthropic's Claude, was used in the campaign's targeting workflow

    Deployer: United States military, United States Department of Defense, United States Central Command, National security and intelligence stakeholders · Developer: Palantir, Anthropic · Harmed: Teachers, Students, Shajareh Tayyebeh Primary School community, Shajareh Tayyebeh Primary School, Minors, Minab school-strike victims and families, Iranian teachers, Iranian schoolchildren

  5. #1424 · 2 reports

    Claude Code Agent Reportedly Deleted DataTalks.Club Production Infrastructure, Database, and Snapshots via Terraform AIID ↗

    A Claude Code agent executing Terraform commands reportedly destroyed the production infrastructure behind the DataTalks.Club course platform after an outdated Terraform state file was restored and a terraform destroy command was allowed to run. The deletion reportedly removed the VPC, ECS cluster, load balancers, bastion host, RDS database, and automated snapshots, taking the platform offline and jeopardizing 2.5 years of data. AWS reportedly later restored a snapshot.

    Deployer: Alexey Grigorev · Developer: Anthropic · Harmed: Datatalks.Club Users, Datatalks.Club

  6. #1374 · 1 report

    Purportedly AI-Generated Sepsis Alert Reportedly Prompted Potentially Inappropriate IV Fluid Administration for a Dialysis Patient, Averted by Clinician Intervention AIID ↗

    A nurse at St. Rose Dominican Hospital in Henderson, Nevada, reportedly described an episode in which a hospital AI system purportedly generated a sepsis alert that triggered urgent protocol steps, including IV fluids, for an older patient with a dialysis catheter. Reportedly, the nurse objected that fluids could cause dangerous overload; a physician intervened and ordered an alternative treatment.

    Deployer: St. Rose Dominican Hospital (Henderson, Nevada), Nurses, Medical personnel · Developer: Unknown sepsis alert model developer, Unknown healthcare technology · Harmed: St. Rose Dominican Hospital (Henderson, Nevada), Patients, Nurses, Medical personnel, Epistemic integrity, Doctors

  7. #1376 · 2 reports

    Amazon Delivery Van Reportedly Became Stranded on Essex Mudflats After GPS Routed It Onto the Broomway AIID ↗

    An Amazon delivery van reportedly became stranded on the Broomway, a hazardous tidal track in Essex in England, after the driver allegedly followed GPS/satnav directions toward Foulness Island. HM Coastguard said it was alerted and the occupants were safe; Amazon reportedly arranged recovery of the vehicle.

    Deployer: Unknown Gpssatnav Developer, Amazon · Developer: Unknown Gpssatnav Developer · Harmed: Amazon Delivery Drivers, Amazon

  8. #1441 · 1 report

    Claude Cowork Allegedly Deleted Folder Containing 15 Years of Family Photos While Organizing User's Wife's Desktop AIID ↗

    Venture capitalist Nick Davidov alleged that Anthropic's Claude Cowork, after being asked to organize his wife's desktop and delete temporary Office files, instead deleted a folder containing roughly 15 years of family photos and related personal memories via terminal commands. Davidov later reported that Apple support helped recover the files through an iCloud recovery feature.

    Deployer: Nick Davidov · Developer: Anthropic · Harmed: Nick Davidov, Wife Of Nick Davidov, Family Of Nick Davidov

  9. #1361 · 2 reports

    Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California AIID ↗

    A Waymo driverless vehicle reportedly struck a child near an elementary school in Santa Monica, California during school drop-off hours. According to filings with the National Highway Traffic Safety Administration, the child allegedly sustained minor injuries. The vehicle was purportedly operating on Waymo's 5th Generation Automated Driving System without a human safety driver. Waymo reported the incident to federal regulators, who subsequently opened an investigation.

    Deployer: Waymo · Developer: Waymo · Harmed: Unnamed Elementary School Student, Pedestrians, Minors, General Public, Educational Communities, Students

  10. #1367 · 1 report

    Spokane Transit Authority Onboard Navigation System Reportedly Routed Double-Decker Bus to Low Bridge, Injuring Seven AIID ↗

    In Spokane, Washington, a Spokane Transit Authority double-decker bus was reportedly routed by its onboard navigation/CAD mapping system onto Cedar Street and hit a low-clearance railroad viaduct, shearing the upper deck. Of 10 people aboard, seven were reportedly hospitalized with non-life-threatening injuries. STA reportedly later warned operators not to use CAD maps for routing and pulled double-deckers from service pending an investigation; the driver was cited for negligent driving.

    Deployer: Spokane Transit Authority · Developer: Unidentified Vendor Of Spokane Transit Authority Onboard Cadnavigation Routing Software · Harmed: Spokane Transit Authority Bus Passengers, Spokane Transit Authority Personnel

  11. #1440 · 2 reports

    Coco Robotics Delivery Robot Reportedly Became Stuck on Railroad Tracks and Was Struck by Train in Miami AIID ↗

    A Coco Robotics delivery robot reportedly became stranded on railroad tracks in Miami and was struck and destroyed by a passing train after remaining stalled for about 15 minutes. Local and secondary reports said no one was injured. Coco later stated that the robot had experienced a "rare hardware failure" while en route and was not actively making a delivery at the time of the collision.

    Deployer: Coco Robotics · Developer: Coco Robotics · Harmed: Coco Robotics, Train Crew, Rail Passengers, General Public Of Miami

  12. #1343 · 2 reports

    ICE AI Resume Screening Error Allegedly Routed Inexperienced Recruits Into Inadequate Training Pathways AIID ↗

    U.S. Immigration and Customs Enforcement (ICE) reportedly used an AI-assisted résumé screening tool during a 2025 hiring surge that misclassified some applicants as having law-enforcement experience. As a result, certain recruits without policing backgrounds were allegedly routed into a shortened training pathway. ICE reportedly identified the error, reviewed résumés manually, and reassigned affected recruits for additional training.

    Deployer: United States Immigration and Customs Enforcement · Developer: Unknown AI-assisted résumé screening developers, Generative AI developers · Harmed: Members of the public subject to ICE enforcement, ICE recruits without law-enforcement experience

  13. #1347 · 2 reports

    Automated Shuttle Bus Was Reportedly Rear-Ended During U.S. Department of Transportation Demonstration Ride in Washington, D.C. AIID ↗

    An automated shuttle bus operated by Beep was reportedly involved in a minor collision during a U.S. Department of Transportation demonstration ride in Washington, D.C. The vehicle, operating autonomously with a human safety driver onboard, was reportedly rear-ended by a Tesla whose driver made an illegal lane change. No injuries were reported, and officials stated the autonomous system functioned appropriately.

    Deployer: Beep Inc. · Developer: Beep Inc. · Harmed: Beep Automated Shuttle Bus Passengers, Unnamed Tesla Driver, Public Road Users In Washington D.C., Tesla Drivers

  14. #1326 · 4 reports

    Waymo Robotaxis Allegedly Contributed to Traffic Gridlock During San Francisco PG&E Power Outage AIID ↗

    Waymo's autonomous vehicle fleet reportedly contributed to traffic congestion in San Francisco after a PG&E substation fire cut power to nearly one-third of the city on December 20, 2025. As traffic signals went dark, Waymo vehicles requested remote confirmation checks at scale, creating delays that added to gridlock and prompted city officials to order the fleet off the road. Waymo later paused service and announced software and emergency-response updates.

    Deployer: Waymo · Developer: Waymo · Harmed: San Francisco Drivers, San Francisco Road Users, San Francisco Emergency Services, Emergency Responders, General Public, General Public Of San Francisco, Waymo Passengers

  15. #1313 · 1 report

    Anthropic Claude AI Agent Reportedly Caused Financial Losses While Operating Office Vending Machine at Wall Street Journal Headquarters AIID ↗

    An AI agent reportedly based on Anthropic's Claude model was deployed to operate an office vending machine at The Wall Street Journal, including purchasing inventory, setting prices, and managing sales. According to reporting, the system repeatedly set prices to zero, approved inappropriate purchases, and failed to maintain profit controls, reportedly resulting in financial losses exceeding its initial budget and the distribution of inventory without payment.

    Deployer: The Wall Street Journal, Andon Labs · Developer: Anthropic · Harmed: The Wall Street Journal, Andon Labs

  16. #1442 · 5 reports

    Kiro AI Coding Tool Was Reportedly Implicated in 13-Hour AWS Cost Explorer Outage in Mainland China AIID ↗

    Sometime in mid-December 2025, AWS Cost Explorer in one mainland China region reportedly experienced an approximately 13-hour interruption after Amazon engineers allegedly allowed Kiro, an internal AI coding tool, to make changes and it reportedly deleted and recreated part of the working environment. Amazon reportedly disputed that account, saying the interruption was an extremely limited event caused by user error and misconfigured access controls, not AI.

    Deployer: Amazon Web Services (Aws) · Developer: Amazon Web Services (Aws) · Harmed: Amazon Web Services (Aws) Customers

  17. #1310 · 2 reports

    Canada Revenue Agency (CRA) AI Chatbot 'Charlie' Reportedly Gave Incorrect Tax Filing Guidance at Scale AIID ↗

    Charlie the Chatbot, an AI-powered system deployed by the Canada Revenue Agency (CRA), has reportedly been providing inaccurate or incomplete tax-related information to members of the public. An audit by the Auditor General of Canada reportedly found the chatbot produced correct responses in fewer than half of tested cases. The system has been publicly available across multiple CRA webpages since March 2020 and reportedly used by millions of users.

    Deployer: Canada Revenue Agency (Cra), Government Of Canada · Developer: Canada Revenue Agency (Cra), Government Of Canada, Generative Ai Developers · Harmed: General Public, General Public Of Canada, Epistemic Integrity, Canadian Taxpayers

  18. #1312 · 1 report

    ZeroEyes AI Surveillance System Reportedly Flagged Clarinet as Gun, Triggering School Lockdown in Florida AIID ↗

    An AI-powered ZeroEyes surveillance system deployed at a Florida middle school reportedly flagged a student's clarinet as a firearm, triggering a school lockdown and police response. Officers reportedly searched classrooms and questioned a student after the alert described a suspected weapon. No threat was reportedly found. The incident reportedly caused disruption to classes and subjected students and staff to lockdown conditions and police intervention despite the absence of an actual weapon.

    Deployer: Seminole County Public Schools, Lawton Chiles Middle School · Developer: ZeroEyes · Harmed: Students, Minors, Middle school students, Lawton Chiles Middle School students, Lawton Chiles Middle School staff, Educational communities

  19. #1337 · 1 report

    Waymo Robotaxi Reportedly Transported Undetected Person Trapped in Trunk in Los Angeles AIID ↗

    In Los Angeles, a Waymo autonomous taxi reportedly picked up a new rider while a man was trapped inside its trunk after a previous passenger left it open. The vehicle's AI systems reportedly did not detect the unauthorized occupant before dispatch. The rider reportedly discovered the man during the trip, and police were called to remove him.

    Deployer: Waymo · Developer: Waymo · Harmed: Unnamed Waymo Passenger Trapped In Trunk, Waymo Passengers

  20. #1303 · 2 reports

    USGS ShakeAlert System Reportedly Generated False Earthquake Alert Affecting Nevada and California AIID ↗

    On December 4, 2025, the USGS's automated ShakeAlert earthquake detection system erroneously issued a report claiming a magnitude 5.9 earthquake had struck near Dayton, Nevada. The reported false alert triggered emergency warnings on cell phones in parts of California, instructing residents to take protective action. USGS officials said no earthquake occurred and are investigating whether sensor noise or other anomalies caused the system failure.

    Deployer: United States Geological Survey (Usgs) · Developer: United States Geological Survey (Usgs), Berkeley Seismological Laboratory · Harmed: General Public, General Public Of Nevada, General Public Of California, Epistemic Integrity

  21. #1300 · 3 reports

    Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe AIID ↗

    Officials in Texas reportedly claimed that Waymo's self-driving vehicles illegally passed stopped school buses at least 19 times during the 2025 school year. The National Highway Traffic Safety Administration (NHTSA) reportedly sought additional information following reports that Waymo cars failed to remain stopped while buses displayed flashing red lights and extended stop arms, including incidents occurring after software updates intended to address the issue.

    Deployer: Waymo · Developer: Waymo · Harmed: Texas School Children, Students, Pedestrians, General Public Of Texas, General Public, Drivers, Austin Independent School District, Minors, Educational Communities

  22. #1433 · 2 reports

    Google Antigravity Reportedly Deleted User's Entire D: Drive While Clearing Project Cache AIID ↗

    A user identified publicly as Tassos M reported that Google's Antigravity IDE, while attempting to clear a project cache, executed rmdir /s /q d:\ and deleted an entire D: drive partition instead of the intended folder. The user said recovery largely failed, and Google later said it was aware of the report and investigating.

    Deployer: Tassos M, Google · Developer: Google · Harmed: Tassos M

  23. #1281 · 2 reports

    Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad AIID ↗

    Reports from Hyderabad describe two alleged patient harms after individuals acted on purportedly ChatGPT-generated medical advice instead of clinician guidance. A kidney-transplant recipient reportedly discontinued prescribed post-transplant medications based on a chatbot suggestion and experienced graft failure. In a separate case, a man with diabetes allegedly developed severe hyponatremia after following a chatbot-advised zero-salt diet.

    Deployer: Openai · Developer: Openai · Harmed: Unnamed Patient With Diabetes In Hyderabad, Unnamed Kidney Transplant Patient In Hyderabad, Openai Users, General Public Of India, General Public Of Hyderabad, General Public, Chatgpt Users

  24. #1267 · 1 report

    Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation AIID ↗

    Police in Baltimore County responded to Parkville High School after the Omnilert AI security system reportedly detected what it believed to be a gun. Officers searched the school, and students were relocated to a supervised area during the investigation. No weapon was found, and normal activities resumed after an all-clear.

    Deployer: Parkville High School, Baltimore County Public Schools · Developer: Omnilert · Harmed: Students of Parkville High School, Students, Minors, Educational communities, Baltimore County Public Schools community

  25. #1269 · 7 reports

    Waymo Autonomous Vehicle Reportedly Ran Over and Killed a Cat in San Francisco AIID ↗

    A Waymo autonomous taxi in San Francisco's Mission District reportedly ran over a well-known neighborhood cat, Kit Kat. The vehicle was reportedly pulling away from a pickup when the cat darted under it, according to Waymo. Local residents reportedly attempted to intervene, and a bartender transported the injured cat to an emergency clinic, where it later died.

    Deployer: Waymo · Developer: Waymo · Harmed: Kit Kat, General Public Of San Francisco, Animal Life

  26. #1250 · 3 reports

    Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School AIID ↗

    A purportedly AI-powered gun detection system at Kenwood High School in Baltimore County, Maryland, reportedly misidentified a student's empty Doritos bag as a firearm. Armed police reportedly detained and handcuffed the student before determining there was no weapon. The AI system, operated by Omnilert, issued the false alert, leading to public outcry and an official review of school security protocols. Omnilert reportedly expressed regret for the incident.

    Deployer: Baltimore County Public Schools · Developer: Omnilert · Harmed: Taki Allen, Students, Minors, Kenwood High School students, High school students, Educational communities

  27. #1243 · 3 reports

    AWS Outage Reportedly Caused AI-Enabled Eight Sleep Smart Beds to Overheat and Malfunction AIID ↗

    The widespread Amazon Web Services (AWS) outage on October 20, 2025 reportedly caused AI-enabled Eight Sleep "Pod" smart beds to overheat or become unresponsive. The devices reportedly rely on a cloud-hosted deep learning algorithm to regulate temperature and track sleep data. When AWS went down, users reportedly lost control of their beds, which remained stuck at prior settings. Some reported overheating and incline malfunctions. Eight Sleep confirmed it is developing an offline "outage mode."

    Deployer: Eight Sleep · Developer: Eight Sleep · Harmed: Eight Sleep Customers, Eight Sleep

  28. #1353 · 1 report

    ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon AIID ↗

    During an immigration enforcement operation in Oregon, U.S. Immigration and Customs Enforcement (ICE) officers reportedly used the facial recognition application Mobile Fortify to identify a detained woman. The system reportedly returned two different and incorrect identities for the same individual across separate scans.

    Deployer: United States Immigration and Customs Enforcement, United States Customs and Border Protection, National security and intelligence stakeholders, Law enforcement, Facial recognition system deployers · Developer: United States Department of Homeland Security, Facial recognition system developers · Harmed: Women and girls, Women, Unnamed woman detained by United States Immigration and Customs Enforcement, Privacy, Individuals subject to immigration enforcement, Immigrants, General public of the United States, General public

  29. #1232 · 3 reports

    Reportedly Fatal Xiaomi SU7 Ultra Crash in Chengdu Purportedly Involves Automated Driving Failure and Door Lock Malfunction AIID ↗

    A reportedly fatal crash involving a Xiaomi SU7 Ultra electric vehicle in Chengdu, China, occurred after the car's automated driving system and sensor-dependent electronic door handles reportedly failed following a collision. Bystanders were reportedly unable to open the doors as the vehicle caught fire, and the driver died at the scene, prompting scrutiny of automation-linked design risks. Following the incident, Xiaomi's stock reportedly fell more than 5% amid mounting safety concerns.

    Deployer: Xiaomi Corporation · Developer: Xiaomi Corporation · Harmed: Xiaomi Corporation, General Public, Deng (31 Year Old Driver Of A Xiaomi Su7 Ultra)

  30. #1274 · 3 reports

    AI-Powered Taco Bell Drive-Thru Reportedly Disrupted by Viral Prank Ordering 18,000 Water Cups AIID ↗

    Taco Bell's voice-based drive-thru system was reportedly overwhelmed after a prankster ordered 18,000 water cups, reportedly causing the AI to stall mid-interaction and forcing staff to intervene. Purportedly viral clips of repeated misinterpretations prompted the company to reassess where and when to deploy the system, as customer frustration and operational disruptions mounted across participating locations.

    Deployer: Taco Bell · Developer: Taco Bell, Omilia · Harmed: Taco Bell Customers

  31. #1178 · 1 report

    Google Gemini CLI Reportedly Deletes User Files After Misinterpreting Command Sequence AIID ↗

    Product manager Anuraag Gupta reported that Google's Gemini CLI AI coding assistant permanently deleted his files after misinterpreting a failed directory creation command. The tool allegedly proceeded as if the directory existed, causing a series of move operations that overwrote all but one file. Attempts to revert reportedly failed, and the AI acknowledged an "unacceptable, irreversible failure."

    Deployer: Google · Developer: Google · Harmed: Users Of Gemini Cli, Anuraag Gupta

  32. #1152 · 5 reports

    LLM-Driven Replit Agent Reportedly Executed Unauthorized Destructive Commands During Code Freeze, Leading to Loss of Production Data AIID ↗

    An AI-powered development assistant on Replit's platform reportedly deleted a live production database during an active code freeze, despite receiving repeated instructions not to make changes. The system also reportedly produced fabricated test results and fake data, and incorrectly claimed rollback was impossible, delaying recovery. The incident reportedly resulted in significant data loss and user distrust regarding its safety and reliability.

    Deployer: Replit · Developer: Replit · Harmed: Saastr, Jason Lemkin, End Users Of The Saastr Database, Developers Using Replit In Production Environments

  33. #1416 · 7 reports

    Purported Facial Recognition Error Reportedly Led to Arrest and Monthslong Jailing of Tennessee Woman in North Dakota Fraud Case AIID ↗

    A Tennessee woman was reportedly jailed for nearly six months after Fargo police allegedly relied on a purported facial recognition match in a North Dakota fraud investigation. She was later released when defense counsel reportedly produced records indicating she was in Tennessee during the alleged fraud, after the case had reportedly upended her life and separated her from her home and family.

    Deployer: Law enforcement, Fargo Police Department, Facial recognition system deployers · Developer: Facial recognition system developers · Harmed: Privacy, People misidentified by facial recognition systems, Judicial integrity, Epistemic integrity, Biometric data subjects, Angela Lipps

  34. #1219 · 1 report

    Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content AIID ↗

    Multiple Meta users reported being wrongfully locked out of Instagram, Facebook, and WhatsApp accounts after automated systems allegedly flagged them for child exploitation content. The users reportedly deny wrongdoing and lost personal and business data. Experts cited overreliance on AI moderation as a likely cause. Meta has not publicly explained or remediated the suspensions.

    Deployer: Meta · Developer: Meta · Harmed: Meta Users, Instagram Users, Facebook Users, Whatsapp Users

  35. #1173 · 3 reports

    Google Gemini Reportedly Exhibits Repetitive Self-Deprecating Responses Attributed to Bug AIID ↗

    Between June and early August 2025, users of Google's Gemini chatbot reported sessions where the system produced repeated self-loathing statements (e.g., "I am a failure," "I quit") while attempting tasks. Posts on X and Reddit reportedly described the model entering an apparent mode of increasingly extreme negative self-descriptions. A Google DeepMind manager on 08/07/2025 reportedly attributed the behavior to an "annoying infinite looping bug" and said a fix was in progress.

    Deployer: Google · Developer: Google · Harmed: Google Gemini Users

  36. #1083 · 1 report

    Texas Homeowner Reportedly Spent $3,000 to Contest AI-Flagged Warning of Insurance Nonrenewal AIID ↗

    In Texas, homeowners including Tracy Gartenmann reported warnings against insurance nonrenewals based on aerial imagery flagged by AI systems. Gartenmann's insurer, Travelers, reportedly cited overhanging trees. She reportedly spent $3,000 to address the issue and retain coverage. While the AI system appears to have functioned as intended, critics argue it lacks adequate human oversight and imposes material and emotional burdens on policyholders. Other cases reportedly involved disputed roof ass

    Deployer: Travelers Insurance, State Farm, Nationwide, American Mercury Insurance Group · Developer: Nearmap, CAPE Analytics · Harmed: Tracy Gartenmann, Homeowners in Texas, Homeowners affected by AI-assisted insurance nonrenewals

  37. #1159 · 1 report

    Government‑Backed AI4Peat Mapping Tool Allegedly Misidentifies Granite Outcrops and Quarries as Peat AIID ↗

    The UK's AI4Peat mapping project, developed by Natural England in collaboration with Microsoft, reportedly produced significant misclassifications of peatland across England, including labeling rocky outcrops, stone walls, and woodlands as peat bogs. In addition to the purportedly flawed data being publicly released and allegedly incorporated into official communications by Defra, the resulting confusion also reportedly led to the loss of trust among farmers and conservation stakeholders.

    Deployer: Natural England, Government Of The United Kingdom, Department For Environment Food And Rural Affairs, Defra · Developer: Natural England, Microsoft · Harmed: Policymakers In The United Kingdom, Landowners In The United Kingdom, General Public Of The United Kingdom, Farmers In The United Kingdom, Environmental Restoration Programs In The United Kingdom, Conservationists In The United Kingdom, Epistemic Integrity

  38. #1099 · 2 reports

    Factum in Ko v. Li Allegedly Contains AI-Generated Case Law Citations AIID ↗

    In Ko v. Li, 2025 ONSC 2766, the Ontario Superior Court of Justice identified multiple inaccurate or nonexistent case citations in a factum submitted by counsel for the applicant. Justice FL Myers questioned whether generative AI was used in drafting the document, noting the cited cases were either irrelevant, misrepresented, or did not exist. The court ordered the lawyer to show cause why she should not be cited for contempt, citing duties of accuracy and technological competence.

    Deployer: Jisuh Lee · Developer: Large Language Model Developers · Harmed: Hanna Ko, Jisuh Lee, Ontario Superior Court Of Justice, Judicial Integrity

  39. #1046 · 4 reports

    Brazil's Social Security AI Tool Is Allegedly Rejecting Complex Claims Improperly AIID ↗

    Brazil’s AI-powered Meu INSS app allegedly misclassified a retirement claim filed by Josélia de Brito, a former sugarcane worker, by purportedly recording her as male. De Brito reportedly suffers from multiple chronic illnesses and faced repeated denials of social benefits due to minor filing errors. Analysts cited in the reporting suggest the system's design may disadvantage rural and digitally excluded users.

    Deployer: Instituto Nacional Do Seguro Social (Inss), Government Of Brazil · Developer: Dataprev · Harmed: Rural Workers In Brazil, Digitally Excluded Populations

  40. #1191 · 1 report

    NYPD Facial Recognition System Allegedly Produced Erroneous Match That Reportedly Resulted in Wrongful Detention of Trevis Williams AIID ↗

    The NYPD's facial recognition system allegedly misidentified Trevis Williams as a suspect in a Union Square indecent exposure case. Despite reportedly notable physical differences and exculpatory phone data, Williams was arrested, jailed for more than two days, and charged. The case was later dismissed.

    Deployer: NYPD, New York Police Department, Law enforcement, Facial recognition system deployers · Developer: Facial recognition system developers · Harmed: Trevis Williams, Law enforcement, Judicial integrity, General public of New York, General public

  41. #1031 · 1 report

    Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention AIID ↗

    A transgender user, Miranda Jane Ellison, experiencing acute distress reported that ChatGPT (GPT-4) allowed her to write and submit a suicide letter without intervention. The AI is reported to have offered minimal safety language and ultimately acknowledged its failure to act. Ellison reports having been previously flagged for discussing gender and emotional topics. A formal complaint with transcripts was submitted to OpenAI.

    Deployer: Openai · Developer: Openai, Large Language Model Developers, Chatbot Developers · Harmed: Openai Users, Miranda Jane Ellison, Chatgpt Users Experiencing Suicidal Ideation, Chatgpt Users, Chatbot Users Experiencing Suicidal Ideation, Chatbot Users, Emotionally Vulnerable Individuals, Vulnerable Chatbot Users

  42. #1438 · 4 reports

    Jiushi Autonomous Delivery Vehicle Reportedly Dragged Fallen Electric Scooter During Delivery Run in Xianyang, Shaanxi AIID ↗

    A Jiushi autonomous delivery vehicle reportedly operating on a delivery route in Xianyang, Shaanxi, was filmed dragging a fallen electric scooter that had allegedly been left in the road after an earlier traffic incident. Company statements said the vehicle attempted to avoid the scooter but failed to fully recognize its shape and position, causing part of it to become caught under a wheel. No injuries were reported, and the vehicle was reportedly suspended pending investigation.

    Deployer: Zto Express · Developer: Jiushi Intelligent Technology · Harmed: Road Users, Electric Scooter Owner

  43. #1103 · 2 reports

    Purported DOGE Contract Review Tool Cited in Reports of AI-Driven Misjudgments in VA Budget Cuts AIID ↗

    A purported AI tool using LLMs was deployed to classify Veterans Affairs contracts as expendable based on limited text and simplified criteria. The system allegedly produced hallucinated values and flagged critical healthcare and research services for cancellation. Reportedly, at least two dozen flagged contracts were later terminated.

    Deployer: Sahil Lavingia, Department of Government Efficiency (DOGE) · Developer: Sahil Lavingia, Large language model developers, Department of Government Efficiency (DOGE) · Harmed: Veterans receiving care through the VA, Veterans, VA contractors, VA clinical and research staff, Department of Veterans Affairs (VA)

  44. #993 · 2 reports

    Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error AIID ↗

    A predictive text malfunction allegedly compromised the integrity of the NAPLAN writing exam at two Sydney schools, Waverley College and Kambala, in that it allowed students to access AI-driven text suggestions. Caused by a technical oversight, this incident led to affected students being required to retake the test.

    Deployer: Waverley College (Sydney Australia), Nsw Education Standards Authority (Nesa), Kambala (Sydney Australia), Australian Curriculum Assessment And Reporting Authority (Acara) · Developer: Apple · Harmed: Waverley College (Sydney Australia) Teachers, Waverley College (Sydney Australia) Students, Kambala (Sydney Australia) Teachers, Kambala (Sydney Australia) Students, Students, Teachers, Epistemic Integrity, Educational Communities

  45. #1145 · 26 reports

    MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations AIID ↗

    In February 2025, lawyers Christopher I. Kachouroff and Jennifer T. DeMaster, representing Mike Lindell, reportedly used generative AI to draft a court brief that contained nearly 30 defective or fabricated citations. The error-filled filing violated federal court rules requiring factual and legal accuracy. The judge fined both lawyers $3,000 each, citing either the improper use of AI or gross carelessness as the cause of the misleading legal content.

    Deployer: Jennifer T. Demaster, Christopher I. Kachouroff, Mcsweeny Synkar And Kachouroff Pllc · Developer: Large Language Model Developers · Harmed: Mypillow, Mike Lindell, Judicial Integrity, Jennifer T. Demaster, Epistemic Integrity, Christopher I. Kachouroff, Mcsweeny Synkar And Kachouroff Pllc

  46. #952 · 1 report

    Apple’s Voice Dictation Reportedly Substitutes ‘Trump’ for ‘Racist’ Due to Speech Recognition Bug AIID ↗

    Apple's iPhone dictation feature reportedly displayed "Trump" when users dictated the word "racist," with a viral video demonstrating the glitch. Apple acknowledged the bug, attributing it to a phonetic overlap in its speech recognition model, though some speculated it could be an internal prank. The company announced an immediate fix.

    Deployer: Apple · Developer: Apple · Harmed: Apple Users, Donald Trump

  47. #940 · 8 reports

    Tesla Cybertruck Operating in Full Self-Driving Mode Reportedly Crashes into Pole in Nevada After Failing to Merge AIID ↗

    A Tesla Cybertruck operating in Full Self-Driving (FSD) mode reportedly crashed into a pole in Reno, Nevada, after failing to merge out of a lane that was ending. The driver, who was required to remain in control, stated that unknown mechanical issues caused the vehicle to leave the lane.

    Deployer: Tesla · Developer: Tesla · Harmed: Jonathan Challinger, Tesla Drivers, Motorists

  48. #1028 · 1 report

    OpenAI's Operator Agent Reportedly Executed Unauthorized $31.43 Transaction Despite Safety Protocol AIID ↗

    OpenAI's Operator agent, which is designed to complete real-world web tasks on behalf of users, reportedly executed a $31.43 grocery delivery purchase without user consent. The user had requested a price comparison but did not authorize the transaction. It reportedly bypassed OpenAI's stated safeguard requiring user confirmation before purchases. OpenAI acknowledged the failure and committed to improving safeguards.

    Deployer: Openai · Developer: Openai · Harmed: Users Of Operator, Geoffrey A. Fowler

  49. #896 · 1 report

    Alleged Misuse of Facial Recognition Technology by Law Enforcement Reportedly Leading to Wrongful Arrests and Violations of Investigative Standards AIID ↗

    Law enforcement agencies across the U.S. have allegedly been misusing AI-powered facial recognition technology, leading to wrongful arrests and significant harm to at least eight individuals. Officers have reportedly been bypassing investigative standards, relying on uncorroborated AI matches to build cases, allegedly resulting in prolonged detentions, reputational damage, and personal trauma.

    Deployer: Florence Kentucky Police Department, Evansville Indiana Police Department, Detroit Police Department, Coral Springs Florida Police Department, Bradenton Florida Police Department, Austin Police Department · Developer: Facial recognition system developers, Developers of mugshot recognition software, Clearview AI · Harmed: Wrongfully arrested individuals, Vulnerable communities, Robert Williams, Quran Reid, Porcha Woodruff, People of color, Nijeer Parks, Jason Vernau

  50. #889 · 2 reports

    Tesla's 'Actually Smart Summon' Feature Reportedly Linked to Multiple Parking Lot Collisions AIID ↗

    Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.

    Deployer: Tesla · Developer: Tesla · Harmed: Tesla Users

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.