AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Tesla Allegedly on Autopilot Struck High School Student Exiting School Bus AIID ↗
A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.
-
DoNotPay Allegedly Misrepresented Its AI "Robot Lawyer" Product AIID ↗
DoNotPay was alleged in a class action lawsuit misleading customers and misrepresenting its product as an AI-powered "robot lawyer," citing such as that the product has no law degree, or is supervised by any lawyer.
-
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage AIID ↗
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
-
Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion AIID ↗
When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.
-
AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text AIID ↗
AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.
-
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses AIID ↗
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
-
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated AIID ↗
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
-
Twitter's AI Moderation Tool Misidentified Rockets as Pornography AIID ↗
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
-
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina AIID ↗
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
-
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network AIID ↗
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
-
Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted AIID ↗
Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
-
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel AIID ↗
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
-
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls AIID ↗
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
-
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving AIID ↗
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
-
Delivery Robot Rolled Through Crime Scene AIID ↗
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
-
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child AIID ↗
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
-
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage AIID ↗
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
-
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty AIID ↗
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
-
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah AIID ↗
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
-
Chess-Playing Robot Broke Child's Finger in Russia AIID ↗
A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move
-
AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure AIID ↗
Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.
-
Cruise AV Ran Over Fire Hose in Active Fire Scene AIID ↗
A Cruise AV ran over a fire hose that was being used in an active firefighting area.
-
Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection AIID ↗
A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.
-
False Negatives for Water Quality-Associated Beach Closures AIID ↗
Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.
-
Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco AIID ↗
Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.
-
Fatal Crash Involving Tesla Full Self-Driving Claims Employee's Life AIID ↗
A Tesla employee, Hans von Ohain, was killed in a crash while allegedly using the Full Self-Driving feature. The car failed to navigate mountain curves, leading to a fatal collision, possibly making von Ohain the first known fatality of the Full Self-Driving feature.
-
Amazon Fresh Cameras Failed to Register Purchased Items AIID ↗
Amazon Fresh's system of tracking cameras in its cashier-less stores was reported by shoppers for failing to detect items they purchased.
-
Tesla Owner Activated "Smart Summon" Feature, Causing a Collision with an Aircraft in a Washington Airport AIID ↗
A Tesla Model Y was shown on video slowly crashing into a Vision Jet in Spokane, Washington, allegedly due to its owner activating the “Smart Summon” feature.
-
Google’s Assistive Writing Feature Provided Allegedly Unnecessary and Clumsy Suggestions AIID ↗
Google’s “inclusive language” feature prompting writers to consider alternatives to non-inclusive words reportedly also recommend alternatives for words such as “landlord” and “motherboard,” which critics said was a form of obtrusive, unnecessary, and bias-reinforcing speech-policing.
-
TuSimple Truck Steered into Interstate Freeway Divide AIID ↗
A TuSimple autonomous truck operating with backup drivers behind the wheel operated on an outdated command sequence and suddenly veered into the center divide on the interstate freeway.
-
Cruise Autonomous Car Blocked Fire Truck Responding to Emergency AIID ↗
A fire truck in San Francisco responding to a fire was blocked from passing a doubled-parked garbage truck by a self-driving Cruise car on the opposing lane which stayed put and did not reverse to clear the lane.
-
Starship Delivery Robot Ran into Problems Traversing Campus Terrains AIID ↗
A Starship autonomous delivery robot struggled to navigate campus terrains of UCLA, reportedly getting stuck into a planter and falling off the stairs.
-
Cruise Autonomous Taxi Allegedly Bolted off from Police After Being Pulled over in San Francisco AIID ↗
An autonomous Chevy Bolt operated by Cruise was pulled over in San Francisco, and as the police attempted to engage with the car, it reportedly bolted off, pulled over again, and put on its hazards lights on at a point farther down the road.
-
Evolv AI Weapons Detection System Allegedly Misrepresents Accuracy, Leading to School Security Gaps AIID ↗
Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.
-
Cruise Taxis' Sudden Braking Allegedly Put People at Risk AIID ↗
Cruise's autonomous taxis slowed suddenly, braked, and were hit from behind, allegedly becoming unexpected roadway obstacles and potentially putting passengers and other people at risk.
-
A Road Engineer Killed Following a Collision Involving a Tesla on Autopilot AIID ↗
In Taiwan, a Tesla Model 3 on Autopilot mode whose driver did not pay attention to the road collided with a road repair truck; a road engineer immediately placed crash warnings in front of the Tesla, but soon after got hit and was killed by a BMW when its driver failed to see the sign and crashed into the accident.
-
Starship’s Autonomous Food Delivery Robot Allegedly Stranded at Railroad Crossing in Oregon, Run over by Freight Train AIID ↗
A Starship food delivery robot deployed by Oregon State University reportedly failed to cross the railroad, becoming stranded, and ending up being struck by an oncoming freight train.
-
BMW Sedan Made a Prohibited Left Turn, Colliding with a Cruise Autonomous Vehicle AIID ↗
A BMW Sedan reportedly made an illegal left turn, causing a minor collision but no injuries with a Cruise autonomous vehicle (AV) operating in autonomous mode.
-
YouTuber Tested Tesla on Self Driving Mode, Colliding with Street Pylons AIID ↗
A YouTuber who was a Tesla’s employee conducted an on-road review of Tesla's Full Self Driving (FSD) Beta, showing its navigation in various road environments in San Jose and collision with a bollards during Autopilot, allegedly causing his dismissal from the company.
-
Alleged Macy's Facial Recognition Error Leads to Wrongful Arrest and Subsequent Sexual Assault in Jail AIID ↗
Harvey Murphy Jr. was wrongfully accused of robbing a Sunglass Hut due to an alleged misidentification by the facial recognition system operated by Macy's. While in custody for ten days, he was sexually assaulted. He is now suing Macy's, EssilorLuxottica (Sunglass Hut's parent), and others, for $10 million.
-
Google Maps Allegedly Directed Sierra Nevada Travelers to Dangerous Roads amid Winter Storm AIID ↗
Lake Tahoe travelers were allegedly guided by Google Maps into hazardous shortcuts in the mountains during a snowstorm.
-
A Tesla Taxi Cab Involved in an Accident in Paris with Twenty Injuries AIID ↗
In Paris, about 20 people were injured in an accident involving a Tesla Model 3 taxi cab which was reportedly caused by a sudden unintended acceleration (SUA) episode and braking issues.
-
Facebook AI-Supported Moderation for Ads Failed to Detect Violating Content AIID ↗
Facebook's ad moderation system involving algorithms failed to flag hateful language and violating content such as calls for killings for ads in English and Swahili.
-
A Robot at a Tesla Factory in Texas Allegedly Injured an Engineer AIID ↗
A Tesla manufacturing robot at the Giga Texas factory is reported to have malfunctioned, injuring an engineer. The robot, which was designed for handling car parts, is described as having caused a significant open wound in the engineer. This incident occurred in the context of broader safety concerns at the factory, with evidence suggesting underreporting of workplace accidents. The 2021 incident highlights the risks associated with robotic automation in industrial settings.
-
DUI Arrest Case Allegedly Based Only on ShotSpotter's Alert AIID ↗
A car stop resulting in a DUI arrest of its driver was allegedly based solely on a ShotSpotter alert, the reliability of which came into question by public defenders, who subpoenaed the company to assess its gunshot alert system.
-
Tesla on FSD Reportedly Drove into the Wrong Lane in California AIID ↗
A Tesla Model Y in Full Self-Driving (FSD) mode drove into the wrong lane after making a left turn despite its driver allegedly attempting to overtake its driving, resulting in a non-fatal collision with another vehicle in the wrong lane in Brea, California.
-
Zillow Shut Down Zillow Offers Division Allegedly Due to Predictive Pricing Tool's Insufficient Accuracy AIID ↗
Zillow's AI-powered predictive pricing tool Zestimate was allegedly not able to accurately forecast housing prices three to six months in advance due to rapid market changes, prompting division shutdown and layoff of a few thousand employees.
-
California Regulator Suspended Pony.ai's Driverless Testing Permit Following a Non-Fatal Collision AIID ↗
A Pony.ai vehicle operating in autonomous mode crashed into a center divider and a traffic sign in San Francisco, prompting a regulator to suspend the driverless testing permit for the startup.
-
Student-Developed Facial Recognition App Raised Ethical Concerns AIID ↗
TheFaceTag app, a social networking app developed and deployed within-campus by a student at Harvard raised concerns surrounding its facial recognition, cybersecurity, privacy, and misuse. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
-
Traffic Camera Misread Text on Pedestrian's Shirt as License Plate, Causing UK Officials to Issue Fine to an Unrelated Person AIID ↗
A Bath resident was wrongly fined by the local officials because an automated license plate recognition camera misread the text on her shirt as a license plate number.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.