Artificial Intelligence Policy Tracker

AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Filter incidents (1 active)

Two-letter code, e.g. US

Reset

305 incidents · subdomain: Lack of capability or robustness · page 5 of 13

  1. #550 · 2 reports

    Tesla Allegedly on Autopilot Struck High School Student Exiting School Bus AIID ↗

    A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.

    Deployer: Tesla · Developer: Tesla · Harmed: Tillman Mitchell, The Mitchells Family

  2. #497 · 2 reports

    DoNotPay Allegedly Misrepresented Its AI "Robot Lawyer" Product AIID ↗

    DoNotPay was alleged in a class action lawsuit misleading customers and misrepresenting its product as an AI-powered "robot lawyer," citing such as that the product has no law degree, or is supervised by any lawyer.

    Deployer: Donotpay · Developer: Donotpay · Harmed: Jonathan Faridian, Donotpay Customers

  3. #608 · 21 reports

    UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage AIID ↗

    UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.

    Deployer: UnitedHealthcare · Developer: NaviHealth · Harmed: Patients, Medicare Advantage Plan Patients, Healthcare Providers (Doctors and Therapists), Elderly patients

  4. #511 · 4 reports

    Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion AIID ↗

    When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.

    Deployer: Microsoft · Developer: Openai, Microsoft · Harmed: Bing Users

  5. #466 · 7 reports

    AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text AIID ↗

    AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.

    Deployer: Originality.Ai, Openai, Edward Tian · Developer: Openai, Edward Tian · Harmed: Teachers, Students, Educators, Educational Communities

  6. #459 · 4 reports

    Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses AIID ↗

    Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.

    Deployer: Cruise · Developer: Cruise · Harmed: San Francisco Residents, San Francisco Firefighters, San Francisco Fire Department

  7. #514 · 1 report

    Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated AIID ↗

    Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.

    Deployer: Turnitin · Developer: Turnitin · Harmed: Students, Lucy Goetz, High school students, Educational communities

  8. #453 · 1 report

    Twitter's AI Moderation Tool Misidentified Rockets as Pornography AIID ↗

    Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.

    Deployer: Twitter · Developer: Twitter · Harmed: X (Twitter) Users

  9. #446 · 5 reports

    ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina AIID ↗

    ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.

    Deployer: Law enforcement, Durham Police Department · Developer: ShotSpotter · Harmed: mass shooting victims, Law enforcement, Durham residents, Durham Police Department

  10. #432 · 1 report

    Southwest Airlines Crew Scheduling Solver Degenerates Flight Network AIID ↗

    Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.

    Deployer: Southwest Airlines · Developer: General Electric · Harmed: Airline Passengers

  11. #419 · 3 reports

    Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted AIID ↗

    Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.

    Deployer: Facebook · Developer: Facebook · Harmed: Facebook Users

  12. #434 · 8 reports

    Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel AIID ↗

    A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.

    Deployer: Tesla · Developer: Tesla · Harmed: Traffic Participants, Tesla Drivers

  13. #463 · 3 reports

    Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls AIID ↗

    Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.

    Deployer: Apple · Developer: Apple · Harmed: Apple Watch Users Doing Winter Activities, Ski Patrols, Emergency Dispatchers

  14. #426 · 1 report

    XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving AIID ↗

    An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.

    Deployer: Xpeng · Developer: Xpeng · Harmed: Xpeng Driver

  15. #350 · 2 reports

    Delivery Robot Rolled Through Crime Scene AIID ↗

    A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.

    Deployer: Serve Robotics · Developer: Serve Robotics · Harmed: Police Investigators

  16. #303 · 2 reports

    Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child AIID ↗

    Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.

    Deployer: Google · Developer: Google · Harmed: A Software Engineer Named Mark, Parents Using Telemedicine Services

  17. #398 · 3 reports

    Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage AIID ↗

    Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.

    Deployer: Tesla · Developer: Tesla · Harmed: Tesla Drivers, Horse Drawn Carriages

  18. #1222 · 1 report

    CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty AIID ↗

    Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.

    Deployer: Hello Digit, Oportun Financial Corporation · Developer: Hello Digit, Oportun Financial Corporation · Harmed: Hello Digit Customers, Bank Account Holders Enrolled In Auto Saves, Consumers Charged Overdraft Fees Due To Auto Saves, Consumers Denied Overdraft Reimbursement, Consumers Whose Accrued Interest Was Retained

  19. #271 · 3 reports

    Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah AIID ↗

    A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.

    Deployer: Tesla · Developer: Tesla · Harmed: Landon Embry, Motorcyclists, Tesla Drivers

  20. #241 · 5 reports

    Chess-Playing Robot Broke Child's Finger in Russia AIID ↗

    A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move

    Deployer: Russian Chess Federation · Developer: Unknown · Harmed: Child Named Christopher

  21. #1436 · 2 reports

    AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure AIID ↗

    Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.

    Deployer: Marc Dean, Surgical Teams Using Trudi Navigation System · Developer: Acclarent, Ai Enabled Surgical Navigation System Developers, Ai Enabled Healthcare System Developers, Johnson And Johnson, Integra Lifesciences · Harmed: Erin Ralph, Surgical Patients, Patients, Patients Undergoing Ai Assisted Procedures, Sinus Surgery Patients

  22. #460 · 2 reports

    Cruise AV Ran Over Fire Hose in Active Fire Scene AIID ↗

    A Cruise AV ran over a fire hose that was being used in an active firefighting area.

    Deployer: Cruise · Developer: Cruise · Harmed: San Francisco Firefighters, San Francisco Fire Department

  23. #293 · 7 reports

    Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection AIID ↗

    A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.

    Deployer: Cruise · Developer: Cruise · Harmed: Cruise Passengers, Toyota Prius Passengers

  24. #290 · 3 reports

    False Negatives for Water Quality-Associated Beach Closures AIID ↗

    Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.

    Deployer: Toronto City Government · Developer: Toronto Public Health · Harmed: Sunnyside Beachgoers, Marie Curtis Beachgoers, Toronto Citizens

  25. #253 · 4 reports

    Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco AIID ↗

    Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.

    Deployer: Cruise · Developer: Cruise · Harmed: San Francisco Traffic Participants, San Francisco Public

Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.

Frequently asked questions

What is recorded in each incident?

What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.

Does an incident mean wrongdoing was proven?

No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.

How current is the incident data?

It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.

Does this page include the full incident reports?

No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.