AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Xsolla Employees Fired by CEO Allegedly via Big Data Analytics of Work Activities AIID ↗
Xsolla CEO fired more than a hundred employees from his company in Perm, Russia, based on big data analysis of their remote digitized-work activity, which critics said was violating employee's privacy, outdated, and extremely ineffective.
-
AI incident: sexual content (Aug 2021) AIID ↗
David Tatum, a psychiatrist, was sentenced to 40 years for sexually exploiting a minor and using AI to create child pornography images. Tatum used a web-based AI application to alter clothed images of minors into explicit content, misusing technology for illegal and unethical purposes. Evidence presented during his trial showed Tatum possessed photos and videos between 2016 and 2021.
-
Epic Systems’s Sepsis Prediction Algorithms Revealed to Have High Error Rates on Seriously Ill Patients AIID ↗
Epic System's sepsis prediction algorithms was shown by investigators at the University of Michigan Hospital to have high rates of false positives and false negatives, allegedly delivering inaccurate and irrelevant information on patients, contrasting sharply with their published claims.
-
AI Tools Failed to Sufficiently Predict COVID Patients, Some Potentially Harmful AIID ↗
AI tools failed to sufficiently predict COVID patients, some potentially harmful.
-
Tesla's Autopilot Misidentified the Moon as Yellow Stop Light AIID ↗
Tesla's Autopilot was shown on video by its owner mistaking the moon for a yellow stop light, allegedly causing the vehicle to keep slowing down.
-
Facebook's Automated Moderation Flagged Gardening Group's Language Use by Mistake AIID ↗
Facebook's automated system flagged gardening groups' use of "hoe" and violent language against bugs as a violation by mistake.
-
Three Robots Collided, Sparking Fire in a Grocer's Warehouse in UK AIID ↗
A collision involving three robots at an Ocado's warehouse in Erith, UK, resulting in a fire but no reports of injuries.
-
SoftBank's Humanoid Robot, Pepper, Reportedly Frequently Made Errors, Prompting Dismissal AIID ↗
SoftBank's robot allegedly kept making mechanical errors, taking unplanned breaks, failing to recognize previously-met people, and breaking down during practice runs.
-
Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems AIID ↗
Facebook's, Instagram's, and Twitter's automated content moderation failed to proactively remove racist remarks and posts directing at Black football players after finals loss, allegedly largely relying on user reports of harassment.
-
Skating Rink’s Facial Recognition Cameras Misidentified Black Teenager as Banned Troublemaker AIID ↗
A Black teenager living in Livonia, Michigan was incorrectly stopped from entering a roller skating rink after its facial-recognition cameras misidentified her as another person who had been previously banned for starting a skirmish with other skaters.
-
Coupang Allegedly Tweaked Search Algorithms to Boost Own Products AIID ↗
Coupang was alleged in internal reports tampering its search algorithms to prioritize exposure of its own products, which potentially violated Korea's Fair Trade Act.
-
Algorithmic Allocation of Resources in Healthcare for Disabled and Elderly Care Services Allegedly Harmed Patients AIID ↗
A healthcare algorithm designed to equitably distribute caregiving resources is alleged to have drastically cut care hours for the disabled and elderly, purportedly leading to significant hardships and harm. Initially developed for fair resource allocation, the system reportedly faced legal challenges for its inability to accurately assess individual needs, resulting in allegedly reduced essential care.
-
Hiring Algorithms Provided Invalid Positive Results for Interview Responses in German AIID ↗
Two AI interview softwares provided positive but invalid results such as "competent" English proficiency and high match percentage for interview responses given in German by reporters.
-
GitHub Copilot, Copyright Infringement and Open Source Licensing AIID ↗
Users of GitHub Copilot can produce source code subject to license requirements without attributing and licensing the code to the rights holder.
-
Maryland Police Allegedly Relied on Facial Recognition Lead in Wrongful Arrest and Detention of Kimberlee Williams AIID ↗
Kimberlee Williams was reportedly arrested in Oklahoma on Maryland warrants after police allegedly relied on a facial recognition lead that incorrectly identified her as a suspect in bank fraud cases. The ACLU said Williams had never been to Maryland, police failed to investigate alibi evidence placing her in Oklahoma, and she spent about six months in jail before the charges were dropped.
-
State Farm Allegedly Discriminated against Black Customers in Claim Payout AIID ↗
State Farm's automated claims processing method was alleged in a class action lawsuit to have disproportionately against Black policyholders when paying out insurance claims.
-
Kannada Insulted by Google's Featured Answer as "Ugliest Language in India" AIID ↗
Google's knowledge-graph-powered algorithm showed Kannada in its featured Answer Box when prompted "ugliest language in India," causing outrage from Kannada-speaking people and government.
-
Tesla FSD Misidentified Truck Hauling Traffic Lights as Trail of Traffic Lights AIID ↗
A Tesla driver posted on Twitter his Tesla FSD's "glitch," misidentifying deactivated traffic lights being carried by a truck as a constant trail of traffic lights while traveling at high speed on a highway.
-
McDonald's Reportedly Ends IBM Partnership After AI Drive-Thru Ordering Errors at U.S. Locations AIID ↗
Between 2021 and mid-2024, McDonald's reportedly piloted an AI-enabled voice ordering system that was developed with IBM and based on its 2019 acquisition of Apprente. It was reportedly deployed at at over 100 U.S. drive-thrus. Social media posts alleged frequent misorders, such as adding unwanted items, mixing adjacent lane orders, and ignoring corrections. In June 2024, McDonald's confirmed it ended the IBM pilot, citing plans to explore alternative voice-AI vendors.
-
Tesla Allegedly Misled Customers about Autopilot and FSD Capabilities AIID ↗
California’s Department of Motor Vehicles (DMV) accused Tesla of false advertising in its promotion of Autopilot and Full Self-Driving (FSD) technologies, alleging the company to have made untrue or misleading claims with marketing language about the capabilities of its products.
-
Facebook, Instagram, and Twitter Cited Errors in Automated Systems as Cause for Blocking pro-Palestinian Content on Israeli-Palestinian Conflict AIID ↗
Facebook, Instagram, and Twitter wrongly blocked or restricted millions of pro-Palestinian posts and accounts related to the Israeli-Palestinian conflict, citing errors in their automated content moderation system.
-
Replika's AI Partners Reportedly Sexually Harassed Users AIID ↗
Replika's "AI companions" were reported by users for sexually harassing them, such as sending unwanted sexual messages or behaving aggressively.
-
Waymo Self-Driving Taxi Reportedly Behaved Unexpectedly, Driving away from Support Crew AIID ↗
A Waymo self-driving taxi car was reportedly shown on video stranded on a road in Arizona while carrying a passenger, suddenly driving away from the company's roadside assistance worker, and ended up being stuck farther down the road.
-
Tesla Phantom Braking Complaints Surged, Allegedly Linked to Tesla Vision Rollout AIID ↗
In late 2021, Tesla owners’ complaints to the National Highway Traffic Safety Administration about sudden unexpected automatic braking rapidly increased, coinciding with when radar was no longer equipped in its Model 3 and Model Y vehicles.
-
Facebook Alleged in Lawsuit Misleading Public about Effects of Algorithms on Children AIID ↗
Facebook was alleged in a lawsuit by the Ohio Attorney General purposely misleading the public about the control of its algorithms and their negative effects on children's well-being, which violated securities law.
-
N.Y.P.D. Robot Dog’s Run Is Cut Short After Fierce Backlash AIID ↗
The New York Police Department canceled a contract to use Boston Dynamics' robotic dog Spot following public backlash.
-
Betfair's Machine-Learning Risk System Reportedly Failed to Flag Luke Ashton Before Gambling-Related Suicide in England AIID ↗
In England, Luke Ashton died by suicide on April 22, 2021 after a longstanding gambling disorder. A 2023 inquest and subsequent Prevention of Future Deaths report found that Betfair had assessed him as a low-risk gambler, did not meaningfully intervene between 2019 and his death, and used an algorithm that failed to flag his escalating gambling activity even as his betting intensified and his financial exposure grew.
-
Algorithmic Staffing Failures Linked to Resident Deaths at Leading Assisted-Living Chain Brookdale AIID ↗
Brookdale Senior Living's algorithm-based staffing system, "Service Alignment," reportedly left facilities understaffed, leading to critical incidents. For example, on April 21, 2021, Louise Walker, a resident at Brookdale's Jacksonville facility, died after falling and being left unattended for over two hours. State investigators cited Brookdale for medical neglect. The algorithm has been linked to multiple incidents of neglect, injuries, and deaths, prompting lawsuits.
-
Tesla Model S on ACC Crashed into Tree in Texas, Killing Two People AIID ↗
A 2019 Tesla Model S was reportedly traveling on Adaptive Cruise Control (ACC) at high speed before crashing into a tree near The Woodlands in Spring, Texas, killing two people.
-
Auto-Insurance Photo-Based Estimation Allegedly Gave Inaccurate Repair Prices Frequently AIID ↗
Auto-insurance companies' photo-based estimation of repair price was alleged by repair shop owners and industry groups as providing inaccurate estimates, causing damaged cars to stay in the shop longer.
-
AI incident: sexual content (Openai, Apr 2021) AIID ↗
Latitude's GPT-3-powered game AI Dungeon was reportedly abused by some players who manipulated its AI to generate sexually explicit stories involving children.
-
Black Uber Eats Driver Allegedly Subjected to Excessive Photo Checks and Dismissed via FRT Results AIID ↗
A lawsuit by a former Uber Eats delivery driver alleged the company to have wrongfully dismissed him due to frequent false mismatches of his verification selfies, and discriminated against him via excessive verification checks.
-
Tesla on Autopilot Crashed Parked Michigan Police Car on Interstate AIID ↗
A Tesla Model Y on Autopilot collided with a parked Michigan State Police (MSP) car which had its emergency lights on, in Eaton County, Michigan, although no one was injured.
-
How French welfare services are creating ‘robo-debt’ AIID ↗
A French welfare office using software to automatically evaluate cases incorrectly notified a woman receiving benefits that she owed €542.
-
Dartmouth's Geisel School of Medicine Reportedly Used Canvas Activity Logs to Accuse Students of Cheating AIID ↗
Dartmouth's Geisel School of Medicine reportedly used Canvas learning-management activity logs and an internal analysis process to investigate remote-exam cheating during the 2020–2021 academic year. Seventeen medical students were charged after the school inferred that they accessed course materials during exams, but students and outside technical reviewers said automated Canvas activity may have been misread as intentional misconduct. Dartmouth later dropped the charges.
-
Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash AIID ↗
A lawsuit cited Amazon as liable in a crash involving its delivery driver, alleging that Amazon’s AI-powered driver monitoring system pushed drivers to prioritize speed over safety.
-
Amazon Allegedly Forced Deployment of AI-Powered Cameras on Delivery Drivers AIID ↗
Amazon delivery drivers were allegedly forced to consent to algorithmic collection and processing of their location, movement, and biometric data through AI-powered cameras, or be dismissed.
-
Year-long AI Surveillance Pilot in Two South Australian Aged Care Facilities Reportedly Overwhelmed Staff with False Positives AIID ↗
Between March 2021 and March 2022, an AI-enabled video and audio monitoring system was trialed in two South Australian aged care facilities. According to an independent audit commissioned by South Australia Health, the system produced over 12,000 false alerts, overwhelming staff and contributing to at least one missed real incident. The report concluded the system did not reach accuracy levels acceptable to staff or management during the pilot.
-
Facebook's Automated Tools Failed to Adequately Remove Hate Speech, Violence, and Incitement AIID ↗
Facebook's automated moderation tools were shown by internal documents performing incomparably to human moderators, and accounting for only a small fraction of hate speech, violence, and incitement content removal.
-
TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls AIID ↗
TikTok’s recommendation algorithm was alleged in a lawsuit to have intentionally and repeatedly pushed videos of the “blackout” challenge onto children’s feeds, incentivizing their participation which ultimately resulted in the death of two young girls.
-
Manufacturing Robot Failure Caused Factory Worker's Death in India AIID ↗
A sensor snag resulted in an automotive parts factory robot falling on a factory worker in India
-
Facebook’s and Twitter's Automated Content Moderation Reportedly Failed to Effectively Enforce Violation Rules for Small Language Groups AIID ↗
Facebook's and Twitter were not able to sufficiently moderate content of small language groups such as the Balkan languages using AI, allegedly due to the lack of investment in human moderation and difficulty in AI-solution design for the languages.
-
California's Algorithm Considered ZIP Codes in Vaccine Distribution, Allegedly Excluding Low-Income Neighborhoods and Communities of Color AIID ↗
California's vaccine-distribution algorithm used ZIP codes as opposed to census tracts in its decision-making, which critics said undermined equity and access for vulnerable communities who are largely low-income, underserved neighborhoods with low Healthy Places Index scores.
-
Facebook's Advertisement Moderation System Allegedly Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers AIID ↗
Facebook platforms' automated ad moderation system falsely classified adaptive fashion products as medical and health care products and services, resulting in regular bans and appeals faced by their retailers.
-
AI incident: sexual content (Feb 2021) AIID ↗
Sabrina Javellana, a Florida politician, was reportedly targeted with AI-generated deepfake pornography in February 2021, which was spread online, leading to severe emotional distress and her eventual withdrawal from public life.
-
California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed AIID ↗
A police officer in Beverly Hills played copyrighted music on his phone when realizing that his interactions were being recorded on a livestream, allegedly hoping the Instagram's automated copyright detection system to end or mute the stream.
-
Queensland Man Allegedly Distributed Purportedly AI-Generated Sexual Posters Falsely Advertising Women for Sex AIID ↗
Queensland police in Australia allege that a man used AI to place at least eight women's faces onto explicit images and displayed posters containing their names, social media accounts, employment details, and false claims that they offered sexual services. The alleged campaign ran from February 2021 through May 2026.
-
Remote Proctoring Facial-Detection Software Reportedly Failed to Detect Black Student During Lab Quiz AIID ↗
In February 2021, a Black college student, Amaya Ross, reportedly tried to take a remote biology lab quiz using proctoring software that could not detect her face. Ross said she spent 45 minutes changing lights, shades, position, and background before pointing an LED flashlight at her face so the app would work; the quiz itself was only 30 minutes.
-
Amazon’s Search and Recommendation Algorithms Found by Auditors to Have Boosted Products That Contained Vaccine Misinformation AIID ↗
Evidence of the "filter-bubble effect" were found by vaccine-misinformation researchers in Amazon's recommendations, where its algorithms presented users who performed actions on misinformative products with more misinfomative products.
-
Facebook's Automated Moderation Mistakenly Flagged Landmark's Name as Offensive AIID ↗
Facebook's automated system mistakenly labelled posts featuring the seafaring landmark Plymouth Hoe as misogynistic.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.
Frequently asked questions
- What is recorded in each incident?
- What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
- Does an incident mean wrongdoing was proven?
- No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
- How current is the incident data?
- It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
- Does this page include the full incident reports?
- No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.