AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud AIID ↗
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
-
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident AIID ↗
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
-
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving AIID ↗
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
-
GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks AIID ↗
Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.
-
Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams AIID ↗
Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.
-
"The Little Mermaid" Clip Doctored Using Generative AI to Replace Black Actress with White Character AIID ↗
A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of "The Little Mermaid," replacing a Black actress with a white digital character.
-
Delivery Robot Rolled Through Crime Scene AIID ↗
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
-
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human AIID ↗
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
-
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube AIID ↗
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
-
GAN Artwork Won First Place at State Fair Competition AIID ↗
An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which raised concerns surrounding labor displacement and unfair competition.
-
BlenderBot 3 Cited Dutch Politician as a Terrorist AIID ↗
Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was confused about its association.
-
Stable Diffusion Reportedly Exhibited Biases for Prompts Featuring Professions AIID ↗
Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.
-
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child AIID ↗
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
-
AI incident: sexual content (Stability Ai, Aug 2022) AIID ↗
Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.
-
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage AIID ↗
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
-
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty AIID ↗
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
-
Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments AIID ↗
The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to have “occasionally” made offensive and inconsistent remarks such as invoking Jewish stereotypes.
-
Facial Recognition Trial by UK Southern Co-op Alleged as Unlawful AIID ↗
Southern Co-op's use of facial recognition reportedly to curb violent crime in UK supermarkets was alleged by civil society and privacy groups as "unlawful" and "complete" invasion of privacy.
-
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah AIID ↗
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
-
Users Reported Security Issues with Google Pixel 6a's Fingerprint Unlocking AIID ↗
Google Pixel 6a's fingerprint recognition feature was reported by users for security issues, in which phones were mistakenly unlocked by unregistered fingerprints.
-
Chess-Playing Robot Broke Child's Finger in Russia AIID ↗
A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move
-
Google Lens’s Camera-Based Translation Feature Provided an Offensive Mistranslation of a Book Title in Korean AIID ↗
A book title by Korea’s first minister of culture was mistranslated into an offensive phrase by Google Lens’s camera-based translation feature allegedly due to its training on internet communications and a lack of context.
-
Deepfakes Reportedly Deployed in Online Interviews for Remote Work Positions AIID ↗
Voice and video deepfakes were reported by FBI Internet Crime Complaint Center (IC3) in complaint reports to have been deployed during online interviews of the candidates for remote-work positions.
-
AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure AIID ↗
Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.
-
Kalibrate Fuel Pricing Allegedly Enabled California Gas Station Operators to Coordinate Higher Pump Prices AIID ↗
Major gas station operators in California allegedly used Kalibrate Fuel Pricing to automate pump prices using competitor data and reduce price competition. A June 2026 complaint said the AI-based system increased gasoline prices by as much as 30 cents per gallon where adoption was widespread.
-
Cruise AV Ran Over Fire Hose in Active Fire Scene AIID ↗
A Cruise AV ran over a fire hose that was being used in an active firefighting area.
-
DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes AIID ↗
Publicly deployed open-source model DALL-E Mini was acknowledged by its developers and found by its users to have produced images which reinforced racial and gender biases.
-
Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection AIID ↗
A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.
-
False Negatives for Water Quality-Associated Beach Closures AIID ↗
Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.
-
YouTuber Built, Made Publicly Available, and Released Model Trained on Toxic 4chan Posts as Prank AIID ↗
A YouTuber built GPT-4chan, a model based on OpenAI’s GPT-J and trained on posts containing racism, misogyny, and antisemitism collected from 4chan’s “politically incorrect” board, which he made publicly available, and deployed as multiple bots posting thousands of messages on the same 4chan board as a prank.
-
Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US AIID ↗
Axon Enterprise considered development of remotely operated drones capable of tasering at a target a short distance away as a defense mechanism for mass shootings, despite its internal AI ethics board’s previous objection and condemnation as dangerous and fantastical.
-
SafeRent AI Screening Tool Allegedly Discriminated Against Housing Voucher Applicants AIID ↗
SafeRent’s AI-powered tenant screening tool used credit history and non-rental-related debts to assign scores, disproportionately penalizing Black and Hispanic renters and those using housing vouchers. The reported discriminatory housing outcomes violated the Fair Housing Act and Massachusetts law. A class action lawsuit (Louis, et al. v. SafeRent Solutions, et al.) resulted in a $2.275 million settlement and changes to SafeRent’s practices.
-
Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco AIID ↗
Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.
-
Fatal Crash Involving Tesla Full Self-Driving Claims Employee's Life AIID ↗
A Tesla employee, Hans von Ohain, was killed in a crash while allegedly using the Full Self-Driving feature. The car failed to navigate mountain curves, leading to a fatal collision, possibly making von Ohain the first known fatality of the Full Self-Driving feature.
-
Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent AIID ↗
Major Australian retailers reportedly analyzed in-store footage to capture facial features of their customers without consent, which was criticized by consumer groups as creepy and invasive.
-
Amazon Fresh Cameras Failed to Register Purchased Items AIID ↗
Amazon Fresh's system of tracking cameras in its cashier-less stores was reported by shoppers for failing to detect items they purchased.
-
Yahoo Boys Allegedly Employ Real-Time Deepfake Technology in Romance Scams AIID ↗
Scammers from Nigeria, known as "Yahoo Boys," are reportedly utilizing real-time deepfake technology to impersonate individuals during video calls, deceiving victims in romance scams. By allegedly altering their appearance with face-swapping software, they build trust under false identities to defraud targets of substantial sums.
-
Tesla Owner Activated "Smart Summon" Feature, Causing a Collision with an Aircraft in a Washington Airport AIID ↗
A Tesla Model Y was shown on video slowly crashing into a Vision Jet in Spokane, Washington, allegedly due to its owner activating the “Smart Summon” feature.
-
Robbers Accessed Drugged Gay Men's Bank Accounts Using Their Phones' Facial Recognition AIID ↗
Gay men in New York City were drugged by robbers who accessed their phones using facial recognition while they were unconscious to transfer funds out of their bank accounts.
-
Google’s Assistive Writing Feature Provided Allegedly Unnecessary and Clumsy Suggestions AIID ↗
Google’s “inclusive language” feature prompting writers to consider alternatives to non-inclusive words reportedly also recommend alternatives for words such as “landlord” and “motherboard,” which critics said was a form of obtrusive, unnecessary, and bias-reinforcing speech-policing.
-
AI incident: sexual content (Apr 2022) AIID ↗
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of
-
AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston AIID ↗
GAN faces were allegedly used by scammers alongside a parked domain and a fake website to impersonate a Boston law firm.
-
TuSimple Truck Steered into Interstate Freeway Divide AIID ↗
A TuSimple autonomous truck operating with backup drivers behind the wheel operated on an outdated command sequence and suddenly veered into the center divide on the interstate freeway.
-
Cruise Autonomous Car Blocked Fire Truck Responding to Emergency AIID ↗
A fire truck in San Francisco responding to a fire was blocked from passing a doubled-parked garbage truck by a self-driving Cruise car on the opposing lane which stayed put and did not reverse to clear the lane.
-
Starship Delivery Robot Ran into Problems Traversing Campus Terrains AIID ↗
A Starship autonomous delivery robot struggled to navigate campus terrains of UCLA, reportedly getting stuck into a planter and falling off the stairs.
-
DALL-E 2 Reported for Gender and Racially Biased Outputs AIID ↗
Developers of OpenAI's DALL-E 2 cited risks of the model, varying from misuse as disinformation and explicit content generation, to gender and racial bias.
-
Cruise Autonomous Taxi Allegedly Bolted off from Police After Being Pulled over in San Francisco AIID ↗
An autonomous Chevy Bolt operated by Cruise was pulled over in San Francisco, and as the police attempted to engage with the car, it reportedly bolted off, pulled over again, and put on its hazards lights on at a point farther down the road.
-
Evolv AI Weapons Detection System Allegedly Misrepresents Accuracy, Leading to School Security Gaps AIID ↗
Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.
-
Three Make-Up Artists Lost Jobs Following Black-Box Automated Decision by HireVue AIID ↗
Three make-up artists lost their positions following an algorithmically-assessed video interview by HireVue who reportedly failed to provide adequate explanation of the findings.
-
Deepfake Video of Ukrainian President Yielding to Russia Posted on Ukrainian Websites and Social Media AIID ↗
A quickly-debunked deepfaked video of the Ukrainian President Volodymyr Zelenskyy was posted on various Ukrainian websites and social media platforms encouraging Ukrainians to surrender to Russian forces during the Russia-Ukraine war.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.
Frequently asked questions
- What is recorded in each incident?
- What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
- Does an incident mean wrongdoing was proven?
- No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
- How current is the incident data?
- It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
- Does this page include the full incident reports?
- No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.