AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Facial Recognition Error Reportedly Leads to Wrongful Arrest of Georgia Man and $200K Settlement in Louisiana AIID ↗
In November 2022, Randal "Quran" Reid was arrested in Georgia based on warrants from Louisiana that reportedly stemmed from a purportedly faulty facial recognition match using Clearview AI. Despite reportedly having never visited Louisiana, Reid was jailed for six days before authorities withdrew the warrants. No corroborating evidence had been gathered, and the technology's use was omitted from legal documents. In May 2025, Jefferson Parish settled with Reid for $200,000 in a federal civil righ
-
Louisiana Police Wrongfully Arrested Black Man Using False Face Match AIID ↗
Louisiana police reportedly used a false facial recognition match and secured an arrest warrant for a Black man for thefts he did not commit.
-
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel AIID ↗
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
-
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women AIID ↗
Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.
-
Deepfake of FTX's Former CEO Posted on Twitter Aiming to Scam FTX Collapse Victims AIID ↗
A visual and audio deepfake of former FTX CEO Sam Bankman-Fried was posted on Twitter to scam victims of the exchange's collapse by urging people to transfer funds into an anonymous cryptocurrency wallet.
-
Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training AIID ↗
Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.
-
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls AIID ↗
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
-
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content AIID ↗
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
-
Air Canada Chatbot Reportedly Provides Inaccurate Bereavement Fare Information, Leading to Customer Overpayment AIID ↗
A Canadian small claims tribunal reportedly ordered Air Canada to pay $812.02 in damages and court fees after its website chatbot allegedly provided inaccurate information about bereavement fare eligibility, leading a customer to overpay for flights. The tribunal reportedly found the airline responsible for information presented by its chatbot, rejecting the argument that the chatbot was a separate legal entity, and characterized the error as negligent misrepresentation.
-
Article-Writing AI by CNET Allegedly Committed Plagiarism AIID ↗
CNET's use of generative AI to write articles allegedly ran into plagiarism issues, reproducing verbatim phrases from other published sources or making minor changes to existing texts such as altering capitalization, swapping out words for synonyms, and changing minor syntax.
-
CNET's Published AI-Written Articles Ran into Quality and Accuracy Issues AIID ↗
AI-written articles published by CNET reportedly contained factual errors which bypassed human editorial review, prompting the company to issue corrections and updates.
-
KFC Sent Insensitive Kristallnacht Promotion via Holiday Detection System AIID ↗
KFC cited an error in an automated holiday detection system which identified the anniversary of Kristallnacht and prompted an insensitive push notification promoting its chicken.
-
Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked AIID ↗
Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.
-
Stable Diffusion's Training Data Contained Copyrighted Images AIID ↗
Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.
-
Weibo Model Had Difficulty Detecting Shifts in Censored Speech AIID ↗
Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.
-
Canadian Police's Release of Suspect's AI-Generated Facial Photo Reportedly Reinforced Racial Profiling AIID ↗
The Edmonton Police Service (EPS) in Canada released a facial image of a Black male suspect generated by an algorithm using DNA phenotyping, which was denounced by the local community as racial profiling.
-
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud AIID ↗
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
-
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident AIID ↗
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
-
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving AIID ↗
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
-
GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks AIID ↗
Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.
-
Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams AIID ↗
Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.
-
"The Little Mermaid" Clip Doctored Using Generative AI to Replace Black Actress with White Character AIID ↗
A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of "The Little Mermaid," replacing a Black actress with a white digital character.
-
Delivery Robot Rolled Through Crime Scene AIID ↗
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
-
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human AIID ↗
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
-
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube AIID ↗
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
-
GAN Artwork Won First Place at State Fair Competition AIID ↗
An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which raised concerns surrounding labor displacement and unfair competition.
-
BlenderBot 3 Cited Dutch Politician as a Terrorist AIID ↗
Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was confused about its association.
-
Stable Diffusion Reportedly Exhibited Biases for Prompts Featuring Professions AIID ↗
Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.
-
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child AIID ↗
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
-
Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn AIID ↗
Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.
-
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage AIID ↗
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
-
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty AIID ↗
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
-
Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments AIID ↗
The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to have “occasionally” made offensive and inconsistent remarks such as invoking Jewish stereotypes.
-
Facial Recognition Trial by UK Southern Co-op Alleged as Unlawful AIID ↗
Southern Co-op's use of facial recognition reportedly to curb violent crime in UK supermarkets was alleged by civil society and privacy groups as "unlawful" and "complete" invasion of privacy.
-
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah AIID ↗
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
-
Users Reported Security Issues with Google Pixel 6a's Fingerprint Unlocking AIID ↗
Google Pixel 6a's fingerprint recognition feature was reported by users for security issues, in which phones were mistakenly unlocked by unregistered fingerprints.
-
Chess-Playing Robot Broke Child's Finger in Russia AIID ↗
A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move
-
Google Lens’s Camera-Based Translation Feature Provided an Offensive Mistranslation of a Book Title in Korean AIID ↗
A book title by Korea’s first minister of culture was mistranslated into an offensive phrase by Google Lens’s camera-based translation feature allegedly due to its training on internet communications and a lack of context.
-
Deepfakes Reportedly Deployed in Online Interviews for Remote Work Positions AIID ↗
Voice and video deepfakes were reported by FBI Internet Crime Complaint Center (IC3) in complaint reports to have been deployed during online interviews of the candidates for remote-work positions.
-
AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure AIID ↗
Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.
-
Kalibrate Fuel Pricing Allegedly Enabled California Gas Station Operators to Coordinate Higher Pump Prices AIID ↗
Major gas station operators in California allegedly used Kalibrate Fuel Pricing to automate pump prices using competitor data and reduce price competition. A June 2026 complaint said the AI-based system increased gasoline prices by as much as 30 cents per gallon where adoption was widespread.
-
Cruise AV Ran Over Fire Hose in Active Fire Scene AIID ↗
A Cruise AV ran over a fire hose that was being used in an active firefighting area.
-
DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes AIID ↗
Publicly deployed open-source model DALL-E Mini was acknowledged by its developers and found by its users to have produced images which reinforced racial and gender biases.
-
Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection AIID ↗
A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.
-
False Negatives for Water Quality-Associated Beach Closures AIID ↗
Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.
-
YouTuber Built, Made Publicly Available, and Released Model Trained on Toxic 4chan Posts as Prank AIID ↗
A YouTuber built GPT-4chan, a model based on OpenAI’s GPT-J and trained on posts containing racism, misogyny, and antisemitism collected from 4chan’s “politically incorrect” board, which he made publicly available, and deployed as multiple bots posting thousands of messages on the same 4chan board as a prank.
-
Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US AIID ↗
Axon Enterprise considered development of remotely operated drones capable of tasering at a target a short distance away as a defense mechanism for mass shootings, despite its internal AI ethics board’s previous objection and condemnation as dangerous and fantastical.
-
SafeRent AI Screening Tool Allegedly Discriminated Against Housing Voucher Applicants AIID ↗
SafeRent’s AI-powered tenant screening tool used credit history and non-rental-related debts to assign scores, disproportionately penalizing Black and Hispanic renters and those using housing vouchers. The reported discriminatory housing outcomes violated the Fair Housing Act and Massachusetts law. A class action lawsuit (Louis, et al. v. SafeRent Solutions, et al.) resulted in a $2.275 million settlement and changes to SafeRent’s practices.
-
Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco AIID ↗
Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.
-
Fatal Crash Involving Tesla Full Self-Driving Claims Employee's Life AIID ↗
A Tesla employee, Hans von Ohain, was killed in a crash while allegedly using the Full Self-Driving feature. The car failed to navigate mountain curves, leading to a fatal collision, possibly making von Ohain the first known fatality of the Full Self-Driving feature.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.