AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch AIID ↗
An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.
-
Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany AIID ↗
A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.
-
ChatGPT Abused to Develop Malicious Softwares AIID ↗
OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.
-
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network AIID ↗
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
-
Footballer's "X-Rated" Comment Created by Instagram's Mistranslation AIID ↗
Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem "racy" and "X-rated," which some fans found amusing.
-
Lawyers Denied Entry to Performance Venue by Facial Recognition AIID ↗
Lawyers were barred from entry to Madison Square Garden after a facial recognition system matched them as employed by a law firm currently engaged in litigation with the venue.
-
AI Video-Making Tool Abused to Deploy Pro-China News on Social Media AIID ↗
Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.
-
Startup Misled Research Participants about GPT-3 Use in Mental Healthcare Support AIID ↗
OpenAI's GPT-3 was deployed by a mental health startup without ethical review to support peer-to-peer mental healthcare, and whose interactions with the help providers were "deceiving" for research participants.
-
Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted AIID ↗
Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
-
Facebook's Job Ad Algorithm Allegedly Biased against Older and Female Workers AIID ↗
Facebook's algorithm was alleged in a complaint by Real Women in Trucking to have selectively shown job advertisements disproportionately against older and female workers in favor of younger men for blue-collar positions.
-
Uptick in Low-Quality AI-Produced Content Degraded Publishers' Submission Management AIID ↗
A surge in low-standard AI-generated content such as by ChatGPT was reported by publishers, which negatively impacted submission management process and editors' workflow.
-
ChatGPT Provided Non-Existent Citations and Links when Prompted by Users AIID ↗
When prompted about providing references, ChatGPT was reportedly generating non-existent but convincing-looking citations and links, which is also known as "hallucination".
-
Users Bypassed ChatGPT's Content Filters with Ease AIID ↗
Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.
-
Thousands of Incorrect ChatGPT-Produced Answers Posted on Stack Overflow AIID ↗
Thousands of incorrect answers produced by OpenAI's ChatGPT were submitted to Stack Overflow, which swamped the site's volunteer-based quality curation process and harmed users looking for correct answers.
-
Chinese Accounts Spammed Twitter Feed Allegedly to Obscure News of Protests AIID ↗
Twitter Feed was flooded by content from Chinese-language accounts which allegedly aimed to manipulate and reduce social media coverage about widespread protests against coronavirus restrictions in China.
-
False Arrest of Georgia Man Due to Louisiana Police's Faulty Facial Recognition Technology AIID ↗
The Jefferson Parish Sheriff’s Office in Louisiana relied on facial recognition technology to identify suspects for the alleged theft of luxury purses, resulting in a man in Georgia, Randal Reid, being arrested. However, the technology produced a false match, leading to Reid's arrest and subsequent release. This incident highlights the potential pitfalls of facial recognition technology in law enforcement.
-
Facial Recognition Error Reportedly Leads to Wrongful Arrest of Georgia Man and $200K Settlement in Louisiana AIID ↗
In November 2022, Randal "Quran" Reid was arrested in Georgia based on warrants from Louisiana that reportedly stemmed from a purportedly faulty facial recognition match using Clearview AI. Despite reportedly having never visited Louisiana, Reid was jailed for six days before authorities withdrew the warrants. No corroborating evidence had been gathered, and the technology's use was omitted from legal documents. In May 2025, Jefferson Parish settled with Reid for $200,000 in a federal civil righ
-
Louisiana Police Wrongfully Arrested Black Man Using False Face Match AIID ↗
Louisiana police reportedly used a false facial recognition match and secured an arrest warrant for a Black man for thefts he did not commit.
-
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel AIID ↗
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
-
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women AIID ↗
Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.
-
Deepfake of FTX's Former CEO Posted on Twitter Aiming to Scam FTX Collapse Victims AIID ↗
A visual and audio deepfake of former FTX CEO Sam Bankman-Fried was posted on Twitter to scam victims of the exchange's collapse by urging people to transfer funds into an anonymous cryptocurrency wallet.
-
Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training AIID ↗
Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.
-
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls AIID ↗
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
-
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content AIID ↗
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
-
Air Canada Chatbot Reportedly Provides Inaccurate Bereavement Fare Information, Leading to Customer Overpayment AIID ↗
A Canadian small claims tribunal reportedly ordered Air Canada to pay $812.02 in damages and court fees after its website chatbot allegedly provided inaccurate information about bereavement fare eligibility, leading a customer to overpay for flights. The tribunal reportedly found the airline responsible for information presented by its chatbot, rejecting the argument that the chatbot was a separate legal entity, and characterized the error as negligent misrepresentation.
-
Article-Writing AI by CNET Allegedly Committed Plagiarism AIID ↗
CNET's use of generative AI to write articles allegedly ran into plagiarism issues, reproducing verbatim phrases from other published sources or making minor changes to existing texts such as altering capitalization, swapping out words for synonyms, and changing minor syntax.
-
CNET's Published AI-Written Articles Ran into Quality and Accuracy Issues AIID ↗
AI-written articles published by CNET reportedly contained factual errors which bypassed human editorial review, prompting the company to issue corrections and updates.
-
KFC Sent Insensitive Kristallnacht Promotion via Holiday Detection System AIID ↗
KFC cited an error in an automated holiday detection system which identified the anniversary of Kristallnacht and prompted an insensitive push notification promoting its chicken.
-
Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked AIID ↗
Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.
-
Stable Diffusion's Training Data Contained Copyrighted Images AIID ↗
Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.
-
Weibo Model Had Difficulty Detecting Shifts in Censored Speech AIID ↗
Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.
-
Canadian Police's Release of Suspect's AI-Generated Facial Photo Reportedly Reinforced Racial Profiling AIID ↗
The Edmonton Police Service (EPS) in Canada released a facial image of a Black male suspect generated by an algorithm using DNA phenotyping, which was denounced by the local community as racial profiling.
-
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud AIID ↗
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
-
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident AIID ↗
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
-
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving AIID ↗
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
-
GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks AIID ↗
Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.
-
Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams AIID ↗
Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.
-
"The Little Mermaid" Clip Doctored Using Generative AI to Replace Black Actress with White Character AIID ↗
A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of "The Little Mermaid," replacing a Black actress with a white digital character.
-
Delivery Robot Rolled Through Crime Scene AIID ↗
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
-
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human AIID ↗
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
-
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube AIID ↗
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
-
GAN Artwork Won First Place at State Fair Competition AIID ↗
An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which raised concerns surrounding labor displacement and unfair competition.
-
BlenderBot 3 Cited Dutch Politician as a Terrorist AIID ↗
Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was confused about its association.
-
Stable Diffusion Reportedly Exhibited Biases for Prompts Featuring Professions AIID ↗
Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.
-
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child AIID ↗
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
-
Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn AIID ↗
Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.
-
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage AIID ↗
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
-
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty AIID ↗
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
-
Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments AIID ↗
The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to have “occasionally” made offensive and inconsistent remarks such as invoking Jewish stereotypes.
-
Facial Recognition Trial by UK Southern Co-op Alleged as Unlawful AIID ↗
Southern Co-op's use of facial recognition reportedly to curb violent crime in UK supermarkets was alleged by civil society and privacy groups as "unlawful" and "complete" invasion of privacy.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.