AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage AIID ↗
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
-
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban AIID ↗
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
-
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election AIID ↗
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
-
Purported Deepfake Video Falsely Depicts Biden Announcing National Draft for Ukraine AIID ↗
A purportedly AI-generated deepfake video falsely depicting President Biden announcing a national draft to support Ukraine was reportedly shared on social media, causing widespread misinformation. The video reportedly misled the public until debunked by fact-checkers.
-
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio AIID ↗
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
-
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote AIID ↗
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
-
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories AIID ↗
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
-
Facial Recognition Misidentifies Pregnant Woman Leading to False Arrest in Detroit AIID ↗
Porcha Woodruff was arrested and subsequently had charges dropped due to an unreliable facial recognition match. Despite being visibly pregnant, she was implicated in a robbery and carjacking based on an outdated photo used in a lineup.
-
Vanderbilt Peabody Office's Purportedly ChatGPT-Drafted Message About Michigan State Shooting Reportedly Drew Student Backlash AIID ↗
On February 16, 2023, Vanderbilt University's Peabody College Office of Equity, Diversity and Inclusion reportedly sent students a message about the Michigan State University shooting that disclosed it had been drafted or paraphrased using ChatGPT. Students reportedly criticized the message as impersonal and disrespectful in a moment of grief. Peabody later apologized for "poor judgment," and two EDI deans temporarily stepped back during a review.
-
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy AIID ↗
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
-
Bing AI Search Tool Reportedly Declared Threats against Users AIID ↗
Users such as the person who revealed its built-in initial prompts reported Bing AI-powered search tool for making death threats or declaring them as threats, sometimes as an unintended persona.
-
Bing Chat Tentatively Hallucinated in Extended Conversations with Users AIID ↗
Early testers reported Bing Chat, in extended conversations with users, having tendencies to make up facts and emulate emotions through an unintended persona.
-
Synthesized Voices Were Reportedly Used by Torswats to Sell Swatting Calls Targeting Schools and Homes AIID ↗
A Telegram user or channel known as Torswats reportedly offered paid swatting services and uploaded recordings of false emergency calls using synthesized or computer-generated voices. Reported targets included high schools, private residences, streamers, businesses, and police departments; some calls prompted lockdowns, searches, or armed law-enforcement responses. The exact voice-generation tool was not identified.
-
Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion AIID ↗
When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.
-
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students AIID ↗
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.
-
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand AIID ↗
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
-
Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey AIID ↗
AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending funds to their crypto wallets disguised as donation links for the 2023 Turkey–Syria earthquake.
-
AI Generated Voices Used to Dox Voice Actors AIID ↗
Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.
-
Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information AIID ↗
Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figures on financial statements.
-
Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection AIID ↗
Early testers of Bing Chat successfully used prompt injection to reveal its built-in initial instructions, which contains a list of statements governing ChatGPT's interaction with users.
-
Bing Chat Response Cited ChatGPT Disinformation Example AIID ↗
Reporters from TechCrunch issued a query to Microsoft Bing's ChatGPT feature, which cited an earlier example of ChatGPT disinformation discussed in a news article to substantiate the disinformation.
-
ChatGPT-Powered Bing Reportedly Had Problems with Factual Accuracy on Some Controversial Topics AIID ↗
Microsoft's ChatGPT-powered Bing search engine reportedly ran into factual accuracy problems when prompted about controversial matters, such as inventing plot of a non-existent movie or creating conspiracy theories.
-
Google's Bard Shared Factually Inaccurate Info in Promo Video AIID ↗
Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took pictures of a planet outside the Earth's solar system, reportedly causing shares to temporarily plummet.
-
AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment AIID ↗
The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a transphobic and homophobic dialogue segment intended as comedy.
-
Google Android Earthquake Alerts System Reportedly Underestimated Kahramanmaraş Earthquake and Failed to Send Urgent Warnings to Millions AIID ↗
During the February 6, 2023 Kahramanmaraş earthquake sequence, Google's Android Earthquake Alerts system reportedly estimated the initial magnitude-7.8 earthquake at only magnitude 4.5–4.9. Just 469 users reportedly received its highest-level "Take Action" warning, while approximately 500,000 received lower-level notices; researchers later estimated that roughly 10 million people could have received urgent warnings providing up to 35 seconds to seek safety.
-
Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release AIID ↗
The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before its release, another book appeared bearing the exact title by an author (Marie Karpos) for whom no information could be found. The book appeared to have been written by ChatGPT. While the original Washington Post story does not say so, it is possible the name and description were taken from the Amazon preorder page.
-
Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks AIID ↗
A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on Instagram and circulated on social media.
-
Users Reported Abrupt Behavior Changes of Their AI Replika Companions AIID ↗
Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.
-
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban AIID ↗
Tests by the Italian Data Protection Authority showed Replika lacking age-verification mechanisms and failing to stop minors from interacting with its AI, which prompted the agency to issue an order blocking personal data processing of Italian users.
-
Indian Police Allegedly Tortured and Killed Innocent Man Following Facial Misidentification AIID ↗
A resident in Medak, India died allegedly due to custodial torture by the local police, who misidentified him as a suspect in a theft case using facial recognition.
-
AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text AIID ↗
AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.
-
Celebrities' Deepfake Voices Abused with Malicious Intent AIID ↗
Voices of celebrities and public figures were deepfaked using voice synthesis for malicious intents such as impersonation or defamation, and were shared on social platforms such as 4chan and Reddit.
-
Non-consensual Deepfake Porn Targeted Female Content Creators AIID ↗
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
-
Purported Synthesia Avatars Used in Alleged Pro-Junta Deepfake Video Supporting Ibrahim Traoré in Burkina Faso AIID ↗
In January 2023, purportedly AI-generated videos reportedly began circulating on WhatsApp and social media showing avatars of apparent American pan-Africanists expressing support for Burkina Faso's military junta. The videos were reportedly created using the Synthesia platform. Synthesia later confirmed the videos violated its terms of service and banned the user. The source of the videos remains unidentified.
-
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses AIID ↗
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
-
Mother in Arizona Received Fake Ransom Call Featuring AI Voice of Her Daughter AIID ↗
A mother in Arizona received a ransom call from an anonymous scammer who created her daughter's voice allegedly using AI voice synthesis, which was proven to be fake once her daughter's safety was confirmed.
-
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated AIID ↗
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
-
US CBP App's Failure to Detect Black Faces Reportedly Blocked Asylum Applications AIID ↗
CBP One's facial recognition feature was reportedly disproportionately failing to detect faces of Black asylum seekers from Haiti and African countries, effectively blocking their asylum applications.
-
Canadian Parents Tricked out of Thousands Using Their Son's AI Voice AIID ↗
Two Canadian residents were scammed by an anonymous caller who used AI voice synthesis to replicate their son's voice asking them for legal fees, disguising as his lawyer.
-
ChatGPT-Written Bug Reports Deemed "Nonsense" by White Hat Platform, Prompted Bans AIID ↗
ChatGPT-generated responses submitted to smart contract bug bounty platform Immunefi reportedly lacked details to help diagnose technical issues, which reportedly wasted the platform's time, prompting bans to submitters.
-
Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews AIID ↗
McDonald's, Wendy's, and Hardee's AI chatbots deployed to pre-screen job candidates and schedule interviews reportedly ran into issues such as not giving useful submission instructions, failing to relay information to the manager, and scheduling an interview when the manager was not available.
-
Twitter's AI Moderation Tool Misidentified Rockets as Pornography AIID ↗
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
-
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina AIID ↗
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
-
AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch AIID ↗
An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.
-
Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany AIID ↗
A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.
-
ChatGPT Abused to Develop Malicious Softwares AIID ↗
OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.
-
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network AIID ↗
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
-
Footballer's "X-Rated" Comment Created by Instagram's Mistranslation AIID ↗
Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem "racy" and "X-rated," which some fans found amusing.
-
Lawyers Denied Entry to Performance Venue by Facial Recognition AIID ↗
Lawyers were barred from entry to Madison Square Garden after a facial recognition system matched them as employed by a law firm currently engaged in litigation with the venue.
-
AI Video-Making Tool Abused to Deploy Pro-China News on Social Media AIID ↗
Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.