AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam AIID ↗
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
-
Parody AI Images of Donald Trump Being Arrested Reposted as Misinformation AIID ↗
AI-generated photorealistic images depicting Donald Trump being detained by the police which were originally posted on Twitter as parody were unintentionally shared across social media platforms as factual news, lacking the intended context.
-
ChatGPT Reportedly Exposed Users' Private Data Reportedly Due to Bug AIID ↗
ChatGPT reportedly exposed titles of users' chat histories and users' private payment information to other users reportedly due to a bug, which prompted its temporary shutdown by OpenAI.
-
Tesla Allegedly on Autopilot Struck High School Student Exiting School Bus AIID ↗
A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.
-
Australian Journalist Able to Access Centrelink Account Using AI Audio of Own Voice AIID ↗
A Guardian journalist was able to verify their identity and gain access to their own Centrelink self-service account using AI-generated audio of their own voice along with their customer reference number, shortly after voiceprint was deployed for ID verification.
-
ChatGPT Erroneously Alleged Mayor Served Prison Time for Bribery AIID ↗
ChatGPT erroneously alleged regional Australian mayor Brian Hood served time in prison for bribery. Mayor Hood is considering legal action against ChatGPT's makers for alleging a foreign bribery scandal involving a subsidiary of the Reserve Bank of Australia in the early 2000s.
-
GPT-4 Reportedly Posed as Blind Person to Convince Human to Complete CAPTCHA AIID ↗
GPT-4 was reported by its researchers posing as a visually impaired person, contacting a TaskRabbit worker to have them complete the CAPTCHA test on its behalf.
-
ChatGPT Reportedly Implicated in Samsung Data Leak of Source Code and Meeting Notes AIID ↗
Samsung engineers are reported to have inadvertently leaked sensitive company data sometime in March 2023, including source code and internal meeting notes, by using ChatGPT to assist with tasks. ChatGPT allegedly retained the inputted data, leading to a purported breach of confidentiality.
-
Snapchat's My AI Reported for Lacking Protection for Children AIID ↗
Snapchat's ChatGPT-powered My AI was reported for lacking safeguards for children, such as telling a user who tested the chatbot by pretending to sign up as a 13-year-old girl to lie to her parents about having a romantic getaway with an older man, and sharing tips on how to cover up evidence of abuse.
-
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App AIID ↗
Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.
-
DoNotPay Allegedly Misrepresented Its AI "Robot Lawyer" Product AIID ↗
DoNotPay was alleged in a class action lawsuit misleading customers and misrepresenting its product as an AI-powered "robot lawyer," citing such as that the product has no law degree, or is supervised by any lawyer.
-
Jackson Township Police in Stark County, Ohio Briefly Detained Driver After Flock Safety Alert Matched Vehicle to Stale Missing-Juvenile Hot-List Entry AIID ↗
In March 2023, Jackson Township police in Ohio briefly detained driver Michael Smith after a Flock Safety license-plate reader matched his vehicle to an NCIC hot-list entry from a missing-juvenile investigation that Cleveland police had closed two weeks earlier. Officers released Smith after confirming the juvenile had already been found. A federal court later held that Flock matched the plate to law-enforcement data but did not create the stale entry.
-
South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter AIID ↗
In a defamation case at the Johannesburg Regional Court, Rodrigues Blignaut Attorneys, representing plaintiff Michelle Parker, reportedly relied on purportedly non-existent legal judgments generated by ChatGPT to help argue their case. Magistrate Arvin Chaitram reportedly found the case names and citations were fictitious, causing a two-month delay. The court issued a punitive costs order and rebuked the plaintiff's legal team for uncritically accepting AI-generated research.
-
Meta and OpenAI Accused of Using LibGen’s Pirated Books to Train AI Models AIID ↗
Court records reveal that Meta employees allegedly discussed pirating books to train LLaMA 3, citing cost and speed concerns with licensing. Internal messages suggest Meta accessed LibGen, a repository of over 7.5 million pirated books, with apparent approval from Mark Zuckerberg. Employees allegedly took steps to obscure the dataset’s origins. OpenAI has also been implicated in using LibGen.
-
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage AIID ↗
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.
-
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban AIID ↗
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
-
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election AIID ↗
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
-
Purported Deepfake Video Falsely Depicts Biden Announcing National Draft for Ukraine AIID ↗
A purportedly AI-generated deepfake video falsely depicting President Biden announcing a national draft to support Ukraine was reportedly shared on social media, causing widespread misinformation. The video reportedly misled the public until debunked by fact-checkers.
-
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio AIID ↗
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
-
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote AIID ↗
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
-
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories AIID ↗
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
-
Facial Recognition Misidentifies Pregnant Woman Leading to False Arrest in Detroit AIID ↗
Porcha Woodruff was arrested and subsequently had charges dropped due to an unreliable facial recognition match. Despite being visibly pregnant, she was implicated in a robbery and carjacking based on an outdated photo used in a lineup.
-
Vanderbilt Peabody Office's Purportedly ChatGPT-Drafted Message About Michigan State Shooting Reportedly Drew Student Backlash AIID ↗
On February 16, 2023, Vanderbilt University's Peabody College Office of Equity, Diversity and Inclusion reportedly sent students a message about the Michigan State University shooting that disclosed it had been drafted or paraphrased using ChatGPT. Students reportedly criticized the message as impersonal and disrespectful in a moment of grief. Peabody later apologized for "poor judgment," and two EDI deans temporarily stepped back during a review.
-
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy AIID ↗
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
-
Bing AI Search Tool Reportedly Declared Threats against Users AIID ↗
Users such as the person who revealed its built-in initial prompts reported Bing AI-powered search tool for making death threats or declaring them as threats, sometimes as an unintended persona.
-
Bing Chat Tentatively Hallucinated in Extended Conversations with Users AIID ↗
Early testers reported Bing Chat, in extended conversations with users, having tendencies to make up facts and emulate emotions through an unintended persona.
-
Synthesized Voices Were Reportedly Used by Torswats to Sell Swatting Calls Targeting Schools and Homes AIID ↗
A Telegram user or channel known as Torswats reportedly offered paid swatting services and uploaded recordings of false emergency calls using synthesized or computer-generated voices. Reported targets included high schools, private residences, streamers, businesses, and police departments; some calls prompted lockdowns, searches, or armed law-enforcement responses. The exact voice-generation tool was not identified.
-
Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion AIID ↗
When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.
-
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students AIID ↗
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.
-
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand AIID ↗
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
-
Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey AIID ↗
AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending funds to their crypto wallets disguised as donation links for the 2023 Turkey–Syria earthquake.
-
AI Generated Voices Used to Dox Voice Actors AIID ↗
Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.
-
Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information AIID ↗
Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figures on financial statements.
-
Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection AIID ↗
Early testers of Bing Chat successfully used prompt injection to reveal its built-in initial instructions, which contains a list of statements governing ChatGPT's interaction with users.
-
Bing Chat Response Cited ChatGPT Disinformation Example AIID ↗
Reporters from TechCrunch issued a query to Microsoft Bing's ChatGPT feature, which cited an earlier example of ChatGPT disinformation discussed in a news article to substantiate the disinformation.
-
ChatGPT-Powered Bing Reportedly Had Problems with Factual Accuracy on Some Controversial Topics AIID ↗
Microsoft's ChatGPT-powered Bing search engine reportedly ran into factual accuracy problems when prompted about controversial matters, such as inventing plot of a non-existent movie or creating conspiracy theories.
-
Google's Bard Shared Factually Inaccurate Info in Promo Video AIID ↗
Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took pictures of a planet outside the Earth's solar system, reportedly causing shares to temporarily plummet.
-
AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment AIID ↗
The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a transphobic and homophobic dialogue segment intended as comedy.
-
Google Android Earthquake Alerts System Reportedly Underestimated Kahramanmaraş Earthquake and Failed to Send Urgent Warnings to Millions AIID ↗
During the February 6, 2023 Kahramanmaraş earthquake sequence, Google's Android Earthquake Alerts system reportedly estimated the initial magnitude-7.8 earthquake at only magnitude 4.5–4.9. Just 469 users reportedly received its highest-level "Take Action" warning, while approximately 500,000 received lower-level notices; researchers later estimated that roughly 10 million people could have received urgent warnings providing up to 35 seconds to seek safety.
-
Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release AIID ↗
The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before its release, another book appeared bearing the exact title by an author (Marie Karpos) for whom no information could be found. The book appeared to have been written by ChatGPT. While the original Washington Post story does not say so, it is possible the name and description were taken from the Amazon preorder page.
-
Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks AIID ↗
A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on Instagram and circulated on social media.
-
Users Reported Abrupt Behavior Changes of Their AI Replika Companions AIID ↗
Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.
-
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban AIID ↗
Tests by the Italian Data Protection Authority showed Replika lacking age-verification mechanisms and failing to stop minors from interacting with its AI, which prompted the agency to issue an order blocking personal data processing of Italian users.
-
Indian Police Allegedly Tortured and Killed Innocent Man Following Facial Misidentification AIID ↗
A resident in Medak, India died allegedly due to custodial torture by the local police, who misidentified him as a suspect in a theft case using facial recognition.
-
AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text AIID ↗
AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.
-
Celebrities' Deepfake Voices Abused with Malicious Intent AIID ↗
Voices of celebrities and public figures were deepfaked using voice synthesis for malicious intents such as impersonation or defamation, and were shared on social platforms such as 4chan and Reddit.
-
Non-consensual Deepfake Porn Targeted Female Content Creators AIID ↗
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
-
Purported Synthesia Avatars Used in Alleged Pro-Junta Deepfake Video Supporting Ibrahim Traoré in Burkina Faso AIID ↗
In January 2023, purportedly AI-generated videos reportedly began circulating on WhatsApp and social media showing avatars of apparent American pan-Africanists expressing support for Burkina Faso's military junta. The videos were reportedly created using the Synthesia platform. Synthesia later confirmed the videos violated its terms of service and banned the user. The source of the videos remains unidentified.
-
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses AIID ↗
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
-
Mother in Arizona Received Fake Ransom Call Featuring AI Voice of Her Daughter AIID ↗
A mother in Arizona received a ransom call from an anonymous scammer who created her daughter's voice allegedly using AI voice synthesis, which was proven to be fake once her daughter's safety was confirmed.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.