AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
Filter incidents
-
Meta AI Image Generator Reportedly Fails to Accurately Represent Interracial Relationships AIID ↗
Meta's AI image generator is alleged to produce inaccurate and biased images, consistently failing to depict interracial relationships involving Asian individuals and Caucasian or Black individuals. Instead, it generates images featuring two Asian people or stereotypes, erasing the diversity and representation of Asian people.
-
'Lavender' and 'The Gospel' AI Systems Reportedly Used in Gaza Targeting Operations with Civilian Harm Allegations AIID ↗
The AI system known as "Lavender" was reportedly used by the Israel Defense Forces (IDF) to assist in identifying individuals in Gaza for targeting, while a related system, "The Gospel," was reportedly used to help select and prioritize physical strike targets. Investigations reportedly suggest that these systems operated with limited human review and may have contributed to strikes associated with high civilian casualties. The extent of automation with human oversight, as well as the accuracy o
-
Facial Recognition Misidentification at New World Westend in New Zealand AIID ↗
A facial recognition system at New World Westend supermarket misidentified a Māori woman as a known offender during its trial. The woman was wrongfully accused of trespassing and experienced public embarrassment, raising concerns about racial bias and the technology's accuracy. The supermarket acknowledged its error and apologized.
-
Washington State's Lottery AI Site Reportedly Generates Inappropriate User Image AIID ↗
An AI-powered website by Washington State's Lottery is reported to have inadvertently produced a softcore pornographic image of a user, leading to the site’s immediate shutdown out of caution.
-
Purportedly AI-Powered 007TG Platform Reportedly Used by Scam Networks Linked to $75 Million in Proceeds AIID ↗
007TG was a software suite reportedly used by scam compounds to run fraud across social media, using AI-assisted messaging and translation to help operators manage targets while concealing their identities. Wallet records linked the platform to at least four known scam networks that collectively received at least $75 million, though the evidence does not show how much was directly attributable to 007TG.
-
AI Deepfakes for Voter Outreach Flood Indian Elections AIID ↗
During the 2024 Indian elections, politicians used AI-generated deepfakes to reach voters, who might be unaware they're interacting with digital clones. Providers like Divyendra Singh Jadoun of Polymath Synthetic Media Solutions created deepfakes for personalized messages. This practice, used by various political parties, is not truthful, as voters may be misled by AI-generated content posing as genuine interactions with political figures.
-
Synthetic Voice 'Olesya' by Storm-1516 Falsely Accuses Ukraine in U.S. Election Disinformation Campaign AIID ↗
Russian operatives used AI to create a fake video and voice of "Olesya," a supposed troll in Kyiv, falsely claiming involvement in U.S. elections to support President Biden. U.S. intelligence confirmed the voice was AI-generated. This disinformation campaign aimed to mislead voters, erode trust in democratic institutions, and influence the 2024 election. The incident involved the group Storm-1516, individuals linked to Valery Korovin, and potential veterans of the Internet Research Agency.
-
Scammers Using AI to Impersonate Small Businesses AIID ↗
Scammers are using AI to impersonate small businesses by copying their videos, logos, and social media posts. They create fake listings and ads, diverting customers to cheap knockoffs or stealing their money. This has severely impacted businesses like Bee Cups, Darn Tough Vermont, and Cascade hummingbird feeders, leading to significant financial losses, negative reviews, and damaged reputations. Their deployment of AI makes it challenging for small businesses to combat these fraudulent activitie
-
Mumbai Businessman Reportedly Defrauded via Purported AI-Cloned Voice Impersonating Son AIID ↗
A Mumbai businessman reportedly identified as KT Vinod reportedly lost Rs 80,000 after receiving a call from someone claiming to be a representative of the Indian Embassy in Dubai, who said his son had been arrested. The caller allegedly used AI-generated voice cloning to simulate the voice of Vinod's son, pleading for help. Reportedly convinced of the urgency, Vinod instructed a money transfer via Google Pay. The scam was discovered only after he contacted his son directly.
-
Microsoft-Powered New York City Chatbot Advises Illegal Practices AIID ↗
New York City's chatbot, launched under Mayor Eric Adams's plan to assist businesses, has been reportedly providing dangerously inaccurate legal advice. The Microsoft-powered bot allegedly informed users that landlords can refuse Section 8 vouchers and that businesses can operate cash-free, among other falsehoods. The city acknowledges the chatbot is a pilot program and commits to improvements while the errors are addressed.
-
Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements AIID ↗
Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.
-
ISIS Utilizes AI for Propaganda Videos in News Harvest Program AIID ↗
ISIS supporters have created an AI-generated media program called News Harvest to disseminate propaganda videos. The program produces near-weekly broadcasts featuring AI-generated news anchors discussing ISIS operations globally, using cheap and easy-to-use AI tools. This development showcases the use of AI as a powerful propaganda tool for extremist groups.
-
AI incident: sexual content (Stable Diffusion, Mar 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 26 March 2024. Risk classification, related incidents and the laws on record for this risk area.
-
AI incident: sexual content (Leonardo Ai, Mar 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 26 March 2024. Risk classification, related incidents and the laws on record for this risk area.
-
Purported Deepfake Disinformation Aired on Russian State TV Allegedly Linking Ukraine to Moscow Attack AIID ↗
Russian state television reportedly aired a fabricated video that appeared to imitate senior Ukrainian security officials and present a false admission of involvement in the Crocus City Hall massacre. The clip reportedly used elements from recent interviews combined with allegedly AI-generated audio to create a misleading confession. ISIS-K is reported to have publicly claimed responsibility, while independent analysts and governments have rejected the narrative promoted through the video.
-
The Arizona Agenda Produced a Deepfake of Kari Lake Advocating for the Publication Without Her Consent AIID ↗
The Arizona Agenda produced a deepfake video of Republican Senate candidate Kari Lake giving a testimonial about the publication with the seeming intention of educating the general public about the dangers of deepfakes in the coming election cycle. However, the Arizona Agenda appears not to have sought Lake's consent, prompting a cease-and-desist letter from her campaign.
-
AI incident: sexual content (Mar 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 21 March 2024. Risk classification, related incidents and the laws on record for this risk area.
-
AI incident: sexual content (Mar 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 19 March 2024. Risk classification, related incidents and the laws on record for this risk area.
-
Alleged Deepfake Video Depicts Former President of Kenya Uhuru Kenyatta Announcing 2027 Presidential Bid AIID ↗
A widely shared TikTok video purportedly manipulated by AI depicts former Kenyan president Uhuru Kenyatta announcing a 2027 presidential run. Reported digital forensics and visual inconsistencies confirm the video is an AI-generated deepfake, using archival footage from his presidency with synthesized audio. The clip spread rapidly online but has reportedly been debunked by fact-checkers. Kenyatta has made no such announcement, and such a move would violate Kenya's two-term constitutional limit.
-
AI incident: sexual content (Mar 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 14 March 2024. Risk classification, related incidents and the laws on record for this risk area.
-
Cartels Reportedly Using AI to Expand Operations into Financial Fraud and Human Trafficking AIID ↗
The Jalisco New Generation Cartel is reportedly using AI to expand its financial fraud and human trafficking operations, coercing individuals into illegal activities under the guise of legitimate jobs. INTERPOL warns that this integration of AI into criminal enterprises is a growing trend among cartels across Europe, Asia, and Africa as well.
-
Manipulated Media via AI Disinformation and Deepfakes in 2024 Elections Erode Trust Across More Than 50 Countries AIID ↗
AI-driven election disinformation is escalating globally, leveraging easy-to-use generative AI tools to create convincing deepfakes that mislead voters. This shift has simplified the process for individuals to generate fake content, having already eroded trust in elections by undermining public trust and manipulating voter perceptions. Evidence has, for example, been documented in incidents across the U.S., Moldova, Slovakia, Bangladesh, and Taiwan.
-
Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images AIID ↗
A Microsoft engineer reported that Copilot Designer, an AI image generator, creates content depicting sex, violence, bias, and more. Despite raising concerns and suggesting improvements, the tool remains public, prompting a letter to the FTC.
-
AI-Generated Images of Trump with Black Voters Spread as Disinformation Before U.S. Primary Elections AIID ↗
In the run-up to the U.S. primary elections, supporters of Donald Trump shared AI-generated images showing him with Black voters in an attempt to sway African-American votes. These deepfakes, including Trump's distorted hand visuals, were initially created by satirical accounts but were later misappropriated for political disinformation, misleading millions on social media platforms.
-
Deepfake ID Sales Allegedly Persist as OnlyFake Reportedly Relaunches with New Fraud Tools AIID ↗
Researchers from Au10tix discovered the relaunch of OnlyFake, a site offering AI-generated fake IDs. Despite an earlier takedown, the site reemerged with disclaimers and new tools, including handwritten signature generation. These fakes are challenging biometric verification systems and are reportedly being used to perpetuate fraudulent activity.
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
What is recorded in each incident?
What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
Does an incident mean wrongdoing was proven?
No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
How current is the incident data?
It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
Does this page include the full incident reports?
No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.