AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims AIID ↗
An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.
-
Purportedly AI-Generated Deepfake Investment Ads Defrauded 5,000 Swedish Investors of 500 Million SEK AIID ↗
At least 5,000 Swedish investors were reportedly defrauded of around 500 million SEK (~$52.5 million USD) in 2025 through purportedly AI-generated deepfake investment ads circulated on Meta platforms. Fraudsters allegedly used fabricated videos and profiles of well-known finance figures such as journalist Gabriel Mellqvist and investor Günter Mårder to promote false stock tips in pump-and-dump schemes.
-
Purported Deepfake Video Impersonating Elton John Reportedly Induced Northeast Ohio Man to Authorize $20,000 in Scam Charges AIID ↗
A Northeast Ohio man ("Ray," pseudonym) was allegedly lured by a social-media deepfake video impersonating Elton John into a "push button" scam promising easy income from an online store. Ray reportedly said he was directed by purported "representatives" to open accounts and credit cards, after which charges accumulated to about $20,000. He later reported one card credited $9,400.
-
Purported Deepfake Mimicking RTÉ Broadcast Falsely Announced Irish Presidential Candidate Catherine Connolly's Withdrawal AIID ↗
A purported deepfake video circulated online that is alleged to have falsely depicted Irish presidential candidate Catherine Connolly announcing her withdrawal from the race. The clip reportedly mimicked an RTÉ news broadcast and spread across social media before being reported to the Electoral Commission. Connolly reportedly condemned the video as a malicious attempt to mislead voters and undermine democratic trust.
-
Google's Bard, Gemini, and Gemma AI Systems Allegedly Generated Defamatory Claims About Activist Robby Starbuck, Prompting Lawsuit AIID ↗
Conservative activist Robby Starbuck reportedly filed a defamation lawsuit against Google, alleging its Bard, Gemini, and Gemma AI systems generated false statements linking him to sexual assault and extremist activity. Starbuck claims the outputs caused reputational harm and sought over $15 million in damages. Google acknowledged the hallucinations as known LLM behavior and stated it works to minimize such inaccuracies. See also Incident 1247.
-
Westlaw CoCounsel Reportedly Generated False Legal Quotations in United States v. Farris AIID ↗
In United States v. Farris, court-appointed attorney Steven N. Howe admitted using Westlaw CoCounsel to draft appellate briefs that reportedly included AI-generated false quotations and misleading descriptions of precedent. The filing disrupted Farris's appeal, leading the court to appoint new counsel and restart briefing, while Howe lost his compensation and faced possible disciplinary action.
-
Virginia Candidate John Reid Reportedly Used AI-Generated Deepfake of Opponent Ghazala Hashmi in Simulated Political Debate AIID ↗
Republican Virginia lieutenant governor candidate John Reid reportedly held a 40-minute mock debate against a purportedly AI-generated version of Democratic opponent Sen. Ghazala Hashmi. The bot reportedly mimicked her voice and synthesized responses trained on her public statements. Hashmi's campaign denounced the nonconsensual likeness as a "shoddy gimmick."
-
California Immigration Attorneys Reportedly Sanctioned Over Briefs Containing Probable Hallucinations in LNU v. Blanche AIID ↗
California immigration attorneys Mike Singh Sethi and William Rounds were reportedly sanctioned in LNU v. Blanche after Ninth Circuit filings included purportedly fabricated and materially inaccurate legal authorities. The court said unauthorized generative AI use by unlicensed brief writers was probable and found that the attorneys failed to verify the filings and repeatedly lacked candor about the errors' source.
-
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School AIID ↗
A purportedly AI-powered gun detection system at Kenwood High School in Baltimore County, Maryland, reportedly misidentified a student's empty Doritos bag as a firearm. Armed police reportedly detained and handcuffed the student before determining there was no weapon. The AI system, operated by Omnilert, issued the false alert, leading to public outcry and an official review of school security protocols. Omnilert reportedly expressed regret for the incident.
-
AWS Outage Reportedly Caused AI-Enabled Eight Sleep Smart Beds to Overheat and Malfunction AIID ↗
The widespread Amazon Web Services (AWS) outage on October 20, 2025 reportedly caused AI-enabled Eight Sleep "Pod" smart beds to overheat or become unresponsive. The devices reportedly rely on a cloud-hosted deep learning algorithm to regulate temperature and track sleep data. When AWS went down, users reportedly lost control of their beds, which remained stuck at prior settings. Some reported overheating and incline malfunctions. Eight Sleep confirmed it is developing an offline "outage mode."
-
Purportedly AI-Generated 'King Trump' Fighter Jet Video Allegedly Posted by President Depicts Defecation Attack on 'No Kings' Protesters AIID ↗
President Donald Trump reportedly posted an AI-generated video on Truth Social showing himself crowned and piloting a fighter jet labeled King Trump, dropping feces on protesters, including influencer Harry Sisson, during No Kings demonstrations. The clip, allegedly created by another account, drew criticism from Sisson and musician Kenny Loggins, whose song "Danger Zone" was reportedly used without consent.
-
Purported Deepfake Video Allegedly Shows Conservative MP George Freeman Leaving Party for Reform UK AIID ↗
A purported AI-generated deepfake video circulated online falsely depicting UK Conservative MP George Freeman announcing his defection to the Reform UK party. The fabricated clip, which mimicked Freeman’s likeness and voice without his knowledge or consent, included statements critical of the Conservatives and was widely shared on social media. Freeman denounced the video as disinformation, reported it to police, and warned that such synthetic media pose serious risks to democratic processes.
-
Purported AI-Generated Video Reportedly Used in RM5,800 (~$1,400) Sextortion Attempt Targeting Malaysian Minor via Telegram AIID ↗
A Malaysian family reported that scammers used purported AI-generated explicit video content to target their teenage son in a sextortion attempt. The perpetrators allegedly contacted the boy via Telegram, sending manipulated footage that depicted him in compromising situations and demanding RM5,800 (~$1,400) to prevent its release. The family alerted authorities and warned others about the growing use of generative AI in targeting minors.
-
Purported AI-Generated Deepfake Video Reportedly Depicts Senator Chuck Schumer Endorsing Government Shutdown in NRSC Campaign Ad AIID ↗
The National Republican Senatorial Committee (NRSC) allegedly released a 30-second campaign ad featuring a purported deepfake video of Senator Chuck Schumer repeatedly saying, "Every day gets better for us," implying enthusiasm for a government shutdown. While the video reportedly was marked as AI-generated, it was widely circulated on social media and drew criticism from journalists and researchers, who warned it could mislead voters and erode trust in authentic political communication.
-
ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon AIID ↗
During an immigration enforcement operation in Oregon, U.S. Immigration and Customs Enforcement (ICE) officers reportedly used the facial recognition application Mobile Fortify to identify a detained woman. The system reportedly returned two different and incorrect identities for the same individual across separate scans.
-
Multiple Purported AI-Assisted Cheating Incidents Reported Across South Korea's SKY Universities During October 2025 Midterms AIID ↗
Reports from South Korea's SKY universities indicate multiple AI-assisted cheating incidents during the October 2025 midterms. At Yonsei, dozens reportedly used ChatGPT and other tools despite bans in an Oct. 15 online exam. Korea University and Seoul National reportedly found students using AI or sharing answers via group chats, prompting punitive sanctions across the institutions.
-
Purportedly AI-Generated Hunting Regulation Errors Reportedly Lead to Idaho Citation and Multi-State Warnings from Wildlife Agencies AIID ↗
A hunter in Idaho was reportedly cited for hunting a day early after relying on an AI-generated search result that misrepresented state regulations, pulling information from a failed proposal. Wildlife agencies in Idaho, Wyoming, Illinois, and Maine later warned of similar AI errors.
-
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online AIID ↗
New South Wales police in Australia launched an investigation after parents reported that purported AI-generated sexually explicit images of female students from a Sydney high school had been created and circulated online. The reported manipulated images, produced without consent using deepfake tools, prompted school involvement and a criminal probe under new state laws banning such content.
-
Reportedly Fatal Xiaomi SU7 Ultra Crash in Chengdu Purportedly Involves Automated Driving Failure and Door Lock Malfunction AIID ↗
A reportedly fatal crash involving a Xiaomi SU7 Ultra electric vehicle in Chengdu, China, occurred after the car's automated driving system and sensor-dependent electronic door handles reportedly failed following a collision. Bystanders were reportedly unable to open the doors as the vehicle caught fire, and the driver died at the scene, prompting scrutiny of automation-linked design risks. Following the incident, Xiaomi's stock reportedly fell more than 5% amid mounting safety concerns.
-
OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions AIID ↗
An NBC News investigation found that OpenAI's language models o4-mini, GPT-5-mini, oss-20b, and oss-120b could be jailbroken under normal usage conditions to bypass safety guardrails and generate detailed instructions for creating chemical, biological, and nuclear weapons. Using a publicly documented jailbreak prompt, reporters repeatedly elicited hazardous outputs such as steps to synthesize pathogens or maximize harm with chemical agents. The findings reportedly revealed significant real-world
-
ChatGPT-Generated Image of Nonexistent 'Homeless Man' Was Used in False St. Petersburg, Florida Burglary and Sexual Battery Reports AIID ↗
A St. Petersburg, Florida woman, Brooke Schinault, used a ChatGPT-generated image of a nonexistent man while falsely reporting that he broke into her home and sexually battered her. Police said the image resembled a viral "AI homeless man" prank and was found in a deleted folder dated before the alleged attack. The report prompted officers, rescue personnel, a detective, and forensic DNA collection. She later pleaded no contest and was adjudged guilty of misdemeanor false reporting.
-
Purported Deepfake Explicit Images of Middle School Students Allegedly Created and Circulated Using Mobile App in Goffstown, New Hampshire AIID ↗
In Goffstown, New Hampshire, unnamed eighth-grade boys at Mountain View Middle School allegedly used an AI-enabled app to create and circulate sexualized deepfake images and videos depicting female classmates.
-
Purportedly AI-Generated Home Intruder Videos Allegedly Prompt Dozens of Dutch Police Call-Outs AIID ↗
Dutch police reported that children used purported AI tools to generate fake videos showing a homeless intruder inside their homes, which parents believed were real. The clips allegedly triggered dozens of emergency call-outs and at least two helicopter searches for nonexistent burglars. Police posted a TikTok warning after repeated false alarms, noting the strain on resources and urging families to stop the prank.
-
Bodycam Footage Reportedly Contradicted Purportedly ChatGPT-Generated Use-of-Force Narrative by Immigration Agent AIID ↗
Body-worn camera footage released in litigation over Operation Midway Blitz reportedly showed that an immigration agent used ChatGPT to generate a long-form use-of-force narrative based on minimal inputs. A federal judge found that multiple AI-assisted reports conflicted with contemporaneous video evidence, undermining their accuracy and credibility and raising concerns about the use of generative AI in official law enforcement reporting.
-
Old Mutual Reportedly Warns of Purported Deepfake Videos Impersonating Chairman Trevor Manuel in Investment Scams AIID ↗
Old Mutual of South Africa reportedly warned of purported deepfake videos impersonating its chairman, former finance minister Trevor Manuel, promoting fake investment schemes on social media. The purported AI-generated videos used his likeness and cloned voice to solicit funds, prompting a public statement from Manuel denying involvement.
-
Purportedly AI-Generated 'Home Invasion Prank' Images Reportedly Circulate in Ireland, Causing Panic and False Emergency Calls AIID ↗
Irish police (Garda Síochána) reportedly issued a public warning after a viral "home invasion" prank spread on social media. The prank allegedly uses AI image-generation filters to insert a fake intruder into photos of family homes and send them to relatives, often elderly, claiming someone has broken in. The hoax reportedly caused panic and distress, and multiple false 999 calls diverted Garda resources, prompting an official appeal to stop the trend.
-
Zoetis Vetscan Imagyst Allegedly Misclassified Dog's Cancerous Tumor, Leading to Second Surgery and Death AIID ↗
In October 2025, Columbia Veterinary Hospital in The Dalles, Oregon reportedly used Zoetis's Vetscan Imagyst AI to analyze a rapidly growing neck mass in an 11-year-old Belgian Tervuren. The system allegedly classified the mass as inflammatory, while a later biopsy found aggressive cancer. The hospital alleges the first surgery failed to remove all cancer, requiring a second operation; the dog died from complications. Zoetis allegedly later apologized and said similar incidents had occurred.
-
AI-Themed Investment Scam Network Reportedly Used Keitaro Cloaking Across 15,500 Domains AIID ↗
Researchers reported that threat actors abused Keitaro Tracker infrastructure to cloak and route AI-themed investment scams across about 15,500 domains. The campaigns allegedly used AI-trading claims, deepfake videos or imagery, generative AI-produced copy and visuals, spoofed news pages, and fraudulent trading platforms to target potential victims while hiding scam content from scanners and reviewers.
-
Purportedly AI-Generated Deepfake Ads on Instagram Impersonate Gisele Bündchen and Other Celebrities in Brazilian Fraud Scheme AIID ↗
Police in Brazil reportedly arrested four suspects accused of using purportedly AI-generated deepfake videos of model Gisele Bündchen and other celebrities in Instagram ads to promote fake giveaways and skincare products. The scheme was allegedly active since at least August 2024 and generated over 20 million reais ($3.9 million) in suspicious funds. Victims allegedly lost small amounts that often went unreported, creating what investigators called "statistical immunity."
-
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates AIID ↗
A Tech Transparency Project investigation identified purportedly AI-generated deepfake ads on Facebook impersonating President Trump, Elon Musk, Rep. Alexandria Ocasio-Cortez, Senators Elizabeth Warren and Bernie Sanders, and Press Secretary Karoline Leavitt. The ads allegedly promoted fake $5,000 government rebates and similar scams, reportedly misleading users and generating ad revenue for Meta before removal.
-
Purported AI-Enabled Pro-Russian Influence Campaign Centered on Burkina Faso's Ibrahim Traoré and Disseminated Across African Media AIID ↗
Reports describe a purported AI-enabled influence and disinformation campaign centered on Burkina Faso's junta leader Ibrahim Traoré. Dozens of purported AI-generated or AI-manipulated videos, allegedly produced by groups such as Black Rebellion and Univers Inspirant, have circulated widely across African media promoting pro-Traoré and pro-Russian narratives, with similar synthetic content appearing during regional conflicts and political events.
-
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru AIID ↗
Two tourists in Peru reportedly relied on AI-generated travel information describing a nonexistent destination called the "Sacred Canyon of Humantay." One tourist had paid nearly $160 to reach a rural road near Mollepata without a guide or actual destination. Trek operator Miguel Ángel Góngora Meza intervened after seeing the purportedly AI-generated itinerary and warned that such misinformation could expose travelers to serious risks in high-altitude Andean terrain.
-
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan AIID ↗
Dana Yao and her husband, Robert, reportedly used ChatGPT to plan a sunset hike on Mount Misen in Japan. ChatGPT allegedly told them the last ropeway departed at 5:30 PM, but the service had already closed when they reached the summit, leaving them stranded.
-
Google Gemini Reportedly Reinforced Delusions, Allegedly Contributing to Florida User's Near-Harm Episode and Suicide AIID ↗
According to a March 2026 wrongful-death complaint, Google's Gemini allegedly reinforced Jonathan Gavalas's delusions, sent him on a failed mission near Miami International Airport that risked serious violence, and later framed suicide as "transference," purportedly contributing to his death on October 2, 2025. Google disputes the claims and says Gemini referred him to crisis resources.
-
YouTube Channel Reportedly Posts Purported Deepfake Video of Rajat Sharma Announcing India-Bangladesh Conflict AIID ↗
A purported deepfake video depicting Indian journalist Rajat Sharma reporting on a potential India-Bangladesh war was uploaded to the YouTube channel The Real Report. Fact-checkers reportedly found no such broadcast existed and, according to their metrics, verified that the clip was likely AI-generated.
-
Donald Trump Reportedly Posts Purported AI-Modified Video of Chuck Schumer and Hakeem Jeffries During U.S. Government Shutdown Talks AIID ↗
President Donald Trump reportedly posted a purportedly AI-modified video on Truth Social depicting Senate Minority Leader Chuck Schumer making fabricated statements and House Minority Leader Hakeem Jeffries in a sombrero. Critics, including Jeffries and Rep. Ro Khanna, reportedly condemned the video as racist and misleading during budget negotiations over a looming government shutdown. The AI tool used for modification has not been identified.
-
Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures AIID ↗
In a first-of-its-kind case under Australia's Online Safety Act, the Federal Court ordered Anthony Rotondo to pay $343,500 plus costs for creating and sharing nonconsensual deepfake pornographic images of prominent Australian women on MrDeepFakes.com. After reportedly receiving a removal notice in 2023, Rotondo defied authorities, emailed the images to dozens of recipients, and was later found in contempt. The images were reportedly taken down after he provided account access to investigators.
-
Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play AIID ↗
An Australian IT professional, Samuel McCarthy, reportedly recorded an interaction with the Nomi AI chatbot in which it allegedly encouraged him, posing as a 15-year-old, to murder his father. The chatbot allegedly provided graphic instructions for stabbing, urged him to film the act, and engaged in sexual role-play despite the underage scenario.
-
Purportedly AI-Edited Obscene Clip Reportedly Impersonated Thai Actor Khunnapat Pichetworawut in Paid Scam AIID ↗
Thai actor Khunnapat Pichetworawut reportedly said scammers used AI to edit his face and private chat images into an obscene video purportedly presented as a leaked clip of him and sold access through private groups for about 800–1,000 baht. Reports say the material circulated on X.
-
Gaggle Alert Reportedly Leads to Arrest of 15-Year-Old in Volusia County, Florida, for School Threat the Student Claimed Was Not Serious AIID ↗
A 15-year-old student in Volusia County, Florida, was reportedly detained after the Gaggle student monitoring system flagged a written shooting threat on a school-issued laptop. The student reportedly claims the threat was not serious. The alert reportedly led to the student's arrest on felony charges. The system appeared to operate as designed but reportedly resulted in criminal enforcement against a minor.
-
Purportedly AI-Generated False Citations in Arizona Probate Appeal Reportedly Led to Sanctions Against Self-Represented Appellant AIID ↗
Self-represented appellant Jeffrey Kotchka reportedly used purported AI tools to prepare an opening brief in a probate dispute involving his late mother's estate. The Arizona Court of Appeals found six of its eight citations deficient, including two nonexistent cases, and said Kotchka had made no effort to verify them. The court affirmed the appointment of his sister, Kim Dineen, as personal representative, ordering Kotchka to pay her attorney fees attributable to addressing the false citations.
-
Purported AI-Generated Deepfake of Irish Fine Gael Presidential Candidate Heather Humphreys Used in Fake Investment Videos on Meta Platforms AIID ↗
Purported deepfake videos reportedly circulated on Meta platforms cloning Irish Fine Gael presidential candidate Heather Humphreys to allegedly portray her endorsing high-return investment schemes. The purportedly AI-generated image and voice cloning aimed to exploit public trust and lure consumers into fraud. The Bank of Ireland warned of further scams and risks.
-
Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage AIID ↗
Multiple AI systems allegedly spread false claims in the aftermath of Charlie Kirk's assassination at Utah Valley University. Perplexity and Grok chatbots reportedly stated Kirk was alive, mischaracterized authentic video as satire, and wrongly identified Utah Democrat Michael Mallinson as the suspect. A Google AI Overview allegedly claimed Kirk was on Ukraine's Myrotvorets "enemies" list, a reported falsehood that echoed pro-Kremlin narratives.
-
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections AIID ↗
Researchers and European officials reported that Russian operatives have been using purportedly AI-generated posts, videos, and websites to influence Moldova's September 2025 parliamentary elections. Networks of over 900 accounts across TikTok, Facebook, Instagram, Telegram, and YouTube have reportedly spread fabricated narratives, including reportedly misogynistic and false smears of President Maia Sandu.
-
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam AIID ↗
A Facebook post reportedly used a deepfake-altered clip of then-Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan to promote investment in the "Power of Siberia-2" pipeline and direct viewers to a registration website. The video allegedly modified a 2024 MONGOL TV interview with altered lip movement and added Russian audio, while the linked site sought personal information.
-
Philippines Senate Hearing Featured Reports of Purported AI-Generated Deepfake Pornography Targeting Actress Angel Aquino and Content Creator Queen Hera's Daughter AIID ↗
In Manila, actress Angel Aquino reportedly said in a hearing how AI-generated deepfake porn video unlawfully used her face. She reportedly testified at a Senate hearing led by Sen. Risa Hontiveros and urged punishment for creators and those sharing the purported deepfakes. Influencer Queen Hera also reported a deepfake image of her daughter on the dark web; tools and perpetrators were reportedly not identified.
-
Nigeria-Based YouTube Network Allegedly Uses AI Voiceovers and Anchors to Amplify Pro-Kremlin Narratives AIID ↗
A network of five Nigeria-based YouTube channels reportedly drew millions of views while purportedly amplifying Kremlin-aligned narratives. The channels allegedly used AI-generated anchors and synthetic voiceovers to present repurposed interviews with pro-Russian commentators Scott Ritter and Douglas Macgregor. Attribution of the network's motives and funding remains uncertain, with reported possibilities ranging from freelance monetization to proxy involvement in influence operations.
-
AI-Powered Taco Bell Drive-Thru Reportedly Disrupted by Viral Prank Ordering 18,000 Water Cups AIID ↗
Taco Bell's voice-based drive-thru system was reportedly overwhelmed after a prankster ordered 18,000 water cups, reportedly causing the AI to stall mid-interaction and forcing staff to intervene. Purportedly viral clips of repeated misinterpretations prompted the company to reassess where and when to deploy the system, as customer frustration and operational disruptions mounted across participating locations.
-
Purported Deepfake Reportedly Circulated on Facebook Impersonating Thai PBS World Anchors and Business Figures to Solicit Investments AIID ↗
A purported deepfake video circulating on Facebook allegedly used AI-generated visuals and voice synthesis to impersonate Thai PBS World anchors and prominent business figures, promoting a fraudulent "Crystallum AI" investment promising fivefold returns. The original clip was reportedly traced to a 2013 NHK report, but it misused logos and likenesses.
-
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts AIID ↗
Testing by Common Sense Media and Stanford clinicians reportedly found Meta's AI chatbot, embedded in Instagram and Facebook, produced unsafe responses to teen accounts. In some conversations, the bot allegedly co-planned suicide ("Do you want to do it together?"), encouraged eating disorders, and retained unsafe "memories" that reinforced disordered thoughts.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.