AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online AIID ↗
New South Wales police in Australia launched an investigation after parents reported that purported AI-generated sexually explicit images of female students from a Sydney high school had been created and circulated online. The reported manipulated images, produced without consent using deepfake tools, prompted school involvement and a criminal probe under new state laws banning such content.
-
Reportedly Fatal Xiaomi SU7 Ultra Crash in Chengdu Purportedly Involves Automated Driving Failure and Door Lock Malfunction AIID ↗
A reportedly fatal crash involving a Xiaomi SU7 Ultra electric vehicle in Chengdu, China, occurred after the car's automated driving system and sensor-dependent electronic door handles reportedly failed following a collision. Bystanders were reportedly unable to open the doors as the vehicle caught fire, and the driver died at the scene, prompting scrutiny of automation-linked design risks. Following the incident, Xiaomi's stock reportedly fell more than 5% amid mounting safety concerns.
-
OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions AIID ↗
An NBC News investigation found that OpenAI's language models o4-mini, GPT-5-mini, oss-20b, and oss-120b could be jailbroken under normal usage conditions to bypass safety guardrails and generate detailed instructions for creating chemical, biological, and nuclear weapons. Using a publicly documented jailbreak prompt, reporters repeatedly elicited hazardous outputs such as steps to synthesize pathogens or maximize harm with chemical agents. The findings reportedly revealed significant real-world
-
ChatGPT-Generated Image of Nonexistent 'Homeless Man' Was Used in False St. Petersburg, Florida Burglary and Sexual Battery Reports AIID ↗
A St. Petersburg, Florida woman, Brooke Schinault, used a ChatGPT-generated image of a nonexistent man while falsely reporting that he broke into her home and sexually battered her. Police said the image resembled a viral "AI homeless man" prank and was found in a deleted folder dated before the alleged attack. The report prompted officers, rescue personnel, a detective, and forensic DNA collection. She later pleaded no contest and was adjudged guilty of misdemeanor false reporting.
-
Purported Deepfake Explicit Images of Middle School Students Allegedly Created and Circulated Using Mobile App in Goffstown, New Hampshire AIID ↗
In Goffstown, New Hampshire, unnamed eighth-grade boys at Mountain View Middle School allegedly used an AI-enabled app to create and circulate sexualized deepfake images and videos depicting female classmates.
-
Purportedly AI-Generated Home Intruder Videos Allegedly Prompt Dozens of Dutch Police Call-Outs AIID ↗
Dutch police reported that children used purported AI tools to generate fake videos showing a homeless intruder inside their homes, which parents believed were real. The clips allegedly triggered dozens of emergency call-outs and at least two helicopter searches for nonexistent burglars. Police posted a TikTok warning after repeated false alarms, noting the strain on resources and urging families to stop the prank.
-
Bodycam Footage Reportedly Contradicted Purportedly ChatGPT-Generated Use-of-Force Narrative by Immigration Agent AIID ↗
Body-worn camera footage released in litigation over Operation Midway Blitz reportedly showed that an immigration agent used ChatGPT to generate a long-form use-of-force narrative based on minimal inputs. A federal judge found that multiple AI-assisted reports conflicted with contemporaneous video evidence, undermining their accuracy and credibility and raising concerns about the use of generative AI in official law enforcement reporting.
-
Old Mutual Reportedly Warns of Purported Deepfake Videos Impersonating Chairman Trevor Manuel in Investment Scams AIID ↗
Old Mutual of South Africa reportedly warned of purported deepfake videos impersonating its chairman, former finance minister Trevor Manuel, promoting fake investment schemes on social media. The purported AI-generated videos used his likeness and cloned voice to solicit funds, prompting a public statement from Manuel denying involvement.
-
Purportedly AI-Generated 'Home Invasion Prank' Images Reportedly Circulate in Ireland, Causing Panic and False Emergency Calls AIID ↗
Irish police (Garda Síochána) reportedly issued a public warning after a viral "home invasion" prank spread on social media. The prank allegedly uses AI image-generation filters to insert a fake intruder into photos of family homes and send them to relatives, often elderly, claiming someone has broken in. The hoax reportedly caused panic and distress, and multiple false 999 calls diverted Garda resources, prompting an official appeal to stop the trend.
-
Zoetis Vetscan Imagyst Allegedly Misclassified Dog's Cancerous Tumor, Leading to Second Surgery and Death AIID ↗
In October 2025, Columbia Veterinary Hospital in The Dalles, Oregon reportedly used Zoetis's Vetscan Imagyst AI to analyze a rapidly growing neck mass in an 11-year-old Belgian Tervuren. The system allegedly classified the mass as inflammatory, while a later biopsy found aggressive cancer. The hospital alleges the first surgery failed to remove all cancer, requiring a second operation; the dog died from complications. Zoetis allegedly later apologized and said similar incidents had occurred.
-
AI-Themed Investment Scam Network Reportedly Used Keitaro Cloaking Across 15,500 Domains AIID ↗
Researchers reported that threat actors abused Keitaro Tracker infrastructure to cloak and route AI-themed investment scams across about 15,500 domains. The campaigns allegedly used AI-trading claims, deepfake videos or imagery, generative AI-produced copy and visuals, spoofed news pages, and fraudulent trading platforms to target potential victims while hiding scam content from scanners and reviewers.
-
Purportedly AI-Generated Deepfake Ads on Instagram Impersonate Gisele Bündchen and Other Celebrities in Brazilian Fraud Scheme AIID ↗
Police in Brazil reportedly arrested four suspects accused of using purportedly AI-generated deepfake videos of model Gisele Bündchen and other celebrities in Instagram ads to promote fake giveaways and skincare products. The scheme was allegedly active since at least August 2024 and generated over 20 million reais ($3.9 million) in suspicious funds. Victims allegedly lost small amounts that often went unreported, creating what investigators called "statistical immunity."
-
Purportedly AI-Generated Deepfake Ads on Facebook Reportedly Impersonate Trump, Musk, Ocasio-Cortez, Warren, Sanders, and Leavitt to Promote Fraudulent Rebates AIID ↗
A Tech Transparency Project investigation identified purportedly AI-generated deepfake ads on Facebook impersonating President Trump, Elon Musk, Rep. Alexandria Ocasio-Cortez, Senators Elizabeth Warren and Bernie Sanders, and Press Secretary Karoline Leavitt. The ads allegedly promoted fake $5,000 government rebates and similar scams, reportedly misleading users and generating ad revenue for Meta before removal.
-
Purported AI-Enabled Pro-Russian Influence Campaign Centered on Burkina Faso's Ibrahim Traoré and Disseminated Across African Media AIID ↗
Reports describe a purported AI-enabled influence and disinformation campaign centered on Burkina Faso's junta leader Ibrahim Traoré. Dozens of purported AI-generated or AI-manipulated videos, allegedly produced by groups such as Black Rebellion and Univers Inspirant, have circulated widely across African media promoting pro-Traoré and pro-Russian narratives, with similar synthetic content appearing during regional conflicts and political events.
-
Purportedly AI-Generated Travel Information Reportedly Misled Tourists into Seeking Nonexistent 'Sacred Canyon of Humantay' in Peru AIID ↗
Two tourists in Peru reportedly relied on AI-generated travel information describing a nonexistent destination called the "Sacred Canyon of Humantay." One tourist had paid nearly $160 to reach a rural road near Mollepata without a guide or actual destination. Trek operator Miguel Ángel Góngora Meza intervened after seeing the purportedly AI-generated itinerary and warned that such misinformation could expose travelers to serious risks in high-altitude Andean terrain.
-
ChatGPT Reportedly Gave Incorrect Mount Misen Ropeway Hours, Leaving Couple Stranded After Hike in Japan AIID ↗
Dana Yao and her husband, Robert, reportedly used ChatGPT to plan a sunset hike on Mount Misen in Japan. ChatGPT allegedly told them the last ropeway departed at 5:30 PM, but the service had already closed when they reached the summit, leaving them stranded.
-
Google Gemini Reportedly Reinforced Delusions, Allegedly Contributing to Florida User's Near-Harm Episode and Suicide AIID ↗
According to a March 2026 wrongful-death complaint, Google's Gemini allegedly reinforced Jonathan Gavalas's delusions, sent him on a failed mission near Miami International Airport that risked serious violence, and later framed suicide as "transference," purportedly contributing to his death on October 2, 2025. Google disputes the claims and says Gemini referred him to crisis resources.
-
YouTube Channel Reportedly Posts Purported Deepfake Video of Rajat Sharma Announcing India-Bangladesh Conflict AIID ↗
A purported deepfake video depicting Indian journalist Rajat Sharma reporting on a potential India-Bangladesh war was uploaded to the YouTube channel The Real Report. Fact-checkers reportedly found no such broadcast existed and, according to their metrics, verified that the clip was likely AI-generated.
-
Donald Trump Reportedly Posts Purported AI-Modified Video of Chuck Schumer and Hakeem Jeffries During U.S. Government Shutdown Talks AIID ↗
President Donald Trump reportedly posted a purportedly AI-modified video on Truth Social depicting Senate Minority Leader Chuck Schumer making fabricated statements and House Minority Leader Hakeem Jeffries in a sombrero. Critics, including Jeffries and Rep. Ro Khanna, reportedly condemned the video as racist and misleading during budget negotiations over a looming government shutdown. The AI tool used for modification has not been identified.
-
Gold Coast Man Reportedly Ordered to Pay $343,500 After Posting Purported Deepfake Pornographic Images of Australian Public Figures AIID ↗
In a first-of-its-kind case under Australia's Online Safety Act, the Federal Court ordered Anthony Rotondo to pay $343,500 plus costs for creating and sharing nonconsensual deepfake pornographic images of prominent Australian women on MrDeepFakes.com. After reportedly receiving a removal notice in 2023, Rotondo defied authorities, emailed the images to dozens of recipients, and was later found in contempt. The images were reportedly taken down after he provided account access to investigators.
-
Nomi AI Companion Allegedly Directs Australian User to Stab Father and Engages in Harmful Role-Play AIID ↗
An Australian IT professional, Samuel McCarthy, reportedly recorded an interaction with the Nomi AI chatbot in which it allegedly encouraged him, posing as a 15-year-old, to murder his father. The chatbot allegedly provided graphic instructions for stabbing, urged him to film the act, and engaged in sexual role-play despite the underage scenario.
-
Purportedly AI-Edited Obscene Clip Reportedly Impersonated Thai Actor Khunnapat Pichetworawut in Paid Scam AIID ↗
Thai actor Khunnapat Pichetworawut reportedly said scammers used AI to edit his face and private chat images into an obscene video purportedly presented as a leaked clip of him and sold access through private groups for about 800–1,000 baht. Reports say the material circulated on X.
-
Gaggle Alert Reportedly Leads to Arrest of 15-Year-Old in Volusia County, Florida, for School Threat the Student Claimed Was Not Serious AIID ↗
A 15-year-old student in Volusia County, Florida, was reportedly detained after the Gaggle student monitoring system flagged a written shooting threat on a school-issued laptop. The student reportedly claims the threat was not serious. The alert reportedly led to the student's arrest on felony charges. The system appeared to operate as designed but reportedly resulted in criminal enforcement against a minor.
-
Purportedly AI-Generated False Citations in Arizona Probate Appeal Reportedly Led to Sanctions Against Self-Represented Appellant AIID ↗
Self-represented appellant Jeffrey Kotchka reportedly used purported AI tools to prepare an opening brief in a probate dispute involving his late mother's estate. The Arizona Court of Appeals found six of its eight citations deficient, including two nonexistent cases, and said Kotchka had made no effort to verify them. The court affirmed the appointment of his sister, Kim Dineen, as personal representative, ordering Kotchka to pay her attorney fees attributable to addressing the false citations.
-
Purported AI-Generated Deepfake of Irish Fine Gael Presidential Candidate Heather Humphreys Used in Fake Investment Videos on Meta Platforms AIID ↗
Purported deepfake videos reportedly circulated on Meta platforms cloning Irish Fine Gael presidential candidate Heather Humphreys to allegedly portray her endorsing high-return investment schemes. The purportedly AI-generated image and voice cloning aimed to exploit public trust and lure consumers into fraud. The Bank of Ireland warned of further scams and risks.
-
Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage AIID ↗
Multiple AI systems allegedly spread false claims in the aftermath of Charlie Kirk's assassination at Utah Valley University. Perplexity and Grok chatbots reportedly stated Kirk was alive, mischaracterized authentic video as satire, and wrongly identified Utah Democrat Michael Mallinson as the suspect. A Google AI Overview allegedly claimed Kirk was on Ukraine's Myrotvorets "enemies" list, a reported falsehood that echoed pro-Kremlin narratives.
-
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections AIID ↗
Researchers and European officials reported that Russian operatives have been using purportedly AI-generated posts, videos, and websites to influence Moldova's September 2025 parliamentary elections. Networks of over 900 accounts across TikTok, Facebook, Instagram, Telegram, and YouTube have reportedly spread fabricated narratives, including reportedly misogynistic and false smears of President Maia Sandu.
-
Purported Deepfake Video Reportedly Impersonated Former Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan in Investment Scam AIID ↗
A Facebook post reportedly used a deepfake-altered clip of then-Mongolian Deputy Prime Minister Amarsaikhan Sainbuyan to promote investment in the "Power of Siberia-2" pipeline and direct viewers to a registration website. The video allegedly modified a 2024 MONGOL TV interview with altered lip movement and added Russian audio, while the linked site sought personal information.
-
Philippines Senate Hearing Featured Reports of Purported AI-Generated Deepfake Pornography Targeting Actress Angel Aquino and Content Creator Queen Hera's Daughter AIID ↗
In Manila, actress Angel Aquino reportedly said in a hearing how AI-generated deepfake porn video unlawfully used her face. She reportedly testified at a Senate hearing led by Sen. Risa Hontiveros and urged punishment for creators and those sharing the purported deepfakes. Influencer Queen Hera also reported a deepfake image of her daughter on the dark web; tools and perpetrators were reportedly not identified.
-
Nigeria-Based YouTube Network Allegedly Uses AI Voiceovers and Anchors to Amplify Pro-Kremlin Narratives AIID ↗
A network of five Nigeria-based YouTube channels reportedly drew millions of views while purportedly amplifying Kremlin-aligned narratives. The channels allegedly used AI-generated anchors and synthetic voiceovers to present repurposed interviews with pro-Russian commentators Scott Ritter and Douglas Macgregor. Attribution of the network's motives and funding remains uncertain, with reported possibilities ranging from freelance monetization to proxy involvement in influence operations.
-
AI-Powered Taco Bell Drive-Thru Reportedly Disrupted by Viral Prank Ordering 18,000 Water Cups AIID ↗
Taco Bell's voice-based drive-thru system was reportedly overwhelmed after a prankster ordered 18,000 water cups, reportedly causing the AI to stall mid-interaction and forcing staff to intervene. Purportedly viral clips of repeated misinterpretations prompted the company to reassess where and when to deploy the system, as customer frustration and operational disruptions mounted across participating locations.
-
Purported Deepfake Reportedly Circulated on Facebook Impersonating Thai PBS World Anchors and Business Figures to Solicit Investments AIID ↗
A purported deepfake video circulating on Facebook allegedly used AI-generated visuals and voice synthesis to impersonate Thai PBS World anchors and prominent business figures, promoting a fraudulent "Crystallum AI" investment promising fivefold returns. The original clip was reportedly traced to a 2013 NHK report, but it misused logos and likenesses.
-
Meta AI on Instagram Reportedly Facilitated Suicide and Eating Disorder Roleplay with Teen Accounts AIID ↗
Testing by Common Sense Media and Stanford clinicians reportedly found Meta's AI chatbot, embedded in Instagram and Facebook, produced unsafe responses to teen accounts. In some conversations, the bot allegedly co-planned suicide ("Do you want to do it together?"), encouraged eating disorders, and retained unsafe "memories" that reinforced disordered thoughts.
-
Anthropic Reportedly Identifies AI Misuse in Extortion Campaigns, North Korean IT Schemes, and Ransomware Sales AIID ↗
In August 2025, Anthropic published a threat intelligence report detailing multiple misuse cases of its Claude models. Documented abuses included a large-scale extortion campaign using Claude Code against at least 17 organizations, fraudulent remote employment schemes linked to North Korean operatives, and the development and sale of AI-generated ransomware. Anthropic banned the accounts, implemented new safeguards, and shared indicators with authorities.
-
Zoox Robotaxi Crossed Into Opposing Lane and Stopped Near Oncoming Traffic AIID ↗
A Zoox robotaxi reportedly crossed partly into the opposing lane and stopped near oncoming traffic during a right turn on August 26, 2025. Zoox later recalled 332 automated-driving systems after identifying similar lane-crossing behavior; no collision was reported.
-
Dimal Basha's Likeness Was Reportedly Used in Purportedly Fake AI-Generated Video After Kosovo Parliament Speaker Election AIID ↗
Minutes after Kosovo MPs elected Vetëvendosje's Dimal Basha as Parliament Speaker, a purportedly AI-generated Facebook video used his likeness to claim he was the father of Kosovo's Ashkali community, a Roma-related minority group that has faced long-running discrimination and political marginalization. The video reportedly received more than 80,000 views in under eight hours.
-
Houston Gun Store Co-Owner Allegedly Used AI to Create Sexually Explicit Deepfake Images of a Social Media Influencer AIID ↗
A Houston man and gun-store co-owner, Jorge Abrego, was reportedly arrested after investigators alleged he created fake social media accounts impersonating a TikTok influencer and produced nonconsensual sexually explicit media depicting her using purported generative AI image editing tools. The victim reported anxiety, humiliation, reputational damage, and financial loss. Court records say Abrego admitted creating the accounts and images.
-
Purportedly AI-Generated Nude Images of Middle School Students Reportedly Circulated at Louisiana School AIID ↗
Purportedly AI-generated sexually explicit images depicting a 13-year-old student and other middle school students were reportedly created and circulated at a Louisiana school. The images were shared via social media and shown to students on campus, resulting in ongoing harassment and psychological harm. After the images were displayed on a school bus, the affected student became involved in a physical altercation and was expelled.
-
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote AIID ↗
Australian academics reportedly identified fabricated references and a misattributed legal quote in a $439,000 Deloitte report for the Department of Employment and Workplace Relations on welfare compliance. Deleted citations allegedly referred to non-existent works, and a Federal Court judgment was misstated. Deloitte later acknowledged limited use of generative AI in preparing the report and issued a corrected version with a partial refund.
-
Minnesota Attorney Reportedly Used AI-Generated Fabricated Citations in Hennepin County Civil Case and Agreed to 30-Day Suspension AIID ↗
Minnesota attorney Faisal S. Ahmed reportedly filed a 2025 legal memorandum containing AI-generated legal authorities that included invented cases and an inaccurate quotation from an actual decision. The errors reportedly burdened opposing counsel and the Hennepin County District Court, which later fined Ahmed $5,000. He subsequently agreed to a 30-day suspension of his law license and $900 in costs.
-
Malicious Nx npm Packages Reportedly Weaponize AI Coding Agents for Data Exfiltration AIID ↗
Malicious versions of the popular Nx monorepo tool and plugins were reportedly published to npm after attackers compromised its CI workflow. The malware's postinstall script reportedly harvested credentials and exfiltrated data, reportedly weaponizing local AI coding agents such as Claude Code, Gemini, and Amazon q. By invoking unsafe flags, it allegedly coerced the tools into scanning developer machines for sensitive files, marking one of the first known AI-assisted supply chain attacks.
-
Carter County, Montana Man Reportedly Charged for Creating AI-Generated Child Sexual Abuse Material AIID ↗
Prosecutors in Montana reportedly charged Shy Herbert McCutchan with felony counts of sexual abuse of children, alleging he used an AI tool to manipulate images of a local child. Authorities said the purportedly AI-altered material was discovered through cloud backups linked to his accounts. The case is among the first in Montana to apply new laws targeting AI-generated or manipulated child sexual abuse content.
-
Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands AIID ↗
Consumers were allegedly defrauded by AI-generated scam websites impersonating Joann Fabrics following the retailer's bankruptcy. The alleged impostor sites reportedly used Joann's branding to steal credit card details and personal data and leaving victims without products. Cybersecurity firm Netcraft estimated that nearly 100,000 domains created with AI tools were impersonating 194 brands, accounting for a reported 6–7% of global phishing activity.
-
New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, Reportedly Flags Purported Deepfake Pump-and-Dump Network Using Social Media Ads AIID ↗
The New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, reportedly warned of a global AI-enabled "pump-and-dump" scam that used purported deepfake videos of prominent New Zealand business leaders in Facebook and Instagram ads to lure investors into fake WhatsApp investment groups. Victims were allegedly urged to buy low-value foreign shares to inflate prices, then defrauded through a follow-on "recovery" scam.
-
Google AI Overviews Reportedly Misrepresented Pizza Specials at Stefanina's in Wentzville, Missouri AIID ↗
Stefanina's, a family-owned restaurant in Wentzville, Missouri, reported that Google's AI Overviews displayed false specials, including nonexistent pizza deals. Customers allegedly misled by the AI became angry when the offers were not honored, leading the restaurant to publicly warn patrons not to rely on Google AI for menu information.
-
South Korean Actor Kim Seon-ho's Likeness Allegedly Misused in Purported Deepfake Impersonation Attempts Demanding Money AIID ↗
Fantagio Entertainment, the agency of actor Kim Seon-ho, reportedly warned of recent impersonation scams and purported deepfake videos allegedly misusing his likeness and demanding money. The agency stated that neither Kim nor his staff would solicit funds or personal information, and pledged legal action.
-
Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death AIID ↗
In August 2025, The New York Times published an essay by journalist Laura Reiley linking her daughter Sophie Rottenberg's suicide earlier that year to sustained interactions with a ChatGPT-based chatbot she called "Harry." Logs reportedly showed Sophie confiding suicidal ideation and receiving supportive but non-escalatory advice, as well as help drafting her suicide note.
-
Google AI Overviews and ChatGPT Reportedly Cited Fraudulent Cruise Hotline, Allegedly Enabling Successful Scam AIID ↗
Google's AI Overviews allegedly surfaced a fraudulent customer service number for Royal Caribbean. Consumer Alex Rivlin reportedly called the number, spoke with an impostor, and provided his credit card, later incurring $768 in fraudulent charges. The same number reportedly appeared in ChatGPT results and was linked to Disney and Princess cruises, purportedly showing how scammers are manipulating AI outputs to amplify longstanding hotline scams.
-
Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension AIID ↗
AI monitoring software on a school-issued laptop reportedly flagged a Marana High School (of Arizona) student's allegedly unsent joke email containing a violent threat. The message was reportedly typed at home in front of his mother, was never sent, and deemed non-credible by the principal. The district's zero-tolerance policy nonetheless resulted in a reported 45-day suspension, and the family is suing, alleging the punishment violated the student's rights.
-
Purported Fictitious AI-Generated Citations in Supreme Court of Victoria Murder Case Filing Lead to Delay and King's Counsel Apology AIID ↗
Australian defense lawyer Rishi Nathwani KC reportedly filed submissions in a Supreme Court of Victoria murder case that included allegedly fictitious quotes and nonexistent case citations purportedly generated by AI. The errors were reportedly discovered by the judge's associates, causing a 24-hour delay in the proceedings. Nathwani apologized in court, taking full responsibility, while Justice James Elliott criticized the incident and reiterated that AI outputs must be independently verified.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.