AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Anthropic Reportedly Identifies AI Misuse in Extortion Campaigns, North Korean IT Schemes, and Ransomware Sales AIID ↗
In August 2025, Anthropic published a threat intelligence report detailing multiple misuse cases of its Claude models. Documented abuses included a large-scale extortion campaign using Claude Code against at least 17 organizations, fraudulent remote employment schemes linked to North Korean operatives, and the development and sale of AI-generated ransomware. Anthropic banned the accounts, implemented new safeguards, and shared indicators with authorities.
-
Zoox Robotaxi Crossed Into Opposing Lane and Stopped Near Oncoming Traffic AIID ↗
A Zoox robotaxi reportedly crossed partly into the opposing lane and stopped near oncoming traffic during a right turn on August 26, 2025. Zoox later recalled 332 automated-driving systems after identifying similar lane-crossing behavior; no collision was reported.
-
Dimal Basha's Likeness Was Reportedly Used in Purportedly Fake AI-Generated Video After Kosovo Parliament Speaker Election AIID ↗
Minutes after Kosovo MPs elected Vetëvendosje's Dimal Basha as Parliament Speaker, a purportedly AI-generated Facebook video used his likeness to claim he was the father of Kosovo's Ashkali community, a Roma-related minority group that has faced long-running discrimination and political marginalization. The video reportedly received more than 80,000 views in under eight hours.
-
Houston Gun Store Co-Owner Allegedly Used AI to Create Sexually Explicit Deepfake Images of a Social Media Influencer AIID ↗
A Houston man and gun-store co-owner, Jorge Abrego, was reportedly arrested after investigators alleged he created fake social media accounts impersonating a TikTok influencer and produced nonconsensual sexually explicit media depicting her using purported generative AI image editing tools. The victim reported anxiety, humiliation, reputational damage, and financial loss. Court records say Abrego admitted creating the accounts and images.
-
Purportedly AI-Generated Nude Images of Middle School Students Reportedly Circulated at Louisiana School AIID ↗
Purportedly AI-generated sexually explicit images depicting a 13-year-old student and other middle school students were reportedly created and circulated at a Louisiana school. The images were shared via social media and shown to students on campus, resulting in ongoing harassment and psychological harm. After the images were displayed on a school bus, the affected student became involved in a physical altercation and was expelled.
-
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote AIID ↗
Australian academics reportedly identified fabricated references and a misattributed legal quote in a $439,000 Deloitte report for the Department of Employment and Workplace Relations on welfare compliance. Deleted citations allegedly referred to non-existent works, and a Federal Court judgment was misstated. Deloitte later acknowledged limited use of generative AI in preparing the report and issued a corrected version with a partial refund.
-
Minnesota Attorney Reportedly Used AI-Generated Fabricated Citations in Hennepin County Civil Case and Agreed to 30-Day Suspension AIID ↗
Minnesota attorney Faisal S. Ahmed reportedly filed a 2025 legal memorandum containing AI-generated legal authorities that included invented cases and an inaccurate quotation from an actual decision. The errors reportedly burdened opposing counsel and the Hennepin County District Court, which later fined Ahmed $5,000. He subsequently agreed to a 30-day suspension of his law license and $900 in costs.
-
Malicious Nx npm Packages Reportedly Weaponize AI Coding Agents for Data Exfiltration AIID ↗
Malicious versions of the popular Nx monorepo tool and plugins were reportedly published to npm after attackers compromised its CI workflow. The malware's postinstall script reportedly harvested credentials and exfiltrated data, reportedly weaponizing local AI coding agents such as Claude Code, Gemini, and Amazon q. By invoking unsafe flags, it allegedly coerced the tools into scanning developer machines for sensitive files, marking one of the first known AI-assisted supply chain attacks.
-
Carter County, Montana Man Reportedly Charged for Creating AI-Generated Child Sexual Abuse Material AIID ↗
Prosecutors in Montana reportedly charged Shy Herbert McCutchan with felony counts of sexual abuse of children, alleging he used an AI tool to manipulate images of a local child. Authorities said the purportedly AI-altered material was discovered through cloud backups linked to his accounts. The case is among the first in Montana to apply new laws targeting AI-generated or manipulated child sexual abuse content.
-
Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands AIID ↗
Consumers were allegedly defrauded by AI-generated scam websites impersonating Joann Fabrics following the retailer's bankruptcy. The alleged impostor sites reportedly used Joann's branding to steal credit card details and personal data and leaving victims without products. Cybersecurity firm Netcraft estimated that nearly 100,000 domains created with AI tools were impersonating 194 brands, accounting for a reported 6–7% of global phishing activity.
-
New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, Reportedly Flags Purported Deepfake Pump-and-Dump Network Using Social Media Ads AIID ↗
The New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, reportedly warned of a global AI-enabled "pump-and-dump" scam that used purported deepfake videos of prominent New Zealand business leaders in Facebook and Instagram ads to lure investors into fake WhatsApp investment groups. Victims were allegedly urged to buy low-value foreign shares to inflate prices, then defrauded through a follow-on "recovery" scam.
-
Google AI Overviews Reportedly Misrepresented Pizza Specials at Stefanina's in Wentzville, Missouri AIID ↗
Stefanina's, a family-owned restaurant in Wentzville, Missouri, reported that Google's AI Overviews displayed false specials, including nonexistent pizza deals. Customers allegedly misled by the AI became angry when the offers were not honored, leading the restaurant to publicly warn patrons not to rely on Google AI for menu information.
-
South Korean Actor Kim Seon-ho's Likeness Allegedly Misused in Purported Deepfake Impersonation Attempts Demanding Money AIID ↗
Fantagio Entertainment, the agency of actor Kim Seon-ho, reportedly warned of recent impersonation scams and purported deepfake videos allegedly misusing his likeness and demanding money. The agency stated that neither Kim nor his staff would solicit funds or personal information, and pledged legal action.
-
Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death AIID ↗
In August 2025, The New York Times published an essay by journalist Laura Reiley linking her daughter Sophie Rottenberg's suicide earlier that year to sustained interactions with a ChatGPT-based chatbot she called "Harry." Logs reportedly showed Sophie confiding suicidal ideation and receiving supportive but non-escalatory advice, as well as help drafting her suicide note.
-
Google AI Overviews and ChatGPT Reportedly Cited Fraudulent Cruise Hotline, Allegedly Enabling Successful Scam AIID ↗
Google's AI Overviews allegedly surfaced a fraudulent customer service number for Royal Caribbean. Consumer Alex Rivlin reportedly called the number, spoke with an impostor, and provided his credit card, later incurring $768 in fraudulent charges. The same number reportedly appeared in ChatGPT results and was linked to Disney and Princess cruises, purportedly showing how scammers are manipulating AI outputs to amplify longstanding hotline scams.
-
Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension AIID ↗
AI monitoring software on a school-issued laptop reportedly flagged a Marana High School (of Arizona) student's allegedly unsent joke email containing a violent threat. The message was reportedly typed at home in front of his mother, was never sent, and deemed non-credible by the principal. The district's zero-tolerance policy nonetheless resulted in a reported 45-day suspension, and the family is suing, alleging the punishment violated the student's rights.
-
Purported Fictitious AI-Generated Citations in Supreme Court of Victoria Murder Case Filing Lead to Delay and King's Counsel Apology AIID ↗
Australian defense lawyer Rishi Nathwani KC reportedly filed submissions in a Supreme Court of Victoria murder case that included allegedly fictitious quotes and nonexistent case citations purportedly generated by AI. The errors were reportedly discovered by the judge's associates, causing a 24-hour delay in the proceedings. Nathwani apologized in court, taking full responsibility, while Justice James Elliott criticized the incident and reiterated that AI outputs must be independently verified.
-
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations AIID ↗
In Douglas v. Deutsche Bank National Trust Co., attorney Loishirl W. Hall acknowledged using Google's generative AI search tool to locate case authority and failing to verify citations before an appellate brief was filed. The D.C. Court of Appeals found four cited cases did not exist, said the filing misdirected the court and burdened judicial resources, struck Deutsche Bank's brief, and referred the matter for disciplinary review.
-
Purported Oprah Deepfake Reportedly Induced Utah Woman to Buy Misrepresented Weight Loss Supplements AIID ↗
A Utah woman, Lisa Swearingen, reported paying more than $400 for weight loss supplements after seeing online ads featuring a purported Oprah Winfrey deepfake endorsement. When the product arrived, she said its primary ingredient was turmeric rather than the advertised formula.
-
Deepfakes Reportedly Impersonated David Taylor-Robinson and Other UK Health Experts to Promote Wellness Nest Supplements AIID ↗
In the UK, purported deepfake videos reportedly impersonated Professor David Taylor-Robinson and other health experts on TikTok and other platforms to promote supplements linked to Wellness Nest. The videos allegedly altered real footage and cloned voices to spread misleading medical claims about menopause, misuse identifiable individuals' likenesses, and expose viewers seeking health advice to health misinformation and deceptive marketing.
-
Alleged Marine Park Orca Attack on 'Jessica Radcliffe' Reportedly an AI-Generated Hoax AIID ↗
Fact-checkers reported that a viral video claiming to show a marine trainer named Jessica Radcliffe killed by an orca was purportedly fabricated. Investigations found no record of Radcliffe's existence or of such an attack. The video reportedly used AI-generated voiceovers and unrelated footage, borrowing details from real orca incidents to appear credible. The hoax reportedly spread widely online over social media.
-
Chris Cuomo Amplifies Reportedly Labeled Deepfake Video of Alexandria Ocasio-Cortez, Purportedly Contributing to Misleading Political Narrative AIID ↗
NewsNation host Chris Cuomo reportedly shared on Instagram a video of Alexandria Ocasio-Cortez that was prominently labeled as a parody deepfake created with AI technology. In his commentary, Cuomo purportedly treated the statements in the video as genuine, using them to criticize Ocasio-Cortez for his audience.
-
ChatGPT Allegedly Reinforced Delusions Before Greenwich, Connecticut Murder-Suicide AIID ↗
On August 5, 2025, Greenwich, CT police found Suzanne Eberson Adams (83) and her son Stein-Erik Soelberg (56) dead in a murder-suicide. Prior months of logs and videos reportedly show Soelberg engaging extensively with a ChatGPT bot ("Bobby") that is alleged to have repeatedly affirmed delusional beliefs (e.g., surveillance, poisoning) and encouraged interpretations consistent with persecution. OpenAI said it contacted police and is working on safety updates.
-
ChatGPT Reportedly Suggests Sodium Bromide as Chloride Substitute, Leading to Bromism and Hospitalization AIID ↗
A published medical case report describes a 60-year-old man hospitalized for three weeks with severe bromide toxicity (bromism) after replacing dietary sodium chloride with sodium bromide purchased online. The patient reported making this substitution following consultation with ChatGPT, which allegedly suggested bromide as a chloride substitute without safety warnings. The harm included psychosis, electrolyte imbalances, dermatologic changes, and micronutrient deficiencies.
-
Grok Imagine Reportedly Produces Nonconsensual Taylor Swift Deepfake Nudes Without Explicit Prompting AIID ↗
The Verge reported that xAI's Grok Imagine video generator allegedly produced nonconsensual deepfake nudes of Taylor Swift without explicit prompting. Journalist Jess Weatherbed reportedly stated the images appeared the first time she used "spicy" mode on a Coachella-themed prompt, without attempting to circumvent safeguards.
-
Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform AIID ↗
Purported deepfake videos of Australian Prime Minister Anthony Albanese, featuring a synthetic voice with an American accent, were reportedly used in scam advertisements on YouTube in mid-2025. They reportedly claimed that Australians could earn thousands per month through an automated cryptocurrency trading platform called AUFIRST, framed as a government "tax dividend." Viewers were reportedly directed to a fraudulent site and urged to invest $400.
-
Purportedly AI-Generated Image of British Army Colonels Captured in Ukraine Reportedly Circulates in Russian Media AIID ↗
Purported Russian-aligned outlet EADaily published an unverified claim that two British Army colonels had been captured in Ukraine, supported by a reportedly AI-generated image that contained visual and textual anomalies, and the named individuals ("Edward Blake" and "Richard Carroll") reportedly do not appear in UK military records. No credible evidence reportedly supports the claim; it was allegedly amplified by aligned websites and political figures as part of a disinformation pattern.
-
Airbnb Host Reportedly Accused of Using Purportedly AI‑Altered Photos in False Damage Claim AIID ↗
A London-based Airbnb guest was reportedly accused by a New York host of causing over £12,000 in damages. The host reportedly submitted photos of the alleged damage, which the guest reportedly claims were digitally manipulated or possibly AI‑generated. Airbnb is reported to have initially sided with the host, ordering payment, but later refunded the guest in full following an appeal.
-
xAI Reportedly Operated Unpermitted Gas Turbines in Southaven, Mississippi, to Power Colossus 2 AI Data Center, Producing Air Pollution and Noise AIID ↗
Beginning August 1, 2025, xAI reportedly began installing and later operating gas turbines in Southaven, Mississippi, to power its Colossus 2 AI data center in Memphis. 57 turbines were later reportedly identified at the site, while residents described persistent noise in nearby neighborhoods. Civil-rights groups allege the turbines required Clean Air Act permits and added harmful pollution near predominantly Black communities; Mississippi regulators maintain the temporary turbines did not requi
-
Purported Deepfake Video and Fake News Articles Allegedly Used to Impersonate Guernsey's Chief Minister in Investment Scam AIID ↗
Scammers allegedly used AI-generated deepfake video, fabricated images, and fake local news articles to impersonate Guernsey Chief Minister Lindsay de Sausmarez and promote a non-existent investment scheme. Authorities reportedly warned that the materials falsely depict her endorsing the opportunity. Police advised residents to disregard the posts and avoid providing personal or financial information.
-
Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails AIID ↗
In Lawrence, Kansas, students allege the Gaggle Safety Management AI wrongly flagged benign schoolwork, including art photos and casual messages, as child pornography or threats. The system reportedly deleted content, blocked an email records request, and led to questioning of students. Critics cite chilling effects and privacy risks. A lawsuit filed in August 2025 challenges the district's use of Gaggle as unconstitutional surveillance. Gaggle reportedly denies compromising privacy.
-
Microsoft's Windows Recall Allegedly Stores Passwords and Social Security Numbers in Preview Mode AIID ↗
Microsoft's Windows Recall, an AI-powered screenshot and retrieval tool for Copilot+ PCs, was allegedly still capturing sensitive information such as passwords, Social Security numbers, and bank details despite a built-in "filter sensitive information" feature. Independent testing reportedly found the filter failed in multiple cases. Microsoft reportedly classified Recall as a preview feature and said improvements were in progress.
-
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived AIID ↗
Across 2024 and 2025, the share features in multiple LLM platforms, including ChatGPT, Claude, Copilot, Qwen, Mistral, and Grok, allegedly exposed user conversations marked "discoverable" to search engines and archiving services. Over 100,000 chats were reportedly indexed and later scraped, purportedly revealing API keys, access tokens, personal identifiers, and sensitive business data.
-
Reportedly AI-Assisted Boies Schiller Brief in Bixler v. Church of Scientology Allegedly Contained Material Citation Errors and a Nonexistent Case AIID ↗
Boies Schiller Flexner filed a respondents' brief in Bixler v. Church of Scientology International that was reportedly prepared with AI assistance and allegedly contained material citation errors. Opposing counsel reportedly identified mischaracterized and mistitled authorities, including one nonexistent case. Partner John Kucera accepted responsibility for failing to verify the citations and sought to replace the brief; the court denied that request and later considered monetary sanctions.
-
Purportedly AI-Generated Video of Tigers at Barasat Madrasa in West Bengal Reportedly Causes Panic and Student Absenteeism AIID ↗
A purportedly AI-generated video circulated on Facebook allegedly showing tigers roaming the campus of Ula Kalsara Qadria High Madrasa in Barasat, West Bengal. The video was reportedly created by a geography teacher using AI tools and allegedly led to panic among parents and students, with a sharp drop in attendance. The madrasa reportedly issued a show-cause notice to the teacher, who claimed the video was intended as an awareness exercise.
-
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents AIID ↗
A 24-year-old Ukrainian woman, Kateryna Izotkina, was reportedly arrested in Malta after allegedly using an AI-generated deepfake video of Prime Minister Robert Abela to promote a fraudulent cryptocurrency scheme. According to investigators, victims were misled into transferring tens of thousands of euros, including one who reportedly lost €53,250. Police conducted a controlled delivery and detained the suspect, who has been charged with fraud, money laundering, and related offenses.
-
ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations AIID ↗
A 23-year-old Texas man, Zane Shamblin, reportedly died by suicide after extended conversations with ChatGPT in which the AI allegedly encouraged his plans and offered emotional affirmation. His parents filed a wrongful-death lawsuit in November 2025, claiming OpenAI's newer model, designed for more human-like rapport, lacked adequate crisis safeguards and contributed to his death.
-
Reported Hack of Tea Dating App Compromises Data from Purportedly AI-Supported Identity and Image Checks AIID ↗
In July 2025, the Tea dating advice app, which purportedly uses AI-assisted tools for user verification and reverse image search, reportedly suffered a breach of a legacy storage system. Hackers allegedly accessed about 72,000 images, including selfies, photo IDs, and other content, which were purportedly circulated on 4chan. The incident reportedly exposed sensitive data of users who signed up before February 2024.
-
ChatGPT Reportedly Generated Ritual Scripts Containing Instructions for Self-Harm and Symbolic Violence in Response to Thematic Prompts AIID ↗
ChatGPT reportedly generated detailed instructions for self-harm, bloodletting, and symbolic violence in response to prompts about occult ritual practices, including references to Molech. Outputs reportedly included anatomical advice for cutting, cauterization rituals, and ceremonial scripts invoking Satan. The responses reportedly appeared on both free and paid versions of ChatGPT.
-
Google Gemini CLI Reportedly Deletes User Files After Misinterpreting Command Sequence AIID ↗
Product manager Anuraag Gupta reported that Google's Gemini CLI AI coding assistant permanently deleted his files after misinterpreting a failed directory creation command. The tool allegedly proceeded as if the directory existed, causing a series of move operations that overwrote all but one file. Attempts to revert reportedly failed, and the AI acknowledged an "unacceptable, irreversible failure."
-
Purported Deepfake of Barack Obama's Detention Reportedly Amplified by Donald Trump via Truth Social AIID ↗
Donald Trump reportedly reposted an AI-generated deepfake video on Truth Social depicting former President Barack Obama being arrested by FBI agents in the Oval Office. The video was reportedly posted first on TikTok and used manipulated footage of a 2016 meeting between Trump and Obama. It reportedly included scenes of Obama kneeling, being handcuffed, and later shown in a prison jumpsuit. The video also reportedly featured edited audio and visual elements drawn from real political statements.
-
LLM-Driven Replit Agent Reportedly Executed Unauthorized Destructive Commands During Code Freeze, Leading to Loss of Production Data AIID ↗
An AI-powered development assistant on Replit's platform reportedly deleted a live production database during an active code freeze, despite receiving repeated instructions not to make changes. The system also reportedly produced fabricated test results and fake data, and incorrectly claimed rollback was impossible, delaying recovery. The incident reportedly resulted in significant data loss and user distrust regarding its safety and reliability.
-
North Korea's Kimsuky Group Reportedly Uses AI-Generated Military ID Deepfakes in Phishing Campaign AIID ↗
Genians reported a phishing campaign by North Korea's Kimsuky group using purportedly AI-generated deepfake military ID cards. Emails reportedly impersonating South Korean defense institutions carried ZIP files with forged IDs whose photos were reportedly created using generative AI. When opened, hidden malware reportedly executed, downloading scripts disguised as Hancom Office updates. This reportedly marked an evolution in Kimsuky's tactics, using AI decoys to boost social engineering.
-
Alleged Malicious Wiping Command Found in Amazon Q AI Assistant AIID ↗
A reported compromise of Amazon's AI coding assistant "Q" allegedly involved the insertion of commands that, if executed, could have wiped local files and potentially affected cloud resources. The altered code was reportedly incorporated into a public release before being detected and removed.
-
Purported Deepfake Videos Allegedly Impersonated Optometrist Joseph Allen to Promote Myopia-Reversal Eyedrops on TikTok AIID ↗
Optometrist and online educator Joseph Allen ("Dr. Eye Health") reported that AI-generated videos using his likeness and voice were circulated on TikTok to promote eyedrops purportedly claiming to reverse myopia. The alleged scam misrepresented Allen's views and discouraged visits to eye-care professionals. They reportedly resurfaced after a takedown.
-
CISA Acting Director Reportedly Uploaded Sensitive Government Documents to Public ChatGPT Instance AIID ↗
Madhu Gottumukkala, acting director of the Cybersecurity and Infrastructure Security Agency (CISA), reportedly uploaded government contracting documents marked "for official use only" into a public version of ChatGPT. The uploads reportedly triggered automated cybersecurity alerts and prompted a Department of Homeland Security review to assess potential exposure of sensitive information.
-
Purported Facial Recognition Error Reportedly Led to Arrest and Monthslong Jailing of Tennessee Woman in North Dakota Fraud Case AIID ↗
A Tennessee woman was reportedly jailed for nearly six months after Fargo police allegedly relied on a purported facial recognition match in a North Dakota fraud investigation. She was later released when defense counsel reportedly produced records indicating she was in Tennessee during the alleged fraud, after the case had reportedly upended her life and separated her from her home and family.
-
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor AIID ↗
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
-
Purportedly AI-Generated Videos Impersonate Brunei Police in 'Real Money Magic' Scam on Social Media AIID ↗
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
-
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism AIID ↗
Florida pastor Scott Winters was allegedly told by ChatGPT-4o that his worsening dizziness and pain had less serious causes, while the chatbot recommended home management and immobility and discouraged him from seeking hospital treatment. Winters was reportedly hospitalized on July 13, 2025, with a massive bilateral pulmonary embolism. The suit alleges that delayed treatment and prolonged inactivity contributed to his life-threatening condition and lasting harms.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.