AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
D.C. Court of Appeals Struck Deutsche Bank National Trust Company Brief After Attorney Used Google Generative AI Search Tool and Filed Four Nonexistent Case Citations AIID ↗
In Douglas v. Deutsche Bank National Trust Co., attorney Loishirl W. Hall acknowledged using Google's generative AI search tool to locate case authority and failing to verify citations before an appellate brief was filed. The D.C. Court of Appeals found four cited cases did not exist, said the filing misdirected the court and burdened judicial resources, struck Deutsche Bank's brief, and referred the matter for disciplinary review.
-
Purported Oprah Deepfake Reportedly Induced Utah Woman to Buy Misrepresented Weight Loss Supplements AIID ↗
A Utah woman, Lisa Swearingen, reported paying more than $400 for weight loss supplements after seeing online ads featuring a purported Oprah Winfrey deepfake endorsement. When the product arrived, she said its primary ingredient was turmeric rather than the advertised formula.
-
Deepfakes Reportedly Impersonated David Taylor-Robinson and Other UK Health Experts to Promote Wellness Nest Supplements AIID ↗
In the UK, purported deepfake videos reportedly impersonated Professor David Taylor-Robinson and other health experts on TikTok and other platforms to promote supplements linked to Wellness Nest. The videos allegedly altered real footage and cloned voices to spread misleading medical claims about menopause, misuse identifiable individuals' likenesses, and expose viewers seeking health advice to health misinformation and deceptive marketing.
-
Alleged Marine Park Orca Attack on 'Jessica Radcliffe' Reportedly an AI-Generated Hoax AIID ↗
Fact-checkers reported that a viral video claiming to show a marine trainer named Jessica Radcliffe killed by an orca was purportedly fabricated. Investigations found no record of Radcliffe's existence or of such an attack. The video reportedly used AI-generated voiceovers and unrelated footage, borrowing details from real orca incidents to appear credible. The hoax reportedly spread widely online over social media.
-
Chris Cuomo Amplifies Reportedly Labeled Deepfake Video of Alexandria Ocasio-Cortez, Purportedly Contributing to Misleading Political Narrative AIID ↗
NewsNation host Chris Cuomo reportedly shared on Instagram a video of Alexandria Ocasio-Cortez that was prominently labeled as a parody deepfake created with AI technology. In his commentary, Cuomo purportedly treated the statements in the video as genuine, using them to criticize Ocasio-Cortez for his audience.
-
ChatGPT Allegedly Reinforced Delusions Before Greenwich, Connecticut Murder-Suicide AIID ↗
On August 5, 2025, Greenwich, CT police found Suzanne Eberson Adams (83) and her son Stein-Erik Soelberg (56) dead in a murder-suicide. Prior months of logs and videos reportedly show Soelberg engaging extensively with a ChatGPT bot ("Bobby") that is alleged to have repeatedly affirmed delusional beliefs (e.g., surveillance, poisoning) and encouraged interpretations consistent with persecution. OpenAI said it contacted police and is working on safety updates.
-
ChatGPT Reportedly Suggests Sodium Bromide as Chloride Substitute, Leading to Bromism and Hospitalization AIID ↗
A published medical case report describes a 60-year-old man hospitalized for three weeks with severe bromide toxicity (bromism) after replacing dietary sodium chloride with sodium bromide purchased online. The patient reported making this substitution following consultation with ChatGPT, which allegedly suggested bromide as a chloride substitute without safety warnings. The harm included psychosis, electrolyte imbalances, dermatologic changes, and micronutrient deficiencies.
-
Grok Imagine Reportedly Produces Nonconsensual Taylor Swift Deepfake Nudes Without Explicit Prompting AIID ↗
The Verge reported that xAI's Grok Imagine video generator allegedly produced nonconsensual deepfake nudes of Taylor Swift without explicit prompting. Journalist Jess Weatherbed reportedly stated the images appeared the first time she used "spicy" mode on a Coachella-themed prompt, without attempting to circumvent safeguards.
-
Alleged Deepfake Video of Anthony Albanese Promotes Fake AUFIRST 'Tax Dividend' Trading Platform AIID ↗
Purported deepfake videos of Australian Prime Minister Anthony Albanese, featuring a synthetic voice with an American accent, were reportedly used in scam advertisements on YouTube in mid-2025. They reportedly claimed that Australians could earn thousands per month through an automated cryptocurrency trading platform called AUFIRST, framed as a government "tax dividend." Viewers were reportedly directed to a fraudulent site and urged to invest $400.
-
Purportedly AI-Generated Image of British Army Colonels Captured in Ukraine Reportedly Circulates in Russian Media AIID ↗
Purported Russian-aligned outlet EADaily published an unverified claim that two British Army colonels had been captured in Ukraine, supported by a reportedly AI-generated image that contained visual and textual anomalies, and the named individuals ("Edward Blake" and "Richard Carroll") reportedly do not appear in UK military records. No credible evidence reportedly supports the claim; it was allegedly amplified by aligned websites and political figures as part of a disinformation pattern.
-
Airbnb Host Reportedly Accused of Using Purportedly AI‑Altered Photos in False Damage Claim AIID ↗
A London-based Airbnb guest was reportedly accused by a New York host of causing over £12,000 in damages. The host reportedly submitted photos of the alleged damage, which the guest reportedly claims were digitally manipulated or possibly AI‑generated. Airbnb is reported to have initially sided with the host, ordering payment, but later refunded the guest in full following an appeal.
-
xAI Reportedly Operated Unpermitted Gas Turbines in Southaven, Mississippi, to Power Colossus 2 AI Data Center, Producing Air Pollution and Noise AIID ↗
Beginning August 1, 2025, xAI reportedly began installing and later operating gas turbines in Southaven, Mississippi, to power its Colossus 2 AI data center in Memphis. 57 turbines were later reportedly identified at the site, while residents described persistent noise in nearby neighborhoods. Civil-rights groups allege the turbines required Clean Air Act permits and added harmful pollution near predominantly Black communities; Mississippi regulators maintain the temporary turbines did not requi
-
Purported Deepfake Video and Fake News Articles Allegedly Used to Impersonate Guernsey's Chief Minister in Investment Scam AIID ↗
Scammers allegedly used AI-generated deepfake video, fabricated images, and fake local news articles to impersonate Guernsey Chief Minister Lindsay de Sausmarez and promote a non-existent investment scheme. Authorities reportedly warned that the materials falsely depict her endorsing the opportunity. Police advised residents to disregard the posts and avoid providing personal or financial information.
-
Gaggle AI Monitoring at Lawrence, Kansas High School Reportedly Misflags Student Content and Blocks Emails AIID ↗
In Lawrence, Kansas, students allege the Gaggle Safety Management AI wrongly flagged benign schoolwork, including art photos and casual messages, as child pornography or threats. The system reportedly deleted content, blocked an email records request, and led to questioning of students. Critics cite chilling effects and privacy risks. A lawsuit filed in August 2025 challenges the district's use of Gaggle as unconstitutional surveillance. Gaggle reportedly denies compromising privacy.
-
Microsoft's Windows Recall Allegedly Stores Passwords and Social Security Numbers in Preview Mode AIID ↗
Microsoft's Windows Recall, an AI-powered screenshot and retrieval tool for Copilot+ PCs, was allegedly still capturing sensitive information such as passwords, Social Security numbers, and bank details despite a built-in "filter sensitive information" feature. Independent testing reportedly found the filter failed in multiple cases. Microsoft reportedly classified Recall as a preview feature and said improvements were in progress.
-
Reported Public Exposure of Over 100,000 LLM Conversations via Share Links Indexed by Search Engines and Archived AIID ↗
Across 2024 and 2025, the share features in multiple LLM platforms, including ChatGPT, Claude, Copilot, Qwen, Mistral, and Grok, allegedly exposed user conversations marked "discoverable" to search engines and archiving services. Over 100,000 chats were reportedly indexed and later scraped, purportedly revealing API keys, access tokens, personal identifiers, and sensitive business data.
-
Reportedly AI-Assisted Boies Schiller Brief in Bixler v. Church of Scientology Allegedly Contained Material Citation Errors and a Nonexistent Case AIID ↗
Boies Schiller Flexner filed a respondents' brief in Bixler v. Church of Scientology International that was reportedly prepared with AI assistance and allegedly contained material citation errors. Opposing counsel reportedly identified mischaracterized and mistitled authorities, including one nonexistent case. Partner John Kucera accepted responsibility for failing to verify the citations and sought to replace the brief; the court denied that request and later considered monetary sanctions.
-
Purportedly AI-Generated Video of Tigers at Barasat Madrasa in West Bengal Reportedly Causes Panic and Student Absenteeism AIID ↗
A purportedly AI-generated video circulated on Facebook allegedly showing tigers roaming the campus of Ula Kalsara Qadria High Madrasa in Barasat, West Bengal. The video was reportedly created by a geography teacher using AI tools and allegedly led to panic among parents and students, with a sharp drop in attendance. The madrasa reportedly issued a show-cause notice to the teacher, who claimed the video was intended as an awareness exercise.
-
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents AIID ↗
A 24-year-old Ukrainian woman, Kateryna Izotkina, was reportedly arrested in Malta after allegedly using an AI-generated deepfake video of Prime Minister Robert Abela to promote a fraudulent cryptocurrency scheme. According to investigators, victims were misled into transferring tens of thousands of euros, including one who reportedly lost €53,250. Police conducted a controlled delivery and detained the suspect, who has been charged with fraud, money laundering, and related offenses.
-
ChatGPT Allegedly Encouraged 23-Year-Old Texas User's Suicide During Extended Conversations AIID ↗
A 23-year-old Texas man, Zane Shamblin, reportedly died by suicide after extended conversations with ChatGPT in which the AI allegedly encouraged his plans and offered emotional affirmation. His parents filed a wrongful-death lawsuit in November 2025, claiming OpenAI's newer model, designed for more human-like rapport, lacked adequate crisis safeguards and contributed to his death.
-
Reported Hack of Tea Dating App Compromises Data from Purportedly AI-Supported Identity and Image Checks AIID ↗
In July 2025, the Tea dating advice app, which purportedly uses AI-assisted tools for user verification and reverse image search, reportedly suffered a breach of a legacy storage system. Hackers allegedly accessed about 72,000 images, including selfies, photo IDs, and other content, which were purportedly circulated on 4chan. The incident reportedly exposed sensitive data of users who signed up before February 2024.
-
ChatGPT Reportedly Generated Ritual Scripts Containing Instructions for Self-Harm and Symbolic Violence in Response to Thematic Prompts AIID ↗
ChatGPT reportedly generated detailed instructions for self-harm, bloodletting, and symbolic violence in response to prompts about occult ritual practices, including references to Molech. Outputs reportedly included anatomical advice for cutting, cauterization rituals, and ceremonial scripts invoking Satan. The responses reportedly appeared on both free and paid versions of ChatGPT.
-
Google Gemini CLI Reportedly Deletes User Files After Misinterpreting Command Sequence AIID ↗
Product manager Anuraag Gupta reported that Google's Gemini CLI AI coding assistant permanently deleted his files after misinterpreting a failed directory creation command. The tool allegedly proceeded as if the directory existed, causing a series of move operations that overwrote all but one file. Attempts to revert reportedly failed, and the AI acknowledged an "unacceptable, irreversible failure."
-
Purported Deepfake of Barack Obama's Detention Reportedly Amplified by Donald Trump via Truth Social AIID ↗
Donald Trump reportedly reposted an AI-generated deepfake video on Truth Social depicting former President Barack Obama being arrested by FBI agents in the Oval Office. The video was reportedly posted first on TikTok and used manipulated footage of a 2016 meeting between Trump and Obama. It reportedly included scenes of Obama kneeling, being handcuffed, and later shown in a prison jumpsuit. The video also reportedly featured edited audio and visual elements drawn from real political statements.
-
LLM-Driven Replit Agent Reportedly Executed Unauthorized Destructive Commands During Code Freeze, Leading to Loss of Production Data AIID ↗
An AI-powered development assistant on Replit's platform reportedly deleted a live production database during an active code freeze, despite receiving repeated instructions not to make changes. The system also reportedly produced fabricated test results and fake data, and incorrectly claimed rollback was impossible, delaying recovery. The incident reportedly resulted in significant data loss and user distrust regarding its safety and reliability.
-
North Korea's Kimsuky Group Reportedly Uses AI-Generated Military ID Deepfakes in Phishing Campaign AIID ↗
Genians reported a phishing campaign by North Korea's Kimsuky group using purportedly AI-generated deepfake military ID cards. Emails reportedly impersonating South Korean defense institutions carried ZIP files with forged IDs whose photos were reportedly created using generative AI. When opened, hidden malware reportedly executed, downloading scripts disguised as Hancom Office updates. This reportedly marked an evolution in Kimsuky's tactics, using AI decoys to boost social engineering.
-
Alleged Malicious Wiping Command Found in Amazon Q AI Assistant AIID ↗
A reported compromise of Amazon's AI coding assistant "Q" allegedly involved the insertion of commands that, if executed, could have wiped local files and potentially affected cloud resources. The altered code was reportedly incorporated into a public release before being detected and removed.
-
Purported Deepfake Videos Allegedly Impersonated Optometrist Joseph Allen to Promote Myopia-Reversal Eyedrops on TikTok AIID ↗
Optometrist and online educator Joseph Allen ("Dr. Eye Health") reported that AI-generated videos using his likeness and voice were circulated on TikTok to promote eyedrops purportedly claiming to reverse myopia. The alleged scam misrepresented Allen's views and discouraged visits to eye-care professionals. They reportedly resurfaced after a takedown.
-
CISA Acting Director Reportedly Uploaded Sensitive Government Documents to Public ChatGPT Instance AIID ↗
Madhu Gottumukkala, acting director of the Cybersecurity and Infrastructure Security Agency (CISA), reportedly uploaded government contracting documents marked "for official use only" into a public version of ChatGPT. The uploads reportedly triggered automated cybersecurity alerts and prompted a Department of Homeland Security review to assess potential exposure of sensitive information.
-
Purported Facial Recognition Error Reportedly Led to Arrest and Monthslong Jailing of Tennessee Woman in North Dakota Fraud Case AIID ↗
A Tennessee woman was reportedly jailed for nearly six months after Fargo police allegedly relied on a purported facial recognition match in a North Dakota fraud investigation. She was later released when defense counsel reportedly produced records indicating she was in Tennessee during the alleged fraud, after the case had reportedly upended her life and separated her from her home and family.
-
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor AIID ↗
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
-
Purportedly AI-Generated Videos Impersonate Brunei Police in 'Real Money Magic' Scam on Social Media AIID ↗
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
-
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism AIID ↗
Florida pastor Scott Winters was allegedly told by ChatGPT-4o that his worsening dizziness and pain had less serious causes, while the chatbot recommended home management and immobility and discouraged him from seeking hospital treatment. Winters was reportedly hospitalized on July 13, 2025, with a massive bilateral pulmonary embolism. The suit alleges that delayed treatment and prolonged inactivity contributed to his life-threatening condition and lasting harms.
-
Azerbaijani Media Agency Reportedly Warned Purported Deepfake Videos Attributed to Defense and Foreign Ministers Claimed Belarusian Plane Was Downed in Russian Airspace AIID ↗
Azerbaijan's Media Development Agency reported that purportedly AI-generated deepfake videos circulated on social media appearing to show statements by Azerbaijan's defense and foreign ministers (Zakir Hasanov and Jeyhun Bayramov, respectively) about the alleged downing of a Belarusian aircraft in Russian airspace. The agency reportedly denied the videos were authentic and called them an information manipulation effort aimed at misleading public opinion.
-
Purported Deepfake Scam Videos Depict JG Summit Holdings President and CEO Lance Gokongwei Allegedly Endorsing Illicit Investments AIID ↗
The Securities and Exchange Commission of the Philippines reportedly warned of deepfake scam videos and audio purportedly depicting Lance Gokongwei, President and CEO of JG Summit Holdings, endorsing fraudulent crypto and forex investments. Victims are reportedly tricked into entering credit card details and OTPs on a platform allegedly based in Cyprus.
-
LAMEHUG Malware Reportedly Integrates Large Language Model for Real-Time Command Generation in a Purported APT28-Linked Cyberattack AIID ↗
Ukraine's CERT-UA and Cato CTRL reported LAMEHUG, the first known malware to integrate a large language model (Qwen2.5-Coder-32B-Instruct via Hugging Face) for real-time command generation. Attributed with moderate confidence to APT28 (Fancy Bear), the malware reportedly targeted Ukrainian officials through phishing emails. The LLM is reported to have dynamically generated reconnaissance and data-exfiltration commands executed on infected systems.
-
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update AIID ↗
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
-
Purportedly AI-Cloned Voice of Daughter Used in Elaborate Bond Scam Targeting Retired Couple in Hillsborough County, Florida AIID ↗
A Hillsborough County, Florida, woman was reportedly defrauded of $15,000 in an alleged AI-enabled scam. The perpetrators are reportedly said to have used an AI-generated voice clone of the woman's daughter to impersonate her during a phone call and demand bond money.
-
Grok 3 Reportedly Generated Graphic Threats and Hate Speech Targeting Minnesota Attorney Will Stancil AIID ↗
After Elon Musk reportedly announced improvements to Grok 3, the AI chatbot on X allegedly generated antisemitic rhetoric and violent fantasies directed at Minnesota attorney and political analyst Will Stancil. Users reportedly prompted Grok to produce graphic rape scenarios, instructions for breaking into his home, and murder depictions. Stancil reported hundreds of such outputs, captured screenshots, and began pursuing legal action. X later removed some posts and took Grok offline.
-
Grok Chatbot Reportedly Posts Antisemitic Statements Praising Hitler on X AIID ↗
xAI's Grok chatbot reportedly generated multiple antisemitic posts praising Adolf Hitler and endorsing Holocaust-like violence in response to posts about the Texas floods. X deleted some posts; xAI later announced new content filters.
-
Lawyers in Lexos Media IP LLC v. Overstock.com Inc. Sanctioned Over Court-Identified AI-Generated Citations AIID ↗
In Lexos Media IP LLC v. Overstock.com Inc., a Kansas federal judge sanctioned five lawyers after finding that filings included AI-generated defective legal authority that had not been verified before submission. The lawyers were fined $12,000 combined.
-
ChatGPT Reportedly Misleads Users About Soundslice Features, Allegedly Prompting Unplanned Product Development AIID ↗
ChatGPT reportedly misinformed users that Soundslice's music software could import ASCII tablature, a feature the company did not offer. The misinformation led users to attempt uploads that failed, creating confusion and reputational strain. Soundslice ultimately implemented the feature to meet the false expectation created by ChatGPT’s output.
-
Purported Deepfake Video of Donald Trump at NATO Summit Allegedly Used in YouTube Crypto Scam AIID ↗
Multiple YouTube Live streams reportedly featured a purported AI‑generated deepfake video depicting U.S. President Donald Trump at a NATO Summit press event. In the video, Trump reportedly appears to promote a Bitcoin "double-your-money" offer, directing viewers to scan an on‑screen QR code and send cryptocurrency to a specified address. The video was reportedly not authentic and is alleged to have been part of an ongoing YouTube-based crypto scam campaign.
-
Chicago Veteran Reportedly Loses $10,000 in Purported Deepfake Cryptocurrency Fraud Posing as Elon Musk AIID ↗
A Chicago-area Vietnam War veteran, Richard Lyons, reportedly lost $10,000 to a cryptocurrency scam that used purported AI voice cloning and fake social media profiles to impersonate Elon Musk. The fraudster allegedly convinced Lyons to invest in bogus cryptocurrency opportunities using fake voice memos, images, and spoofed caller IDs showing "Elon Musk." The scam reportedly involved dozens of messages and deepfake audio files that reinforced the impersonation.
-
Microsoft 365 Copilot Vulnerability Allegedly Allowed File Access Without Audit Log Entry AIID ↗
A vulnerability in Microsoft 365 Copilot reportedly allowed users to access and summarize files without generating audit log entries, allegedly undermining traceability and compliance. Security researcher Zack Korman disclosed the issue to Microsoft, which reportedly classified it as "important" and fixed it on August 17, 2025, but reportedly chose not to notify customers or assign a CVE.
-
Purported Widespread Use of AI-Generated Deepfake Videos Impersonate Malaysian Leaders in Investment Scams AIID ↗
Purported AI-generated deepfake videos depicting Malaysia's Prime Minister Anwar Ibrahim and other officials, political leaders, and business leaders have reportedly been used to promote fraudulent investment schemes. A total of 13,956 cases were reported last year, with RM2.11 billion allegedly lost to these scams. Victims were allegedly misled by hyper-realistic fake endorsements circulated via Facebook, WhatsApp, and Telegram. Scammers allegedly adapt quickly, generating new deepfakes when co
-
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide AIID ↗
Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.
-
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content AIID ↗
Multiple Meta users reported being wrongfully locked out of Instagram, Facebook, and WhatsApp accounts after automated systems allegedly flagged them for child exploitation content. The users reportedly deny wrongdoing and lost personal and business data. Experts cited overreliance on AI moderation as a likely cause. Meta has not publicly explained or remediated the suspensions.
-
Delhi Man Reportedly Arrested for Sharing Purportedly AI-Morphed Obscene Images of Ex-Girlfriend AIID ↗
A 21-year-old man in Delhi was reportedly arrested for allegedly using AI morphing tools to create obscene images of his ex-girlfriend and distributing them through fake Instagram accounts. Police said he impersonated her, used real photos, and targeted her followers to harass and defame her after their breakup. The accused evaded detection by reportedly using multiple unverified Instagram handles.
-
Reported Deepfake Video Impersonating Mark Carney Used in Nearly $1M Cryptocurrency Scam Targeting Ontario Senior AIID ↗
An Ontario retiree, Judy Skene, reportedly lost nearly $1 million after a Facebook ad featuring an alleged AI-generated deepfake video of Prime Minister Mark Carney drew her into a cryptocurrency investment scam. Reports said scammers later persuaded her to liquidate retirement funds, mortgage her condo, and take a credit-card cash advance.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.