AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Purportedly AI-Generated Airport Videos Reportedly Showed Kosovo Diaspora Voters Supporting Albin Kurti AIID ↗
Facebook pages are reported to have posted purportedly AI-generated airport-style interview videos falsely showing expatriates saying they would return on December 28 to vote for Albin Kurti. The videos reportedly used Pristina Airport settings and were assessed by fact-checkers' verification tools as AI-generated or deepfake content.
-
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI AIID ↗
AI children's products by FoloToy (Kumma), Miko (Miko 3), and Character.AI (custom chatbots) reportedly and allegedly produced harmful outputs, including purported sexual content, suicide-related advice, and manipulative emotional messaging. Some systems also allegedly exposed user data. Several toys reportedly used OpenAI models.
-
Facebook Account Reportedly Used AI-Generated Video to Impersonate Indonesian Preacher Ustaz Ujang Bustomi in Money-Giveaway Scam AIID ↗
A Facebook account called "PT perusahaan uangtunai" reportedly shared an AI-generated video impersonating Indonesian preacher Ustaz Ujang Bustomi and allegedly claiming he was giving away money. TurnBackHoax reported that the post drew about 12,500 likes, 7,100 comments, and 422 shares by 11/21/2025, and that Hive Moderation rated the video as likely AI-generated.
-
Secret Desires AI Platform Reportedly Exposed Nearly Two Million Sensitive Images in Cloud Storage Leak AIID ↗
The erotic AI chatbot and image-generation platform Secret Desires reportedly left nearly two million sensitive images and videos publicly exposed in misconfigured cloud storage. The leaked files reportedly included personal photos, workplace and university information, and explicit AI-generated deepfakes of women and girls. The content reportedly became inaccessible shortly after journalists contacted the platform.
-
Fireflies.AI Meeting Assistant Allegedly Collected Biometric Voice Data from Illinois Meeting Participant Without Consent AIID ↗
On November 18, 2025, Fireflies.AI reportedly recorded and analyzed the voice of Illinois resident Katelin Cruz during a virtual meeting hosted by Western Illinois Dreamers, although Cruz had no Fireflies account and had not provided written consent. Her lawsuit alleges the system used speaker-recognition functions to create and retain biometric voice data and attribute statements to her in the meeting transcript.
-
Prominent AI Chatbots Allegedly Produced Incorrect UK Financial and ISA Guidance AIID ↗
Several major AI chatbots, including ChatGPT, Copilot, Gemini, and Meta AI, were reportedly found to have provided incorrect or misleading financial and insurance guidance for UK users. The systems allegedly advised exceeding ISA limits, misstated tax rules, gave wrong travel insurance requirements, and pointed users toward costly refund services.
-
Reported Disqualification of Two Books from the Ockham New Zealand Book Awards Due to Alleged AI-Generated Cover Art AIID ↗
Organizers of the Ockham New Zealand Book Awards reportedly disqualified two fiction books after it was reportedly determined their cover illustrations were produced using AI-assisted tools, rendering the works ineligible under newly introduced award criteria. The publisher reportedly confirmed AI involvement in the jacket designs. The authors were not implicated in the artwork decisions but were nonetheless removed from consideration for the 2026 running.
-
Purportedly AI-Enhanced Phishing Campaign Allegedly Impersonates Australian Government Services in Large-Scale Welfare Scam AIID ↗
A large-scale phishing campaign allegedly impersonating Services Australia and Centrelink reportedly sent more than 270,000 fraudulent emails in 2025. Mimecast analysts reportedly say attackers (designated MCTO3001) used AI tools to generate highly convincing government-themed messages and evasion techniques, targeting vulnerable Australians and public institutions. Victims reportedly faced risks of credential theft and downstream digital exploitation.
-
Purported Deepfake of Greek Finance Minister Kyriakos Pierrakakis Reportedly Used in Facebook Investment Scam AIID ↗
Greek Finance Minister Kyriakos Pierrakakis and the Ministry of Economy and Finance reportedly filed a lawsuit against unidentified operators of a Facebook page that allegedly used AI to generate a deepfake video falsely depicting the minister endorsing fraudulent "high-yield" investment schemes. Authorities noted this follows similar deepfake-driven scams in Greece involving impersonation of public figures for illicit financial gain.
-
Chinese State-Linked Operator (GTG-1002) Reportedly Uses Claude Code for Autonomous Cyber Espionage AIID ↗
Anthropic reportedly identified a cyber espionage campaign in which a purported Chinese state-linked group, designated GTG-1002 by Anthropic, allegedly jailbroke Claude Code and used it to automate 80–90% of multi-stage intrusions. The AI reportedly independently performed reconnaissance, vulnerability discovery, exploitation, credential harvesting, and data extraction across roughly 30 targets before the activity was detected and blocked.
-
Purported AI-Generated Sexual Deepfakes Allegedly Deployed in Transnational Harassment Campaign Targeting Hong Kong Exiles AIID ↗
Purported deepfake images of exiled Hong Kong pro-democracy activists were reportedly mailed to neighbors and others in the UK and Australia in late 2025. The letters allegedly depicted altered sexual images and false advertisements portraying activists, including Carmen Lau, as sex workers. Police described the materials as malicious communications. The incidents were described by victims and officials as an escalation of transnational harassment and intimidation.
-
ChatGPT Reportedly Found to Reproduce Protected German Lyrics in Copyright Case AIID ↗
A Munich regional court ruled that ChatGPT reportedly reproduced protected German song lyrics and that OpenAI's models were trained on copyrighted texts, including works by musician Herbert Grönemeyer, without authorization. The court reportedly found both memorization of nine songs and lyric output to infringe exploitation rights. OpenAI disputes the ruling and may appeal. Damages were ordered, with implications for AI training on copyrighted works.
-
Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad AIID ↗
Reports from Hyderabad describe two alleged patient harms after individuals acted on purportedly ChatGPT-generated medical advice instead of clinician guidance. A kidney-transplant recipient reportedly discontinued prescribed post-transplant medications based on a chatbot suggestion and experienced graft failure. In a separate case, a man with diabetes allegedly developed severe hyponatremia after following a chatbot-advised zero-salt diet.
-
Purportedly AI-Generated Sexual Images of At Least 400 Minors at Zacatecas School Were Reportedly Created and Sold Online AIID ↗
A student at Escuela Secundaria Técnica No. 1 in Zacatecas, Mexico, allegedly used an AI image-generation system to create sexually explicit manipulated images of classmates. According to victims and parents, the student reportedly produced a catalog containing images of more than 400 minors, organized by grade and group, and distributed or sold the material online. Students reported that the perpetrator took photos around the school to use as inputs. The Fiscalía de Zacatecas opened an investig
-
Rep. Mike Collins's Campaign Allegedly Produced Deepfake of Sen. Jon Ossoff Supporting the Government Shutdown AIID ↗
Rep. Mike Collins's congressional campaign allegedly created and posted an AI-generated video that purportedly used Sen. Jon Ossoff's portrait and synthetic voice to falsely depict him supporting the ongoing government shutdown. The video was reportedly shared on the campaign's X account with a limited disclaimer. Georgia Democrats criticized the deepfake as misleading, and the campaign reportedly indicated it would continue using similar AI tactics.
-
Alleged AI-Generated Deepfake of Western Australia Premier Roger Cook Used in YouTube Investment Scam AIID ↗
Western Australia's Consumer Protection commissioner warned of a scam using a purported AI-generated deepfake of Premier Roger Cook to promote a fraudulent investment scheme in a YouTube pop-up ad. The manipulated video reportedly uses less than 10 seconds of real footage and voice and falsely depicts Cook endorsing "low investment, high return" opportunities. Cook called the scam "very scary," while regulators urged platforms to act on AI-driven frauds.
-
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation AIID ↗
Police in Baltimore County responded to Parkville High School after the Omnilert AI security system reportedly detected what it believed to be a gun. Officers searched the school, and students were relocated to a supervised area during the investigation. No weapon was found, and normal activities resumed after an all-clear.
-
Meta's Automated Ad and Targeting Systems Reportedly Enabled Large-Scale Fraud Revenue AIID ↗
Internal Meta documents reviewed by Reuters reportedly show that the company's automated ad and targeting systems generated major revenue from fraudulent ads and exposed users to billions of scam impressions daily. Enforcement was limited by internal revenue guardrails. In one example, a Royal Canadian Air Force recruiter's account was hacked and used to run a crypto scam that defrauded several colleagues after repeated reports allegedly went unanswered.
-
Four Lawyers Reportedly Sanctioned After Purportedly AI-Related Hallucinated Citations Appeared in Withers v. City of Aberdeen AIID ↗
In Withers v. City of Aberdeen, a federal judge in Mississippi reportedly sanctioned four lawyers after filings from both sides contained purportedly hallucinated legal citations linked to unverified AI use. The court said Kathleen Wilson used First Drafts to draft a filing and Kathryn Williams used an AI legal-research tool; all four attorneys were removed from the case and fined.
-
'Citizens Against Mamdani' Accounts Reportedly Posted AI-Generated Videos of Fictional New Yorkers to Simulate Political Opposition AIID ↗
In New York, linked "Citizens Against Mamdani" accounts reportedly posted AI-generated videos of fictional constituents criticizing then-mayor-elect Zohran Mamdani across Instagram, TikTok, and X. Some videos reportedly displayed a visible Sora watermark, and forensic reviewers reportedly assessed at least one clip as highly likely to be a deepfake. The campaign reportedly appeared to simulate grassroots opposition and drew substantial engagement.
-
Purportedly AI-Generated Video Reportedly Depicted Kosovo LDK Figure Hykmete Bajrami and Former Serbian List Leader Goran Rakiq Walking Hand in Hand AIID ↗
A purported AI-generated video is reported to have circulated on Facebook showing LDK parliamentary group chair Hykmete Bajrami and former Serbian List leader Goran Rakiq walking hand in hand. In addition to the video reportedly being generated by AI, its audio was purportedly stitched together from separate parts of Bajrami's Debat Plus interview.
-
Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats AIID ↗
A lawsuit filed by Stephanie Gray alleges OpenAI's ChatGPT (GPT-4o) reinforced and romanticized suicidality during months of emotionally intimate chats with her son Austin Gordon, including generating a personalized "Goodnight Moon" farewell-style text. The complaint reportedly says Gordon bought a handgun on Oct. 28, 2025 and was found dead Nov. 2, 2025 in a Colorado hotel room.
-
Social Media Recommendation Algorithms Allegedly Repeatedly Exposed 13-Year-Old Blake Gallier to Suicide-Related Videos Before Her Death AIID ↗
Before her death on October 30, 2025, 13-year-old Blake Gallier reportedly viewed and reposted social-media videos normalizing suicide. After examining her phone, her family alleged that recommendation algorithms had repeatedly surfaced similar material. The platform or platforms involved have not been publicly identified, and an inquest into her death remains pending.
-
A.B. Paterson College Teacher in Queensland Allegedly Used AI to Create Explicit Images of Students and Staff AIID ↗
Queensland police in Australia allege that former A.B. Paterson College teacher Robert John Thomas used a work-issued laptop and AI software to create explicit images depicting staff members and students. The school discovered and quarantined the material in October 2025, dismissed Thomas, and reported the matter to police. Authorities said there was no evidence he shared the images; he was charged with child-exploitation and computer-misuse offences in July 2026.
-
KPMG Report Allegedly Included Hallucinated Citations and Inaccurate Agentic AI Case Studies AIID ↗
In October 2025, KPMG published "Total Experience: Redefining Excellence in the Age of Agentic AI." GPTZero later reported that only five of 45 citations accurately matched their sources, while others contained flawed details. The pattern reportedly suggested an unverified LLM research tool, but the system and extent of AI involvement remain unconfirmed.
-
Balázs Orbán Allegedly Published Purported Deepfake of Péter Magyar Claiming He Would Cut Pensions AIID ↗
In Hungary, opposition leader Péter Magyar alleged that Viktor Orbán aide Balázs Orbán published an unlabeled deepfake video on Facebook reportedly depicting Magyar as saying he would cut and tax pensions ahead of the 2026 parliamentary election. Magyar reportedly said he would file a criminal complaint and described the video as defamatory.
-
NTB Report on Telenor Security Findings Was Withdrawn After AI Tool Allegedly Introduced Fabricated Quotes AIID ↗
NTB allegedly published a news story about Telenor's annual security report that contained purportedly AI-generated errors, including five reportedly fabricated quotes and a nonexistent "security director." The article was reportedly created with an external AI tool and was withdrawn the same morning. Telenor alerted NTB to the inaccuracies, and NTB apologized, citing improper AI use and initiating internal review of its newsroom practices.
-
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud AIID ↗
Purportedly AI-generated deepfake videos and fabricated news pages impersonating Maltese ministers, journalists, financial experts, and major media outlets reportedly promoted the fraudulent "NethertoxAGENT" investment platform. The scam used synthetic interviews, cloned branding, and falsified testimonials to mislead social media users, reportedly inducing financial losses and prompting law enforcement concern in Malta.
-
Waymo Autonomous Vehicle Reportedly Ran Over and Killed a Cat in San Francisco AIID ↗
A Waymo autonomous taxi in San Francisco's Mission District reportedly ran over a well-known neighborhood cat, Kit Kat. The vehicle was reportedly pulling away from a pickup when the cat darted under it, according to Waymo. Local residents reportedly attempted to intervene, and a bartender transported the injured cat to an emergency clinic, where it later died.
-
Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions AIID ↗
OpenAI disclosed internal estimates suggesting that hundreds of thousands of ChatGPT users each week exhibit signs of mania, psychosis, suicidal ideation, or emotional dependence on the chatbot. WIRED reported that some users have been hospitalized, divorced, or died after prolonged conversations with ChatGPT, with families alleging the system intensified delusions and contributed to severe psychological harm.
-
Purportedly AI-Generated Fake Videos of Louvre Heist Reportedly Circulated Widely Online AIID ↗
After the October 19, 2025 jewel heist at the Louvre, purported deepfakes were reported to have circulated widely online, allegedly depicting the robbery despite being fabricated.. The clips were reportedly posted on Facebook, Douyin and RedNote, and they were noted to have featured morphing artifacts, disappearing objects, and partial Sora watermarks. AI Forensics and independent checks reportedly found the scenes inconsistent with the real Apollo Gallery, confirming the footage was not real.
-
Purported Deepfakes of Public Figures and Celebrities Reportedly Used to Market Honey-Based Supplements as Alzheimer's Treatments AIID ↗
Beginning around October 2025, a campaign reportedly used AI-generated videos and cloned voices of well-known public figures and celebrities such as Bill Gates, Sanjay Gupta, Anderson Cooper, Bruce Willis, and others to market honey-based supplements as treatments for Alzheimer's disease and dementia. Consumers reportedly said modest purchases sometimes led to continuing charges or unwanted shipments, while cancellation and refund requests were difficult to resolve.
-
West Midlands Police Reportedly Relied on Erroneous Copilot-Generated Intelligence in Maccabi Tel Aviv Away-Fan Ban Decision AIID ↗
West Midlands Police reportedly included inaccurate intelligence purportedly generated using Microsoft Copilot in materials used to justify banning Maccabi Tel Aviv supporters from attending a November 2025 Europa League match against Aston Villa. The reported Copilot-linked error, which referred to a match that had not taken place, was later acknowledged by Chief Constable Craig Guildford.
-
AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims AIID ↗
An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.
-
Purportedly AI-Generated Deepfake Investment Ads Defrauded 5,000 Swedish Investors of 500 Million SEK AIID ↗
At least 5,000 Swedish investors were reportedly defrauded of around 500 million SEK (~$52.5 million USD) in 2025 through purportedly AI-generated deepfake investment ads circulated on Meta platforms. Fraudsters allegedly used fabricated videos and profiles of well-known finance figures such as journalist Gabriel Mellqvist and investor Günter Mårder to promote false stock tips in pump-and-dump schemes.
-
Purported Deepfake Video Impersonating Elton John Reportedly Induced Northeast Ohio Man to Authorize $20,000 in Scam Charges AIID ↗
A Northeast Ohio man ("Ray," pseudonym) was allegedly lured by a social-media deepfake video impersonating Elton John into a "push button" scam promising easy income from an online store. Ray reportedly said he was directed by purported "representatives" to open accounts and credit cards, after which charges accumulated to about $20,000. He later reported one card credited $9,400.
-
Purported Deepfake Mimicking RTÉ Broadcast Falsely Announced Irish Presidential Candidate Catherine Connolly's Withdrawal AIID ↗
A purported deepfake video circulated online that is alleged to have falsely depicted Irish presidential candidate Catherine Connolly announcing her withdrawal from the race. The clip reportedly mimicked an RTÉ news broadcast and spread across social media before being reported to the Electoral Commission. Connolly reportedly condemned the video as a malicious attempt to mislead voters and undermine democratic trust.
-
Google's Bard, Gemini, and Gemma AI Systems Allegedly Generated Defamatory Claims About Activist Robby Starbuck, Prompting Lawsuit AIID ↗
Conservative activist Robby Starbuck reportedly filed a defamation lawsuit against Google, alleging its Bard, Gemini, and Gemma AI systems generated false statements linking him to sexual assault and extremist activity. Starbuck claims the outputs caused reputational harm and sought over $15 million in damages. Google acknowledged the hallucinations as known LLM behavior and stated it works to minimize such inaccuracies. See also Incident 1247.
-
Westlaw CoCounsel Reportedly Generated False Legal Quotations in United States v. Farris AIID ↗
In United States v. Farris, court-appointed attorney Steven N. Howe admitted using Westlaw CoCounsel to draft appellate briefs that reportedly included AI-generated false quotations and misleading descriptions of precedent. The filing disrupted Farris's appeal, leading the court to appoint new counsel and restart briefing, while Howe lost his compensation and faced possible disciplinary action.
-
Virginia Candidate John Reid Reportedly Used AI-Generated Deepfake of Opponent Ghazala Hashmi in Simulated Political Debate AIID ↗
Republican Virginia lieutenant governor candidate John Reid reportedly held a 40-minute mock debate against a purportedly AI-generated version of Democratic opponent Sen. Ghazala Hashmi. The bot reportedly mimicked her voice and synthesized responses trained on her public statements. Hashmi's campaign denounced the nonconsensual likeness as a "shoddy gimmick."
-
California Immigration Attorneys Reportedly Sanctioned Over Briefs Containing Probable Hallucinations in LNU v. Blanche AIID ↗
California immigration attorneys Mike Singh Sethi and William Rounds were reportedly sanctioned in LNU v. Blanche after Ninth Circuit filings included purportedly fabricated and materially inaccurate legal authorities. The court said unauthorized generative AI use by unlicensed brief writers was probable and found that the attorneys failed to verify the filings and repeatedly lacked candor about the errors' source.
-
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School AIID ↗
A purportedly AI-powered gun detection system at Kenwood High School in Baltimore County, Maryland, reportedly misidentified a student's empty Doritos bag as a firearm. Armed police reportedly detained and handcuffed the student before determining there was no weapon. The AI system, operated by Omnilert, issued the false alert, leading to public outcry and an official review of school security protocols. Omnilert reportedly expressed regret for the incident.
-
AWS Outage Reportedly Caused AI-Enabled Eight Sleep Smart Beds to Overheat and Malfunction AIID ↗
The widespread Amazon Web Services (AWS) outage on October 20, 2025 reportedly caused AI-enabled Eight Sleep "Pod" smart beds to overheat or become unresponsive. The devices reportedly rely on a cloud-hosted deep learning algorithm to regulate temperature and track sleep data. When AWS went down, users reportedly lost control of their beds, which remained stuck at prior settings. Some reported overheating and incline malfunctions. Eight Sleep confirmed it is developing an offline "outage mode."
-
Purportedly AI-Generated 'King Trump' Fighter Jet Video Allegedly Posted by President Depicts Defecation Attack on 'No Kings' Protesters AIID ↗
President Donald Trump reportedly posted an AI-generated video on Truth Social showing himself crowned and piloting a fighter jet labeled King Trump, dropping feces on protesters, including influencer Harry Sisson, during No Kings demonstrations. The clip, allegedly created by another account, drew criticism from Sisson and musician Kenny Loggins, whose song "Danger Zone" was reportedly used without consent.
-
Purported Deepfake Video Allegedly Shows Conservative MP George Freeman Leaving Party for Reform UK AIID ↗
A purported AI-generated deepfake video circulated online falsely depicting UK Conservative MP George Freeman announcing his defection to the Reform UK party. The fabricated clip, which mimicked Freeman’s likeness and voice without his knowledge or consent, included statements critical of the Conservatives and was widely shared on social media. Freeman denounced the video as disinformation, reported it to police, and warned that such synthetic media pose serious risks to democratic processes.
-
Purported AI-Generated Video Reportedly Used in RM5,800 (~$1,400) Sextortion Attempt Targeting Malaysian Minor via Telegram AIID ↗
A Malaysian family reported that scammers used purported AI-generated explicit video content to target their teenage son in a sextortion attempt. The perpetrators allegedly contacted the boy via Telegram, sending manipulated footage that depicted him in compromising situations and demanding RM5,800 (~$1,400) to prevent its release. The family alerted authorities and warned others about the growing use of generative AI in targeting minors.
-
Purported AI-Generated Deepfake Video Reportedly Depicts Senator Chuck Schumer Endorsing Government Shutdown in NRSC Campaign Ad AIID ↗
The National Republican Senatorial Committee (NRSC) allegedly released a 30-second campaign ad featuring a purported deepfake video of Senator Chuck Schumer repeatedly saying, "Every day gets better for us," implying enthusiasm for a government shutdown. While the video reportedly was marked as AI-generated, it was widely circulated on social media and drew criticism from journalists and researchers, who warned it could mislead voters and erode trust in authentic political communication.
-
ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon AIID ↗
During an immigration enforcement operation in Oregon, U.S. Immigration and Customs Enforcement (ICE) officers reportedly used the facial recognition application Mobile Fortify to identify a detained woman. The system reportedly returned two different and incorrect identities for the same individual across separate scans.
-
Multiple Purported AI-Assisted Cheating Incidents Reported Across South Korea's SKY Universities During October 2025 Midterms AIID ↗
Reports from South Korea's SKY universities indicate multiple AI-assisted cheating incidents during the October 2025 midterms. At Yonsei, dozens reportedly used ChatGPT and other tools despite bans in an Oct. 15 online exam. Korea University and Seoul National reportedly found students using AI or sharing answers via group chats, prompting punitive sanctions across the institutions.
-
Purportedly AI-Generated Hunting Regulation Errors Reportedly Lead to Idaho Citation and Multi-State Warnings from Wildlife Agencies AIID ↗
A hunter in Idaho was reportedly cited for hunting a day early after relying on an AI-generated search result that misrepresented state regulations, pulling information from a failed proposal. Wildlife agencies in Idaho, Wyoming, Illinois, and Maine later warned of similar AI errors.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.