AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
Filter incidents (1 active)
-
Figma Disables AI Feature After Accusations of Copying Apple’s Weather App AIID ↗
Figma has temporarily disabled its AI design feature, "Make Design," after accusations of copying Apple’s Weather app. Andy Allen of NotBoring Software highlighted the issue, prompting Figma CEO Dylan Field to deny claims of training the AI on specific app designs. However, Field acknowledged flaws in the QA process and promised to suspend the feature until it meets quality standards. The incident has implications for designers.
-
Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme AIID ↗
Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for "fees" or "taxes" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.
-
AllHere's Chatbot 'Ed' Fails and Costs Los Angeles Unified School District $6 Million AIID ↗
The Los Angeles Unified School District invested up to $6 million in developing the AI chatbot "Ed," meant to provide academic and mental health support for students. The chatbot allegedly failed to meet expectations, and the project collapsed when AllHere, the contracted start-up, faced financial difficulties. Prince George's County Public Schools in Maryland was also affected. Founder Joanna Smith-Griffin was removed as CEO in June 2024 and later arrested on fraud charges.
-
OpenAI's ChatGPT Mac App Stored User Data in Unencrypted Text Files AIID ↗
OpenAI's ChatGPT macOS app stored user conversations in plain text. If accessed by a malicious actor, these conversations could have been easily read. The critical security flaw was demonstrated by a third party and ultimately resolved after OpenAI released an update to encrypt the stored data.
-
AI incident: sexual content (Jul 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 1 July 2024. Risk classification, related incidents and the laws on record for this risk area.
-
AI incident: sexual content (Undress AI, Jun 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 29 June 2024. Risk classification, related incidents and the laws on record for this risk area.
-
Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan AIID ↗
Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that "Lau" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment.
-
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes AIID ↗
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
-
AI Work Assistants Require More Effort Than Expected, CIOs Say AIID ↗
AI work assistants, such as Copilot for Microsoft 365 and Gemini for Google Workspace, are proving to be more labor-intensive than anticipated for enterprises. CIOs report that these AI tools struggle with outdated or inaccurate data, leading to incorrect outputs. Companies are finding they must invest heavily in data management to ensure reliability. This added effort has led to delays in deployment and frustration, as businesses work to maximize the potential of these expensive AI tools.
-
Udio Allegedly Copied Copyrighted Sound Recordings Without Permission to Train Its Generative AI Models AIID ↗
Record labels and independent artists alleged that Udio copied copyrighted recordings without permission and used them to train its generative music models. Udio acknowledged that its training data presumably included recordings owned by the plaintiffs but argued the copying was fair use. Plaintiffs alleged losses of licensing control and compensation and competition from AI-generated music.
-
Suno Allegedly Copied Copyrighted Music Without Permission to Train Its Generative AI Models AIID ↗
Record labels and independent artists alleged that Suno copied copyrighted recordings without permission and used them to train its generative music models. Suno later acknowledged training on tens of millions of publicly accessible recordings while asserting fair use. Plaintiffs alleged the practice deprived rightsholders of licensing control and compensation and enabled competing AI-generated music.
-
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud AIID ↗
A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.
-
AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection AIID ↗
Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.
-
Senior Minister of Singapore Lee Hsien Loong Allegedly Misrepresented in Two Deepfake Videos on Foreign Relations AIID ↗
Two deepfake videos falsely depicted Senior Minister of Singapore Lee Hsien Loong commenting on US-China relations and the South China Sea. The videos misleadingly attributed views to him and the Singapore government. Posted on TikTok, the videos amassed over 190,000 views before being removed.
-
Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech AIID ↗
TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.
-
AI incident: sexual content (Instagram, Jun 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 20 June 2024. Risk classification, related incidents and the laws on record for this risk area.
-
Erroneous Declined Transaction Notification by PayPal AI Assistant AIID ↗
On July 13th, 2024, a user reported an incident involving PayPal's generative AI chatbot. The chatbot allegedly incorrectly informed the user of a declined transaction that never occurred, causing confusion and prompting a call to customer service for clarification. This false alert suggests a flaw in the AI system's reliability. The incident created unnecessary labor for both the user and PayPal's human support, demonstrating the potential harm of deploying generative AI without thorough testin
-
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites AIID ↗
An audit by NewsGuard revealed that leading chatbots, including ChatGPT-4, You.com’s Smart Assistant, and others, repeated Russian disinformation narratives in one-third of their responses. These narratives originated from a network of fake news sites created by John Mark Dougan (Incident 701). The audit tested 570 prompts across 10 AI chatbots, showing that AI remains a tool for spreading disinformation despite efforts to prevent misuse.
-
Tesla Reportedly in Autopilot Mode Hits Parked Police Vehicle in Fullerton, California AIID ↗
A Tesla reportedly in self-driving mode crashed into a parked patrol vehicle in Fullerton, California while the officer was responding to a fatal DUI crash. The officer narrowly escaped injury. The driver reports having been distracted by a cellphone and having relied on the Tesla’s AI. (The earlier crash involved a suspected DUI driver who killed a motorcyclist stopped at a red light.)
-
Independent News Sites Flagged as Spam by Facebook's AI Moderation System AIID ↗
Facebook's AI moderation system mistakenly flagged and removed legitimate news articles from independent local publishers as spam. This affected publishers worldwide, disrupting content distribution and impacting traffic. Despite attempts to appeal, many publishers received no response.
-
Purportedly AI-Generated Papers Are Alleged to Have Manipulated Scopus Rankings in Top Philosophy Journals AIID ↗
Three reportedly fake journals published by Addleton Academic Publishers allegedly manipulated Scopus rankings by extensively cross-citing each other and using AI-generated papers filled with buzzwords. These journals, placed in the top 10 of Scopus's 2023 CiteScore philosophy list, reportedly featured fake authors, affiliations, and grant numbers, in turn allegedly pushing legitimate journals to lower tiers, affecting academic evaluations and awards.
-
Yale Student Suspended and Given F After GPTZero Allegedly Misclassified Exam as AI-Generated AIID ↗
In 2024, Yale University reportedly used GPTZero as one factor in investigating whether Executive MBA student Thierry Rignol used AI on an exam. Rignol reportedly denied cheating and alleged the detector falsely classified his writing as AI-generated. Yale reportedly later suspended him for a year and gave him an F, while citing additional evidence and his conduct during the investigation. Rignol has challenged the process in federal court.
-
Auto Insurers Allegedly Are Surreptitiously Collecting and Scoring Driver Data AIID ↗
The insurance industry allegedly uses AI and telematics to score drivers based on behaviors tracked by automakers and apps like Life360. Data, often collected without clear consent, may affect insurance rates and raises privacy concerns. Consumers are largely unaware of this surveillance, leading to potential misuse and discrimination based on driving habits or socioeconomic factors.
-
Turkish Student in Isparta Allegedly Uses AI to Cheat on Exam, Leading to Arrest AIID ↗
A Turkish student in Isparta was reportedly arrested for using ChatGPT to cheat during the 2024 YKS university entrance exam. The student, identified as M.E.E., is alleged to have employed a sophisticated setup involving a router, mobile phone, earphone, and a button-shaped camera to transmit exam questions to ChatGPT and receive answers in real-time.
-
AI incident: sexual content (Jun 2024) AIID ↗
An AI Incident Database record involving sexual content, dated 7 June 2024. Risk classification, related incidents and the laws on record for this risk area.
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
What is recorded in each incident?
What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
Does an incident mean wrongdoing was proven?
No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
How current is the incident data?
It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
Does this page include the full incident reports?
No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.