AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump AIID ↗
Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.
-
Trump Reportedly Shares Purportedly AI-Generated Images Falsely Suggesting Taylor Swift Endorsement AIID ↗
Donald Trump reportedly shared images that were purportedly generated by AI on social media that are alleged to have depicted Taylor Swift endorsing him for the upcoming election. The images reportedly included Swift dressed as Uncle Sam and fans wearing "Swifties for Trump" shirts.
-
Microsoft Copilot Falsely Accuses Journalist Martin Bernklau of Crimes AIID ↗
Microsoft's Copilot is reported to have falsely accused veteran court reporter Martin Bernklau of committing serious crimes, including child abuse and fraud. The tool is described as having generated defamatory content that not only accused Bernklau of multiple crimes he covered as a journalist but also provided his personal contact details. Attempts by Microsoft to remove the false entries were only temporarily successful, as the defamatory information reportedly reappeared.
-
AI incident: sexual content (Aug 2024) AIID ↗
In August 2024, the San Francisco City Attorney’s Office filed a first-of-its-kind lawsuit against 16 websites accused of using generative AI to create and distribute nonconsensual pornographic deepfakes, including images of minors. The sites, which had over 200 million visits in six months, invited users to upload real images to generate explicit fakes. By March 2025, 11 of the targeted websites had shut down following legal pressure.
-
ChatGPT Allegedly Defamed Norwegian User by Inventing Child Homicide and Imprisonment AIID ↗
In August 2024, ChatGPT is reported to have falsely claimed that Norwegian citizen Arve Hjalmar Holmen had killed his two sons and been sentenced to 21 years in prison. The fabricated response allegedly included specific details about the supposed crime, despite Holmen never being accused or convicted of any offense. The incident prompted a GDPR complaint for defamation and inaccurate personal data.
-
Deepfake Elon Musk Videos Have Reportedly Contributed to Billions in Fraud AIID ↗
Scammers used AI to create deepfake videos of Elon Musk promoting fraudulent investment opportunities. Over time, these scams have reportedly led to billions in investor losses. The deepfakes also use voice cloning technology. They have been distributed on social media and YouTube. In particular, they target the elderly, such as 82-year-old Steve Beauchamp, to invest significant sums. Despite efforts by platforms to remove these videos, the scams continue to proliferate.
-
Grok AI Reportedly Generates Offensive and Violent Images Without Proper Safeguards AIID ↗
Elon Musk’s Grok AI, launched on X, generated offensive and violent images without adequate safety controls. The AI produced deepfakes of public figures like Taylor Swift, Kamala Harris, and Alexandria Ocasio-Cortez, as well as copyrighted characters such as Mickey Mouse in inappropriate scenarios. Despite claiming adherence to certain content guidelines, Grok's outputs included politically charged and explicit imagery
-
Reported Glitch in Waymo Self-Driving Cars Purportedly Triggers Regular All-Night Honking in San Francisco AIID ↗
Waymo self-driving cars in San Francisco's South of Market neighborhood reportedly began honking at each other late at night, disturbing residents' sleep. The autonomous vehicles, reportedly using a parking lot for ride pauses, triggered honking due to a purported glitch in their algorithms. Despite residents' complaints, the issue allegedly persisted for weeks until Waymo acknowledged the problem and began working on a fix.
-
Grok AI Chatbot Reportedly Spreads Unfounded Rumors About Trump’s Dentures AIID ↗
Grok, X’s AI-powered chatbot, reportedly spread unsubstantiated claims about former President Trump’s alleged dentures during his interview with Elon Musk. The AI-generated summary is alleged to have falsely stated that Trump’s speech issues were due to missing dentures, despite no evidence. The post was quickly removed, but the incident is an example of concerns over Grok's tendency to amplify misinformation.
-
TikTok AI System Used to Amplify Election Disinformation by Foreign Networks AIID ↗
AI-generated misinformation on TikTok, driven by foreign networks, has flooded the platform with false narratives about the 2024 U.S. presidential election. Thousands of videos spreading political lies were identified, potentially influencing millions of users. Despite TikTok’s efforts to remove these accounts, the AI-driven disinformation campaign continues to challenge the integrity of the election.
-
Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China AIID ↗
In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensiv
-
Apple Intelligence Allegedly Flags Scam Messages as High Priority AIID ↗
Apple’s AI notification summarization and prioritization feature, part of the Apple Intelligence update, has reportedly flagged scam and phishing messages as high-priority, and is allegedly misleading users into trusting fraudulent communications. By rephrasing and condensing messages, the system is allegedly amplifying scam risks inadvertently and reportedly increasing the likelihood of financial harm for users.
-
Reported AI-Manipulated Video Depicts Donald Trump Endorsing Peter Obi and Criticizing Bola Tinubu AIID ↗
A widely circulated video reportedly falsely depicts Donald Trump endorsing Nigerian politician Peter Obi and criticizing President Bola Tinubu. FactCheckAfrica confirmed the video was false, originally sourced from a 2017 U.S. presidential interview about Trump's first 100 days in office. AI-generated audio and altered visuals were reportedly used to fabricate a politically charged statement unrelated to the original content.
-
Norwegian Student Reportedly Used AI-Generated Deepfake Videos in Spanish Coursework at University of South-Eastern Norway AIID ↗
A student at the University of South-Eastern Norway reportedly submitted multiple deepfake videos for Spanish coursework, featuring an AI-generated likeness and synthetic voice. Faculty reportedly noted unnatural facial movements and inconsistent language ability. The case was reportedly ruled academic misconduct, resulting in annulled grades and a year-long suspension, marking one of Norway's first confirmed deepfake-related cheating cases.
-
South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations AIID ↗
Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.
-
AI-Generated Fake 'True Crime' Video About Non-Existent Littleton Murder Goes Viral AIID ↗
An AI-generated "true crime" video on YouTube falsely depicted a Littleton man's "secret gay love affair" and murder by his stepson. The 25-minute video, which garnered nearly 2 million views, fabricated details and used deepfake technology to deceive viewers into believing the story was real. Despite being flagged as false by local authorities and lacking credible sources, the video sparked widespread misinformation and outrage online.
-
TikTok Network Amplifies AI-Generated Nazi Propaganda and Hate Speech AIID ↗
A coordinated neo-Nazi network on TikTok used AI-generated media, including Hitler speeches, to spread Nazi propaganda and extremist content, violating TikTok’s hate speech policies. The network evaded platform moderation through coded language, imagery, and music, with some accounts accumulating millions of views. TikTok’s algorithm further amplified the reach of this content, despite community guidelines.
-
Deepfake of Kamala Harris Saying Damaging Comments Circulates on X and Is Amplified by Elon Musk AIID ↗
The X user @MrReaganUSA uploaded a deepfake of Kamala Harris saying damaging comments about Joe Biden and her own qualifications for the presidency, originally marking it as a parody. The post was shared and amplified eight hours later via Elon Musk's account without the disclaimer.
-
SearchGPT Reportedly Misleads Users with Incorrect Festival Dates in Demo AIID ↗
OpenAI’s prototype AI tool, SearchGPT, provided incorrect dates for An Appalachian Summer Festival in Boone, North Carolina during a demonstration video. The AI listed dates that were incorrect, potentially misleading users planning to attend the event, but also harming the reputation of OpenAI as the incident occurred during a high-profile event.
-
Sichuan Province Beset by Numerous Fabricated AI-Generated Reports of Disasters and Crises AIID ↗
In Sichuan, AI tools were reportedly used to create and disseminate false reports across various cities, including fabricated stories of landslides, earthquakes, standoffs, accidents, and health-related incidents. These AI-driven rumors misled the public, caused alarm and confusion, and strained local authorities. The alleged perpetrators sought social media engagement and financial gain through clickbait content. The authorities in Sichuan ultimately levied administrative penalties against the
-
AI Chatbots Reportedly Inaccurately Conveyed Real-Time Political News AIID ↗
Over a week of back-to-back, significant breaking political news stories, including the Trump rally shooting and Biden’s campaign withdrawal, AI chatbots reportedly failed to provide accurate real-time updates. Most chatbots gave incorrect or outdated information, demonstrating their current limitations in handling fast-paced news. These incidents suggest the continuing need for improved AI capabilities and caution in their deployment for real-time news dissemination.
-
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage AIID ↗
A purported deepfake video depicting Philippine President Ferdinand Marcos Jr. using drugs was released by Rodrigo Duterte ally Claire "Maharlika" Contreras at a Maisug rally in Los Angeles. The clip was reportedly timed to discredit Marcos ahead of his State of the Nation Address. Philippine authorities reportedly confirmed it was fake. The video was allegedly amplified by China's Spamouflage network via coordinated inauthentic accounts on X and YouTube.
-
False Election Data on Kamala Harris Reportedly Circulated via Grok AI Chatbot AIID ↗
After President Joe Biden stepped aside as a presidential candidate on July 21, 2024, the AI chatbot Grok on X reportedly falsely informed users that Vice President Kamala Harris missed the ballot deadline in nine states. This misinformation, which spread widely on social media, prompted secretaries of state from five U.S. states to urge Elon Musk to address the problem.
-
Fatalities Reportedly Occur Despite VioGén Algorithm's Low or Negligible Risk Scores AIID ↗
The VioGén algorithm was designed to help Spanish police assess and prioritize the risk of repeat domestic violence incidents. However, its low-risk assessment of Lobna Hemid reportedly led to inadequate protection; her husband murdered her. Since 2007, 247 women have been killed after being assessed by VioGén. A review of 98 homicides found that 55 of the slain women were scored as negligible or low risk.
-
Ferrari Executive Targeted by AI Deepfake Scam Impersonating CEO Benedetto Vigna AIID ↗
A Ferrari executive was targeted by an AI-generated deepfake impersonating CEO Benedetto Vigna in an alleged fraud attempt. The scammer, using WhatsApp and a cloned voice, claimed an urgent, secretive financial deal required immediate action. The executive became suspicious after detecting slight artificial intonations; the scam failed when the executive tested the caller by asking about a recent book recommendation.
-
Gemini AI Allegedly Reads Google Drive Files Without Explicit User Consent AIID ↗
Kevin Bankston, a privacy activist, claims that Google's Gemini AI scans private Google Drive PDFs without explicit user consent. Bankston reports that after using Gemini on one document, the AI continues to access similar files automatically. Google disputes these claims, stating that Gemini requires proactive user activation and operates within privacy-preserving settings.
-
Taranaki, New Zealand Resident Allegedly Defrauded of $224K in Bitcoin Scam Using Deepfake of Prime Minister Christopher Luxon AIID ↗
A Taranaki, New Zealand resident allegedly lost $224,000 in a Bitcoin scam involving a deepfake video reportedly depicting Prime Minister Christopher Luxon. The AI-generated video, shared on Facebook, purportedly promoted cryptocurrency investments targeting superannuitants. Scammers posing as financial advisers reportedly gained remote access to the victim’s computer and created accounts to facilitate the transfer of funds.
-
Grok AI Model Reportedly Fails to Produce Reliable News in Wake of Trump Assassination Attempt AIID ↗
xAI's model Grok, intended to automate news delivery on the X platform, is reported to have struggled to provide accurate information during the attempted assassination of former President Donald Trump. Grok apparently issued incorrect headlines, including false reports about Vice President Kamala Harris being shot and misidentifying the alleged shooter. These errors show the pitfalls of relying on AI for real-time news aggregation, as it allegedly amplified unverified claims and failed to recog
-
Suspect in Palisades Fire Allegedly Consulted ChatGPT for Arson Tips and Legal Advice Before Blaze That Killed 12 and Destroyed 6,837 Structures AIID ↗
Federal prosecutors allege that Jonathan Rinderknecht, arrested on 10/08/2025, consulted ChatGPT for arson-related imagery and legal advice before and after deliberately starting the Palisades fire in Los Angeles on 01/01/2025. The blaze, which reignited on 01/07/2025, killed 12 people and destroyed 6,873 buildings. Prosecutors say he generated a dystopian fire image with ChatGPT and later asked about liability for fires caused by cigarettes.
-
NullBulge's AI-Powered Malware Allegedly Compromises Disney Employee and Internal Data AIID ↗
A Disney employee, Matthew Van Andel, reportedly downloaded AI-powered malware allegedly developed by the cybercriminal group NullBulge, resulting in a major cybersecurity breach. Hackers purportedly accessed Disney's Slack system, exposing 44 million internal messages, employee and customer data, and financial records. NullBulge also reportedly leaked Van Andel’s personal financial information, leading to identity theft and his eventual termination.
-
Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers AIID ↗
Researchers have argued that the Department for Work and Pensions' Universal Credit system disproportionately impacts single mothers. Automated processes in the system, designed to determine eligibility and detect fraud, are reported to have introduced biases, leading to financial instability and hardship. The algorithms allegedly miscalculate earnings and delay childcare reimbursements, in turn exacerbating income volatility and debt among single mothers.
-
Baidu Robotaxi Allegedly Involved in Collision with Pedestrian in Wuhan AIID ↗
On July 7, 2024, a Baidu Robotaxi reportedly collided with a pedestrian at a traffic intersection in Wuhan. The incident occurred as the autonomous vehicle started moving on a green light while the pedestrian was allegedly crossing against a red light. The pedestrian sustained minor injuries, and Baidu was reported to have been cooperating with local authorities for further investigation.
-
AI-Generated Obituaries Are Reportedly Intensifying Grief for Bereaved Families AIID ↗
AI-generated obituaries on various websites are reported to have compounded the grief of bereaved families by spreading incorrect and unauthorized information about their loved ones. These obituaries, produced without the families' knowledge, often contain errors and appear on ad-filled sites, exacerbating the emotional distress of the grieving process.
-
China Targets AI-Driven Fraud and Deepfake Scandals with New Crackdowns AIID ↗
Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
-
Purported Deepfake Targets Olena Zelenska in Alleged Russian Disinformation Campaign AIID ↗
A purported deepfake video falsely suggesting that Olena Zelenska, wife of Ukrainian President Volodymyr Zelenskyy, purchased a luxury car, reportedly circulated widely online. The video is reportedly part of a Russian-linked disinformation campaign aimed at undermining Ukraine and its supporters.
-
Figma Disables AI Feature After Accusations of Copying Apple’s Weather App AIID ↗
Figma has temporarily disabled its AI design feature, "Make Design," after accusations of copying Apple’s Weather app. Andy Allen of NotBoring Software highlighted the issue, prompting Figma CEO Dylan Field to deny claims of training the AI on specific app designs. However, Field acknowledged flaws in the QA process and promised to suspend the feature until it meets quality standards. The incident has implications for designers.
-
Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme AIID ↗
Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for "fees" or "taxes" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.
-
AllHere's Chatbot 'Ed' Fails and Costs Los Angeles Unified School District $6 Million AIID ↗
The Los Angeles Unified School District invested up to $6 million in developing the AI chatbot "Ed," meant to provide academic and mental health support for students. The chatbot allegedly failed to meet expectations, and the project collapsed when AllHere, the contracted start-up, faced financial difficulties. Prince George's County Public Schools in Maryland was also affected. Founder Joanna Smith-Griffin was removed as CEO in June 2024 and later arrested on fraud charges.
-
OpenAI's ChatGPT Mac App Stored User Data in Unencrypted Text Files AIID ↗
OpenAI's ChatGPT macOS app stored user conversations in plain text. If accessed by a malicious actor, these conversations could have been easily read. The critical security flaw was demonstrated by a third party and ultimately resolved after OpenAI released an update to encrypt the stored data.
-
AI incident: sexual content (Jul 2024) AIID ↗
Female politicians in the United Kingdom, including Angela Rayner, Gillian Keegan, Penny Mordaunt, Priti Patel, Stella Creasy, and Dehenna Davison, have reportedly been targeted by non-consensual, purportedly AI-generated deepfake pornography. The images, which some accounts suggest may have circulated online for an extended period, were reported to have caused distress and, in at least some instances, to have prompted reports to or involvement by law enforcement.
-
AI incident: sexual content (Undress AI, Jun 2024) AIID ↗
Throughout 2024, schools in Australia reportedly dealt with a significant rise and proliferation of nonconsensual deepfake pornography of students. Often, male students are reported to use "nudify" apps such as Undress AI with images of their classmates and teachers. Many of the sites have reportedly remained legal and allegedly accessible to minors, who in turn are purportedly using the sites to generate pornography of their peers.
-
Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan AIID ↗
Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that "Lau" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment.
-
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes AIID ↗
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
-
AI Work Assistants Require More Effort Than Expected, CIOs Say AIID ↗
AI work assistants, such as Copilot for Microsoft 365 and Gemini for Google Workspace, are proving to be more labor-intensive than anticipated for enterprises. CIOs report that these AI tools struggle with outdated or inaccurate data, leading to incorrect outputs. Companies are finding they must invest heavily in data management to ensure reliability. This added effort has led to delays in deployment and frustration, as businesses work to maximize the potential of these expensive AI tools.
-
Udio Allegedly Copied Copyrighted Sound Recordings Without Permission to Train Its Generative AI Models AIID ↗
Record labels and independent artists alleged that Udio copied copyrighted recordings without permission and used them to train its generative music models. Udio acknowledged that its training data presumably included recordings owned by the plaintiffs but argued the copying was fair use. Plaintiffs alleged losses of licensing control and compensation and competition from AI-generated music.
-
Suno Allegedly Copied Copyrighted Music Without Permission to Train Its Generative AI Models AIID ↗
Record labels and independent artists alleged that Suno copied copyrighted recordings without permission and used them to train its generative music models. Suno later acknowledged training on tens of millions of publicly accessible recordings while asserting fair use. Plaintiffs alleged the practice deprived rightsholders of licensing control and compensation and enabled competing AI-generated music.
-
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud AIID ↗
A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.
-
AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection AIID ↗
Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.
-
Senior Minister of Singapore Lee Hsien Loong Allegedly Misrepresented in Two Deepfake Videos on Foreign Relations AIID ↗
Two deepfake videos falsely depicted Senior Minister of Singapore Lee Hsien Loong commenting on US-China relations and the South China Sea. The videos misleadingly attributed views to him and the Singapore government. Posted on TikTok, the videos amassed over 190,000 views before being removed.
-
Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech AIID ↗
TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.
Frequently asked questions
- What is recorded in each incident?
- What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
- Does an incident mean wrongdoing was proven?
- No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
- How current is the incident data?
- It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
- Does this page include the full incident reports?
- No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.