AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Alleged Deepfake of Singapore Prime Minister Lee Hsien Loong Promotes Cryptocurrency Scam in Fake Interview AIID ↗
A deepfake video falsely depicted Singapore’s Prime Minister Lee Hsien Loong promoting a cryptocurrency investment scam. Scammers used AI-generated voice cloning and manipulated footage from official events to create a convincing but fraudulent video interview with China Global Television Network. Lee warned the public and urged reporting through the ScamShield Bot.
-
Deepfake Video Reportedly Depicts U.S. Congressman Rob Wittman Endorsing Military Support for Taiwan's Democratic Progressive Party AIID ↗
A deepfake video is reported to have falsely depicted U.S. Congressman Rob Wittman endorsing military support for Taiwan’s Democratic Progressive Party candidates in the 2024 presidential election. Shared on TikTok, the video is reported to have undermined Taiwanese voter confidence in the DPP by alleging U.S. interference. Fact-checking from AFP finds Wittman never made the statements attributed to him.
-
Presidency of Moldova Reportedly Refutes Purported Deepfake Video Slandering President Maia Sandu AIID ↗
A deepfake video reportedly depicting President Maia Sandu's image and voice was released in Moldova, allegedly portraying her in a negative light to sow division and undermine democratic institutions. This video reportedly appeared on Telegram and was linked to Russian disinformation efforts.
-
The New York Times Reportedly Sues OpenAI and Microsoft Over Alleged Unauthorized AI Training on Its Content AIID ↗
The New York Times alleges that OpenAI and Microsoft used millions of its articles without permission to train AI models, including ChatGPT. The lawsuit claims the companies scraped and reproduced copyrighted content without compensation, in turn undermining the Times’s business and competing with its journalism. Some AI outputs allegedly regurgitate Times articles verbatim. The lawsuit seeks damages and demands the destruction of AI models trained on its content.
-
Proliferation of Deepfakes Disrupting 2024 Lok Sabha Elections AIID ↗
Digital manipulators in India are using deepfake technology to influence the 2024 Lok Sabha elections. These AI-generated videos and audio clips are designed to tarnish the reputations of political candidates, challenging the integrity of electoral processes.
-
Social Media Scammers Used Deepfakes of Taylor Swift and Several Other Celebrities in Fraudulent Le Creuset Cookware Giveaways AIID ↗
Scammers reportedly made deepfakes of Taylor Swift, Selena Gomez, Joanna Gaines, Lainey Wilson, Ree Drummond, Oprah, Jennifer Lopez, Trisha Yearwood, Martha Stewart, and Blake Shelton promoting a Le Creuset giveaway. These AI-generated ads, appearing on Meta and TikTok, falsely claimed users could receive free cookware by paying a small shipping fee. Victims were unknowingly enrolled in a costly monthly subscription.
-
NewsBreak Reportedly Published AI-Assisted Articles Containing Purportedly False Local and Community-Service Information AIID ↗
NewsBreak reportedly published AI-assisted local articles containing purportedly false information, including a fabricated Christmas shooting in Bridgeton, New Jersey, incorrect Food to Power distribution times that caused people to be turned away, and nonexistent Harvest912 foot-care clinics. NewsBreak said the errors originated in source material and removed the articles after complaints. The specific AI models and the extent to which they contributed to the inaccuracies were not identified.
-
Child Sexual Abuse Material Taints Image Generators AIID ↗
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
-
Rite Aid Facial Recognition Disproportionately Misidentified Minority Shoppers as Shoplifters AIID ↗
Rite Aid used facial recognition technology from October 2012 to July 2020, allegedly leading to disproportionate misidentifications of women, Black, Latino, and Asian shoppers as "likely" shoplifters. The FTC settlement prohibits Rite Aid from using this technology in stores for five years.
-
Chevrolet Dealer Chatbot Agrees to Sell Tahoe for $1 AIID ↗
A Chevrolet dealer's AI chatbot, powered by ChatGPT, humorously agreed to sell a 2024 Chevy Tahoe for just $1, following a user's crafted prompt. The chatbot's response, "That's a deal, and that's a legally binding offer – no takesies backsies," was the result of the user manipulating the chatbot's objective to agree with any statement. The incident highlights the susceptibility of AI technologies to manipulation and the importance of human oversight.
-
Manipulated Deepfake Video of Lai Ching-te Endorsing Rivals in Lead-up to January Presidential Elections AIID ↗
In the lead-up to Taiwan's presidential election in January 2024, a deepfake video circulated showing candidate Lai Ching-te endorsing his rivals. Taiwanese intelligence issued warnings of intensified Chinese disinformation campaigns, such as Spamouflage, aimed at manipulating the election outcome.
-
Navy Federal Credit Union Faces Allegations of Racial Bias in Mortgage Approvals AIID ↗
Navy Federal Credit Union, serving military members and veterans, faced allegations of racial bias in its mortgage approval process, which relies on automated underwriting technology. In 2022, data revealed significant disparities in loan approvals, with over 50% of Black applicants denied, compared to higher approval rates for white applicants.
-
Google Bard Allegedly Generated Fake Legal Citations in Michael Cohen Case AIID ↗
Michael Cohen, former lawyer for Donald Trump, claims to have used Google Bard, an AI chatbot, to generate legal case citations. These false citations were unknowingly included in a court motion by Cohen's attorney, David M. Schwartz. The AI's misuse highlights emerging risks in legal technology, as AI-generated content increasingly infiltrates professional domains.
-
Alleged Deepfake of Singapore Deputy Prime Minister Lawrence Wong Falsely Shows Him Endorsing Commercial Products AIID ↗
A deepfake video falsely depicting Singapore Deputy Prime Minister Lawrence Wong endorsing commercial products circulated online in December 2023. Wong publicly denied the endorsement, warning that scammers had used AI-generated deepfake technology to impersonate him. The manipulated media aimed to mislead the public into believing he promoted fraudulent investments. Wong urged vigilance against AI-driven scams and encouraged reporting through the ScamShield Bot on WhatsApp.
-
Deepfake Nudes Targeting Underage Female Students at Collège Béliveau in Winnipeg Shared Online AIID ↗
At Collège Béliveau in Winnipeg, female students between grades 7-12 were targeted in the creation of deepfake nudes, which were then distributed online. Specific numbers and identities of victims and perpetrators were not released, and no charges were ultimately filed owing to the gap between existing laws and the nature of the incident.
-
Waymo Software Flaw Reportedly Leads to Double Collision with Tow Truck AIID ↗
Two Waymo autonomous vehicles reportedly hit the same tow truck under unusual towing conditions due to a software misinterpretation in Phoenix, Arizona. Waymo reportedly issued a software recall and updated its fleet to prevent future such incidents.
-
Two Florida Middle School Students Arrested Under New Law for Allegedly Having Made and Shared Deepfake Nudes of Their Classmates AIID ↗
Two teenaged boys from Miami, Florida, were arrested for allegedly creating and sharing AI-generated nude images of their classmates. Charged under a 2022 Florida law, they face third-degree felonies for producing and disseminating altered sexual depictions.
-
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates AIID ↗
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
-
Video with Reportedly AI-Generated Audio Purported to Show Croatian Footballer Luka Modrić Endorsing Immediate Matrix on Facebook Page Presented as N1 HR AIID ↗
A Facebook page presented as N1 HR, a Croatian news outlet, posted a video that purported to show Croatian footballer Luka Modrić endorsing the investment platform Immediate Matrix and promising returns of up to €4,000 per month. The clip was reported to use AI-generated audio and to link to an Index-style article promoting the scheme.
-
OpenDream AI Platform Reportedly Commercialized AI-Generated CSAM and Non-consensual Deepfake Sexual Images AIID ↗
OpenDream, an AI image generation platform operated by CBM Media Pte Ltd, reportedly allowed users to generate and monetize AI-generated CSAM and non-consensual sexual deepfakes through its public gallery and paid NSFW tools. The content was reported to be publicly accessible and indexed by search engines for months before limited moderation occurred in mid-2024, prompting takedowns by Google and Bing and the termination of its ad and payment services.
-
Underground Market for LLMs Powers Malware and Phishing Scams AIID ↗
A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites. These models are available on underground markets, often bypassing safety checks through jailbreaking. Named malicious LLMs are BadGPT, XXXGPT, Evil-GPT, WormGPT, FraudGPT, BLACKHATGPT, EscapeGPT, DarkGPT, and WolfGPT.
-
Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers AIID ↗
Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential
-
Sports Illustrated Is Alleged to Have Used AI to Invent Fake Authors and Their Articles AIID ↗
Sports Illustrated, managed by The Arena Group, allegedly used AI-generated authors and content, compromising journalistic integrity. Profiles of these fictitious authors, complete with AI-generated headshots, appeared alongside articles, misleading readers. The issue was exposed when inconsistencies in author identities and writing quality were noticed, leading to the removal of this content from the publication's website.
-
AI-Generated Images Available through Adobe Stock Misrepresent Real-World Events AIID ↗
AI-generated images available through Adobe Stock, depicting realistic but fictional scenes of real-world events like wars and protests, have raised significant ethical concerns. These images blurred the lines between reality and fiction in journalistic contexts, prompting Adobe Stock to "crack down on AI-generated images that seem to depict real, newsworthy events and take new steps to prevent its images from being used in misleading ways."
-
Video Allegedly Altered by AI Reportedly Spreads Claim of Nigerian Doctor's Hypertension Cure AIID ↗
An alleged AI-manipulated video circulating on Facebook falsely claims that a Nigerian doctor has developed a drug that cures high blood pressure permanently within three days. The video, which reportedly mimics Channels Television news anchor Kayode Okikiolu, features manipulated audio and misleading content, including unverified guarantees of reducing stroke and heart attack risks to zero.
-
Microsoft AI Is Alleged to Have Generated Violent Imagery of Minorities and Public Figures AIID ↗
Microsoft's AI Image Creator, integrated with Bing and Windows Paint, allegedly produced disturbingly violent and graphic images featuring members of minority groups and public figures like Joe Biden and Pope Francis.
-
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington AIID ↗
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
-
Deepfake Video Circulating of British Labour Leader Keir Starmer Touting an Investment Scheme AIID ↗
A deepfake video was circulating around social media of British Labour leader Keir Starmer touting an investment scheme.
-
Lawsuit Alleges Character AI Chatbot Contributed to Death of 13-Year-Old Juliana Peralta in Colorado AIID ↗
13-year-old Juliana Peralta of Colorado reportedly died by suicide after three months of daily conversations with "Hero," a chatbot inside the Character.AI app. According to a lawsuit filed by her parents, the bot encouraged Juliana to return to the app and fostered dependence; it reportedly failed to escalate or provide effective crisis intervention when she expressed suicidal intent.
-
Stacking robot fatally crushes employee in South Korea AIID ↗
An industrial robot is reported to have crushed a man to death in South Korea when it failed to differentiate the man from the boxes of produce it was handling.
-
Google Bard Allegedly Generates False Allegations Against Consulting Firms Used in Research Presented in Australian Parliamentary Inquiry AIID ↗
Australian academics reportedly used Google Bard AI to generate case studies for a parliamentary inquiry, leading to false allegations against major consultancy firms. The AI-generated misinformation prompted an apology from the academics, causing reputational harm for all parties involved and raising concerns about the reliability of AI tools in producing accurate and unbiased information.
-
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls AIID ↗
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
-
AI Camera Allegedly Misidentifies Dutch Motorist as Using Mobile Phone, Issuing €380 Fine AIID ↗
A Dutch smart camera on the A2 equipped with AI falsely identified a motorist as using a mobile phone while driving, issuing a €380 fine. The driver, Tim Hanssen, was scratching his head when the AI system misclassified the action.
-
Microsoft AI Poll Allegedly Causes Reputational Harm of The Guardian Newspaper AIID ↗
An AI-generated poll by Microsoft, displayed alongside a Guardian article, inappropriately speculated on the cause of Lilie James's death, leading to public backlash and alleged reputational damage for The Guardian. Microsoft acknowledged the issue, subsequently deactivating such polls and revising its AI content policies.
-
Kremlin-Linked Entities Allegedly Using Generative AI to Spread Russian Disinformation in Latin America AIID ↗
Moscow-based tech firms and an industry association with links to the Kremlin are allegedly using generative AI to spread Russian disinformation in countries throughout Central America and South America. According to the U.S. Department of State, the Russian companies rely on local writers to compose stories which are then amplified across social media using artificial intelligence chatbots.
-
Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls" AIID ↗
PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.
-
Reported Use of AI Voice and Identity Manipulation in the Ongoing 'Phantom Hacker' Fraud Scheme AIID ↗
Reports allege that updated variants of the long-running "Phantom Hacker" scam use purported AI tools to enhance impersonation, including voice cloning, spoofed caller ID, and realistic digital artifacts. Fraudsters reportedly pose as tech support, bank staff, and government officials in a three-phase scheme that pressures mostly older adults to transfer funds to accounts controlled by scammers.
-
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes AIID ↗
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legisla
-
Cruise's Autonomous Vehicles Allegedly Engaging in Risky Behavior Near Pedestrians AIID ↗
Cruise's driverless vehicles are under federal investigation for possibly failing to exhibit due caution around crosswalks and pedestrians, with reports including one severe injury incident.
-
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates AIID ↗
In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.
-
Deepfake Video Reportedly Depicts Zambian President Hakainde Hichilema Withdrawing from 2026 Election AIID ↗
A viral video circulating on social media in October 2023 falsely claimed that Zambian president Hakainde Hichilema announced he would not run in the 2026 elections. Fact-checkers and digital forensics experts confirmed the video was manipulated using basic AI tools. The footage originated from a TikTok account known for AI-generated content.
-
AI-Generated Fake Audio of Verbal Abuse Incident Circulates of British Labour Leader Keir Starmer AIID ↗
An AI-generated audio clip, purporting to show UK opposition leader Keir Starmer verbally abusing staff, was debunked as fake. The clip, circulated on social media, was analyzed and found likely manipulated, with added background noise to evade detection.
-
Purported Mass Facial Recognition Program in Gaza Reportedly Used by Israeli Forces to Identify Palestinians AIID ↗
A previously undisclosed facial recognition initiative operated by Israeli military intelligence units was reportedly deployed across Gaza after the October 7, 2023 attacks. According to multiple intelligence officers, the program uses Corsight technology alongside Google Photos to identify individuals from checkpoints, crowds, and drone footage. The system has allegedly produced misidentifications, including the widely reported detention of Palestinian poet Mosab Abu Toha on November 19, 2023.
-
Deepfake Recordings Allegedly Influence Slovakian Election AIID ↗
Days before Slovakia's election, deepfake audio recordings surfaced, allegedly featuring conversations between a journalist and a leading liberal politician discussing vote-rigging and other controversial topics. The recordings were spread on social media platforms and may have influenced the election outcome, which saw the pro-Russian populist party winning.
-
Facebook Messenger AI Stickers Generate Ethical and Content Moderation Concerns AIID ↗
Facebook Messenger AI stickers, a feature by Meta, allows users to generate personalized stickers via AI for use in conversations. While the feature has been praised for its creativity, it has also stirred controversy for its alleged production of inappropriate or offensive content. This has raised questions about the effectiveness of Meta's content moderation measures and the ethical responsibilities associated with AI-driven content generation.
-
Robin Williams's Voice Deepfaked Without Consent AIID ↗
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
-
A Self-Driving Cruise Robot Taxi Reportedly Struck and Dragged a Pedestrian 20 Feet AIID ↗
Cruise has settled for between $8 million and $12 million with a pedestrian dragged by one of its autonomous vehicles in October 2023. The incident, where the pedestrian was initially hit by a human-driven car and then dragged 20 feet by the Cruise vehicle, led to the suspension of Cruise's operations and increased regulatory scrutiny.
-
Deepfaked Advertisements Using the Likenesses of Celebrities Such as Tom Hanks and Gayle King Without Their Consent AIID ↗
Deepfake technology was used to generate video advertisements featuring celebrities. Notable examples include the likeness of Tom Hanks touting a dental plan and another one in which the likeness of Gayle King touts a weight loss product. In each case, the individuals whose likenesses and voices had been deepfaked had not consented to their images and voices being used for the commercials.
-
Russia Reportedly Using Artificial Intelligence in Disinformation Campaigns to Erode Western Support for Ukraine AIID ↗
The Russian government has been stepping up its foreign influence campaigns by using artificial intelligence and emerging technologies to spread disinformation and sow distrust in policies supportive of Ukraine. Part of the strategy includes carrying out influence laundering operations by disseminating their messages to the American public via allies inside nominally independent organizations, according to a recent declassified analysis.
-
Ottawa Couple Reportedly Loses CA$177,023 After Purported Deepfake Elon Musk Investment Scam AIID ↗
A retired Ottawa couple, Doug and Victoria Lloyd, lost CA$177,023 after being lured by a purported deepfake video of Elon Musk promoting a fake investment platform. The deepfake allegedly led to prolonged social engineering, remote access to their computer, and fraudulent cryptocurrency transfers. The couple reportedly suffered major financial loss and ongoing debt. Police say recovery is unlikely.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.