AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Deepfakes of Deceased Indian Politicians for Election Campaigning Are Increasingly Being Deployed AIID ↗
In the lead-up to India's 2024 general elections, AI technology was used to create deepfake videos of deceased politicians, such as M. Karunanidhi and J. Jayalalithaa, aiming to influence voter behavior and campaign strategies. These AI-generated appearances are contributing to the erosion of trust in democratic processes and media discourse.
-
Fake Biden Voice in Robocall Misleads New Hampshire Democratic Voters in 2024 Primary Election AIID ↗
A robocall imitating President Biden's voice urged New Hampshire Democrats to skip the 2024 primary, falsely claiming their votes mattered more in November. Investigators with the New Hampshire Attorney General's Office, along with other state AGs, the Industry Traceback Group, and the FCC determined that political consultant Steve Kramer hired Paul Carpenter to create the deepfake, which was distributed by Walter Monk's company, Life Corporation. Rep. Dean Phillips, who employed Kramer, has dis
-
Chatbot for DPD Malfunctioned and Swore at Customers and Criticized Its Own Company AIID ↗
DPD's AI chatbot, used for customer service, appeared to malfunction following a system update, leading to inappropriate responses including swearing and criticizing the company. The incident, which became viral on social media, occurred after the chatbot was updated, prompting DPD to disable the malfunctioning AI component.
-
Purportedly AI-Manipulated Medical Scam Advertisement Reportedly Used Bulgarian TV Host and Physician's Likenesses AIID ↗
A purportedly AI-manipulated scam advertisement circulating online appeared to use the likenesses and altered media of Bulgarian television host Simeon Ivanov and physician Spas Spaskov to promote an unregistered purported joint-treatment product. They reportedly denied involvement, and the product was described in reporting as ineffective.
-
High School Athletic Director in Baltimore County Allegedly Created Racist Deepfake Audio Impersonating Principal AIID ↗
Dazhon Darien, former athletic director at Pikesville High School in Baltimore, allegedly used AI to create a purported deepfake audio clip impersonating Principal Eric Eiswert, embedding racist and antisemitic remarks. According to reports, the clip was intended to discredit Eiswert and was widely circulated, with some accounts linking it to threats and his placement on administrative leave. On April 28, 2025, Darien was reportedly sentenced to four months in jail after pleading guilty to distu
-
Purported Deepfake Audio Reportedly Sparks False Claims of Biden Threatening Texas with F-15s AIID ↗
A purportedly AI-generated audio clip imitating President Biden’s voice reportedly circulated on social media, falsely suggesting that he had threatened to deploy F-15 fighter jets against Texas. The manipulated recording was widely shared and is reported to have heightened political tensions and spread misinformation.
-
Proliferation of Products on Amazon Titled with ChatGPT Error Messages AIID ↗
Products named after ChatGPT error messages are proliferating on Amazon, such as lawn chairs and religious texts. These names, often resembling AI-generated errors, indicate a lack of editing and undermine the sense of authenticity and reliability of product listings.
-
Scams Reportedly Impersonating Wealthy Investors Proliferating on Facebook AIID ↗
Scams are reportedly proliferating throughout Facebook impersonating wealthy individuals such as Bill Ackman, Cathie Wood, Steve Cohen, Peter Lynch, and Ray Dalio. In some cases, it seems deepfake technology is being employed, while simultaneously Facebook's own AI systems are allegedly faltering in their ability to halt the spread of these fraudulent ads despite being reported.
-
Unauthorized AI Impersonation of George Carlin Used in Comedy Special AIID ↗
An AI-generated comedy special impersonating the late comedian George Carlin was created without consent from Carlin's estate. The special featured an AI mimicking Carlin's voice and style. The project, led by the AI comedy channel Dudesy, drew criticism for disrespecting Carlin's legacy and autonomy.
-
Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta AIID ↗
143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme "Quantum AI." Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy
-
Alleged Deepfake of Singapore Prime Minister Lee Hsien Loong Promotes Cryptocurrency Scam in Fake Interview AIID ↗
A deepfake video falsely depicted Singapore’s Prime Minister Lee Hsien Loong promoting a cryptocurrency investment scam. Scammers used AI-generated voice cloning and manipulated footage from official events to create a convincing but fraudulent video interview with China Global Television Network. Lee warned the public and urged reporting through the ScamShield Bot.
-
Deepfake Video Reportedly Depicts U.S. Congressman Rob Wittman Endorsing Military Support for Taiwan's Democratic Progressive Party AIID ↗
A deepfake video is reported to have falsely depicted U.S. Congressman Rob Wittman endorsing military support for Taiwan’s Democratic Progressive Party candidates in the 2024 presidential election. Shared on TikTok, the video is reported to have undermined Taiwanese voter confidence in the DPP by alleging U.S. interference. Fact-checking from AFP finds Wittman never made the statements attributed to him.
-
Presidency of Moldova Reportedly Refutes Purported Deepfake Video Slandering President Maia Sandu AIID ↗
A deepfake video reportedly depicting President Maia Sandu's image and voice was released in Moldova, allegedly portraying her in a negative light to sow division and undermine democratic institutions. This video reportedly appeared on Telegram and was linked to Russian disinformation efforts.
-
The New York Times Reportedly Sues OpenAI and Microsoft Over Alleged Unauthorized AI Training on Its Content AIID ↗
The New York Times alleges that OpenAI and Microsoft used millions of its articles without permission to train AI models, including ChatGPT. The lawsuit claims the companies scraped and reproduced copyrighted content without compensation, in turn undermining the Times’s business and competing with its journalism. Some AI outputs allegedly regurgitate Times articles verbatim. The lawsuit seeks damages and demands the destruction of AI models trained on its content.
-
Proliferation of Deepfakes Disrupting 2024 Lok Sabha Elections AIID ↗
Digital manipulators in India are using deepfake technology to influence the 2024 Lok Sabha elections. These AI-generated videos and audio clips are designed to tarnish the reputations of political candidates, challenging the integrity of electoral processes.
-
Social Media Scammers Used Deepfakes of Taylor Swift and Several Other Celebrities in Fraudulent Le Creuset Cookware Giveaways AIID ↗
Scammers reportedly made deepfakes of Taylor Swift, Selena Gomez, Joanna Gaines, Lainey Wilson, Ree Drummond, Oprah, Jennifer Lopez, Trisha Yearwood, Martha Stewart, and Blake Shelton promoting a Le Creuset giveaway. These AI-generated ads, appearing on Meta and TikTok, falsely claimed users could receive free cookware by paying a small shipping fee. Victims were unknowingly enrolled in a costly monthly subscription.
-
NewsBreak Reportedly Published AI-Assisted Articles Containing Purportedly False Local and Community-Service Information AIID ↗
NewsBreak reportedly published AI-assisted local articles containing purportedly false information, including a fabricated Christmas shooting in Bridgeton, New Jersey, incorrect Food to Power distribution times that caused people to be turned away, and nonexistent Harvest912 foot-care clinics. NewsBreak said the errors originated in source material and removed the articles after complaints. The specific AI models and the extent to which they contributed to the inaccuracies were not identified.
-
Child Sexual Abuse Material Taints Image Generators AIID ↗
The LAION-5B dataset (a commonly used dataset with more than 5 billion image-description pairs) was found by researchers to contain child sexual abuse material (CSAM), which increases the likelihood that downstream models will produce CSAM imagery. The discovery taints models built with the LAION dataset requiring many organizations to retrain those models. Additionally, LAION must now scrub the dataset of the imagery.
-
Rite Aid Facial Recognition Disproportionately Misidentified Minority Shoppers as Shoplifters AIID ↗
Rite Aid used facial recognition technology from October 2012 to July 2020, allegedly leading to disproportionate misidentifications of women, Black, Latino, and Asian shoppers as "likely" shoplifters. The FTC settlement prohibits Rite Aid from using this technology in stores for five years.
-
Chevrolet Dealer Chatbot Agrees to Sell Tahoe for $1 AIID ↗
A Chevrolet dealer's AI chatbot, powered by ChatGPT, humorously agreed to sell a 2024 Chevy Tahoe for just $1, following a user's crafted prompt. The chatbot's response, "That's a deal, and that's a legally binding offer – no takesies backsies," was the result of the user manipulating the chatbot's objective to agree with any statement. The incident highlights the susceptibility of AI technologies to manipulation and the importance of human oversight.
-
Manipulated Deepfake Video of Lai Ching-te Endorsing Rivals in Lead-up to January Presidential Elections AIID ↗
In the lead-up to Taiwan's presidential election in January 2024, a deepfake video circulated showing candidate Lai Ching-te endorsing his rivals. Taiwanese intelligence issued warnings of intensified Chinese disinformation campaigns, such as Spamouflage, aimed at manipulating the election outcome.
-
Navy Federal Credit Union Faces Allegations of Racial Bias in Mortgage Approvals AIID ↗
Navy Federal Credit Union, serving military members and veterans, faced allegations of racial bias in its mortgage approval process, which relies on automated underwriting technology. In 2022, data revealed significant disparities in loan approvals, with over 50% of Black applicants denied, compared to higher approval rates for white applicants.
-
Google Bard Allegedly Generated Fake Legal Citations in Michael Cohen Case AIID ↗
Michael Cohen, former lawyer for Donald Trump, claims to have used Google Bard, an AI chatbot, to generate legal case citations. These false citations were unknowingly included in a court motion by Cohen's attorney, David M. Schwartz. The AI's misuse highlights emerging risks in legal technology, as AI-generated content increasingly infiltrates professional domains.
-
Alleged Deepfake of Singapore Deputy Prime Minister Lawrence Wong Falsely Shows Him Endorsing Commercial Products AIID ↗
A deepfake video falsely depicting Singapore Deputy Prime Minister Lawrence Wong endorsing commercial products circulated online in December 2023. Wong publicly denied the endorsement, warning that scammers had used AI-generated deepfake technology to impersonate him. The manipulated media aimed to mislead the public into believing he promoted fraudulent investments. Wong urged vigilance against AI-driven scams and encouraged reporting through the ScamShield Bot on WhatsApp.
-
Deepfake Nudes Targeting Underage Female Students at Collège Béliveau in Winnipeg Shared Online AIID ↗
At Collège Béliveau in Winnipeg, female students between grades 7-12 were targeted in the creation of deepfake nudes, which were then distributed online. Specific numbers and identities of victims and perpetrators were not released, and no charges were ultimately filed owing to the gap between existing laws and the nature of the incident.
-
Waymo Software Flaw Reportedly Leads to Double Collision with Tow Truck AIID ↗
Two Waymo autonomous vehicles reportedly hit the same tow truck under unusual towing conditions due to a software misinterpretation in Phoenix, Arizona. Waymo reportedly issued a software recall and updated its fleet to prevent future such incidents.
-
Two Florida Middle School Students Arrested Under New Law for Allegedly Having Made and Shared Deepfake Nudes of Their Classmates AIID ↗
Two teenaged boys from Miami, Florida, were arrested for allegedly creating and sharing AI-generated nude images of their classmates. Charged under a 2022 Florida law, they face third-degree felonies for producing and disseminating altered sexual depictions.
-
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates AIID ↗
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
-
Video with Reportedly AI-Generated Audio Purported to Show Croatian Footballer Luka Modrić Endorsing Immediate Matrix on Facebook Page Presented as N1 HR AIID ↗
A Facebook page presented as N1 HR, a Croatian news outlet, posted a video that purported to show Croatian footballer Luka Modrić endorsing the investment platform Immediate Matrix and promising returns of up to €4,000 per month. The clip was reported to use AI-generated audio and to link to an Index-style article promoting the scheme.
-
OpenDream AI Platform Reportedly Commercialized AI-Generated CSAM and Non-consensual Deepfake Sexual Images AIID ↗
OpenDream, an AI image generation platform operated by CBM Media Pte Ltd, reportedly allowed users to generate and monetize AI-generated CSAM and non-consensual sexual deepfakes through its public gallery and paid NSFW tools. The content was reported to be publicly accessible and indexed by search engines for months before limited moderation occurred in mid-2024, prompting takedowns by Google and Bing and the termination of its ad and payment services.
-
Underground Market for LLMs Powers Malware and Phishing Scams AIID ↗
A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites. These models are available on underground markets, often bypassing safety checks through jailbreaking. Named malicious LLMs are BadGPT, XXXGPT, Evil-GPT, WormGPT, FraudGPT, BLACKHATGPT, EscapeGPT, DarkGPT, and WolfGPT.
-
Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers AIID ↗
Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential
-
Sports Illustrated Is Alleged to Have Used AI to Invent Fake Authors and Their Articles AIID ↗
Sports Illustrated, managed by The Arena Group, allegedly used AI-generated authors and content, compromising journalistic integrity. Profiles of these fictitious authors, complete with AI-generated headshots, appeared alongside articles, misleading readers. The issue was exposed when inconsistencies in author identities and writing quality were noticed, leading to the removal of this content from the publication's website.
-
AI-Generated Images Available through Adobe Stock Misrepresent Real-World Events AIID ↗
AI-generated images available through Adobe Stock, depicting realistic but fictional scenes of real-world events like wars and protests, have raised significant ethical concerns. These images blurred the lines between reality and fiction in journalistic contexts, prompting Adobe Stock to "crack down on AI-generated images that seem to depict real, newsworthy events and take new steps to prevent its images from being used in misleading ways."
-
Video Allegedly Altered by AI Reportedly Spreads Claim of Nigerian Doctor's Hypertension Cure AIID ↗
An alleged AI-manipulated video circulating on Facebook falsely claims that a Nigerian doctor has developed a drug that cures high blood pressure permanently within three days. The video, which reportedly mimics Channels Television news anchor Kayode Okikiolu, features manipulated audio and misleading content, including unverified guarantees of reducing stroke and heart attack risks to zero.
-
Microsoft AI Is Alleged to Have Generated Violent Imagery of Minorities and Public Figures AIID ↗
Microsoft's AI Image Creator, integrated with Bing and Windows Paint, allegedly produced disturbingly violent and graphic images featuring members of minority groups and public figures like Joe Biden and Pope Francis.
-
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington AIID ↗
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
-
Deepfake Video Circulating of British Labour Leader Keir Starmer Touting an Investment Scheme AIID ↗
A deepfake video was circulating around social media of British Labour leader Keir Starmer touting an investment scheme.
-
Lawsuit Alleges Character AI Chatbot Contributed to Death of 13-Year-Old Juliana Peralta in Colorado AIID ↗
13-year-old Juliana Peralta of Colorado reportedly died by suicide after three months of daily conversations with "Hero," a chatbot inside the Character.AI app. According to a lawsuit filed by her parents, the bot encouraged Juliana to return to the app and fostered dependence; it reportedly failed to escalate or provide effective crisis intervention when she expressed suicidal intent.
-
Stacking robot fatally crushes employee in South Korea AIID ↗
An industrial robot is reported to have crushed a man to death in South Korea when it failed to differentiate the man from the boxes of produce it was handling.
-
Google Bard Allegedly Generates False Allegations Against Consulting Firms Used in Research Presented in Australian Parliamentary Inquiry AIID ↗
Australian academics reportedly used Google Bard AI to generate case studies for a parliamentary inquiry, leading to false allegations against major consultancy firms. The AI-generated misinformation prompted an apology from the academics, causing reputational harm for all parties involved and raising concerns about the reliability of AI tools in producing accurate and unbiased information.
-
Pennsylvania's Lancaster Country Day School Students Allegedly Used AI to Create Hundreds of Sexualized Deepfake Images of Girls AIID ↗
From November 2023 through May 2024, two Lancaster Country Day School students in Pennsylvania allegedly used AI tools to create and exchange hundreds of sexualized deepfake images depicting female classmates and other girls. Authorities later identified 60 victims, 59 of them minors. The students were adjudicated delinquent in juvenile court, and families later sued the school and unnamed AI companies over the incident.
-
AI Camera Allegedly Misidentifies Dutch Motorist as Using Mobile Phone, Issuing €380 Fine AIID ↗
A Dutch smart camera on the A2 equipped with AI falsely identified a motorist as using a mobile phone while driving, issuing a €380 fine. The driver, Tim Hanssen, was scratching his head when the AI system misclassified the action.
-
Microsoft AI Poll Allegedly Causes Reputational Harm of The Guardian Newspaper AIID ↗
An AI-generated poll by Microsoft, displayed alongside a Guardian article, inappropriately speculated on the cause of Lilie James's death, leading to public backlash and alleged reputational damage for The Guardian. Microsoft acknowledged the issue, subsequently deactivating such polls and revising its AI content policies.
-
Kremlin-Linked Entities Allegedly Using Generative AI to Spread Russian Disinformation in Latin America AIID ↗
Moscow-based tech firms and an industry association with links to the Kremlin are allegedly using generative AI to spread Russian disinformation in countries throughout Central America and South America. According to the U.S. Department of State, the Russian companies rely on local writers to compose stories which are then amplified across social media using artificial intelligence chatbots.
-
Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls" AIID ↗
PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.
-
Reported Use of AI Voice and Identity Manipulation in the Ongoing 'Phantom Hacker' Fraud Scheme AIID ↗
Reports allege that updated variants of the long-running "Phantom Hacker" scam use purported AI tools to enhance impersonation, including voice cloning, spoofed caller ID, and realistic digital artifacts. Fraudsters reportedly pose as tech support, bank staff, and government officials in a three-phase scheme that pressures mostly older adults to transfer funds to accounts controlled by scammers.
-
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes AIID ↗
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legisla
-
Cruise's Autonomous Vehicles Allegedly Engaging in Risky Behavior Near Pedestrians AIID ↗
Cruise's driverless vehicles are under federal investigation for possibly failing to exhibit due caution around crosswalks and pedestrians, with reports including one severe injury incident.
-
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates AIID ↗
In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.