AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Alleged LLMjacking Targets AI Cloud Services with Stolen Credentials AIID ↗
Attackers reportedly exploited stolen cloud credentials obtained through a vulnerable Laravel system (CVE-2021-3129) to allegedly abuse AI cloud services, including Anthropic’s Claude and AWS Bedrock, in a scheme referred to as “LLMjacking.” The attackers are said to have monetized access through reverse proxies, reportedly inflating victim costs to as much as $100,000 per day. Additionally, they allegedly bypassed sanctions, enabled LLM models, and evolved techniques to evade detection and logg
-
Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor, Director, and Playwright Kamen Donev's Likeness to Market Joint-Pain Product AIID ↗
A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor, director, and playwright Kamen Donev, allegedly overlaying fabricated audio and altered lip movements to market a purported joint-pain product. The ad reportedly linked to a presumably fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.
-
Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor and TV Host Mihail Bilalov's Likeness to Market Joint-Pain Product AIID ↗
A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor and television host Mihail Bilalov, overlaying purportedly fabricated audio and altered lip movements to market an alleged joint-pain product. The ad reportedly linked to a fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.
-
Kenyan Journalist Jeff Koinange Depicted Endorsing Gambling App in Purported AI-Generated Deepfake AIID ↗
A viral video purportedly manipulated by AI shows Kenyan journalist Jeff Koinange endorsing a mobile gambling app. The video was reportedly created using AI deepfake techniques, uses footage from a legitimate news broadcast, and artificially alters Koinange's voice and mouth movements. Neither Koinange nor Citizen TV has promoted the app, and no legitimate source hosts the video.
-
Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them AIID ↗
Internet Watch Foundation (IWF) has reported that it has found a manual on the dark web that encourages criminals to use "nudifying" AI tools to depict children naked in order to extort victims into providing graphic content.
-
Unauthorized Use of AI to Replicate Tupac Shakur's and Snoop Dogg's Voices in Drake's 'Taylor Made Freestyle' AIID ↗
Drake released a song, "Taylor Made Freestyle," featuring AI-generated voices of Tupac Shakur and Snoop Dogg. The unauthorized replication of Tupac’s voice without the estate's consent led to a cease-and-desist order.
-
Deepfake of Former Prime Minister of Malta Joseph Muscat Allegedly Promotes Nord Invest Scam AIID ↗
A reported doctored video falsely depicts former Maltese Prime Minister Joseph Muscat promoting the crypto platform Nord Invest. The manipulated footage, originally from a 2013 Sky News interview, was overlaid with AI-generated audio to mimic Muscat’s voice endorsing a fraudulent scheme. The video was reportedly shared through Facebook.
-
Reported Audio Deepfake Impersonating CEO Karim Toubba Targets LastPass Employee via WhatsApp AIID ↗
A LastPass employee was reportedly targeted by an audio deepfake impersonating CEO Karim Toubba via WhatsApp. The message used voice-cloning AI in a social engineering attempt to create urgency and bypass security protocols. The employee recognized red flags, reported the incident, and no breach occurred. LastPass shared the incident publicly to raise awareness about deepfake-driven fraud campaigns targeting executives and companies.
-
Deepfake Porn Sites Use Breeze Liu's Image Without Consent AIID ↗
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
-
Reportedly Viral AI-Generated Song about 'Diddy Party' Allegedly Mimics Justin Bieber AIID ↗
A purportedly AI-generated song imitating Justin Bieber's voice, allegedly referencing a "Diddy party," spread widely across social media, reportedly leading fans to believe it was authentic. Experts reportedly identified the audio as likely AI-made, citing frequency mismatches and digital artifacts. The reportedly viral song misrepresented Bieber, posing potential brand and revenue impacts for the artist while misleading listeners.
-
Scammers Using AI to Impersonate Small Businesses AIID ↗
Scammers are using AI to impersonate small businesses by copying their videos, logos, and social media posts. They create fake listings and ads, diverting customers to cheap knockoffs or stealing their money. This has severely impacted businesses like Bee Cups, Darn Tough Vermont, and Cascade hummingbird feeders, leading to significant financial losses, negative reviews, and damaged reputations. Their deployment of AI makes it challenging for small businesses to combat these fraudulent activitie
-
Mumbai Businessman Reportedly Defrauded via Purported AI-Cloned Voice Impersonating Son AIID ↗
A Mumbai businessman reportedly identified as KT Vinod reportedly lost Rs 80,000 after receiving a call from someone claiming to be a representative of the Indian Embassy in Dubai, who said his son had been arrested. The caller allegedly used AI-generated voice cloning to simulate the voice of Vinod's son, pleading for help. Reportedly convinced of the urgency, Vinod instructed a money transfer via Google Pay. The scam was discovered only after he contacted his son directly.
-
Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements AIID ↗
Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.
-
Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors AIID ↗
The FBI has arrested Steven Anderegg of Holmen, Wisconsin for having allegedly used Stable Diffusion to generate about 13,000 sexually explicit images of minors, which he then is also alleged to have shared and distributed, including with at least one minor, via Telegram and Instagram. Anderegg was originally apprehended by state police in March, and this case marks one of the first times the FBI has brought charges against someone for having used AI to generate CSAM.
-
Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes AIID ↗
Sydney-based startup Leonardo AI's text-to-image generator was alleged to have been exploited to create nonconsensual sexual images of celebrities, bypassing content moderation systems with user-shared prompts.
-
Investigation Reports Unauthorized Deepfake Pornography Harms Thousands of Celebrities AIID ↗
A Channel 4 News investigation alleges that nearly 4,000 celebrities globally, including 255 British figures, were victims of deepfake pornography. Faces were superimposed onto explicit content using AI, with the top deepfake sites garnering 100 million views in three months, according to their findings.
-
22 Students at Richmond-Burton Community High School in Illinois Targeted by Deepfake Nudes AIID ↗
22 students at Richmond-Burton Community High School in Illinois were targeted in the creation of deepfake nudes. One of the students, Stevie Hyder, was targeted by classmates who used deepfake technology to alter her April 2023 prom picture into nude pictures, which were then circulated on social media. Two unnamed minors were arrested in late April 2024.
-
Cartels Reportedly Using AI to Expand Operations into Financial Fraud and Human Trafficking AIID ↗
The Jalisco New Generation Cartel is reportedly using AI to expand its financial fraud and human trafficking operations, coercing individuals into illegal activities under the guise of legitimate jobs. INTERPOL warns that this integration of AI into criminal enterprises is a growing trend among cartels across Europe, Asia, and Africa as well.
-
Deepfake ID Sales Allegedly Persist as OnlyFake Reportedly Relaunches with New Fraud Tools AIID ↗
Researchers from Au10tix discovered the relaunch of OnlyFake, a site offering AI-generated fake IDs. Despite an earlier takedown, the site reemerged with disclaimers and new tools, including handwritten signature generation. These fakes are challenging biometric verification systems and are reportedly being used to perpetuate fraudulent activity.
-
Fake AI-Generated Law Firms Sent Fake DMCA Notices to Increase SEO AIID ↗
In March 2024, fake law firms using AI-generated identities sent fraudulent DMCA takedown notices to website owners, demanding backlinks for SEO gains. These AI-generated law firms, like "Commonwealth Legal," used GAN models for realistic attorney images and fabricated bios. The scam involved fake legal threats to coerce site owners into adding backlinks, exploiting AI technology for deceptive practices.
-
Over 400 Purportedly AI-Driven Scams Reportedly Led to $8M Loss for Australians in 2023 AIID ↗
In 2023, Australians reportedly lost over $8 million to scams involving purported deepfake videos and fake news articles that falsely endorsed investment trading platforms. Scammers reportedly used AI-generated content featuring celebrities to mislead victims, leading to significant financial losses. The National Anti-Scam Centre received over 400 reports of these incidents. One man is reported to have lost over $80,000 in cryptocurrency.
-
Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X AIID ↗
Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.
-
Alleged State-Sponsored Hackers Escalate Purported Phishing Attacks Using Artificial Intelligence AIID ↗
State-sponsored hackers from North Korea, Iran, Russia, and China are reportedly leveraging artificial intelligence to conduct sophisticated phishing and social engineering attacks. They target global defense, cybersecurity, and cryptocurrency sectors, aiming to steal sensitive information and, in the case of North Korea, cryptocurrencies to help fund its illicit nuclear program.
-
Deepfake Audio Falsely Attributes Controversial Remarks to Keir Starmer About the Rochdale Azhar Ali Crisis AIID ↗
A deepfake audio clip, falsely claiming to be Keir Starmer discussing the Rochdale byelection and Labour's withdrawl of support for Azhar Ali, circulated online, achieving over 250,000 views. Experts confirmed its inauthenticity, highlighting a significant misuse of AI in fabricating political content.
-
Purported Russian-Linked Network Allegedly Used Deepfake of Maria Ressa on Facebook and Bing to Promote Cryptocurrency Scam Targeting Filipinos AIID ↗
A purportedly Russian-linked scam network allegedly circulated an AI-generated deepfake of journalist Maria Ressa on Facebook and Microsoft Bing. The video reportedly manipulated a 2022 interview to falsely depict Ressa endorsing cryptocurrency. Fraudulent websites allegedly impersonating Rappler and CNN Philippines reportedly amplified the scam. Investigators reportedly linked the operation to a fraudulent network targeting Filipino audiences. Meta and Microsoft removed the content, but similar
-
Alleged Deepfake CFO Scam Reportedly Costs Multinational Engineering Firm Arup $25 Million AIID ↗
A finance employee at the multinational engineering firm Arup was reportedly deceived into transferring $25 million by fraudsters using purported deepfake technology to impersonate the firm's CFO in a video call, according to the Hong Kong police.
-
Glasgow Man Allegedly Used AI Tool to Create and Share Nonconsensual Deepfake Nude Images of Former Classmate AIID ↗
In February 2024, a Glasgow man, Callum Brooks, reportedly used an AI-powered image-alteration tool to create deepfake nude images of a woman he knew from school by modifying her publicly posted social media photos. He allegedly sent the fabricated intimate images to two friends without her consent. The woman was reportedly embarrassed and distressed after learning of the images. Brooks pled guilty in Glasgow Sheriff Court and was fined £335.
-
Purported Deepfake of Andrew Forrest Used to Promote Fraudulent 'Quantum AI' Crypto Platform on Facebook AIID ↗
Cybertrace reportedly identified a purported deepfake of Australian billionaire Andrew Forrest circulating on Facebook on January 27, 2024, falsely depicting him endorsing a fraudulent crypto platform called Quantum AI. The video reportedly altered footage from a 2023 Rhodes Trust talk. Forrest reportedly condemned Meta for failing to curb AI-generated frauds.
-
Significant Increase in Deepfake Nudes of Taylor Swift Circulating on Social Media AIID ↗
AI-generated sexually explicit images of Taylor Swift circulated on X, garnering over 45 million views before removal. Originating from a Telegram group, these deepfakes challenge content moderation, as X's policies against synthetic media and nonconsensual nudity were violated.
-
Purportedly AI-Manipulated Medical Scam Advertisement Reportedly Used Bulgarian TV Host and Physician's Likenesses AIID ↗
A purportedly AI-manipulated scam advertisement circulating online appeared to use the likenesses and altered media of Bulgarian television host Simeon Ivanov and physician Spas Spaskov to promote an unregistered purported joint-treatment product. They reportedly denied involvement, and the product was described in reporting as ineffective.
-
High School Athletic Director in Baltimore County Allegedly Created Racist Deepfake Audio Impersonating Principal AIID ↗
Dazhon Darien, former athletic director at Pikesville High School in Baltimore, allegedly used AI to create a purported deepfake audio clip impersonating Principal Eric Eiswert, embedding racist and antisemitic remarks. According to reports, the clip was intended to discredit Eiswert and was widely circulated, with some accounts linking it to threats and his placement on administrative leave. On April 28, 2025, Darien was reportedly sentenced to four months in jail after pleading guilty to distu
-
Scams Reportedly Impersonating Wealthy Investors Proliferating on Facebook AIID ↗
Scams are reportedly proliferating throughout Facebook impersonating wealthy individuals such as Bill Ackman, Cathie Wood, Steve Cohen, Peter Lynch, and Ray Dalio. In some cases, it seems deepfake technology is being employed, while simultaneously Facebook's own AI systems are allegedly faltering in their ability to halt the spread of these fraudulent ads despite being reported.
-
Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta AIID ↗
143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme "Quantum AI." Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy
-
Alleged Deepfake of Singapore Prime Minister Lee Hsien Loong Promotes Cryptocurrency Scam in Fake Interview AIID ↗
A deepfake video falsely depicted Singapore’s Prime Minister Lee Hsien Loong promoting a cryptocurrency investment scam. Scammers used AI-generated voice cloning and manipulated footage from official events to create a convincing but fraudulent video interview with China Global Television Network. Lee warned the public and urged reporting through the ScamShield Bot.
-
Social Media Scammers Used Deepfakes of Taylor Swift and Several Other Celebrities in Fraudulent Le Creuset Cookware Giveaways AIID ↗
Scammers reportedly made deepfakes of Taylor Swift, Selena Gomez, Joanna Gaines, Lainey Wilson, Ree Drummond, Oprah, Jennifer Lopez, Trisha Yearwood, Martha Stewart, and Blake Shelton promoting a Le Creuset giveaway. These AI-generated ads, appearing on Meta and TikTok, falsely claimed users could receive free cookware by paying a small shipping fee. Victims were unknowingly enrolled in a costly monthly subscription.
-
Alleged Deepfake of Singapore Deputy Prime Minister Lawrence Wong Falsely Shows Him Endorsing Commercial Products AIID ↗
A deepfake video falsely depicting Singapore Deputy Prime Minister Lawrence Wong endorsing commercial products circulated online in December 2023. Wong publicly denied the endorsement, warning that scammers had used AI-generated deepfake technology to impersonate him. The manipulated media aimed to mislead the public into believing he promoted fraudulent investments. Wong urged vigilance against AI-driven scams and encouraged reporting through the ScamShield Bot on WhatsApp.
-
Deepfake Nudes Targeting Underage Female Students at Collège Béliveau in Winnipeg Shared Online AIID ↗
At Collège Béliveau in Winnipeg, female students between grades 7-12 were targeted in the creation of deepfake nudes, which were then distributed online. Specific numbers and identities of victims and perpetrators were not released, and no charges were ultimately filed owing to the gap between existing laws and the nature of the incident.
-
Two Florida Middle School Students Arrested Under New Law for Allegedly Having Made and Shared Deepfake Nudes of Their Classmates AIID ↗
Two teenaged boys from Miami, Florida, were arrested for allegedly creating and sharing AI-generated nude images of their classmates. Charged under a 2022 Florida law, they face third-degree felonies for producing and disseminating altered sexual depictions.
-
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates AIID ↗
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
-
Video with Reportedly AI-Generated Audio Purported to Show Croatian Footballer Luka Modrić Endorsing Immediate Matrix on Facebook Page Presented as N1 HR AIID ↗
A Facebook page presented as N1 HR, a Croatian news outlet, posted a video that purported to show Croatian footballer Luka Modrić endorsing the investment platform Immediate Matrix and promising returns of up to €4,000 per month. The clip was reported to use AI-generated audio and to link to an Index-style article promoting the scheme.
-
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington AIID ↗
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
-
Deepfake Video Circulating of British Labour Leader Keir Starmer Touting an Investment Scheme AIID ↗
A deepfake video was circulating around social media of British Labour leader Keir Starmer touting an investment scheme.
-
Reported Use of AI Voice and Identity Manipulation in the Ongoing 'Phantom Hacker' Fraud Scheme AIID ↗
Reports allege that updated variants of the long-running "Phantom Hacker" scam use purported AI tools to enhance impersonation, including voice cloning, spoofed caller ID, and realistic digital artifacts. Fraudsters reportedly pose as tech support, bank staff, and government officials in a three-phase scheme that pressures mostly older adults to transfer funds to accounts controlled by scammers.
-
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes AIID ↗
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legisla
-
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates AIID ↗
In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.
-
Robin Williams's Voice Deepfaked Without Consent AIID ↗
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
-
Deepfaked Advertisements Using the Likenesses of Celebrities Such as Tom Hanks and Gayle King Without Their Consent AIID ↗
Deepfake technology was used to generate video advertisements featuring celebrities. Notable examples include the likeness of Tom Hanks touting a dental plan and another one in which the likeness of Gayle King touts a weight loss product. In each case, the individuals whose likenesses and voices had been deepfaked had not consented to their images and voices being used for the commercials.
-
Ottawa Couple Reportedly Loses CA$177,023 After Purported Deepfake Elon Musk Investment Scam AIID ↗
A retired Ottawa couple, Doug and Victoria Lloyd, lost CA$177,023 after being lured by a purported deepfake video of Elon Musk promoting a fake investment platform. The deepfake allegedly led to prolonged social engineering, remote access to their computer, and fraudulent cryptocurrency transfers. The couple reportedly suffered major financial loss and ongoing debt. Police say recovery is unlikely.
-
Purported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town AIID ↗
In Spain, an AI app was used to digitally alter photos of young girls, making them appear naked. This manipulation sparked an investigation after these images were circulated in Almendralejo, a town in the Extremadura region, raising serious concerns about digital privacy violations and the potential spread of these images on pornographic sites.
-
Voice deepfake targets bank in failed transfer scam AIID ↗
In spring 2023, Florida investor Clive Kabatznik became the target of an advanced scam attempt involving a voice deepfake mimicking his own voice. The fraudulent caller, using AI-generated speech, contacted Kabatznik's Bank of America representative in an unsuccessful attempt to deceive the banker into transferring funds to a different account.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.