AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Students at a Beverly Hills Middle School Allegedly Created and Shared Deepfake Nudes of Their Classmates AIID ↗
At Beverly Vista Middle School in Beverly Hills, California, students allegedly used AI to generate fake nude photos with their classmates' faces, prompting investigations by school officials and the police. The incident highlights the increasing misuse of generative AI among minors.
-
Video with Reportedly AI-Generated Audio Purported to Show Croatian Footballer Luka Modrić Endorsing Immediate Matrix on Facebook Page Presented as N1 HR AIID ↗
A Facebook page presented as N1 HR, a Croatian news outlet, posted a video that purported to show Croatian footballer Luka Modrić endorsing the investment platform Immediate Matrix and promising returns of up to €4,000 per month. The clip was reported to use AI-generated audio and to link to an Index-style article promoting the scheme.
-
Underground Market for LLMs Powers Malware and Phishing Scams AIID ↗
A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites. These models are available on underground markets, often bypassing safety checks through jailbreaking. Named malicious LLMs are BadGPT, XXXGPT, Evil-GPT, WormGPT, FraudGPT, BLACKHATGPT, EscapeGPT, DarkGPT, and WolfGPT.
-
Male student allegedly used AI to generate nude photos of female classmates at a high school in Issaquah, Washington AIID ↗
At a high school in Issaquah, Washington, a male student is reported to have used deepfake technology to alter pictures of several female classmates and then shared them.
-
Deepfake Video Circulating of British Labour Leader Keir Starmer Touting an Investment Scheme AIID ↗
A deepfake video was circulating around social media of British Labour leader Keir Starmer touting an investment scheme.
-
Kremlin-Linked Entities Allegedly Using Generative AI to Spread Russian Disinformation in Latin America AIID ↗
Moscow-based tech firms and an industry association with links to the Kremlin are allegedly using generative AI to spread Russian disinformation in countries throughout Central America and South America. According to the U.S. Department of State, the Russian companies rely on local writers to compose stories which are then amplified across social media using artificial intelligence chatbots.
-
Reported Use of AI Voice and Identity Manipulation in the Ongoing 'Phantom Hacker' Fraud Scheme AIID ↗
Reports allege that updated variants of the long-running "Phantom Hacker" scam use purported AI tools to enhance impersonation, including voice cloning, spoofed caller ID, and realistic digital artifacts. Fraudsters reportedly pose as tech support, bank staff, and government officials in a three-phase scheme that pressures mostly older adults to transfer funds to accounts controlled by scammers.
-
Female Students at Westfield High School in New Jersey Reportedly Targeted with Deepfake Nudes AIID ↗
In October 2023, alleged deepfake nude images of female students were created and shared at Westfield High School in New Jersey. One alleged implicated system in this incident is the Clothoff deepfake app. A victim, Francesca Mani, and her mother, Dorota, began advocating for stronger laws after the school’s response reportedly left perpetrators unaccountable. Since the incident, their advocacy has drawn national attention, leading to trips to Washington, D.C., and bipartisan backing for legisla
-
Aledo High School Student Allegedly Generates and Distributes Deepfake Nudes of Seven Female Classmates AIID ↗
In October 2023, an unnamed male student at Aledo High School outside of Fort Worth, Texas allegedly generated and distributed deepfake nude pictures of classmate Elliston Berry and six other female students in her friend group via social media. Berry's mother, Anna McAdams, spoke with Senators Ted Cruz and Amy Klobuchar, who consequently drafted the Tools to Address Known Exploitation by Immobilizing Technological Deepfakes on Websites and Networks (or TAKE IT DOWN) Act.
-
Deepfake Video Reportedly Depicts Zambian President Hakainde Hichilema Withdrawing from 2026 Election AIID ↗
A viral video circulating on social media in October 2023 falsely claimed that Zambian president Hakainde Hichilema announced he would not run in the 2026 elections. Fact-checkers and digital forensics experts confirmed the video was manipulated using basic AI tools. The footage originated from a TikTok account known for AI-generated content.
-
Deepfake Recordings Allegedly Influence Slovakian Election AIID ↗
Days before Slovakia's election, deepfake audio recordings surfaced, allegedly featuring conversations between a journalist and a leading liberal politician discussing vote-rigging and other controversial topics. The recordings were spread on social media platforms and may have influenced the election outcome, which saw the pro-Russian populist party winning.
-
Robin Williams's Voice Deepfaked Without Consent AIID ↗
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
-
Deepfaked Advertisements Using the Likenesses of Celebrities Such as Tom Hanks and Gayle King Without Their Consent AIID ↗
Deepfake technology was used to generate video advertisements featuring celebrities. Notable examples include the likeness of Tom Hanks touting a dental plan and another one in which the likeness of Gayle King touts a weight loss product. In each case, the individuals whose likenesses and voices had been deepfaked had not consented to their images and voices being used for the commercials.
-
Russia Reportedly Using Artificial Intelligence in Disinformation Campaigns to Erode Western Support for Ukraine AIID ↗
The Russian government has been stepping up its foreign influence campaigns by using artificial intelligence and emerging technologies to spread disinformation and sow distrust in policies supportive of Ukraine. Part of the strategy includes carrying out influence laundering operations by disseminating their messages to the American public via allies inside nominally independent organizations, according to a recent declassified analysis.
-
Ottawa Couple Reportedly Loses CA$177,023 After Purported Deepfake Elon Musk Investment Scam AIID ↗
A retired Ottawa couple, Doug and Victoria Lloyd, lost CA$177,023 after being lured by a purported deepfake video of Elon Musk promoting a fake investment platform. The deepfake allegedly led to prolonged social engineering, remote access to their computer, and fraudulent cryptocurrency transfers. The couple reportedly suffered major financial loss and ongoing debt. Police say recovery is unlikely.
-
Purported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town AIID ↗
In Spain, an AI app was used to digitally alter photos of young girls, making them appear naked. This manipulation sparked an investigation after these images were circulated in Almendralejo, a town in the Extremadura region, raising serious concerns about digital privacy violations and the potential spread of these images on pornographic sites.
-
Voice deepfake targets bank in failed transfer scam AIID ↗
In spring 2023, Florida investor Clive Kabatznik became the target of an advanced scam attempt involving a voice deepfake mimicking his own voice. The fraudulent caller, using AI-generated speech, contacted Kabatznik's Bank of America representative in an unsuccessful attempt to deceive the banker into transferring funds to a different account.
-
Deepfake Voice Exploit Compromises Retool's Cloud Services AIID ↗
In August 2023, a hacker reportedly was successful in breaching Retool, an IT company specializing in business software solutions, impacting 27 cloud customers. The attacker appears to have initiated the breach by sending phishing SMS messages to employees and later used an AI-generated deepfake voice in a phone call to obtain multi-factor authentication codes. The breach seems to have exposed vulnerabilities in Google's Authenticator app, specifically its cloud-syncing function, further enablin
-
Campaign Featuring Purported AI-Generated Audio Attributed to Omar al-Bashir Spreads During Sudanese Conflict AIID ↗
Beginning in late August 2023, a TikTok channel called The Voice of Sudan circulated purported AI-generated audio claiming to be leaked recordings of former Sudanese president Omar al-Bashir. Experts identified several recordings as voice-cloned fabrications, derived from unrelated broadcasts by a political commentator. The campaign emerged during Sudan's civil war and appeared designed to influence political perceptions. TikTok later removed the account for violating synthetic media policies.
-
AI-Generated Imagery and Multilingual Disinformation in Chinese Campaign Regarding Maui Wildfires AIID ↗
In a disinformation campaign concerning wildfires across Maui, Chinese operatives utilized AI-generated imagery to enhance the credibility of false narratives. These narratives claimed that the wildfires were the result of a secret "weather weapon" being tested by the United States. Researchers from Microsoft and other organizations identified these AI-generated images as a significant new tactic in influence operations.
-
Shein Accused of AI-Driven Art Theft on Merchandise AIID ↗
Artists Krista Perry, Larissa Martinez, and Jay Baron filed a lawsuit against Shein, alleging the company used AI to replicate their art on merchandise. The artists claim Shein's algorithm identifies trending online art, creating near-identical copies for their products without credit or compensation.
-
Grant Reviewers Reportedly Fed Applications into Generative AI to Produce Reports, Allegedly Breaching Confidentiality AIID ↗
Peer reviewers of Australian government grant applications reportedly inserted applicants' work into generative AI systems such as ChatGPT to generate assessment reports, which allegedly posed confidentiality and security issues.
-
Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality AIID ↗
Amazon’s Kindle Unlimited young adult romance bestseller list was flooded with allegedly AI-generated books that made little to no sense, disrupting the rankings. These books were reported to be "clearly there to click farm." Despite being removed from the bestseller list, many remained available for purchase. The incident raised concerns about the integrity of the platform, and the potential financial impact on legitimate authors.
-
Purported Deepfake Image Allegedly Circulating of Donald Trump with Underage Girl at Jeffrey Epstein's Private Island AIID ↗
A purported deepfake image allegedly depicting Donald Trump with an underage girl at Jeffrey Epstein's private island in 1992 has reportedly been circulating on social media.
-
Ron DeSantis's Presidential Campaign Released Twitter Video Containing AI Images of Donald Trump Hugging Anthony Fauci AIID ↗
Ron DeSantis’s presidential campaign shared a video on Twitter featuring some AI-generated images of Donald Trump hugging former White House coronavirus advisor Anthony Fauci, allegedly as a smear campaign. This incident is possibly the first time a major U.S. presidential campaign deployed deepfakes with the intention of misleading the electorate.
-
AI-Generated Voices Amplify Conspiracy Theories on TikTok AIID ↗
NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.
-
Donald Trump's Presidential Campaign Released Deepfakes Attacking Ron DeSantis AIID ↗
Former President Donald Trump released two AI-generated videos using deepfaked voices to mock Florida Governor Ron DeSantis. The first video, posted on platforms like Rumble and Instagram, depicted a chaotic and offensive fake Twitter Spaces event featuring deepfaked voices of Elon Musk, George Soros, Klaus Schwab, Dick Cheney, Adolf Hitler, and a generated voice of Satan. The second video showed a rocket with "Ron 2024" written beside it falling and exploding before liftoff.
-
Alleged Use of Purportedly AI-Generated and Manipulated Media to Misrepresent Candidates and Disrupt Turkey's 2023 Presidential Election AIID ↗
During Turkey's 2023 presidential election, reportedly manipulated and allegedly AI-generated videos, audio, and images were used to smear candidates, purportedly link opposition figures to terrorist groups, and circulate a purported sex tape that reportedly contributed to presidential candidate Muharrem İnce’s withdrawal. These incidents reportedly misled voters, disrupted campaigning, and altered the electoral field.
-
Iranian Hacker Group Cotton Sandstorm Reportedly Integrating AI into Cyber Influence Operations AIID ↗
The Iranian state-sponsored group Cotton Sandstorm, linked to the IRGC, has integrated generative AI into cyber influence operations. In December 2023, it launched Operation “For Humanity," using AI-crafted messaging to hijack a U.S.-based IPTV streaming service with propaganda about the Israel-Hamas conflict. The group also engages in election-related reconnaissance, which suggests they used AI-enhanced influence efforts ahead of the 2024 U.S. election.
-
Novel Deepfake Song Pulled from Music Streaming Services After Allegedly Violating Artist's Rights AIID ↗
The deepfake performance of "Heart On My Sleeve" created to mimic the voice and musical styles of Drake and The Weeknd is no longer available on several streaming services after their record label served copyright takedown notices to the platforms.
-
Purported AI-Generated Audio Disinformation Reportedly Attributed to U.S. Ambassador John Godfrey Circulates in Sudan AIID ↗
In April 2023, a reportedly fake audio message impersonating U.S. Ambassador to Sudan John Godfrey circulated on Sudanese social media. Reportedly produced using AI voice-cloning tools, the message portrayed the ambassador outlining strategies to impose secularism through U.S. support. Researchers attribute the clip to Islamist-linked networks seeking to undermine Western and civilian influence during the ongoing civil conflict. The message was quickly identified as inauthentic.
-
Chinese Businessman Reportedly Defrauded of 4.3 Million Yuan by AI-Generated Deepfake Impersonating Friend AIID ↗
A scammer in China used AI-generated deepfake technology to impersonate a businessman’s trusted friend in a video call, convincing him to transfer 4.3 million yuan ($612,000). The fraudster mimicked the friend’s face and voice, claiming another associate needed funds for a business transaction. Without verifying the transfer, the victim sent the money. He later realized the deception and contacted police, who managed to recover 3.4 million yuan.
-
Quebec Man Sentenced for Having Used Deepfake Technology to Create Synthetic Child Pornography AIID ↗
A Quebec man was sentenced to over three years in prison for using AI deepfake technology to produce synthetic child pornography. He created videos by superimposing children's faces onto other bodies, adding to the challenge of policing digital sexual exploitation. This case marks a disturbing use of AI in criminal activities, raising concerns about digital safety and the vulnerability of children's images online.
-
South Korean man used AI to create sexual images of children AIID ↗
A South Korean man used AI technology to generate 360 images of a sexual nature depicting children in April of 2023. The police confiscated the images and the courts sentenced the man to two and a half years in prison. The case marked the first of its nature in the South Korean court system.
-
FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities AIID ↗
The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats.
-
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam AIID ↗
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
-
GPT-4 Reportedly Posed as Blind Person to Convince Human to Complete CAPTCHA AIID ↗
GPT-4 was reported by its researchers posing as a visually impaired person, contacting a TaskRabbit worker to have them complete the CAPTCHA test on its behalf.
-
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App AIID ↗
Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.
-
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban AIID ↗
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
-
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election AIID ↗
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
-
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio AIID ↗
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
-
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote AIID ↗
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
-
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories AIID ↗
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
-
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy AIID ↗
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
-
Synthesized Voices Were Reportedly Used by Torswats to Sell Swatting Calls Targeting Schools and Homes AIID ↗
A Telegram user or channel known as Torswats reportedly offered paid swatting services and uploaded recordings of false emergency calls using synthesized or computer-generated voices. Reported targets included high schools, private residences, streamers, businesses, and police departments; some calls prompted lockdowns, searches, or armed law-enforcement responses. The exact voice-generation tool was not identified.
-
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students AIID ↗
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.
-
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand AIID ↗
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
-
Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey AIID ↗
AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending funds to their crypto wallets disguised as donation links for the 2023 Turkey–Syria earthquake.
-
AI Generated Voices Used to Dox Voice Actors AIID ↗
Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.
-
Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release AIID ↗
The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before its release, another book appeared bearing the exact title by an author (Marie Karpos) for whom no information could be found. The book appeared to have been written by ChatGPT. While the original Washington Post story does not say so, it is possible the name and description were taken from the Amazon preorder page.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.