AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks AIID ↗
A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on Instagram and circulated on social media.
-
Non-consensual Deepfake Porn Targeted Female Content Creators AIID ↗
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
-
Purported Synthesia Avatars Used in Alleged Pro-Junta Deepfake Video Supporting Ibrahim Traoré in Burkina Faso AIID ↗
In January 2023, purportedly AI-generated videos reportedly began circulating on WhatsApp and social media showing avatars of apparent American pan-Africanists expressing support for Burkina Faso's military junta. The videos were reportedly created using the Synthesia platform. Synthesia later confirmed the videos violated its terms of service and banned the user. The source of the videos remains unidentified.
-
Mother in Arizona Received Fake Ransom Call Featuring AI Voice of Her Daughter AIID ↗
A mother in Arizona received a ransom call from an anonymous scammer who created her daughter's voice allegedly using AI voice synthesis, which was proven to be fake once her daughter's safety was confirmed.
-
Canadian Parents Tricked out of Thousands Using Their Son's AI Voice AIID ↗
Two Canadian residents were scammed by an anonymous caller who used AI voice synthesis to replicate their son's voice asking them for legal fees, disguising as his lawyer.
-
ChatGPT-Written Bug Reports Deemed "Nonsense" by White Hat Platform, Prompted Bans AIID ↗
ChatGPT-generated responses submitted to smart contract bug bounty platform Immunefi reportedly lacked details to help diagnose technical issues, which reportedly wasted the platform's time, prompting bans to submitters.
-
ChatGPT Abused to Develop Malicious Softwares AIID ↗
OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.
-
AI Video-Making Tool Abused to Deploy Pro-China News on Social Media AIID ↗
Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.
-
Chinese Accounts Spammed Twitter Feed Allegedly to Obscure News of Protests AIID ↗
Twitter Feed was flooded by content from Chinese-language accounts which allegedly aimed to manipulate and reduce social media coverage about widespread protests against coronavirus restrictions in China.
-
Deepfake of FTX's Former CEO Posted on Twitter Aiming to Scam FTX Collapse Victims AIID ↗
A visual and audio deepfake of former FTX CEO Sam Bankman-Fried was posted on Twitter to scam victims of the exchange's collapse by urging people to transfer funds into an anonymous cryptocurrency wallet.
-
Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked AIID ↗
Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.
-
Weibo Model Had Difficulty Detecting Shifts in Censored Speech AIID ↗
Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.
-
Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams AIID ↗
Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.
-
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube AIID ↗
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
-
Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn AIID ↗
Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.
-
Deepfakes Reportedly Deployed in Online Interviews for Remote Work Positions AIID ↗
Voice and video deepfakes were reported by FBI Internet Crime Complaint Center (IC3) in complaint reports to have been deployed during online interviews of the candidates for remote-work positions.
-
Yahoo Boys Allegedly Employ Real-Time Deepfake Technology in Romance Scams AIID ↗
Scammers from Nigeria, known as "Yahoo Boys," are reportedly utilizing real-time deepfake technology to impersonate individuals during video calls, deceiving victims in romance scams. By allegedly altering their appearance with face-swapping software, they build trust under false identities to defraud targets of substantial sums.
-
Robbers Accessed Drugged Gay Men's Bank Accounts Using Their Phones' Facial Recognition AIID ↗
Gay men in New York City were drugged by robbers who accessed their phones using facial recognition while they were unconscious to transfer funds out of their bank accounts.
-
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election AIID ↗
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of
-
AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston AIID ↗
GAN faces were allegedly used by scammers alongside a parked domain and a fake website to impersonate a Boston law firm.
-
Deepfake Video of Ukrainian President Yielding to Russia Posted on Ukrainian Websites and Social Media AIID ↗
A quickly-debunked deepfaked video of the Ukrainian President Volodymyr Zelenskyy was posted on various Ukrainian websites and social media platforms encouraging Ukrainians to surrender to Russian forces during the Russia-Ukraine war.
-
Fake LinkedIn Profiles Created Using GAN Photos AIID ↗
More than a thousand inauthentic LinkedIn profiles using allegedly GAN-generated photos were notified by researchers at Stanford to LinkedIn’s staff, and many of which were removed for violating rules against creating fake profiles and falsifying information.
-
AI-Generated Profiles Used in Disinformation Campaign Targeting Ukrainians AIID ↗
According to security reports by Meta, fictitious personas with GAN-generated profile pictures were used by people operating in Russia and Ukraine to push a disinformation campaign targeting Ukrainian social media users, and were taken down.
-
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation AIID ↗
A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation sinc
-
Voices Created Using Publicly Available App Stolen and Resold as NFT without Attribution AIID ↗
An AI-synthetic audio sold as an NFT on Voiceverse’s platform was acknowledged by the company for having been created by 15.ai, a free web app specializing in text-to-speech and AI-voice generation, and reused without proper attribution.
-
Arizona Residents Reportedly a Frequent Target of AI-Driven Romance Scams AIID ↗
Arizona residents, especially senior citizens, are reportedly often the target of AI-driven romance scams. Between 2022 and 2023, reported losses from online romance scams in Arizona totaled over $47 million, ranking the state fifth highest in the nation behind California, Florida, Texas, and New York, according to FBI Internet Crime Complaint Center data. In 2023, it has been reported that Arizonans lost $325 million owing to these scams.
-
Web Accessibility Vendors Allegedly Falsely Claimed to Provide Compliance Using AI AIID ↗
AI-powered web accessibility vendors allegedly overstated to customers about their products' utility for people with disabilities, falsely claiming to deliver automated compliance solutions.
-
Social Media Algorithms Amplified Disinformation Campaign in Honduras Election AIID ↗
In October 2021, a coordinated network of over 317 fake Twitter accounts leveraged AI-driven algorithms to amplify disinformation about the Honduran presidential election, targeting opposition candidate Xiomara Castro. The campaign spread false narratives to suppress voter turnout and undermine the election's integrity. Social media platforms, including Twitter and Facebook, removed the accounts only after being alerted, which also raised concerns about inadequate moderation.
-
Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students AIID ↗
Henan Public Security Department procurement documents reportedly described a surveillance system awarded to Neusoft on September 17, 2021. The planned system would allegedly use about 3,000 facial-recognition cameras linked to regional and national databases to create files and alerts on foreign journalists, international students, and other targeted groups. It could not be confirmed whether the system became operational.
-
North Carolina Psychiatrist Used Artificial Intelligence to Produce Images of Child Sex Abuse AIID ↗
David Tatum, a psychiatrist, was sentenced to 40 years for sexually exploiting a minor and using AI to create child pornography images. Tatum used a web-based AI application to alter clothed images of minors into explicit content, misusing technology for illegal and unethical purposes. Evidence presented during his trial showed Tatum possessed photos and videos between 2016 and 2021.
-
AI-Generated Deepfakes Reportedly Derailed Political Career of Florida Official AIID ↗
Sabrina Javellana, a Florida politician, was reportedly targeted with AI-generated deepfake pornography in February 2021, which was spread online, leading to severe emotional distress and her eventual withdrawal from public life.
-
Facebook Recommended Military Gear Ads Despite Pause on Weapons Accessories Ads AIID ↗
Facebook’s algorithmic recommendations reportedly continued showing advertisements for gun accessories and military gear, despite Facebook’s halt on weapons accessories ads following the US Capitol attack.
-
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers AIID ↗
North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes
-
Japanese Porn Depixelated by Man using Deepfake AIID ↗
A man allegedly unblurred, using deepfake technology, pixelated pornographic images and videos of pornographic actors, which violated Japan’s obscenity law requiring images of genitalia to be obscured.
-
Deepfake Images of Australian Teacher Hannah Grundy and 25 Others Created and Circulated Online by Former Friend AIID ↗
Australian teacher Hannah Grundy discovered her face had been superimposed onto pornographic images using AI deepfake technology, which were shared online alongside personal details. A former trusted friend, Andrew Thomas Hayler, was found responsible, targeting 26 women, including Grundy and close friends, over two years. Hayler pleaded guilty to multiple charges and was sentenced to nine years in prison.
-
WeChat Pay's Facial Recognition Security Evaded by Scammers Using Victims’ Social Media Content AIID ↗
In China, fraudsters bypassed facial-recognition security for online financial transactions on WeChat Pay by crafting identity-verification GIFs of victims from their selfies on WeChat Moments, a social media platform.
-
Reported AI-Assisted Influence Campaigns by GoLaxy Allegedly Targeting Hong Kong and Taiwan Political Discourse AIID ↗
Reportedly leaked documents reviewed by researchers and media allege that Chinese firm GoLaxy used its "GoPro" AI system in multiple influence campaigns. In 2020, it reportedly tracked 180,000 Twitter accounts to counter opposition to Hong Kong's National Security Law; in 2022–2023, it amplified praise for China's Zero Covid policy using purportedly fake Facebook accounts; and in late 2023, allegedly it advised on messaging to weaken Taiwan's Democratic Progressive Party.
-
Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms AIID ↗
A pro-China propaganda campaign deployed fake accounts on Facebook, Twitter, and YouTube using GAN-synthesized faces to share and post comments on its content to gain wider circulation.
-
Kristen Bell Deepfaked in Non-Consensual AI-Generated Pornography AIID ↗
The actor Kristen Bell discovered that her likeness was exploited by creators of deepfake pornography, who shared their non-consensual sexual depictions of her on the Internet.
-
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms AIID ↗
The Indian political social media app Tek Fog allegedly allowed operatives affiliated with the ruling political party to hijack social media trends and manipulate public opinion on other apps such as Twitter and WhatsApp, which opposition parties denounced as a national security threat.
-
Climate Action Group Posted Deepfake of Belgian Prime Minister Urging Climate Crisis Action AIID ↗
A deepfake video showing the Belgium’s prime minister speaking of an urgent need to tackle the climate crises was released by a climate action group.
-
Autonomous Kargu-2 Drone Allegedly Remotely Used to Hunt down Libyan Soldiers AIID ↗
In Libya, a Turkish-made Kargu-2 aerial drone powered by a computer vision model was allegedly used remotely by forces backed by the Tripoli-based government to track down and attack enemies as they were running from rocket attacks.
-
BJP Used Deepfake Videos of Manoj Tiwari to Target Haryanvi Voters in 2020 Delhi Election AIID ↗
In February 2020, India's BJP used purported deepfake videos of party leader Manoj Tiwari to influence voters in the Delhi legislative election. The videos reportedly showed Tiwari delivering scripted campaign messages in Haryanvi and English, which are languages he did not speak, by altering his lip movements and voice. Distributed via thousands of WhatsApp groups, the deepfakes reportedly reached millions of voters without disclosure.
-
Noelle Martin Deepfaked Without Consent in AI-Generated Pornography AIID ↗
In 2017, Noelle Martin discovered explicit deepfake videos online that used AI technology to superimpose her face onto pornographic scenes. This incident was a continuation of the abuse she had experienced since at least 2012, when she first found doctored still images of herself in similar contexts. Despite the initial lack of legal protections, her advocacy efforts were instrumental in making image-based abuse a criminal offense in Australia.
-
Reported AI-Cloned Voice Used to Deceive Hong Kong Bank Manager in Purported $35 Million Fraud Scheme AIID ↗
In January 2020, a Hong Kong-based bank manager for a Japanese company reportedly authorized $35 million in transfers after receiving a call from someone whose voice matched the company director's. According to Emirati investigators, scammers used AI-based voice cloning to impersonate the executive. The fraud allegedly involved at least 17 individuals and reportedly led to global fund transfers that triggered a UAE investigation. U.S. authorities were reportedly later asked to help trace part of
-
Self-Employed Somerset Father Wayne Luxon Reportedly Lost £140,000 After Facebook Deepfake of Martin Lewis Promoted Crypto Scam AIID ↗
Beginning in 2020, Wayne Luxon, a 43-year-old self-employed father of four from Taunton, Somerset, reportedly lost £140,000 after responding to a Facebook advertisement using a purportedly AI-generated Martin Lewis deepfake to promote cryptocurrency investment. Luxon said he was directed to a clone platform where he made additional payments after seeing fictitious gains, and later paid purported tax fees before the account balance fell to zero.
-
Quantum AI and Related AI-Themed Investment Scams Reportedly Used Deepfake Endorsements and Spoofed Media Sites to Solicit Investments AIID ↗
Researchers have described a global AI-themed investment fraud ecosystem using deepfake videos, spoofed news sites, phishing pages, and phone outreach to impersonate celebrities, news outlets, and political leaders. Reports link the scheme to fake trading platforms including Quantum AI and related sites, and to cloaked adtech infrastructure used to route likely victims while hiding scam pages from scanners.
-
Giorgia Meloni Reportedly Targeted by Deepfake Pornography AIID ↗
In 2020, alleged deepfake pornographic videos falsely depicting Italian Prime Minister Giorgia Meloni were uploaded to a U.S. website and viewed millions of times. At the time, she was leader of the Brothers of Italy but not yet PM. In 2024, now serving as PM, Meloni reportedly sued Alessio Scurosu, 40, and his father, Roberto Scurosu, 73, seeking €100,000 in damages. She testified in court, calling the act "a form of violence."
-
Bots Allegedly Made up Roughly Half of Twitter Accounts in Discussions Surrounding COVID-19 Related Issues AIID ↗
Bots by anonymous actors were found by researchers to make up roughly half of Twitter accounts participating in COVID-19 discussions, many of which posted tweets about “reopening America“.
-
Uganda Deployed Huawei's Facial Recognition to Monitor Political Opposition and Protests AIID ↗
Huawei's AI systems involving facial recognition were reportedly deployed by the Ugandan government to monitor political opposition actors and anti-regime sentiments, which raised fears of surveillance and suppression of individual freedoms.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.