AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Reported AI-Generated Video Purportedly Depicting Keanu Reeves Debating Elon Musk Circulates as Misinformation on Social Media AIID ↗
In April 2025, a video circulated online reportedly depicting a televised debate between Keanu Reeves and Elon Musk about AI. The video, posted by the YouTube channel Voices of Change, purportedly used AI-generated voice and visual content to simulate the event. Independent analysis found signs of deepfake audio and imagery, and no credible evidence supported the event's existence.
-
Deepfake Job Applicant Allegedly Used AI Tools to Apply for Remote Role at U.S. Security Startup AIID ↗
Voice authentication startup Pindrop Security reported a job candidate used deepfake software and other AI tools in an attempted scam. This is part of a growing trend in international scammers using AI tools to apply for remote US-based jobs, sometimes successfully.
-
Purported Deepfake Depicts Altercation Between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape AIID ↗
A purported AI‑generated deepfake video circulated online falsely depicting a physical altercation between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape. The footage reportedly caused public confusion and risked damaging relations between Bougainville and Papua New Guinea. Toroama reportedly condemned the video as false and malicious, as well as potentially destabilizing, urging stronger action against misleading AI‑generated content.
-
Hong Kong Syndicate Allegedly Used AI-Generated Facial Composites to Open Bank Accounts AIID ↗
Hong Kong police reportedly arrested eight individuals accused of using purportedly AI-generated facial composites to open bank accounts with altered ID photos. Of 44 applications, 30 reportedly succeeded after passing online identity checks. The accounts were then allegedly used to apply for loans and make credit card purchases totaling HK$860,000, and to launder over HK$1.2 million in suspected criminal proceeds. Police linked the operation to local triad-affiliated fraud networks.
-
Alleged Deepfake Investment Scam in Spain Defrauds 208 Victims of €19 million ($20.9 million) AIID ↗
Spanish police arrested six individuals allegedly behind a €19M ($20.9M) global investment scam powered by AI. The operation used deepfake ads featuring national celebrities to deceive victims, many of whom were selected through targeting algorithms. Scammers posed as financial advisors and fake officials, cycling through romance baiting, investment fraud, and recovery scams. AI-generated content amplified trust and engagement.
-
Reported Darknet Launch of Xanthorox AI Introduces Autonomous Cyberattack Platform AIID ↗
Xanthorox AI is a malicious, modular AI system released on darknet forums in early 2025. Designed from scratch for offensive cyber operations, it runs on private infrastructure and includes models for code generation, phishing, malware, social engineering, and real-time voice/image input. Its release represents a deliberate deployment of an autonomous attack platform.
-
Deepfake of Bermuda Premier David Burt Promotes Investment Scam Using Royal Gazette Branding AIID ↗
The Government of Bermuda warned the public about a deepfake video circulating on Facebook that falsely portrayed Premier David Burt promoting a government investment scheme. The deepfake video reportedly mimicked the branding of The Royal Gazette and was linked to fraudulent social media accounts. Authorities confirmed the content was fake and urged the public to report such scams and to be vigilant about them.
-
AI incident: sexual content (Apr 2025) AIID ↗
Between March 2023 and May 2024, Brandon Tyler of Essex used AI to generate explicit deepfake pornography of at least 20 women he knew personally, including a 16-year-old. He manipulated their social media photos and shared them, along with their personal details, in online forums promoting sexual violence. He was sentenced to five years in prison in April 2025 under the UK's criminal law against sharing sexually explicit deepfakes, in what is one of the first major prosecutions of its kind.
-
Baltimore Lawsuit Alleged DraftKings and FanDuel Used Machine-Learning-Driven Targeting to Exploit Vulnerable Gamblers AIID ↗
In Baltimore, the city sued DraftKings and FanDuel, alleging that the companies used predictive modeling with machine-learning algorithms, extensive user data, personalized promotions, push notifications, and VIP programs to identify and exploit vulnerable bettors, including people showing signs of gambling disorder. The complaint alleges these systems were designed to maximize user lifetime value and contributed to financial and public-health harms among Baltimore residents.
-
AI Voice Clone of Texas Woman Used in Distress Scam Targeting Brother in Port Neches AIID ↗
Jace Edgar of Port Neches, Texas reportedly received a scam phone call using AI-generated voice cloning to mimic his sister in distress. Believing she had been in an accident, Edgar began to act before noticing the caller avoided direct questions. When he contacted his sister, she was unharmed and unaware of the call. Authorities confirmed this was part of a broader rise in AI-powered scams, urging the public to stay vigilant and avoid sharing personal info with unknown callers.
-
DOGE Reportedly Relied on Unvetted ChatGPT Outputs in Canceling National Endowment for the Humanities Grants AIID ↗
Department of Government Efficiency (DOGE) staff reportedly fed National Endowment for the Humanities grant descriptions into ChatGPT to determine whether projects were "DEI," then allegedly used those outputs to help compile a list of grants to terminate. Beginning in April 2025, NEH canceled awards and clawed back funding, reportedly disrupting humanities organizations and projects nationwide after officials allegedly relied on a purportedly flawed, insufficiently vetted AI screening process.
-
Reported AI‑Generated Deepfake Impersonations of Public Figures Allegedly Used in Coordinated Stock Pump‑and‑Dump Scheme Targeting Israeli Investors AIID ↗
A coordinated fraud campaign in Israel allegedly used AI‑generated deepfake impersonations of public figures including Amir Yaron, Benjamin Netanyahu, Eyal Golan, Noa Kirel, Gal Gadot, Elon Musk, and Mark Zuckerberg to promote NASDAQ‑listed Ostin Technology Group Co. Ltd. (OST) in a pump‑and‑dump scheme. Paid social media ads, WhatsApp groups, and fake investment platforms reportedly lured investors before the stock collapsed in early July 2025, causing major reported losses.
-
Reportedly AI-Generated Image Circulates Amid Reports of Tanzania Revenue Authority Job Interviews AIID ↗
An image circulated on Facebook purporting to show hundreds of Tanzanians lining up for just five jobs at the Tanzania Revenue Authority (TRA). The photo, reportedly AI-generated, gained traction shortly after TRA invited over 100,000 applicants for interviews on March 29–30. Though TRA had announced more than 1,500 openings, the image misrepresented the situation, stoking public anxiety during a period of high unemployment.
-
OpenAI's 4o Model Allegedly Used to Generate Fake Receipts and Prescriptions AIID ↗
OpenAI's new image generator, 4o, was reportedly used to produce realistic fraudulent documents, including fake restaurant receipts, prescriptions for controlled substances, and potentially other identity or financial documents. Users demonstrated how the model could be prompted to bypass safety restrictions to be misused for expense fraud, medical forgery, and other various forms of document falsification.
-
AI incident: sexual content (Gennomis By Ai Nomis, Mar 2025) AIID ↗
In March 2025, cybersecurity researcher Jeremiah Fowler discovered an unprotected database linked to GenNomis by AI-NOMIS, a South Korean company offering face-swapping and "nudify" AI services. The exposed 47.8GB dataset included nearly 100,000 files. Many depicted explicit deepfake images, some involving minors or celebrities. No personal data was found, but the breach was a serious failure in data security and consent safeguards in AI image-generation platforms.
-
GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt AIID ↗
In March 2025, Michael Lines, a 34-year-old California man, allegedly spent weeks discussing religious delusions with GPT-4o after disclosing his bipolar disorder and medication use. His complaint says the chatbot validated his belief that he was Jesus, adopted a divine persona, and failed to redirect him when he expressed suicidal intent. Lines later overdosed and survived after law enforcement found him.
-
AI incident: sexual content (Mar 2025) AIID ↗
Students of the Western Dubuque Community School District in Iowa reported that classmates allegedly used AI-enabled applications to generate sexualized deepfake images depicting fellow students. According to local reporting and the Dubuque County Sheriff's Office, the fabricated images were created and shared without consent. The school district reportedly held a public session to address policy gaps and student support following the incident.
-
Purported Meta AI Chatbot Persona 'Big sis Billie' Reportedly Engages in Romantic Roleplay and Provides Address, Linked to User's Fatal Fall AIID ↗
Reuters reported that a cognitively impaired New Jersey man, Thongbue Wongbandue, died after rushing to meet "Big sis Billie," a purported Meta AI chatbot on Facebook Messenger that allegedly assured him it was real, expressed romantic interest, and invited him to a New York apartment. The family and transcripts reportedly suggest the chatbot's outputs contributed to his decision to travel, allegedly resulting in a fatal fall.
-
Fact-Checking Finds Reportedly AI-Generated Video Misattributed Hypertension Cure Endorsements to Taiwo Ajai-Lycett and Chinonso Egemba AIID ↗
Fact-checking reports that a purported AI-generated video circulated on Facebook depicting veteran actor Taiwo Ajai-Lycett discussing a hypertension diagnosis and promoting an unproven treatment by influencer Chinonso Egemba. According to the report, the video exhibited signs of AI generation, including unnatural speech and mismatched lip movements. Both Ajai-Lycett and Egemba have denied involvement, and no credible medical evidence supports the claimed cure.
-
Manipulated Video Using AI-Generated Audio Targets Pakistan's Prime Minister Shehbaz Sharif with Fabricated Interview AIID ↗
A viral video falsely claimed to show Layal al-Ekhtiar of Al Arabiya confronting Pakistan's Prime Minister Shehbaz Sharif over funding a 30-person Umrah delegation with public money while seeking aid from Saudi Arabia. Investigators concluded the video had been dubbed with AI-generated audio. The original interview was broadcast by Saudi-owned Al Arabiya in January 2023, and it contained no such exchange. Lip-sync inconsistencies reportedly confirmed the manipulation.
-
Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability AIID ↗
A WIRED investigation found that OpenAI's video generation model, Sora, exhibits representational bias across race, gender, body type, and disability. In tests using 250 prompts, Sora was more likely to depict CEOs and professors as men, flight attendants and childcare workers as women, and showed limited or stereotypical portrayals of disabled individuals and people with larger bodies.
-
Purported DOGE Contract Review Tool Cited in Reports of AI-Driven Misjudgments in VA Budget Cuts AIID ↗
A purported AI tool using LLMs was deployed to classify Veterans Affairs contracts as expendable based on limited text and simplified criteria. The system allegedly produced hallucinated values and flagged critical healthcare and research services for cancellation. Reportedly, at least two dozen flagged contracts were later terminated.
-
Alleged Fraudulent Prompts via AIXBT Dashboard Led Purported AI Trading Agent to Transfer 55.5 ETH from Simulacrum Wallet AIID ↗
A reported hacker attack allegedly compromised the autonomous AI crypto bot AIXBT, purportedly resulting in the theft of 55.5 ETH (approximately $106,200). The attacker is reported to have infiltrated the secure dashboard of the AIXBT autonomous system at 2:00 AM UTC on March 18, 2025, and allegedly queued two fraudulent prompts that instructed the AI agent to transfer funds from its simulacrum wallet.
-
AI-Enabled Organized Crime Expands Across Europe AIID ↗
Europol’s EU Serious and Organised Crime Threat Assessment (EU-SOCTA) 2025 warns that AI is accelerating the growth of organized crime throughout Europe. Criminal networks are leveraging AI for cyber fraud, ransomware, money laundering, and child exploitation, while AI-powered social engineering and automation are making criminal operations more scalable and harder to detect.
-
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem AIID ↗
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
-
AI incident: sexual content (Mar 2025) AIID ↗
Authorities in Bucks County, Pennsylvania reported that a middle school student allegedly used AI-enabled tools to create sexualized deepfake images depicting classmates. The incident, which reportedly occurred in March 2025, involved images generated without consent and is under investigation by local police and the district attorney's office. The alleged conduct may fall under a new Pennsylvania law addressing non-consensual AI-generated sexual imagery, particularly involving minors.
-
Alleged AI-Generated IRS Scam Websites Used to Defraud U.S. Taxpayers AIID ↗
Scammers have allegedly been using AI-generated imposter websites and phishing emails to impersonate the IRS. They have reportedly been tricking taxpayers into providing personal and financial information. There has been a reported surge in tax-related AI scams leading up to Tax Day 2025, with fraudulent domains mimicking IRS services, along with fake websites, emails, and text messages. The IRS has warned taxpayers to verify official sites and avoid unsolicited links.
-
Docomo Pacific CEO Reports Mother Targeted by Purported AI-Enabled Scam in Guam AIID ↗
Docomo Pacific's CEO, Christine Baleto, disclosed that her elderly mother was targeted by an alleged AI-enabled scam call on Guam. The scammer reportedly posed as a federal agent and used personal details and intimidation, demanding sensitive information under false pretenses. The company's advisory suggests AI voice cloning may have been involved, warning that such technology can convincingly mimic family members' voices, increasing risk for seniors on the island.
-
AI-Generated Voice Cloning of Trump Falsely Proposes Renaming the District of Columbia to the District of America AIID ↗
A viral audio clip circulating on TikTok, Facebook, X, and other platforms falsely portrayed Donald Trump saying he would rename Washington, D.C. as the "District of America." The voice was confirmed to be AI-generated by digital forensics experts. It was initially posted by a now-deleted TikTok account. The clip is reported to have spread rapidly across political lines before it was debunked.
-
Scammers Reportedly Using Deepfake Video Calls to Impersonate Executives in Singapore and Orchestrate Corporate Bank Transfers AIID ↗
Scammers in Singapore are reportedly using AI-generated deepfake video calls to impersonate corporate executives. The calls seek to deceive employees into authorizing fraudulent bank transfers. Usually, it is reported, victims will receive WhatsApp messages inviting them to Zoom meetings. During the calls, the scammers are disguised as senior leaders and will instruct the employees to transfer company funds for fake business transactions and to disclose personal data.
-
Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program AIID ↗
A former contractor of the New South Wales Reconstruction Authority reportedly uploaded a spreadsheet containing personal and health information of Resilient Homes Program applicants to ChatGPT during a three-day period in March 2025. Up to 3,000 people may have reportedly been affected.
-
Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook AIID ↗
In March 2025, an AI-generated deepfake video of Donald Trump criticizing Ukrainian President Volodymyr Zelenskyy for his clothing circulated widely on Facebook. In the video, Trump mocks Zelenskyy by calling him "Temu Zelenskyy." The video was created by a parody YouTube channel using AI voice and face synthesis tools, but it was reportedly mistaken by some viewers as real.
-
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login AIID ↗
A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.
-
Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error AIID ↗
A predictive text malfunction allegedly compromised the integrity of the NAPLAN writing exam at two Sydney schools, Waverley College and Kambala, in that it allowed students to access AI-driven text suggestions. Caused by a technical oversight, this incident led to affected students being required to retake the test.
-
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook AIID ↗
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
-
Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans AIID ↗
Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.
-
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice AIID ↗
AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.
-
Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams AIID ↗
Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.
-
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization AIID ↗
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
-
Amazon and Google AI Allegedly Promote Mein Kampf as 'a True Work of Art' in Search Results AIID ↗
Amazon's AI-generated review summary allegedly misrepresented customer feedback on Mein Kampf by describing it as "a true work of art." Google's search algorithm then surfaced this misleading AI-generated text as a featured snippet, which in turn amplified the error. This incident arose from AI summarizing AI-generated content, in effect creating a self-reinforcing misinformation loop.
-
ChatGPT Was Allegedly Consulted About Attack Options Before Teen Attempted to Stab Officer at Tira, Israel, Police Station AIID ↗
A 16-year-old from Tira, Israel, allegedly entered the city's police station with a knife and attempted to stab a Border Police officer. Prosecutors reportedly alleged that before the attack he had consulted ChatGPT about possible attacks and courses of action. He was charged in juvenile court with attempted aggravated assault as an act of terror. Public reporting does not establish what responses ChatGPT provided or whether they materially assisted the attempted attack.
-
Alleged AI-Generated Video by Spain’s People’s Party Results in Diplomatic Fallout with the Dominican Republic AIID ↗
Spain's People's Party (PP) posted an AI-generated attack video depicting Prime Minister Pedro Sánchez on a beach under the title "The Island of Corruption," a reference to a reality TV show filmed in the Dominican Republic, indirectly linking the country to corruption. The Dominican Foreign Ministry condemned the video as a "vicious attack" for using its national symbols. PP later deleted the post, and Sánchez apologized on behalf of Spain.
-
Apple AI Transcription Allegedly Inserts Explicit Language into Scottish Woman’s Voicemail AIID ↗
An Apple voicemail transcription system allegedly misinterpreted a message from Lookers Land Rover in Motherwell, Scotland, to 66-year-old customer Louise Littlejohn by inserting an explicit phrase and an insult. The original voicemail was a standard business message, but AI processing errors introduced offensive and misleading content into the text version.
-
Art Museum in Jinan, Shandong Allegedly Generated and Displayed a Sexualized Childlike Avatar with an Adult Body AIID ↗
A Chinese art museum in Jinan, Shandong exhibited an AI-generated virtual character, "济南小妮儿" (Jinan Xiaonier), which featured a childlike face on an adult woman’s body with suggestive movements. The display drew public outrage, with critics accusing it of sexualizing children and demanding its removal. The museum defended the exhibit and stated that it had undergone strict review, which only fueled further backlash.
-
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors AIID ↗
At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.
-
Canadian Fraud Ring Allegedly Used AI Voice Cloning in Multi-Year $21 Million Grandparent Scam Targeting Elderly Americans Across 46 States AIID ↗
A Canadian fraud ring allegedly used AI-generated voice cloning to defraud victims across 46 U.S. states by targeting grandparents in a $21 million scam between 2021 and 2024. Operating from call centers in Montreal, the scammers spoofed U.S. phone numbers and used AI-cloned voices of grandchildren to convince victims to pay fake bail fees.
-
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission AIID ↗
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.
-
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million AIID ↗
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
-
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products AIID ↗
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable us
-
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign AIID ↗
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.
Frequently asked questions
- What is recorded in each incident?
- What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
- Does an incident mean wrongdoing was proven?
- No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
- How current is the incident data?
- It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
- Does this page include the full incident reports?
- No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.