AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Reported Use of AI Apps to Create Sexualized Deepfake Images of High School Students at Cascade High School in Iowa AIID ↗
Students of the Western Dubuque Community School District in Iowa reported that classmates allegedly used AI-enabled applications to generate sexualized deepfake images depicting fellow students. According to local reporting and the Dubuque County Sheriff's Office, the fabricated images were created and shared without consent. The school district reportedly held a public session to address policy gaps and student support following the incident.
-
Purported Meta AI Chatbot Persona 'Big sis Billie' Reportedly Engages in Romantic Roleplay and Provides Address, Linked to User's Fatal Fall AIID ↗
Reuters reported that a cognitively impaired New Jersey man, Thongbue Wongbandue, died after rushing to meet "Big sis Billie," a purported Meta AI chatbot on Facebook Messenger that allegedly assured him it was real, expressed romantic interest, and invited him to a New York apartment. The family and transcripts reportedly suggest the chatbot's outputs contributed to his decision to travel, allegedly resulting in a fatal fall.
-
Fact-Checking Finds Reportedly AI-Generated Video Misattributed Hypertension Cure Endorsements to Taiwo Ajai-Lycett and Chinonso Egemba AIID ↗
Fact-checking reports that a purported AI-generated video circulated on Facebook depicting veteran actor Taiwo Ajai-Lycett discussing a hypertension diagnosis and promoting an unproven treatment by influencer Chinonso Egemba. According to the report, the video exhibited signs of AI generation, including unnatural speech and mismatched lip movements. Both Ajai-Lycett and Egemba have denied involvement, and no credible medical evidence supports the claimed cure.
-
Manipulated Video Using AI-Generated Audio Targets Pakistan's Prime Minister Shehbaz Sharif with Fabricated Interview AIID ↗
A viral video falsely claimed to show Layal al-Ekhtiar of Al Arabiya confronting Pakistan's Prime Minister Shehbaz Sharif over funding a 30-person Umrah delegation with public money while seeking aid from Saudi Arabia. Investigators concluded the video had been dubbed with AI-generated audio. The original interview was broadcast by Saudi-owned Al Arabiya in January 2023, and it contained no such exchange. Lip-sync inconsistencies reportedly confirmed the manipulation.
-
Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability AIID ↗
A WIRED investigation found that OpenAI's video generation model, Sora, exhibits representational bias across race, gender, body type, and disability. In tests using 250 prompts, Sora was more likely to depict CEOs and professors as men, flight attendants and childcare workers as women, and showed limited or stereotypical portrayals of disabled individuals and people with larger bodies.
-
Purported DOGE Contract Review Tool Cited in Reports of AI-Driven Misjudgments in VA Budget Cuts AIID ↗
A purported AI tool using LLMs was deployed to classify Veterans Affairs contracts as expendable based on limited text and simplified criteria. The system allegedly produced hallucinated values and flagged critical healthcare and research services for cancellation. Reportedly, at least two dozen flagged contracts were later terminated.
-
Alleged Fraudulent Prompts via AIXBT Dashboard Led Purported AI Trading Agent to Transfer 55.5 ETH from Simulacrum Wallet AIID ↗
A reported hacker attack allegedly compromised the autonomous AI crypto bot AIXBT, purportedly resulting in the theft of 55.5 ETH (approximately $106,200). The attacker is reported to have infiltrated the secure dashboard of the AIXBT autonomous system at 2:00 AM UTC on March 18, 2025, and allegedly queued two fraudulent prompts that instructed the AI agent to transfer funds from its simulacrum wallet.
-
AI-Enabled Organized Crime Expands Across Europe AIID ↗
Europol’s EU Serious and Organised Crime Threat Assessment (EU-SOCTA) 2025 warns that AI is accelerating the growth of organized crime throughout Europe. Criminal networks are leveraging AI for cyber fraud, ransomware, money laundering, and child exploitation, while AI-powered social engineering and automation are making criminal operations more scalable and harder to detect.
-
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem AIID ↗
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
-
Alleged Use of AI to Create Sexualized Deepfake Images of Middle School Students Under Investigation in Bucks County, Pennsylvania AIID ↗
Authorities in Bucks County, Pennsylvania reported that a middle school student allegedly used AI-enabled tools to create sexualized deepfake images depicting classmates. The incident, which reportedly occurred in March 2025, involved images generated without consent and is under investigation by local police and the district attorney's office. The alleged conduct may fall under a new Pennsylvania law addressing non-consensual AI-generated sexual imagery, particularly involving minors.
-
Alleged AI-Generated IRS Scam Websites Used to Defraud U.S. Taxpayers AIID ↗
Scammers have allegedly been using AI-generated imposter websites and phishing emails to impersonate the IRS. They have reportedly been tricking taxpayers into providing personal and financial information. There has been a reported surge in tax-related AI scams leading up to Tax Day 2025, with fraudulent domains mimicking IRS services, along with fake websites, emails, and text messages. The IRS has warned taxpayers to verify official sites and avoid unsolicited links.
-
Docomo Pacific CEO Reports Mother Targeted by Purported AI-Enabled Scam in Guam AIID ↗
Docomo Pacific's CEO, Christine Baleto, disclosed that her elderly mother was targeted by an alleged AI-enabled scam call on Guam. The scammer reportedly posed as a federal agent and used personal details and intimidation, demanding sensitive information under false pretenses. The company's advisory suggests AI voice cloning may have been involved, warning that such technology can convincingly mimic family members' voices, increasing risk for seniors on the island.
-
AI-Generated Voice Cloning of Trump Falsely Proposes Renaming the District of Columbia to the District of America AIID ↗
A viral audio clip circulating on TikTok, Facebook, X, and other platforms falsely portrayed Donald Trump saying he would rename Washington, D.C. as the "District of America." The voice was confirmed to be AI-generated by digital forensics experts. It was initially posted by a now-deleted TikTok account. The clip is reported to have spread rapidly across political lines before it was debunked.
-
Scammers Reportedly Using Deepfake Video Calls to Impersonate Executives in Singapore and Orchestrate Corporate Bank Transfers AIID ↗
Scammers in Singapore are reportedly using AI-generated deepfake video calls to impersonate corporate executives. The calls seek to deceive employees into authorizing fraudulent bank transfers. Usually, it is reported, victims will receive WhatsApp messages inviting them to Zoom meetings. During the calls, the scammers are disguised as senior leaders and will instruct the employees to transfer company funds for fake business transactions and to disclose personal data.
-
Alleged ChatGPT Misuse by Contractor Leads to Reported Data Exposure in New South Wales Resilient Homes Program AIID ↗
A former contractor of the New South Wales Reconstruction Authority reportedly uploaded a spreadsheet containing personal and health information of Resilient Homes Program applicants to ChatGPT during a three-day period in March 2025. Up to 3,000 people may have reportedly been affected.
-
Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook AIID ↗
In March 2025, an AI-generated deepfake video of Donald Trump criticizing Ukrainian President Volodymyr Zelenskyy for his clothing circulated widely on Facebook. In the video, Trump mocks Zelenskyy by calling him "Temu Zelenskyy." The video was created by a parody YouTube channel using AI voice and face synthesis tools, but it was reportedly mistaken by some viewers as real.
-
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login AIID ↗
A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.
-
Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error AIID ↗
A predictive text malfunction allegedly compromised the integrity of the NAPLAN writing exam at two Sydney schools, Waverley College and Kambala, in that it allowed students to access AI-driven text suggestions. Caused by a technical oversight, this incident led to affected students being required to retake the test.
-
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook AIID ↗
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
-
Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans AIID ↗
Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.
-
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice AIID ↗
AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.
-
Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams AIID ↗
Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.
-
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization AIID ↗
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
-
Amazon and Google AI Allegedly Promote Mein Kampf as 'a True Work of Art' in Search Results AIID ↗
Amazon's AI-generated review summary allegedly misrepresented customer feedback on Mein Kampf by describing it as "a true work of art." Google's search algorithm then surfaced this misleading AI-generated text as a featured snippet, which in turn amplified the error. This incident arose from AI summarizing AI-generated content, in effect creating a self-reinforcing misinformation loop.
-
ChatGPT Was Allegedly Consulted About Attack Options Before Teen Attempted to Stab Officer at Tira, Israel, Police Station AIID ↗
A 16-year-old from Tira, Israel, allegedly entered the city's police station with a knife and attempted to stab a Border Police officer. Prosecutors reportedly alleged that before the attack he had consulted ChatGPT about possible attacks and courses of action. He was charged in juvenile court with attempted aggravated assault as an act of terror. Public reporting does not establish what responses ChatGPT provided or whether they materially assisted the attempted attack.
-
Alleged AI-Generated Video by Spain’s People’s Party Results in Diplomatic Fallout with the Dominican Republic AIID ↗
Spain's People's Party (PP) posted an AI-generated attack video depicting Prime Minister Pedro Sánchez on a beach under the title "The Island of Corruption," a reference to a reality TV show filmed in the Dominican Republic, indirectly linking the country to corruption. The Dominican Foreign Ministry condemned the video as a "vicious attack" for using its national symbols. PP later deleted the post, and Sánchez apologized on behalf of Spain.
-
Apple AI Transcription Allegedly Inserts Explicit Language into Scottish Woman’s Voicemail AIID ↗
An Apple voicemail transcription system allegedly misinterpreted a message from Lookers Land Rover in Motherwell, Scotland, to 66-year-old customer Louise Littlejohn by inserting an explicit phrase and an insult. The original voicemail was a standard business message, but AI processing errors introduced offensive and misleading content into the text version.
-
Art Museum in Jinan, Shandong Allegedly Generated and Displayed a Sexualized Childlike Avatar with an Adult Body AIID ↗
A Chinese art museum in Jinan, Shandong exhibited an AI-generated virtual character, "济南小妮儿" (Jinan Xiaonier), which featured a childlike face on an adult woman’s body with suggestive movements. The display drew public outrage, with critics accusing it of sexualizing children and demanding its removal. The museum defended the exhibit and stated that it had undergone strict review, which only fueled further backlash.
-
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors AIID ↗
At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.
-
Canadian Fraud Ring Allegedly Used AI Voice Cloning in Multi-Year $21 Million Grandparent Scam Targeting Elderly Americans Across 46 States AIID ↗
A Canadian fraud ring allegedly used AI-generated voice cloning to defraud victims across 46 U.S. states by targeting grandparents in a $21 million scam between 2021 and 2024. Operating from call centers in Montreal, the scammers spoofed U.S. phone numbers and used AI-cloned voices of grandchildren to convince victims to pay fake bail fees.
-
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission AIID ↗
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.
-
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million AIID ↗
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
-
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products AIID ↗
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable us
-
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign AIID ↗
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
-
Scammers Allegedly Using Deepfake Technology to Impersonate Prime Minister of Armenia Nikol Pashinyan AIID ↗
Scammers are reportedly using deepfake technology to impersonate Prime Minister Nikol Pashinyan, according to the Personal Data Protection Agency. The video is reported to have circulated from a Russian-language account called Noticias Mundiales ("World News").
-
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators AIID ↗
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
-
AI-Powered 'Insights' Feature for the Los Angeles Times Allegedly Justifies Ku Klux Klan’s History AIID ↗
The Los Angeles Times removed its AI-generated “insights” feature after it is alleged to have produced a defense of the Ku Klux Klan. The AI reportedly framed the hate group as a product of societal change rather than an extremist movement. The AI tool, developed by Perplexity and promoted by owner Patrick Soon-Shiong, was designed to provide “different views” on opinion pieces.
-
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré AIID ↗
Between March and May 2025, at least 294 purported AI-generated deepfake music videos were uploaded across a reported 127 YouTube channels, collectively garnering over 8.6 million views by the end of May. The videos depict global celebrities (including Beyoncé, Rihanna, R. Kelly, Selena Gomez, Eminem, and Justin Bieber) praising Burkinabe President Ibrahim Traoré and endorsing military rule.
-
AI-Driven News Platform Accused of Spreading Unverified Terrorism Allegations Against Yale Scholar AIID ↗
An AI-powered news site, Jewish Onliner, allegedly published an article linking Yale Law scholar Helyeh Doutaghi to Samidoun, a sanctioned group, which led to her suspension within days. The site, which claims to use AI for research, fact-checking, and content creation, did not disclose human reporters. Doutaghi denied the allegations and described the move as an attack on academic freedom.
-
Deepfake Video of Indonesian President Prabowo Subianto and Other Officials Reportedly Used in Scam to Defraud Citizens Across 20 Provinces AIID ↗
A deepfake scam allegedly using AI-generated videos of Indonesian President Prabowo Subianto and other officials reportedly defrauded victims across 20 provinces, tricking them into paying Rp 250,000 to Rp 1 million ($15-$60) for purported financial aid. The fraudulent clips, circulated on TikTok, Instagram, and WhatsApp, appeared to show Prabowo offering assistance. Police reportedly arrested two suspects in February 2025, but deepfake scams exploiting high-profile figures continue to spread.
-
Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content AIID ↗
An alleged Instagram algorithm malfunction caused users' Reels feeds to be overwhelmed with violent and distressing content. Many reported seeing deaths, extreme brutality, and other graphic material in rapid succession, often without prior engagement with similar content. The sudden exposure caused psychological distress for many users, with minors and vulnerable individuals particularly affected by the graphic content. Meta confirmed an AI failure was responsible and apologized.
-
Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks AIID ↗
A dataset used to train large language models allegedly contained 12,000 live API keys and authentication credentials. Some of these were reportedly still active and allowed unauthorized access. Truffle Security found these secrets in a December 2024 Common Crawl archive, which spans 250 billion web pages. The affected credentials could have been exploited for unauthorized data access, service disruptions, financial fraud, and a variety of other malicious uses.
-
Purported AI-Generated Images Reportedly Used in Sextortion Scheme Targeting Glasgow, Kentucky Teen Who Later Died by Suicide AIID ↗
16-year-old Elijah Heacock of Glasgow, Kentucky, reportedly died by suicide on February 28, 2025, after receiving threatening messages containing purportedly AI-generated explicit images depicting him. The images were reportedly used in a sextortion attempt demanding money. The FBI has been investigating the case as part of an alleged pattern of online financial sextortion schemes targeting minors.
-
Microsoft Copilot Reportedly Able to Access Cached Data from Since-Private GitHub Repositories AIID ↗
Lasso Security reported that Microsoft Copilot could return content from GitHub repositories that had been public briefly but later set to private or deleted. Lasso attributed this to Bing's caching system, which stored "zombie data" from over 20,000 repositories. The cached content allegedly included sensitive information such as access keys, tokens, and internal packages. Microsoft reportedly classified the issue as low severity and applied only partial mitigations.
-
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material AIID ↗
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
-
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000) AIID ↗
A 57-year-old woman in Bengaluru was allegedly defrauded of ₹3.75 crore (~$425,000 USD) after scammers used a purportedly AI-generated deepfake video of spiritual leader Sadhguru to promote a fake investment platform called Mirrox. The victim was reportedly recruited via Instagram and WhatsApp and was persuaded through trading tutorials on Zoom and fabricated profit screenshots. She reportedly realized the fraud only when withdrawals were blocked and additional fees were demanded.
-
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations AIID ↗
In February 2025, lawyers Christopher I. Kachouroff and Jennifer T. DeMaster, representing Mike Lindell, reportedly used generative AI to draft a court brief that contained nearly 30 defective or fabricated citations. The error-filled filing violated federal court rules requiring factual and legal accuracy. The judge fined both lawyers $3,000 each, citing either the improper use of AI or gross carelessness as the cause of the misleading legal content.
-
Apple’s Voice Dictation Reportedly Substitutes ‘Trump’ for ‘Racist’ Due to Speech Recognition Bug AIID ↗
Apple's iPhone dictation feature reportedly displayed "Trump" when users dictated the word "racist," with a viral video demonstrating the glitch. Apple acknowledged the bug, attributing it to a phonetic overlap in its speech recognition model, though some speculated it could be an internal prank. The company announced an immediate fix.
-
Otter.ai Notetaker Allegedly Recorded Meeting Conversations Without Participants' Informed Consent and Used Data for AI Training AIID ↗
In February 2025, Otter.ai's Notetaker reportedly recorded and transcribed a Zoom conversation involving Justin Brewer, a San Jacinto, California resident who was not an Otter account holder, without his informed consent. Brewer later alleged that Otter obtained and retained his meeting communications and used captured data to train its speech-recognition and machine-learning systems.
-
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors AIID ↗
The American Psychological Association (APA) has warned federal regulators that AI chatbots on Character.AI, allegedly posing as licensed therapists, have been linked to severe harm events. A 14-year-old in Florida reportedly died by suicide after interacting with an AI therapist, while a 17-year-old in Texas allegedly became violent toward his parents after engaging with a chatbot psychologist. Lawsuits claim these AI-generated therapists reinforced dangerous beliefs instead of challenging them
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.