AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Disinformation Deepfake Circulates of State Department Spokesman Matthew Miller Suggesting Belgorod Can Be Attacked with U.S. Weapons AIID ↗
A deepfake video of State Department spokesman Matthew Miller falsely suggested Belgorod was a legitimate target for Ukrainian strikes. This disinformation spread on Telegram and Russian media, misleading the public and inciting tensions. U.S. officials condemned the deepfake. This incident is an example of the threat of AI-powered disinformation and hybrid attacks.
-
Covert AI Influence Operations Linked to Russia, China, Iran, and Israel, OpenAI Reports AIID ↗
In a report released by OpenAI, the company described how its generative AI tools were misused by state actors and private companies in Russia, China, Iran, and Israel to conduct covert influence campaigns aimed at manipulating public opinion and geopolitical narratives.
-
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network AIID ↗
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
-
Reportedly Faulty AI Transcription Threatens Integrity of Genoa Bribery Probe AIID ↗
A reported AI transcription software error in a Genoa bribery investigation is alleged to have incorrectly recorded "illicit financing" instead of "licit financing," which could have significantly impacted the case. The mistake was discovered during a review and is an example of the risks of relying on AI in judicial settings.
-
Facewatch Reported to Have Wrongfully Flagged Home Bargains Customer as Shoplifter AIID ↗
A facial-recognition software used by the British variety store Home Bargains is alleged to have misidentified "Sara" as a shoplifter, leading to staff searching her bag, escorting her from the premises, and banning her from the store. After, Facewatch is reported to have admitted its error to Sara. Facewatch is used by a number of different British stores.
-
Reportedly Hacked AI-Powered Robot Vacuums Allegedly Used for Surveillance and Harassment AIID ↗
Hackers reportedly exploited a vulnerability in Ecovacs’s Deebot X2 robot vacuums, gaining unauthorized access to camera and microphone controls. Users reported privacy invasions and offensive language broadcasted through the devices. Although Ecovacs claimed to have resolved the security flaw, researchers suggest vulnerabilities remain that could potentially leave users exposed to surveillance and harassment through their AI-enabled devices.
-
Study Highlights Persistent Hallucinations in Legal AI Systems AIID ↗
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
-
VA Suicide Prevention Algorithm REACH VET Reportedly Prioritizes Men Over Women Veterans AIID ↗
An AI program named REACH VET, designed and used by the Department of Veterans Affairs (VA) to prevent veteran suicides, was reportedly found to prioritize white men while neglecting female veterans and survivors of military sexual trauma. This oversight persists despite rising suicide rates among these groups. The incident is an example of algorithmic bias and the exclusion of critical risk factors for female veterans.
-
WiseTech Global CEO Richard White Reportedly Deepfaked in Multiple Attempts to Scam Staffers AIID ↗
WiseTech Global's CEO, Richard White, was targeted in multiple deepfake scam attempts where unknown actors used AI to create videos of him requesting money from staff members via WhatsApp. These repeated attempts were identified by the employees, who realized they were not speaking to the real CEO.
-
Meta's AI Chatbots Are Reportedly Entering Online Support Communities Uninvited AIID ↗
Meta's AI chatbots have reportedly begun entering online communities on Facebook, providing responses that mimic human interaction. These chatbots, often uninvited, disrupt the human connection critical for support groups by giving misleading or false information and pretending to share lived experiences.
-
Scarlett Johansson Alleges OpenAI's Sky Imitates Her Voice Without Licensing AIID ↗
OpenAI unveiled a voice assistant with a voice resembling Scarlett Johansson's, despite her refusal to license her voice. Johansson claimed the assistant, "Sky," sounded "eerily similar" to her voice, leading her to seek legal action. OpenAI suspended Sky, asserting the voice was from a different actress.
-
AI Firm Lovo Reportedly Accused of Illegally Replicating Voice Actors' Voices AIID ↗
Two voice actors, Paul Skye Lehrman and Linnea Sage, are reportedly suing AI start-up Lovo for allegedly creating and promoting unauthorized clones of their voices. Lovo's synthetic voices were allegedly discovered in various media, including a podcast and promotional videos. The actors claim they were misled into providing voice samples, which were then allegedly used without consent, violating trademark and privacy laws.
-
Class Action Lawsuit Over Alleged Defects in Volkswagen's AI-Driven AEB Systems AIID ↗
A class action lawsuit involving Volkswagen Group of America addresses alleged defects in the Automated Emergency Braking (AEB) systems of certain vehicles. The lawsuit claims these AI-driven systems failed to function properly, posing safety risks. Volkswagen denies the claims but has agreed to a settlement. Affected users can look up their vehicle's eligibility and file claims for reimbursement. The case brings into question the level of reliability of AI in critical automotive applications.
-
Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts AIID ↗
AI-generated spam images are increasingly filling Facebook feeds, with the platform’s algorithm reportedly amplifying these posts. Many of these images are bizarre, fake, and used in scams, misleading users into engaging with non-existent products or clickbait.
-
GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering AIID ↗
OpenAI's GPT-4o was found to have its Chinese token training data compromised by spam and pornographic phrases due to inadequate data cleaning. Tianle Cai, a Ph.D. student at Princeton University, identified that most of the longest Chinese tokens were irrelevant and inappropriate, primarily originating from spam and pornography websites. The polluted tokens could lead to hallucinations, poor performance, and potential misuse, undermining the chatbot's reliability and safety measures.
-
Google AI Reportedly Delivering Confidently Incorrect and Harmful Information AIID ↗
Google's AI search engine has reportedly been providing users with confidently incorrect and often harmful information. Reports highlight numerous inaccuracies, including misleading health advice and dangerous cooking suggestions. For example, it has falsely claimed Barack Obama as the first Muslim U.S. President, reflecting fringe conspiracy theories, or recommending that glue can be an ingredient in pizza.
-
Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders AIID ↗
An Instagram ad campaign for children's merchandise was intended to reach adult women but was instead predominantly shown to adult men, including convicted sex offenders, due to Instagram's algorithmic targeting. This failure is reported to have led to direct solicitations for sex with a 5-year-old model in the ads.
-
Scammers Reportedly Used AI Voice Clone and YouTube Footage to Impersonate WPP CEO in Unsuccessful Scam Attempt AIID ↗
Scammers reportedly attempted to impersonate WPP CEO Mark Read using AI-generated voice cloning and YouTube footage in a Microsoft Teams scam. They allegedly created a fake WhatsApp account with Read’s image and used deepfake audio to deceive an agency leader into setting up a new business. The scheme, which was unsuccessful, aimed to solicit money and personal data.
-
Google Healthcare AI Model Med‑Gemini Allegedly Produces Non‑Existent 'Basilar Ganglia' Term in Published Output AIID ↗
Google’s Med‑Gemini healthcare AI reportedly produced the non‑existent term "basilar ganglia" in public launch materials, conflating two distinct brain structures. The error reportedly appeared in both a blog post and an arXiv preprint. Google is reported to have initially edited the blog without acknowledgment, later calling it a typo.
-
Purported AI-Generated Deepfake Images of Katy Perry at 2024 Met Gala Circulate Widely AIID ↗
Purported AI-generated images depicting Katy Perry attending the 2024 Met Gala circulated widely on social media, leading to public confusion about her presence at the event. The images were realistic enough to deceive fans and even Perry’s mother, who believed them to be authentic. Perry publicly clarified the images were fake, attributing them to AI and noting she had missed the event due to work.
-
Alleged LLMjacking Targets AI Cloud Services with Stolen Credentials AIID ↗
Attackers reportedly exploited stolen cloud credentials obtained through a vulnerable Laravel system (CVE-2021-3129) to allegedly abuse AI cloud services, including Anthropic’s Claude and AWS Bedrock, in a scheme referred to as “LLMjacking.” The attackers are said to have monetized access through reverse proxies, reportedly inflating victim costs to as much as $100,000 per day. Additionally, they allegedly bypassed sanctions, enabled LLM models, and evolved techniques to evade detection and logg
-
Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor, Director, and Playwright Kamen Donev's Likeness to Market Joint-Pain Product AIID ↗
A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor, director, and playwright Kamen Donev, allegedly overlaying fabricated audio and altered lip movements to market a purported joint-pain product. The ad reportedly linked to a presumably fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.
-
Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor and TV Host Mihail Bilalov's Likeness to Market Joint-Pain Product AIID ↗
A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor and television host Mihail Bilalov, overlaying purportedly fabricated audio and altered lip movements to market an alleged joint-pain product. The ad reportedly linked to a fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.
-
Cybercheck Tool Allegedly Provides Questionable Evidence in Murder Trials AIID ↗
Global Intelligence's Cybercheck AI tool, used by law enforcement to track suspects based on open source data, has allegedly been providing inaccurate or unverifiable evidence in several murder trials. Reportedly the tool lacks transparency and often produces unreliable reports, which has prompted prosecutors to withdraw Cybercheck evidence from multiple cases after its findings were challenged, reportedly wasting law enforcement time and resources while undermining prosecutors' cases.
-
Purported ChatGPT Factual Errors Reportedly Led to Filing of Complaint of GDPR Privacy Violation AIID ↗
The activist organization noyb, founded by Max Schrems, reportedly filed a complaint in Europe against OpenAI alleging that ChatGPT violates the General Data Protection Regulation (GDPR) by providing inaccurate personal information such as birthdates about individuals.
-
ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios AIID ↗
The "Dan" ("Do Anything Now") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.
-
Meta AI Hallucinates Harassment Allegations Against New York Politicians AIID ↗
Meta's AI chatbot in Facebook Messenger falsely accused multiple state lawmakers of sexual harassment, fabricating incidents, investigations, and consequences that never occurred. These fabricated stories, discovered by City & State, sparked outrage among the affected lawmakers and raised concerns about the reliability of the chatbot. Meta acknowledged the errors and committed to ongoing improvements.
-
NHTSA Opens New Probe into Tesla’s Autopilot Following More than a Dozen Fatal Accidents AIID ↗
The NHTSA has linked Tesla's Autopilot to over a dozen fatalities and hundreds of crashes, prompting a new investigation into the adequacy of Tesla's December recall of 2 million vehicles. The probe reports that Tesla’s driver-assist system led to avoidable crashes involving visible hazards, suggesting a critical safety gap between driver expectations and the system’s capabilities. The investigation will assess if Tesla’s recall remedies were sufficient to address these safety risks.
-
Microsoft Copilot Allegedly Provides Unsafe Medical Advice with High Risk of Severe Harm AIID ↗
Microsoft Copilot, when asked medical questions, was reportedly found to provide accurate information only 54% of the time, according to European researchers (citation provided in editor's notes). Analysis by the researchers reported that 42% of Copilot's responses could cause moderate to severe harm, with 22% of responses posing a risk of death or severe injury.
-
Catholic AI Chatbot 'Father Justin' Claimed to Be a Real Priest, Prompting Retraction AIID ↗
Catholic advocacy group Catholic Answers released an AI priest called "Father Justin," which misleadingly claimed to be a real clergy member, offered sacraments, and provided controversial advice. After receiving criticism, the group rebranded the chatbot as a lay theologian to correct the misrepresentation. The incident is an instructive case with respect to deploying AI in sensitive contexts and the potential for causing confusion and harm.
-
Kenyan Journalist Jeff Koinange Depicted Endorsing Gambling App in Purported AI-Generated Deepfake AIID ↗
A viral video purportedly manipulated by AI shows Kenyan journalist Jeff Koinange endorsing a mobile gambling app. The video was reportedly created using AI deepfake techniques, uses footage from a legitimate news broadcast, and artificially alters Koinange's voice and mouth movements. Neither Koinange nor Citizen TV has promoted the app, and no legitimate source hosts the video.
-
The WHO's S.A.R.A.H. Bot Reported to Provide Inconsistent and Inadequate Health Information AIID ↗
The WHO's AI-powered health advisor, S.A.R.A.H. (Smart AI Resource Assistant for Health), is alleged to provide inconsistent and inadequate health information. The bot reportedly gives contradictory responses to the same queries, fails to offer specific contact details for healthcare providers, and inadequately handles severe mental health crises, often giving irrelevant or unhelpful advice.
-
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action AIID ↗
A purported deepfake audio clip portraying Philippine President Ferdinand Marcos Jr. ordering an attack on China spread online in July 2024, fueling tensions in the West Philippine Sea. The Presidential Communications Office reportedly debunked it as fake, attributing it to foreign actors.
-
Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them AIID ↗
Internet Watch Foundation (IWF) has reported that it has found a manual on the dark web that encourages criminals to use "nudifying" AI tools to depict children naked in order to extort victims into providing graphic content.
-
Unauthorized Use of AI to Replicate Tupac Shakur's and Snoop Dogg's Voices in Drake's 'Taylor Made Freestyle' AIID ↗
Drake released a song, "Taylor Made Freestyle," featuring AI-generated voices of Tupac Shakur and Snoop Dogg. The unauthorized replication of Tupac’s voice without the estate's consent led to a cease-and-desist order.
-
Purported Error by Grok Reportedly Misrepresents Basketball Slang as Criminal Allegation Against NBA Player AIID ↗
X's Grok AI bot reportedly generated a trending story falsely claiming that Golden State Warriors guard Klay Thompson was under investigation for vandalizing homes with bricks in Sacramento. The alleged fabrication appeared after Grok reportedly misinterpreted posts describing Thompson "shooting bricks" during a basketball game. The story reportedly ranked #5 briefly on X's trending list.
-
Amandine Le Pen Deepfake Account Misleads Thousands on TikTok AIID ↗
A TikTok account, "Amandine Le Pen," created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as "Lena Maréchal Lep
-
Facebook AI Reportedly Mislabels Auschwitz Photos as 'Bullying' and 'Nudity' AIID ↗
Facebook's AI system allegedly mislabeled around 20 posts from the Auschwitz Memorial Museum as violating community standards for "bullying" and "nudity," reportedly deleting at least one image of orphans. The purported misclassification of historical content allegedly prompted outrage from the museum, which reportedly demanded an explanation. Meta later purportedly apologized, attributing the issue to mistaken notices sent by its AI system and reportedly acknowledged that the posts did not, in
-
Brake Failure in Reportedly AI-Driven Tram Leads to Multiple Injuries in Saint Petersburg, Russia AIID ↗
During a test run in Saint Petersburg in Russia a reportedly AI-powered "Smart Tram" failed, leading to a crash that injured several pedestrians and trapped a woman under its wheels. The tram's AI system reportedly shut off unexpectedly, and both primary and emergency brakes failed despite pre-test checks.
-
Deepfake of Former Prime Minister of Malta Joseph Muscat Allegedly Promotes Nord Invest Scam AIID ↗
A reported doctored video falsely depicts former Maltese Prime Minister Joseph Muscat promoting the crypto platform Nord Invest. The manipulated footage, originally from a 2013 Sky News interview, was overlaid with AI-generated audio to mimic Muscat’s voice endorsing a fraudulent scheme. The video was reportedly shared through Facebook.
-
Reported Audio Deepfake Impersonating CEO Karim Toubba Targets LastPass Employee via WhatsApp AIID ↗
A LastPass employee was reportedly targeted by an audio deepfake impersonating CEO Karim Toubba via WhatsApp. The message used voice-cloning AI in a social engineering attempt to create urgency and bypass security protocols. The employee recognized red flags, reported the incident, and no breach occurred. LastPass shared the incident publicly to raise awareness about deepfake-driven fraud campaigns targeting executives and companies.
-
Deepfake Porn Sites Use Breeze Liu's Image Without Consent AIID ↗
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
-
Error-Prone AI Accessibility Tools Reportedly Lead to Navigation Issues for Blind Internet Users AIID ↗
AI-powered accessibility overlays on websites frequently mislabel or misinterpret content, in turn complicating navigation for blind users and others with disabilities. Users report that the AI tools interfere with screen readers and mislead them with inaccurate descriptions. The reported unreliability in these tools have prompted legal action, as the companies behind them seek compliance with accessibility laws.
-
TikTok Hosts AI-Generated English-Language Hitler Speeches with Millions of Views AIID ↗
AI-generated English-language Adolf Hitler speeches have been proliferating on TikTok. They are reportedly accumulating millions of views despite violating the platform’s hate speech policies. The clips are described as often pairing the audio with misleading translations and memes that glorify Hitler and distort historical facts. While some content has been removed, many accounts reportedly continue to post similar videos.
-
California Homeowner Reportedly Loses Insurance After Purported Aerial Imagery-Based Roof Assessment AIID ↗
A California homeowner's insurance policy was reportedly not renewed after CSAA relied on aerial imagery, purportedly analyzed by an AI system, to assess the roof as having reached the end of its life. The homeowner, Cindy Picos, reportedly commissioned an independent inspection suggesting the roof had a decade of remaining life, but CSAA declined to reverse the decision. The insurer reportedly did not provide the imagery for review.
-
Reportedly Viral AI-Generated Song about 'Diddy Party' Allegedly Mimics Justin Bieber AIID ↗
A purportedly AI-generated song imitating Justin Bieber's voice, allegedly referencing a "Diddy party," spread widely across social media, reportedly leading fans to believe it was authentic. Experts reportedly identified the audio as likely AI-made, citing frequency mismatches and digital artifacts. The reportedly viral song misrepresented Bieber, posing potential brand and revenue impacts for the artist while misleading listeners.
-
OpenAI, Google, and Meta Alleged to Have Overstepped Legal Boundaries for Training AI AIID ↗
In late 2021, OpenAI and other tech giants like Google and Meta reportedly faced data shortages for training AI models. OpenAI is said to have developed a tool called Whisper to transcribe over one million hours of YouTube videos, potentially violating YouTube’s terms of service. Similarly, Google allegedly transcribed YouTube videos, risking copyright infringements. Meta reportedly explored summarizing copyrighted texts without permission and debated acquiring Simon & Schuster for data.
-
China Reportedly Intensifying AI to Spread Disinformation to U.S. and Taiwanese Voters AIID ↗
AI tools linked to China were used to disseminate disinformation targeting voters in the U.S. and Taiwan, according to a Microsoft report. These operations included AI-generated imagery and audio to influence political perceptions and election outcomes, originating from the APT Storm-1376 (also known as Spamouflage and Dragonbridge).
-
Grok AI on X Created and Promoted False Iran Missile Strike News AIID ↗
On April 4, 2024, X's AI chatbot Grok generated a false headline claiming "Iran Strikes Tel Aviv with Heavy Missiles," which was then promoted on X's trending news section. This misinformation, fueled by user spamming of fake news, falsely indicated a serious international conflict. The incident highlighted significant risks associated with relying on AI for content curation and demonstrated the potential for widespread dissemination of harmful misinformation.
-
Google Books Appears to Be Indexing Works Written by AI AIID ↗
Google Books is indexing low-quality, AI-generated books, degrading its database and potentially distorting Google Ngram Viewer's analysis of language trends. This integration of inaccurate or misleading information undermines trust, disseminates poor-quality content, and wastes resources as researchers must spend time clearing up the misinformation.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.