AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Sydney Students Allegedly Forced to Retake NAPLAN After AI Predictive Text Error AIID ↗
A predictive text malfunction allegedly compromised the integrity of the NAPLAN writing exam at two Sydney schools, Waverley College and Kambala, in that it allowed students to access AI-driven text suggestions. Caused by a technical oversight, this incident led to affected students being required to retake the test.
-
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook AIID ↗
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
-
Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans AIID ↗
Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.
-
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice AIID ↗
AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.
-
Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams AIID ↗
Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.
-
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization AIID ↗
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
-
Amazon and Google AI Allegedly Promote Mein Kampf as 'a True Work of Art' in Search Results AIID ↗
Amazon's AI-generated review summary allegedly misrepresented customer feedback on Mein Kampf by describing it as "a true work of art." Google's search algorithm then surfaced this misleading AI-generated text as a featured snippet, which in turn amplified the error. This incident arose from AI summarizing AI-generated content, in effect creating a self-reinforcing misinformation loop.
-
ChatGPT Was Allegedly Consulted About Attack Options Before Teen Attempted to Stab Officer at Tira, Israel, Police Station AIID ↗
A 16-year-old from Tira, Israel, allegedly entered the city's police station with a knife and attempted to stab a Border Police officer. Prosecutors reportedly alleged that before the attack he had consulted ChatGPT about possible attacks and courses of action. He was charged in juvenile court with attempted aggravated assault as an act of terror. Public reporting does not establish what responses ChatGPT provided or whether they materially assisted the attempted attack.
-
Alleged AI-Generated Video by Spain’s People’s Party Results in Diplomatic Fallout with the Dominican Republic AIID ↗
Spain's People's Party (PP) posted an AI-generated attack video depicting Prime Minister Pedro Sánchez on a beach under the title "The Island of Corruption," a reference to a reality TV show filmed in the Dominican Republic, indirectly linking the country to corruption. The Dominican Foreign Ministry condemned the video as a "vicious attack" for using its national symbols. PP later deleted the post, and Sánchez apologized on behalf of Spain.
-
Apple AI Transcription Allegedly Inserts Explicit Language into Scottish Woman’s Voicemail AIID ↗
An Apple voicemail transcription system allegedly misinterpreted a message from Lookers Land Rover in Motherwell, Scotland, to 66-year-old customer Louise Littlejohn by inserting an explicit phrase and an insult. The original voicemail was a standard business message, but AI processing errors introduced offensive and misleading content into the text version.
-
Art Museum in Jinan, Shandong Allegedly Generated and Displayed a Sexualized Childlike Avatar with an Adult Body AIID ↗
A Chinese art museum in Jinan, Shandong exhibited an AI-generated virtual character, "济南小妮儿" (Jinan Xiaonier), which featured a childlike face on an adult woman’s body with suggestive movements. The display drew public outrage, with critics accusing it of sexualizing children and demanding its removal. The museum defended the exhibit and stated that it had undergone strict review, which only fueled further backlash.
-
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors AIID ↗
At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.
-
Canadian Fraud Ring Allegedly Used AI Voice Cloning in Multi-Year $21 Million Grandparent Scam Targeting Elderly Americans Across 46 States AIID ↗
A Canadian fraud ring allegedly used AI-generated voice cloning to defraud victims across 46 U.S. states by targeting grandparents in a $21 million scam between 2021 and 2024. Operating from call centers in Montreal, the scammers spoofed U.S. phone numbers and used AI-cloned voices of grandchildren to convince victims to pay fake bail fees.
-
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission AIID ↗
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.
-
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million AIID ↗
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
-
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products AIID ↗
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable us
-
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign AIID ↗
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
-
Scammers Allegedly Using Deepfake Technology to Impersonate Prime Minister of Armenia Nikol Pashinyan AIID ↗
Scammers are reportedly using deepfake technology to impersonate Prime Minister Nikol Pashinyan, according to the Personal Data Protection Agency. The video is reported to have circulated from a Russian-language account called Noticias Mundiales ("World News").
-
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators AIID ↗
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
-
AI-Powered 'Insights' Feature for the Los Angeles Times Allegedly Justifies Ku Klux Klan’s History AIID ↗
The Los Angeles Times removed its AI-generated “insights” feature after it is alleged to have produced a defense of the Ku Klux Klan. The AI reportedly framed the hate group as a product of societal change rather than an extremist movement. The AI tool, developed by Perplexity and promoted by owner Patrick Soon-Shiong, was designed to provide “different views” on opinion pieces.
-
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré AIID ↗
Between March and May 2025, at least 294 purported AI-generated deepfake music videos were uploaded across a reported 127 YouTube channels, collectively garnering over 8.6 million views by the end of May. The videos depict global celebrities (including Beyoncé, Rihanna, R. Kelly, Selena Gomez, Eminem, and Justin Bieber) praising Burkinabe President Ibrahim Traoré and endorsing military rule.
-
AI-Driven News Platform Accused of Spreading Unverified Terrorism Allegations Against Yale Scholar AIID ↗
An AI-powered news site, Jewish Onliner, allegedly published an article linking Yale Law scholar Helyeh Doutaghi to Samidoun, a sanctioned group, which led to her suspension within days. The site, which claims to use AI for research, fact-checking, and content creation, did not disclose human reporters. Doutaghi denied the allegations and described the move as an attack on academic freedom.
-
Deepfake Video of Indonesian President Prabowo Subianto and Other Officials Reportedly Used in Scam to Defraud Citizens Across 20 Provinces AIID ↗
A deepfake scam allegedly using AI-generated videos of Indonesian President Prabowo Subianto and other officials reportedly defrauded victims across 20 provinces, tricking them into paying Rp 250,000 to Rp 1 million ($15-$60) for purported financial aid. The fraudulent clips, circulated on TikTok, Instagram, and WhatsApp, appeared to show Prabowo offering assistance. Police reportedly arrested two suspects in February 2025, but deepfake scams exploiting high-profile figures continue to spread.
-
Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content AIID ↗
An alleged Instagram algorithm malfunction caused users' Reels feeds to be overwhelmed with violent and distressing content. Many reported seeing deaths, extreme brutality, and other graphic material in rapid succession, often without prior engagement with similar content. The sudden exposure caused psychological distress for many users, with minors and vulnerable individuals particularly affected by the graphic content. Meta confirmed an AI failure was responsible and apologized.
-
Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks AIID ↗
A dataset used to train large language models allegedly contained 12,000 live API keys and authentication credentials. Some of these were reportedly still active and allowed unauthorized access. Truffle Security found these secrets in a December 2024 Common Crawl archive, which spans 250 billion web pages. The affected credentials could have been exploited for unauthorized data access, service disruptions, financial fraud, and a variety of other malicious uses.
-
Purported AI-Generated Images Reportedly Used in Sextortion Scheme Targeting Glasgow, Kentucky Teen Who Later Died by Suicide AIID ↗
16-year-old Elijah Heacock of Glasgow, Kentucky, reportedly died by suicide on February 28, 2025, after receiving threatening messages containing purportedly AI-generated explicit images depicting him. The images were reportedly used in a sextortion attempt demanding money. The FBI has been investigating the case as part of an alleged pattern of online financial sextortion schemes targeting minors.
-
Microsoft Copilot Reportedly Able to Access Cached Data from Since-Private GitHub Repositories AIID ↗
Lasso Security reported that Microsoft Copilot could return content from GitHub repositories that had been public briefly but later set to private or deleted. Lasso attributed this to Bing's caching system, which stored "zombie data" from over 20,000 repositories. The cached content allegedly included sensitive information such as access keys, tokens, and internal packages. Microsoft reportedly classified the issue as low severity and applied only partial mitigations.
-
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material AIID ↗
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
-
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000) AIID ↗
A 57-year-old woman in Bengaluru was allegedly defrauded of ₹3.75 crore (~$425,000 USD) after scammers used a purportedly AI-generated deepfake video of spiritual leader Sadhguru to promote a fake investment platform called Mirrox. The victim was reportedly recruited via Instagram and WhatsApp and was persuaded through trading tutorials on Zoom and fabricated profit screenshots. She reportedly realized the fraud only when withdrawals were blocked and additional fees were demanded.
-
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations AIID ↗
In February 2025, lawyers Christopher I. Kachouroff and Jennifer T. DeMaster, representing Mike Lindell, reportedly used generative AI to draft a court brief that contained nearly 30 defective or fabricated citations. The error-filled filing violated federal court rules requiring factual and legal accuracy. The judge fined both lawyers $3,000 each, citing either the improper use of AI or gross carelessness as the cause of the misleading legal content.
-
Apple’s Voice Dictation Reportedly Substitutes ‘Trump’ for ‘Racist’ Due to Speech Recognition Bug AIID ↗
Apple's iPhone dictation feature reportedly displayed "Trump" when users dictated the word "racist," with a viral video demonstrating the glitch. Apple acknowledged the bug, attributing it to a phonetic overlap in its speech recognition model, though some speculated it could be an internal prank. The company announced an immediate fix.
-
Otter.ai Notetaker Allegedly Recorded Meeting Conversations Without Participants' Informed Consent and Used Data for AI Training AIID ↗
In February 2025, Otter.ai's Notetaker reportedly recorded and transcribed a Zoom conversation involving Justin Brewer, a San Jacinto, California resident who was not an Otter account holder, without his informed consent. Brewer later alleged that Otter obtained and retained his meeting communications and used captured data to train its speech-recognition and machine-learning systems.
-
Character.AI Chatbots Allegedly Impersonating Licensed Therapists and Encouraging Harmful Behaviors AIID ↗
The American Psychological Association (APA) has warned federal regulators that AI chatbots on Character.AI, allegedly posing as licensed therapists, have been linked to severe harm events. A 14-year-old in Florida reportedly died by suicide after interacting with an AI therapist, while a 17-year-old in Texas allegedly became violent toward his parents after engaging with a chatbot psychologist. Lawsuits claim these AI-generated therapists reinforced dangerous beliefs instead of challenging them
-
Unauthorized AI-Generated Video of Donald Trump and Elon Musk Reportedly Appears on HUD Building Screens AIID ↗
An unauthorized satirical AI-generated video reportedly depicting President Trump kissing Elon Musk’s feet played on TV screens within the Department of Housing and Urban Development (HUD) building, seemingly mocking their relationship. The video is reported to have included the phrase “Long live the real king,” referencing a recent Truth Social post by Trump.
-
Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials AIID ↗
A reported phishing campaign is impersonating OpenAI’s ChatGPT Premium subscription service, using AI-generated emails to steal user credentials and financial data. Cybercriminals are allegedly sending fraudulent renewal requests urging victims to update payment details, directing them to spoofed OpenAI login pages.
-
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media AIID ↗
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.
-
Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors AIID ↗
A Texas Department of Public Safety staff sergeant from Edinburg, Preston Wade Pietrzykowski, was reportedly arrested on a charge of possession or promotion of child pornography. Included among the alleged contents of a hard drive belonging to him was CSAM altered or generated by deepfake technology.
-
Kenya's Foreign Affairs Principal Secretary Korir Sing'Oei Reportedly Shared AI-Generated Video Depicting Fareed Zakaria Praising Sudan Diplomacy AIID ↗
Kenya's Foreign Affairs Principal Secretary (PS) Dr. Korir Sing’Oei shared a purportedly AI-generated deepfake video that allegedly depicted CNN journalist Fareed Zakaria praising Kenya's peace diplomacy in Sudan. After reported backlash from the public and journalists on X (Twitter), Sing'Oei deleted the video, but there were reportedly concerns that Kenya's diplomatic credibility was undermined.
-
Nonconsensual Explicit AI-Generated Images of Up to 60 Gladstone Park Secondary College Students in Victoria, Australia, Reportedly Created and Circulated Online AIID ↗
Purportedly AI-generated explicit images of up to 60 female students at Gladstone Park Secondary College in Victoria, Australia, were reportedly created and circulated online. The images were reportedly altered from formal school photos using AI tools to produce nonconsensual explicit content. Two Year 11 students have been suspended, but the full number of individuals involved remains unclear as the investigation is ongoing.
-
Cybercriminals Reportedly Exploited Google’s G.Co Subdomain and Spoofed Caller ID in AI-Driven Phishing Attack on Hack Club Founder AIID ↗
Hack Club founder Zach Latta was reportedly targeted in an AI-assisted phishing attack exploiting Google’s own systems. Cybercriminals allegedly spoofed a legitimate Google Assistant number and used voice cloning to impersonate support staff, claiming unusual login activity from Frankfurt. They reinforced the deception by sending a real email from Google’s Workspace domain. The attack, which relied on Google’s g.co subdomain, was thwarted when inconsistencies raised Latta’s suspicions.
-
ChatGPT Use Was Reportedly Cited in Delusional State Before Homicide and Assault in Readfield, Maine AIID ↗
In February 2025, Samuel Whittemore killed his wife, Margaux Whittemore, and assaulted his mother, Dorothy Whittemore, at a home in Readfield, Maine. Court reporting said forensic psychologists testified he was experiencing bipolar disorder with psychotic features and delusions, and that he had used ChatGPT up to 14 hours a day as a companion before the attack. Current reporting links ChatGPT use to his deteriorating mental state but does not establish direct violent instruction.
-
Two 16-Year-Old Students in Athens, Greece Allegedly Generated Nonconsensual Deepfake Pornography of Their Classmates AIID ↗
In Athens, Greece, two 16-year-old students were arrested for allegedly generated nonconsensual deepfake pornography of their classmates. They reportedly used images taken from social media to create the explicit images, which they are then reported to have disseminated online to others. The parents of the students were reportedly also arrested for neglecting to supervise their behavior.
-
Alleged Use of Purported AI-Generated Identities to Defraud FTX Claims Buyers of $5.6M AIID ↗
An individual or group allegedly used AI-based face modification tools to impersonate FTX claimants in video calls, reportedly defrauding two companies of over $5.6 million in the secondary claims market. The perpetrator reportedly used forged IDs, deepfake-style visuals, and claim data likely obtained from public records or a prior breach at Kroll. Funds were alleged to have been laundered through exchanges including Binance, CoinEx, and Gate.io.
-
Video Reportedly Created with AI Appears to Show Trump Backing Biafra Secession AIID ↗
In February 2025, a video circulated on Facebook that appeared to show U.S. President Donald Trump expressing support for Biafran independence and calling for the release of Indigenous People of Biafra (IPOB) leader Nnamdi Kanu. However, fact-checkers reportedly traced the visuals to a 2021 BBC video unrelated to Biafra; they noted signs of AI manipulation. The altered clip reportedly used tools such as ElonTalks to generate synthetic audio and video from a user-submitted script.
-
AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign AIID ↗
A sophisticated AI-powered phishing scam has reportedly been targeting between 1.8 to 2.5 billion Gmail users, allegedly using deepfake robocalls and phishing emails to steal credentials. Attackers impersonate Google security. They claim suspicious account activity and direct victims to fake Google login pages. The stolen credentials have reportedly been used for identity theft, banking fraud, and session hijacking. The FBI has urged vigilance as AI increases the scale and effectiveness of such
-
Tesla Cybertruck Operating in Full Self-Driving Mode Reportedly Crashes into Pole in Nevada After Failing to Merge AIID ↗
A Tesla Cybertruck operating in Full Self-Driving (FSD) mode reportedly crashed into a pole in Reno, Nevada, after failing to merge out of a lane that was ending. The driver, who was required to remain in control, stated that unknown mechanical issues caused the vehicle to leave the lane.
-
Reported Deepfake of Maltese Prime Minister Robert Abela and Journalist Mark Laurence Zammit Used to Promote Fraudulent Investment AIID ↗
A deepfake scam allegedly used AI-generated audio to mimic Maltese Prime Minister Robert Abela and journalist Mark Laurence Zammit, falsely portraying them as endorsing an investment scheme. The fraudulent video repurposed genuine interview footage from 2022 but replaced the original dialogue with AI-generated voices.
-
Two Waymo Robotaxis Allegedly Contributed to Bike-Lane Collision That Injured San Francisco Cyclist AIID ↗
San Francisco cyclist Jenifer Hanki alleged that on February 16, 2025, one driverless Waymo stopped beside a marked bike lane at a no-stopping curb without warning a passenger who opened a rear door into her path, while a second Waymo crossed into the lane and restricted her escape. Hanki said she suffered brain, spinal, and soft-tissue injuries after striking the door and second vehicle. Her lawsuit alleged failures in Waymo's Safe Exit system and passenger drop-off controls.
-
Purported Deepfake Images of Gráinne Seoige Reportedly Circulated During Ireland's 2024 General Election Campaign AIID ↗
A reported deepfake abuse campaign targeted Gráinne Seoige during her run in Ireland's 2024 general election campaign, when pornographic, purportedly AI-generated images of her were reportedly circulated online. Seoige later described the experience as humiliating and traumatic, and Gardaí said they were investigating the distribution of the material.
-
Purported AI-Generated Audio Was Reportedly Used to Claim Recep Tayyip Erdoğan Expressed Support for Imran Khan in Pakistani Parliament AIID ↗
A reported viral video that was circulated in Pakistan featured purported AI-generated audio depicting Turkish President Recep Tayyip Erdoğan expressing support for jailed former Prime Minister Imran Khan during his 2025 visit. The video is described as having reused footage from 2020 and featured AI-generated audio that fabricated remarks Erdoğan never made. The synthetic voice was reportedly confirmed by forensic tools and audio analysis.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.