AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams AIID ↗
Yahoo Boys (from Nigeria and Ghana) and scammers from Morocco are reportedly targeting U.S. widows and vulnerable individuals using AI-generated images and fake military profiles in "Artificial Patriot" scams. They have allegedly impersonated military officials such as General Matthew W. McFarlane to gain trust, sharing fabricated backstories and emotional appeals. Once trust is established, they request money through untraceable methods.
-
Purported AI-Generated Video Depicts Trump Urging Release of Nigerian Separatist Leader Nnamdi Kanu AIID ↗
A reportedly AI-manipulated video circulated on social media that falsely portrayed U.S. President-elect Donald Trump calling for the release of Nigerian separatist leader Nnamdi Kanu and threatening sanctions against Nigeria. The video allegedly used old footage paired with AI-generated audio mimicking Trump's voice. Fact-checkers identified the video as inauthentic, noting mismatched lip-sync, fabricated quotes, and the fictitious date of "November 31st."
-
Generative AI Plagiarism Incident at Hingham High School Reportedly Tied to Inaccurate Citation Outputs from Grammarly AI AIID ↗
In December 2023, two Hingham High School students ("RNH" and unnamed) reportedly used Grammarly to create a script for an AP U.S. History project. The AI-generated text included fabricated citations to nonexistent books, which the student copied and pasted without verification or acknowledgment of AI use. This violated the school's academic integrity policies, leading to disciplinary action. RNH's parents later sued the school district, but a federal court ruled in favor of the school.
-
Corinth School District Educator in Mississippi Allegedly Used AI to Generate CSAM of Students AIID ↗
An educator in the Corinth School District of Mississippi, Wilson Jones, was arrested for allegedly using AI to generate child sexual abuse material (CSAM) of students. A complaint was filed with the police on January 29th, 2025, and a search warrant was executed on March 3rd, 2025. The FBI allege that the crime was committed sometime on or before November 19th, 2024.
-
Alleged AI-Generated Scam Uses Bank of Cyprus Branding to Solicit Investments AIID ↗
An alleged fraudulent online platform presented as the "Bank of Cyprus Trading AI Platform" was promoted using reportedly fabricated media, including a video that appeared to depict the Bank's CEO endorsing the service. The video reportedly used misleading branding, including the BBC logo, and promised unrealistic investment returns. The Bank of Cyprus publicly denied any affiliation and warned customers about the use of AI-generated content in the scam.
-
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students AIID ↗
The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into "some secondary students" who are alleged to have used AI to "create and electronically distribute obscene images of Richland students." The school administrators became aware of the incident on November 14, 2024.
-
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors AIID ↗
Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
-
Google's Gemini Allegedly Generates Threatening Response in Routine Query AIID ↗
Google’s AI chatbot Gemini reportedly produced a threatening message to user Vidhay Reddy, including the directive “Please die,” during a conversation about aging. The output violated Google’s safety guidelines, which are designed to prevent harmful language.
-
TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content AIID ↗
Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.
-
Purportedly AI-Generated Video Allegedly Depicts Martin Luther King Jr. Supporting Donald Trump AIID ↗
A purported deepfake video allegedly depicting Martin Luther King Jr. endorsing Donald Trump circulated on X, where it was reported to have been viewed over 10 million times. The video, reportedly created by pro-Trump accounts, was reportedly condemned by King's daughter, Bernice King, who called it "vile" and demanded its removal.
-
Reportedly Fake CNN Broadcast Allegedly Used to Spread False Texas Election Results AIID ↗
A reportedly fabricated CNN broadcast graphic showing early Texas election results for the 2024 U.S. presidential race circulated on social media on November 2, 2024. The purportedly manipulated image claimed that Vice President Kamala Harris led over Donald Trump before polls opened, allegedly fueling misinformation about election integrity. CNN is reported to have confirmed the image was inauthentic, and AFP debunked the claims.
-
Deepfake Videos of Barbara O’Neill Allegedly Used in Health Scam Targeting Social Media Users AIID ↗
Deepfake videos of Barbara O’Neill, an Australian alternative health advocate banned from giving medical advice, have allegedly been used in fraudulent social media ads promoting false health cures. They include treatments for prostate issues and erectile dysfunction. These manipulated videos have been widely circulated across African countries. The scam directs users to deceptive websites, potentially for phishing or financial fraud. O’Neill has denied involvement.
-
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case AIID ↗
In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.
-
AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust AIID ↗
AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai.
-
Blogger Milagro Gramz Allegedly Promoted AI-Generated Pornographic Deepfake Targeting Megan Thee Stallion AIID ↗
A blogger, Milagro Gramz, was reportedly found liable for promoting and amplifying a sexually explicit AI-generated deepfake depicting rapper Megan Thee Stallion as part of an online harassment campaign linked to misinformation about her 2020 shooting. Court filings alleged the blogger encouraged followers to view the altered content and spread defamatory claims. In December 2025, a federal jury reportedly awarded damages for harassment and promotion of the deepfake.
-
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish AIID ↗
An analysis reportedly found that multiple AI models provided inaccurate responses to election-related questions, with 52% of Spanish-language answers and 43% of English-language answers containing misinformation or omissions. Errors included misidentifying voting processes and providing information about foreign elections.
-
Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations AIID ↗
In October 2024, Alaska’s Education Commissioner Deena Bishop allegedly used generative AI to draft a school cellphone policy, resulting in reportedly fabricated citations of non-existent studies. The document, which did not disclose AI use, was shared with the state Board of Education, and despite reported corrections, AI-generated errors remained in the final resolution.
-
AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts AIID ↗
OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
-
Salt Lake City Police Chief Mike Brown's Voice and Image Misused in AI-Generated Scam AIID ↗
A scammer used AI to create a deepfake video of Salt Lake City Police Chief Mike Brown, falsely claiming that a recipient owed $100,000 to the federal government. The video, sent via email from a fake SLCPD account, used a cloned voice and repurposed footage from a past interview.
-
Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform AIID ↗
Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.
-
Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum AIID ↗
Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.
-
NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test AIID ↗
NYC implemented an AI enabled weapons scanner for a month-long pilot with limited success. Despite not finding any weapons during the September 2024 testing phase, there were 118 false positives in which a person was searched under suspicion of carrying a weapon with no actual gun detections.
-
Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska AIID ↗
Polish radio station Off Radio Krakow replaced human presenters with AI-generated ones and aired a simulated interview with the deceased poet Wisława Szymborska. The AI-driven experiment aimed to attract younger listeners but led to job losses for former hosts. In response to the public backlash, the station ended its use of AI presenters.
-
AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings AIID ↗
AI writing detection tools have reportedly continued to falsely flag genuine student work as AI-generated, disproportionately impacting ESL and neurodivergent students. Specific cases include Moira Olmsted, Ken Sahib, and Marley Stevens, who were penalized despite writing their work independently. Such tools reportedly exhibit biases, leading to academic penalties, probation, and strained teacher-student relationships.
-
High School Student in Córdoba, Argentina Accused of Using AI to Generate Explicit Images of Classmates AIID ↗
An 18-year-old Argentine student at the pre-university institute of Manuel Belgrano of Córdoba allegedly used AI tools to generate explicit fake images of at least 22 female classmates by combining their faces with other bodies. These images, posted on pornography websites, included the victims' names, leading to harassment and significant psychological harm. Legal authorities charged the student with serious injuries aggravated by gender violence.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Physician Alemka Markotić Endorsing Hondrosol After False Murder Claim on Facebook AIID ↗
A Facebook video purported to show Croatian infectious-disease physician Alemka Markotić and TV host Zoran Šprajc discussing her supposed murder and endorsing a joint-pain product called Hondrosol. The clip and linked article were reported to use AI-generated or manipulated media and to mimic Croatian government branding, directing users toward a scam purchase page.
-
Purported Deepfake Allegedly Misattributes Claims to Former Student in Attack on Vice-Presidential Candidate Tim Walz AIID ↗
A purported viral deepfake accused Democratic vice-presidential nominee Tim Walz of misconduct by using the stolen identity of former student Matthew Metro. Circulated on X and other platforms, the video reportedly reached millions before being flagged for manipulation. U.S. intelligence later revealed it and three other similar events were part of the Russian disinformation campaign Storm-1516, whose aim is to disrupt the 2024 elections.
-
Purported Face‑Swap Technology Reportedly Used to Circumvent Financial Platform's Facial Recognition Security in Nanjing, China AIID ↗
In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI‑powered face‑swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.
-
Alleged License Plate Recognition Errors in Christchurch Lead to Wrongful Parking Fines AIID ↗
An automated license plate recognition (LPR) system at The Landing car park in Christchurch, New Zealand, reportedly issued wrongful fines to dozens of parents dropping off and picking up children. The system allegedly misidentified multiple short visits as prolonged parking, which led to disputed penalties. The operator acknowledged potential errors but continued enforcement.
-
Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups AIID ↗
A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.
-
Alleged AI-Generated Photo Alteration Leads to Inappropriate Modifications in Speaker's Conference Picture AIID ↗
An AI image expansion tool used by a conference organizer unintentionally altered Elizabeth Laraki’s profile picture for a marketing ad, making her blouse appear unbuttoned and showing a fabricated hint of undergarments. The AI generated the lower part of the image when expanding it for vertical formatting. The conference organizers quickly apologized and removed the altered content.
-
Portland Water Bureau SERVUS Algorithm Reportedly Allocates Utility Bill Discount to High-Wealth Consumer AIID ↗
The Portland Water Bureau's AI-driven pilot program for water bill discounts is reported to have randomly selected Tim Boyle, a wealthy high-water consumer, for a 40% discount intended for financially struggling customers. The program, developed by SERVUS, is meant to identify underserved individuals by using machine learning.
-
Uruguayan TV Program Santo y Seña Uses a Deepfake of Political Candidate Yamandú Orsi Without His Consent AIID ↗
Uruguayan TV program Santo y Seña, hosted by Ignacio Álvarez, used AI to create a virtual representation of political candidate Yamandú Orsi, who declined an appearance. Nevertheless, without Orsi's permission, an AI-generated "Orsi" was shown alongside Andrés Ojeda, a rival candidate who appeared in person on the program.
-
Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools AIID ↗
An AI system developed by Infinite Campus and deployed by Nevada to identify at-risk students reportedly led to a sharp reduction in the number classified as needing support, dropping from 270,000 to 65,000. The reclassification allegedly caused significant budget cuts in schools serving low-income populations. The drastic reduction in identified at-risk students reportedly left thousands of vulnerable children without resources and support.
-
Purportedly AI-Altered Fake Nude Images of High School Girls and Women Reportedly Created and Disseminated in Pensacola, Florida AIID ↗
In Pensacola, Florida, an 18-year-old man allegedly used an online AI image-alteration application to digitally "undress" photos of dozens of girls and young women without their consent, creating realistic fake nude images. Some source photos were reportedly taken when the victims were minors. The images were reportedly discovered on the man's phone and subsequently copied and shared with other students by a third party, prompting a police investigation and arrest.
-
ProKYC Tool Allegedly Facilitates Deepfake-Based Account Fraud on Cryptocurrency Exchanges AIID ↗
Cato CTRL security researchers reported that the cybercriminal group ProKYC is selling a deepfake tool capable of bypassing biometric and two-factor authentication (2FA) systems on cryptocurrency exchanges. The tool creates synthetic identities using AI-generated videos and forged documents, enabling fraudulent account creation. A demo video from ProKYC shows the tool in action against ByBit, allowing attackers to verify fake accounts for purposes such as money laundering and identity theft.
-
Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East AIID ↗
An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.
-
AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect AIID ↗
An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.
-
Purportedly AI-Driven Phishing Scam Uses Spoofed Google Call to Attempt Gmail Breach of Security Expert AIID ↗
Scammers allegedly used a purportedly AI-generated voice to impersonate a Google representative in an attempt to steal Gmail account credentials from security expert Sam Mitrovic. The reportedly AI-driven phishing call used a spoofed Google phone number and a fabricated email, making the scam appear legitimate. Mitrovic reportedly noted that the caller's professional demeanor, coupled with AI-generated speech and a Google-related number, could easily deceive unsuspecting users.
-
Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge AIID ↗
Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.
-
Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7 AIID ↗
The hacker group FIN7 is allegedly behind fake AI "nudify" websites distributing infostealer malware to users, according to an investigation by Silent Push. These sites are reported to lure individuals seeking deepfake AI tools into downloading malware disguised as software to "nudify" photos. The malware steals sensitive data from victims, which is used for extortion or financial fraud. FIN7's activity on this front reportedly marks the revival of a group previously declared defunct by the U.S.
-
AI Avatar of Murder Victim Created Without Consent on Character.ai Platform AIID ↗
A user on the Character.ai platform created an unauthorized AI avatar of Jennifer Ann Crecente, a murder victim from 2006, without her family's consent. The avatar was made publicly available, violating Character.ai's policy against impersonation. After the incident surfaced, Character.ai removed the avatar, acknowledging a policy violation.
-
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions AIID ↗
AI-powered meeting assistants, such as Otter.ai's OtterPilot and Zoom's AI Companion, have reportedly shared sensitive and private conversations beyond the intended audience. These tools, which are set to automatically record and distribute meeting transcripts, allegedly sent confidential discussions after participants had left the meeting, the consequences of which led to unintended exposure of proprietary information and privacy breaches.
-
L.A. Woman Reportedly Defrauded of $81,000 and $350,000 Condo Proceeds in Romance Scam Using Purported Deepfake Videos of Actor Steve Burton AIID ↗
In October 2024, Los Angeles resident Abigail Ruvalcaba was reportedly targeted in a romance scam using purported AI-generated deepfake videos and voice impersonations of actor Steve Burton. Believing she was in a relationship, she allegedly sent over $81,000 in cash, gift cards, and crypto, then sold her condo for $350,000 and transferred proceeds to the scammer. Her daughter intervened in February 2025, but the family now reportedly faces bankruptcy and legal battles to recover losses.
-
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes AIID ↗
Beginning sometime in October 2024, students ranging in age from 12 to 20 in schools in Malta were targeted in deepfake nude incidents. The attackers have been superimposing the faces of some of the students over the bodies of naked girls or using "nudify" apps to "undress" the photos, which have reportedly been sent to the victims over WhatsApp in order to humiliate them or in some cases blackmail them.
-
Purportedly AI-Manipulated Video Allegedly Targets Moldovan Economic Development Minister Dumitru Alaiba in Election Disinformation Campaign AIID ↗
A purportedly AI-manipulated video and some photos circulated online depicting Moldova's Economic Development Minister, Dumitru Alaiba, in compromising situations as part of an alleged disinformation campaign by pro-Kremlin supporters, one that has been reported to rely on AI to generate fake content. Alaiba reportedly denounced the purported synthetic media as having been released to mislead the public and influence Moldova's elections by undermining his reputation and the government's pro-Euro
-
Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco AIID ↗
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
-
Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion AIID ↗
A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products.
-
Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax AIID ↗
A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.
-
Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam AIID ↗
Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.