AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content AIID ↗
Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.
-
Purportedly AI-Generated Video Allegedly Depicts Martin Luther King Jr. Supporting Donald Trump AIID ↗
A purported deepfake video allegedly depicting Martin Luther King Jr. endorsing Donald Trump circulated on X, where it was reported to have been viewed over 10 million times. The video, reportedly created by pro-Trump accounts, was reportedly condemned by King's daughter, Bernice King, who called it "vile" and demanded its removal.
-
Reportedly Fake CNN Broadcast Allegedly Used to Spread False Texas Election Results AIID ↗
A reportedly fabricated CNN broadcast graphic showing early Texas election results for the 2024 U.S. presidential race circulated on social media on November 2, 2024. The purportedly manipulated image claimed that Vice President Kamala Harris led over Donald Trump before polls opened, allegedly fueling misinformation about election integrity. CNN is reported to have confirmed the image was inauthentic, and AFP debunked the claims.
-
Deepfake Videos of Barbara O’Neill Allegedly Used in Health Scam Targeting Social Media Users AIID ↗
Deepfake videos of Barbara O’Neill, an Australian alternative health advocate banned from giving medical advice, have allegedly been used in fraudulent social media ads promoting false health cures. They include treatments for prostate issues and erectile dysfunction. These manipulated videos have been widely circulated across African countries. The scam directs users to deceptive websites, potentially for phishing or financial fraud. O’Neill has denied involvement.
-
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case AIID ↗
In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.
-
AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust AIID ↗
AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai.
-
Blogger Milagro Gramz Allegedly Promoted AI-Generated Pornographic Deepfake Targeting Megan Thee Stallion AIID ↗
A blogger, Milagro Gramz, was reportedly found liable for promoting and amplifying a sexually explicit AI-generated deepfake depicting rapper Megan Thee Stallion as part of an online harassment campaign linked to misinformation about her 2020 shooting. Court filings alleged the blogger encouraged followers to view the altered content and spread defamatory claims. In December 2025, a federal jury reportedly awarded damages for harassment and promotion of the deepfake.
-
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish AIID ↗
An analysis reportedly found that multiple AI models provided inaccurate responses to election-related questions, with 52% of Spanish-language answers and 43% of English-language answers containing misinformation or omissions. Errors included misidentifying voting processes and providing information about foreign elections.
-
Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations AIID ↗
In October 2024, Alaska’s Education Commissioner Deena Bishop allegedly used generative AI to draft a school cellphone policy, resulting in reportedly fabricated citations of non-existent studies. The document, which did not disclose AI use, was shared with the state Board of Education, and despite reported corrections, AI-generated errors remained in the final resolution.
-
AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts AIID ↗
OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
-
Salt Lake City Police Chief Mike Brown's Voice and Image Misused in AI-Generated Scam AIID ↗
A scammer used AI to create a deepfake video of Salt Lake City Police Chief Mike Brown, falsely claiming that a recipient owed $100,000 to the federal government. The video, sent via email from a fake SLCPD account, used a cloned voice and repurposed footage from a past interview.
-
Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform AIID ↗
Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.
-
Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum AIID ↗
Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.
-
NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test AIID ↗
NYC implemented an AI enabled weapons scanner for a month-long pilot with limited success. Despite not finding any weapons during the September 2024 testing phase, there were 118 false positives in which a person was searched under suspicion of carrying a weapon with no actual gun detections.
-
Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska AIID ↗
Polish radio station Off Radio Krakow replaced human presenters with AI-generated ones and aired a simulated interview with the deceased poet Wisława Szymborska. The AI-driven experiment aimed to attract younger listeners but led to job losses for former hosts. In response to the public backlash, the station ended its use of AI presenters.
-
AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings AIID ↗
AI writing detection tools have reportedly continued to falsely flag genuine student work as AI-generated, disproportionately impacting ESL and neurodivergent students. Specific cases include Moira Olmsted, Ken Sahib, and Marley Stevens, who were penalized despite writing their work independently. Such tools reportedly exhibit biases, leading to academic penalties, probation, and strained teacher-student relationships.
-
High School Student in Córdoba, Argentina Accused of Using AI to Generate Explicit Images of Classmates AIID ↗
An 18-year-old Argentine student at the pre-university institute of Manuel Belgrano of Córdoba allegedly used AI tools to generate explicit fake images of at least 22 female classmates by combining their faces with other bodies. These images, posted on pornography websites, included the victims' names, leading to harassment and significant psychological harm. Legal authorities charged the student with serious injuries aggravated by gender violence.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Physician Alemka Markotić Endorsing Hondrosol After False Murder Claim on Facebook AIID ↗
A Facebook video purported to show Croatian infectious-disease physician Alemka Markotić and TV host Zoran Šprajc discussing her supposed murder and endorsing a joint-pain product called Hondrosol. The clip and linked article were reported to use AI-generated or manipulated media and to mimic Croatian government branding, directing users toward a scam purchase page.
-
Purported Deepfake Allegedly Misattributes Claims to Former Student in Attack on Vice-Presidential Candidate Tim Walz AIID ↗
A purported viral deepfake accused Democratic vice-presidential nominee Tim Walz of misconduct by using the stolen identity of former student Matthew Metro. Circulated on X and other platforms, the video reportedly reached millions before being flagged for manipulation. U.S. intelligence later revealed it and three other similar events were part of the Russian disinformation campaign Storm-1516, whose aim is to disrupt the 2024 elections.
-
Purported Face‑Swap Technology Reportedly Used to Circumvent Financial Platform's Facial Recognition Security in Nanjing, China AIID ↗
In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI‑powered face‑swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.
-
Alleged License Plate Recognition Errors in Christchurch Lead to Wrongful Parking Fines AIID ↗
An automated license plate recognition (LPR) system at The Landing car park in Christchurch, New Zealand, reportedly issued wrongful fines to dozens of parents dropping off and picking up children. The system allegedly misidentified multiple short visits as prolonged parking, which led to disputed penalties. The operator acknowledged potential errors but continued enforcement.
-
Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups AIID ↗
A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.
-
Alleged AI-Generated Photo Alteration Leads to Inappropriate Modifications in Speaker's Conference Picture AIID ↗
An AI image expansion tool used by a conference organizer unintentionally altered Elizabeth Laraki’s profile picture for a marketing ad, making her blouse appear unbuttoned and showing a fabricated hint of undergarments. The AI generated the lower part of the image when expanding it for vertical formatting. The conference organizers quickly apologized and removed the altered content.
-
Portland Water Bureau SERVUS Algorithm Reportedly Allocates Utility Bill Discount to High-Wealth Consumer AIID ↗
The Portland Water Bureau's AI-driven pilot program for water bill discounts is reported to have randomly selected Tim Boyle, a wealthy high-water consumer, for a 40% discount intended for financially struggling customers. The program, developed by SERVUS, is meant to identify underserved individuals by using machine learning.
-
Uruguayan TV Program Santo y Seña Uses a Deepfake of Political Candidate Yamandú Orsi Without His Consent AIID ↗
Uruguayan TV program Santo y Seña, hosted by Ignacio Álvarez, used AI to create a virtual representation of political candidate Yamandú Orsi, who declined an appearance. Nevertheless, without Orsi's permission, an AI-generated "Orsi" was shown alongside Andrés Ojeda, a rival candidate who appeared in person on the program.
-
Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools AIID ↗
An AI system developed by Infinite Campus and deployed by Nevada to identify at-risk students reportedly led to a sharp reduction in the number classified as needing support, dropping from 270,000 to 65,000. The reclassification allegedly caused significant budget cuts in schools serving low-income populations. The drastic reduction in identified at-risk students reportedly left thousands of vulnerable children without resources and support.
-
Purportedly AI-Altered Fake Nude Images of High School Girls and Women Reportedly Created and Disseminated in Pensacola, Florida AIID ↗
In Pensacola, Florida, an 18-year-old man allegedly used an online AI image-alteration application to digitally "undress" photos of dozens of girls and young women without their consent, creating realistic fake nude images. Some source photos were reportedly taken when the victims were minors. The images were reportedly discovered on the man's phone and subsequently copied and shared with other students by a third party, prompting a police investigation and arrest.
-
ProKYC Tool Allegedly Facilitates Deepfake-Based Account Fraud on Cryptocurrency Exchanges AIID ↗
Cato CTRL security researchers reported that the cybercriminal group ProKYC is selling a deepfake tool capable of bypassing biometric and two-factor authentication (2FA) systems on cryptocurrency exchanges. The tool creates synthetic identities using AI-generated videos and forged documents, enabling fraudulent account creation. A demo video from ProKYC shows the tool in action against ByBit, allowing attackers to verify fake accounts for purposes such as money laundering and identity theft.
-
Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East AIID ↗
An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.
-
AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect AIID ↗
An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.
-
Purportedly AI-Driven Phishing Scam Uses Spoofed Google Call to Attempt Gmail Breach of Security Expert AIID ↗
Scammers allegedly used a purportedly AI-generated voice to impersonate a Google representative in an attempt to steal Gmail account credentials from security expert Sam Mitrovic. The reportedly AI-driven phishing call used a spoofed Google phone number and a fabricated email, making the scam appear legitimate. Mitrovic reportedly noted that the caller's professional demeanor, coupled with AI-generated speech and a Google-related number, could easily deceive unsuspecting users.
-
Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge AIID ↗
Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.
-
Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7 AIID ↗
The hacker group FIN7 is allegedly behind fake AI "nudify" websites distributing infostealer malware to users, according to an investigation by Silent Push. These sites are reported to lure individuals seeking deepfake AI tools into downloading malware disguised as software to "nudify" photos. The malware steals sensitive data from victims, which is used for extortion or financial fraud. FIN7's activity on this front reportedly marks the revival of a group previously declared defunct by the U.S.
-
AI Avatar of Murder Victim Created Without Consent on Character.ai Platform AIID ↗
A user on the Character.ai platform created an unauthorized AI avatar of Jennifer Ann Crecente, a murder victim from 2006, without her family's consent. The avatar was made publicly available, violating Character.ai's policy against impersonation. After the incident surfaced, Character.ai removed the avatar, acknowledging a policy violation.
-
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions AIID ↗
AI-powered meeting assistants, such as Otter.ai's OtterPilot and Zoom's AI Companion, have reportedly shared sensitive and private conversations beyond the intended audience. These tools, which are set to automatically record and distribute meeting transcripts, allegedly sent confidential discussions after participants had left the meeting, the consequences of which led to unintended exposure of proprietary information and privacy breaches.
-
L.A. Woman Reportedly Defrauded of $81,000 and $350,000 Condo Proceeds in Romance Scam Using Purported Deepfake Videos of Actor Steve Burton AIID ↗
In October 2024, Los Angeles resident Abigail Ruvalcaba was reportedly targeted in a romance scam using purported AI-generated deepfake videos and voice impersonations of actor Steve Burton. Believing she was in a relationship, she allegedly sent over $81,000 in cash, gift cards, and crypto, then sold her condo for $350,000 and transferred proceeds to the scammer. Her daughter intervened in February 2025, but the family now reportedly faces bankruptcy and legal battles to recover losses.
-
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes AIID ↗
Beginning sometime in October 2024, students ranging in age from 12 to 20 in schools in Malta were targeted in deepfake nude incidents. The attackers have been superimposing the faces of some of the students over the bodies of naked girls or using "nudify" apps to "undress" the photos, which have reportedly been sent to the victims over WhatsApp in order to humiliate them or in some cases blackmail them.
-
Purportedly AI-Manipulated Video Allegedly Targets Moldovan Economic Development Minister Dumitru Alaiba in Election Disinformation Campaign AIID ↗
A purportedly AI-manipulated video and some photos circulated online depicting Moldova's Economic Development Minister, Dumitru Alaiba, in compromising situations as part of an alleged disinformation campaign by pro-Kremlin supporters, one that has been reported to rely on AI to generate fake content. Alaiba reportedly denounced the purported synthetic media as having been released to mislead the public and influence Moldova's elections by undermining his reputation and the government's pro-Euro
-
Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco AIID ↗
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
-
Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion AIID ↗
A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products.
-
Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax AIID ↗
A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.
-
Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam AIID ↗
Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.
-
ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report AIID ↗
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
-
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response AIID ↗
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing
-
Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money AIID ↗
Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.
-
Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool AIID ↗
In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.
-
Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida AIID ↗
A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.
-
Starship Technologies Delivery Robot Reportedly Injures Arizona State University Employee AIID ↗
A semi-autonomous delivery robot operated by Starship Technologies reportedly struck a pedestrian employed by Arizona State University on the campus sometime in September 2023, purportedly causing injuries after abruptly reversing into her. The robot is reported to have initially knocked the pedestrian down, then moved toward her again while she was still on the ground. The company reportedly offered the victim promo codes and insurance information as an apology. On September 19, 2024, 404 Media
-
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba AIID ↗
Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.
-
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims AIID ↗
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.