AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform AIID ↗
Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.
-
Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum AIID ↗
Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.
-
NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test AIID ↗
NYC implemented an AI enabled weapons scanner for a month-long pilot with limited success. Despite not finding any weapons during the September 2024 testing phase, there were 118 false positives in which a person was searched under suspicion of carrying a weapon with no actual gun detections.
-
Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska AIID ↗
Polish radio station Off Radio Krakow replaced human presenters with AI-generated ones and aired a simulated interview with the deceased poet Wisława Szymborska. The AI-driven experiment aimed to attract younger listeners but led to job losses for former hosts. In response to the public backlash, the station ended its use of AI presenters.
-
AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings AIID ↗
AI writing detection tools have reportedly continued to falsely flag genuine student work as AI-generated, disproportionately impacting ESL and neurodivergent students. Specific cases include Moira Olmsted, Ken Sahib, and Marley Stevens, who were penalized despite writing their work independently. Such tools reportedly exhibit biases, leading to academic penalties, probation, and strained teacher-student relationships.
-
High School Student in Córdoba, Argentina Accused of Using AI to Generate Explicit Images of Classmates AIID ↗
An 18-year-old Argentine student at the pre-university institute of Manuel Belgrano of Córdoba allegedly used AI tools to generate explicit fake images of at least 22 female classmates by combining their faces with other bodies. These images, posted on pornography websites, included the victims' names, leading to harassment and significant psychological harm. Legal authorities charged the student with serious injuries aggravated by gender violence.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Physician Alemka Markotić Endorsing Hondrosol After False Murder Claim on Facebook AIID ↗
A Facebook video purported to show Croatian infectious-disease physician Alemka Markotić and TV host Zoran Šprajc discussing her supposed murder and endorsing a joint-pain product called Hondrosol. The clip and linked article were reported to use AI-generated or manipulated media and to mimic Croatian government branding, directing users toward a scam purchase page.
-
Purported Deepfake Allegedly Misattributes Claims to Former Student in Attack on Vice-Presidential Candidate Tim Walz AIID ↗
A purported viral deepfake accused Democratic vice-presidential nominee Tim Walz of misconduct by using the stolen identity of former student Matthew Metro. Circulated on X and other platforms, the video reportedly reached millions before being flagged for manipulation. U.S. intelligence later revealed it and three other similar events were part of the Russian disinformation campaign Storm-1516, whose aim is to disrupt the 2024 elections.
-
Purported Face‑Swap Technology Reportedly Used to Circumvent Financial Platform's Facial Recognition Security in Nanjing, China AIID ↗
In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI‑powered face‑swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.
-
Alleged License Plate Recognition Errors in Christchurch Lead to Wrongful Parking Fines AIID ↗
An automated license plate recognition (LPR) system at The Landing car park in Christchurch, New Zealand, reportedly issued wrongful fines to dozens of parents dropping off and picking up children. The system allegedly misidentified multiple short visits as prolonged parking, which led to disputed penalties. The operator acknowledged potential errors but continued enforcement.
-
Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups AIID ↗
A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.
-
Alleged AI-Generated Photo Alteration Leads to Inappropriate Modifications in Speaker's Conference Picture AIID ↗
An AI image expansion tool used by a conference organizer unintentionally altered Elizabeth Laraki’s profile picture for a marketing ad, making her blouse appear unbuttoned and showing a fabricated hint of undergarments. The AI generated the lower part of the image when expanding it for vertical formatting. The conference organizers quickly apologized and removed the altered content.
-
Portland Water Bureau SERVUS Algorithm Reportedly Allocates Utility Bill Discount to High-Wealth Consumer AIID ↗
The Portland Water Bureau's AI-driven pilot program for water bill discounts is reported to have randomly selected Tim Boyle, a wealthy high-water consumer, for a 40% discount intended for financially struggling customers. The program, developed by SERVUS, is meant to identify underserved individuals by using machine learning.
-
Uruguayan TV Program Santo y Seña Uses a Deepfake of Political Candidate Yamandú Orsi Without His Consent AIID ↗
Uruguayan TV program Santo y Seña, hosted by Ignacio Álvarez, used AI to create a virtual representation of political candidate Yamandú Orsi, who declined an appearance. Nevertheless, without Orsi's permission, an AI-generated "Orsi" was shown alongside Andrés Ojeda, a rival candidate who appeared in person on the program.
-
Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools AIID ↗
An AI system developed by Infinite Campus and deployed by Nevada to identify at-risk students reportedly led to a sharp reduction in the number classified as needing support, dropping from 270,000 to 65,000. The reclassification allegedly caused significant budget cuts in schools serving low-income populations. The drastic reduction in identified at-risk students reportedly left thousands of vulnerable children without resources and support.
-
Purportedly AI-Altered Fake Nude Images of High School Girls and Women Reportedly Created and Disseminated in Pensacola, Florida AIID ↗
In Pensacola, Florida, an 18-year-old man allegedly used an online AI image-alteration application to digitally "undress" photos of dozens of girls and young women without their consent, creating realistic fake nude images. Some source photos were reportedly taken when the victims were minors. The images were reportedly discovered on the man's phone and subsequently copied and shared with other students by a third party, prompting a police investigation and arrest.
-
ProKYC Tool Allegedly Facilitates Deepfake-Based Account Fraud on Cryptocurrency Exchanges AIID ↗
Cato CTRL security researchers reported that the cybercriminal group ProKYC is selling a deepfake tool capable of bypassing biometric and two-factor authentication (2FA) systems on cryptocurrency exchanges. The tool creates synthetic identities using AI-generated videos and forged documents, enabling fraudulent account creation. A demo video from ProKYC shows the tool in action against ByBit, allowing attackers to verify fake accounts for purposes such as money laundering and identity theft.
-
Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East AIID ↗
An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.
-
AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect AIID ↗
An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.
-
Purportedly AI-Driven Phishing Scam Uses Spoofed Google Call to Attempt Gmail Breach of Security Expert AIID ↗
Scammers allegedly used a purportedly AI-generated voice to impersonate a Google representative in an attempt to steal Gmail account credentials from security expert Sam Mitrovic. The reportedly AI-driven phishing call used a spoofed Google phone number and a fabricated email, making the scam appear legitimate. Mitrovic reportedly noted that the caller's professional demeanor, coupled with AI-generated speech and a Google-related number, could easily deceive unsuspecting users.
-
Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge AIID ↗
Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.
-
Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7 AIID ↗
The hacker group FIN7 is allegedly behind fake AI "nudify" websites distributing infostealer malware to users, according to an investigation by Silent Push. These sites are reported to lure individuals seeking deepfake AI tools into downloading malware disguised as software to "nudify" photos. The malware steals sensitive data from victims, which is used for extortion or financial fraud. FIN7's activity on this front reportedly marks the revival of a group previously declared defunct by the U.S.
-
AI Avatar of Murder Victim Created Without Consent on Character.ai Platform AIID ↗
A user on the Character.ai platform created an unauthorized AI avatar of Jennifer Ann Crecente, a murder victim from 2006, without her family's consent. The avatar was made publicly available, violating Character.ai's policy against impersonation. After the incident surfaced, Character.ai removed the avatar, acknowledging a policy violation.
-
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions AIID ↗
AI-powered meeting assistants, such as Otter.ai's OtterPilot and Zoom's AI Companion, have reportedly shared sensitive and private conversations beyond the intended audience. These tools, which are set to automatically record and distribute meeting transcripts, allegedly sent confidential discussions after participants had left the meeting, the consequences of which led to unintended exposure of proprietary information and privacy breaches.
-
L.A. Woman Reportedly Defrauded of $81,000 and $350,000 Condo Proceeds in Romance Scam Using Purported Deepfake Videos of Actor Steve Burton AIID ↗
In October 2024, Los Angeles resident Abigail Ruvalcaba was reportedly targeted in a romance scam using purported AI-generated deepfake videos and voice impersonations of actor Steve Burton. Believing she was in a relationship, she allegedly sent over $81,000 in cash, gift cards, and crypto, then sold her condo for $350,000 and transferred proceeds to the scammer. Her daughter intervened in February 2025, but the family now reportedly faces bankruptcy and legal battles to recover losses.
-
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes AIID ↗
Beginning sometime in October 2024, students ranging in age from 12 to 20 in schools in Malta were targeted in deepfake nude incidents. The attackers have been superimposing the faces of some of the students over the bodies of naked girls or using "nudify" apps to "undress" the photos, which have reportedly been sent to the victims over WhatsApp in order to humiliate them or in some cases blackmail them.
-
Purportedly AI-Manipulated Video Allegedly Targets Moldovan Economic Development Minister Dumitru Alaiba in Election Disinformation Campaign AIID ↗
A purportedly AI-manipulated video and some photos circulated online depicting Moldova's Economic Development Minister, Dumitru Alaiba, in compromising situations as part of an alleged disinformation campaign by pro-Kremlin supporters, one that has been reported to rely on AI to generate fake content. Alaiba reportedly denounced the purported synthetic media as having been released to mislead the public and influence Moldova's elections by undermining his reputation and the government's pro-Euro
-
Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco AIID ↗
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
-
Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion AIID ↗
A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products.
-
Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax AIID ↗
A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.
-
Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam AIID ↗
Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.
-
ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report AIID ↗
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
-
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response AIID ↗
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing
-
Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money AIID ↗
Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.
-
Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool AIID ↗
In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.
-
Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida AIID ↗
A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.
-
Starship Technologies Delivery Robot Reportedly Injures Arizona State University Employee AIID ↗
A semi-autonomous delivery robot operated by Starship Technologies reportedly struck a pedestrian employed by Arizona State University on the campus sometime in September 2023, purportedly causing injuries after abruptly reversing into her. The robot is reported to have initially knocked the pedestrian down, then moved toward her again while she was still on the ground. The company reportedly offered the victim promo codes and insurance information as an apology. On September 19, 2024, 404 Media
-
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba AIID ↗
Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.
-
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims AIID ↗
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
-
AI-Generated Media Reportedly Used in Russian Disinformation Campaign in Moldova AIID ↗
Russian-linked entities allegedly deployed AI-generated images and videos to spread disinformation aimed at swaying Moldova’s referendum on E.U. membership. The AI-enhanced media campaign included fabricated stories and doctored visuals, the purpose of which was reportedly designed to amplify fear and undermine pro-E.U. sentiment in the days leading up to the referendum.
-
Purportedly AI-Generated Audio Allegedly Fabricates Biden's Admission of Role in Pakistani Political Crisis AIID ↗
A purported deepfake audio file is alleged to have falsely claimed that U.S. President Joe Biden conspired with Pakistan's Army Chief, General Syed Asim Munir, to remove former Prime Minister Imran Khan in 2022. Widely shared online, the audio is reported to have exploited generative AI to spread political misinformation.
-
Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang AIID ↗
A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.
-
Purported Deepfake of Brian May Allegedly Exploited in Scam Offering Fake Queen Backstage Tickets AIID ↗
Scammers allegedly created an AI-generated deepfake of Queen guitarist Brian May, reportedly posting a video on TikTok in which the fake May offers backstage tickets to a Queen concert. The real Brian May reportedly warned fans about this "disgusting" scam, emphasizing that Queen has no tour dates planned and does not sell backstage access.
-
Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise AIID ↗
Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.
-
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion AIID ↗
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
-
ESPN's AI Coverage Reportedly Overlooks Alex Morgan in Her Final Match Recap AIID ↗
ESPN's AI-generated recap of Alex Morgan's final professional soccer match reportedly failed to mention her significant retirement moment, instead providing a standard rundown that missed the emotional context.
-
Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam AIID ↗
Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.
-
Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries AIID ↗
Amazon's Alexa was found to provide politically biased responses when asked about the 2024 presidential candidates. It refused to give reasons to vote for Donald Trump, citing neutrality, while offering detailed endorsements for Kamala Harris. Amazon labeled the discrepancy an "error" and reportedly corrected it.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook AIID ↗
A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.
-
53% of American and British Businesses Report Attacks by AI-Powered Deepfake Scams in 2024 AIID ↗
According to Medius, Deepfake scams have targeted 53% of businesses in the U.S. and U.K., with 43% falling victim. Using AI to create realistic fake videos and audio of corporate executives, scammers have successfully stolen millions, including $25 million from British engineering group Arup.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.