AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Deepfake Video Reportedly Depicts Zambian President Hakainde Hichilema Withdrawing from 2026 Election AIID ↗
A viral video circulating on social media in October 2023 falsely claimed that Zambian president Hakainde Hichilema announced he would not run in the 2026 elections. Fact-checkers and digital forensics experts confirmed the video was manipulated using basic AI tools. The footage originated from a TikTok account known for AI-generated content.
-
AI-Generated Fake Audio of Verbal Abuse Incident Circulates of British Labour Leader Keir Starmer AIID ↗
An AI-generated audio clip, purporting to show UK opposition leader Keir Starmer verbally abusing staff, was debunked as fake. The clip, circulated on social media, was analyzed and found likely manipulated, with added background noise to evade detection.
-
Purported Mass Facial Recognition Program in Gaza Reportedly Used by Israeli Forces to Identify Palestinians AIID ↗
A previously undisclosed facial recognition initiative operated by Israeli military intelligence units was reportedly deployed across Gaza after the October 7, 2023 attacks. According to multiple intelligence officers, the program uses Corsight technology alongside Google Photos to identify individuals from checkpoints, crowds, and drone footage. The system has allegedly produced misidentifications, including the widely reported detention of Palestinian poet Mosab Abu Toha on November 19, 2023.
-
Deepfake Recordings Allegedly Influence Slovakian Election AIID ↗
Days before Slovakia's election, deepfake audio recordings surfaced, allegedly featuring conversations between a journalist and a leading liberal politician discussing vote-rigging and other controversial topics. The recordings were spread on social media platforms and may have influenced the election outcome, which saw the pro-Russian populist party winning.
-
Facebook Messenger AI Stickers Generate Ethical and Content Moderation Concerns AIID ↗
Facebook Messenger AI stickers, a feature by Meta, allows users to generate personalized stickers via AI for use in conversations. While the feature has been praised for its creativity, it has also stirred controversy for its alleged production of inappropriate or offensive content. This has raised questions about the effectiveness of Meta's content moderation measures and the ethical responsibilities associated with AI-driven content generation.
-
Robin Williams's Voice Deepfaked Without Consent AIID ↗
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
-
A Self-Driving Cruise Robot Taxi Reportedly Struck and Dragged a Pedestrian 20 Feet AIID ↗
Cruise has settled for between $8 million and $12 million with a pedestrian dragged by one of its autonomous vehicles in October 2023. The incident, where the pedestrian was initially hit by a human-driven car and then dragged 20 feet by the Cruise vehicle, led to the suspension of Cruise's operations and increased regulatory scrutiny.
-
Deepfaked Advertisements Using the Likenesses of Celebrities Such as Tom Hanks and Gayle King Without Their Consent AIID ↗
Deepfake technology was used to generate video advertisements featuring celebrities. Notable examples include the likeness of Tom Hanks touting a dental plan and another one in which the likeness of Gayle King touts a weight loss product. In each case, the individuals whose likenesses and voices had been deepfaked had not consented to their images and voices being used for the commercials.
-
Russia Reportedly Using Artificial Intelligence in Disinformation Campaigns to Erode Western Support for Ukraine AIID ↗
The Russian government has been stepping up its foreign influence campaigns by using artificial intelligence and emerging technologies to spread disinformation and sow distrust in policies supportive of Ukraine. Part of the strategy includes carrying out influence laundering operations by disseminating their messages to the American public via allies inside nominally independent organizations, according to a recent declassified analysis.
-
Ottawa Couple Reportedly Loses CA$177,023 After Purported Deepfake Elon Musk Investment Scam AIID ↗
A retired Ottawa couple, Doug and Victoria Lloyd, lost CA$177,023 after being lured by a purported deepfake video of Elon Musk promoting a fake investment platform. The deepfake allegedly led to prolonged social engineering, remote access to their computer, and fraudulent cryptocurrency transfers. The couple reportedly suffered major financial loss and ongoing debt. Police say recovery is unlikely.
-
Anthropic Allegedly Copied Copyrighted Song Lyrics Without Permission to Train Claude AIID ↗
Music publishers alleged that Anthropic copied copyrighted song lyrics without permission to train Claude and that Claude reproduced protected lyrics in its outputs. Anthropic denied infringement and has argued that its training use is fair use. Publishers alleged that the conduct deprived rightsholders and songwriters of licensing control and revenue and undermined markets for licensed lyrics.
-
Gannett Halts AI-Generated High School Sports Articles After Series of Errors and Public Backlash AIID ↗
Gannett, a newspaper chain, temporarily halted its AI experiment that used a tool called LedeAI to generate high school sports articles. The decision came after several articles produced by the AI showed glaring errors, repetitive language, and awkward phrasing, drawing criticism and mockery on social media.
-
Peppermill Casino Facial Recognition System Reportedly Misidentified Individual, Leading to Wrongful Arrest in Reno AIID ↗
Purported facial recognition technology deployed at Reno's Peppermill Casino reportedly misidentified Jason Killinger as an individual previously banned from the venue. Casino security reportedly detained Killinger and contacted police, leading to his arrest by the Reno PD. He was reportedly held for 11 hours, including several hours in handcuffs, before fingerprinting reportedly confirmed the misidentification. The incident resulted in alleged physical injury and civil liberties harms.
-
Purported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town AIID ↗
In Spain, an AI app was used to digitally alter photos of young girls, making them appear naked. This manipulation sparked an investigation after these images were circulated in Almendralejo, a town in the Extremadura region, raising serious concerns about digital privacy violations and the potential spread of these images on pornographic sites.
-
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs AIID ↗
Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.
-
Deepfake Video of Ron DeSantis Dropping Out of 2024 Presidential Race Circulating AIID ↗
In early September 2023, a deepfake video created by C3PMeme circulated on social media, showing Ron DeSantis falsely claiming he was dropping out of the 2024 presidential race. DeSantis did not actually suspend his campaign until January 21, 2024.
-
Voice deepfake targets bank in failed transfer scam AIID ↗
In spring 2023, Florida investor Clive Kabatznik became the target of an advanced scam attempt involving a voice deepfake mimicking his own voice. The fraudulent caller, using AI-generated speech, contacted Kabatznik's Bank of America representative in an unsuccessful attempt to deceive the banker into transferring funds to a different account.
-
Reported Doctored Video of Nigerian President Bola Tinubu Claims Naira Will Be Replaced by U.S. Dollar AIID ↗
A reported viral video circulated in Nigeria in the late summer and early fall of 2023 falsely claiming that President Bola Tinubu announced plans to replace the naira with the U.S. dollar. The video, reportedly styled as a news segment from Arise News, was allegedly digitally altered using AI-generated audio and lip-sync manipulation. Arise News publicly denounced the clip as a deepfake, and no legitimate media sources corroborated the claim. The video appeared amid public anxiety over Nigeria'
-
Deepfake Voice Exploit Compromises Retool's Cloud Services AIID ↗
In August 2023, a hacker reportedly was successful in breaching Retool, an IT company specializing in business software solutions, impacting 27 cloud customers. The attacker appears to have initiated the breach by sending phishing SMS messages to employees and later used an AI-generated deepfake voice in a phone call to obtain multi-factor authentication codes. The breach seems to have exposed vulnerabilities in Google's Authenticator app, specifically its cloud-syncing function, further enablin
-
Campaign Featuring Purported AI-Generated Audio Attributed to Omar al-Bashir Spreads During Sudanese Conflict AIID ↗
Beginning in late August 2023, a TikTok channel called The Voice of Sudan circulated purported AI-generated audio claiming to be leaked recordings of former Sudanese president Omar al-Bashir. Experts identified several recordings as voice-cloned fabrications, derived from unrelated broadcasts by a political commentator. The campaign emerged during Sudan's civil war and appeared designed to influence political perceptions. TikTok later removed the account for violating synthetic media policies.
-
Flawed AI in Google Search Reportedly Misinforms about Geography AIID ↗
Google's search AI erroneously claimed no African country begins with 'K', along with various other geography-and-letter-based questions, misguiding users with a flawed featured snippet. Originating from ChatGPT-written posts and inaccurately scraped by Google, this incident highlights issues in AI-generated content and misinformation in search results, compromising Google's reliability as an information source.
-
Alleged Gaggle Surveillance Alert Reportedly Leads to Arrest and Detention of 13-Year-Old Student in Fairview, Tennessee AIID ↗
Sometime in August 2023, a 13-year-old student at Fairview Middle School in Tennessee was reportedly arrested, strip-searched, and detained overnight after Gaggle's purported AI-powered surveillance system flagged a private online message as a threat. The student's comment, reportedly a joke in context, was sent to law enforcement under a state zero-tolerance law. The incident reportedly resulted in house arrest, alternative school placement, and a lawsuit alleging wrongful arrest.
-
Cruise Robotaxi Initially Blamed for Ambulance Delay in Case Where Patient Later Died; Subsequent Reports Clear Cruise of Fault AIID ↗
In an initial report, a Cruise robotaxi was said to have delayed a San Francisco ambulance transporting Sammy Davis, a critically injured 69-year-old hit by a city bus. Davis later died. Subsequent clarification revealed that Cruise was not at fault for the fatality; the actual cause was a human-operated city bus. Despite this, the incident is included as it highlights challenges in the interaction between autonomous vehicles and emergency services in urban settings.
-
Driverless Cruise Cars Immobilized in San Francisco Traffic Jam AIID ↗
A fleet of Cruise's autonomous vehicles became unexpectedly immobilized on a busy San Francisco street, causing significant traffic disruption. The incident was attributed to wireless connectivity issues exacerbated by a nearby festival.
-
AI Meal Planner Suggests Hazardous Chlorine Gas Recipe AIID ↗
Pak 'n' Save's AI-based app, Savey Meal-bot, inadvertently suggested dangerous recipes, including one creating chlorine gas, when users entered non-food household items, raising safety and oversight concerns.
-
AI-Generated Imagery and Multilingual Disinformation in Chinese Campaign Regarding Maui Wildfires AIID ↗
In a disinformation campaign concerning wildfires across Maui, Chinese operatives utilized AI-generated imagery to enhance the credibility of false narratives. These narratives claimed that the wildfires were the result of a secret "weather weapon" being tested by the United States. Researchers from Microsoft and other organizations identified these AI-generated images as a significant new tactic in influence operations.
-
Cigna Algorithm PXDX Allegedly Rejected Thousands of Patient Claims En Masse in Breach of California Law AIID ↗
Cigna health insurer faces a class-action lawsuit for allegedly using the PXDX ("procedure-to-diagnosis") algorithm to automatically reject over 300,000 patient claims in violation of California law, prompting two members to file the lawsuit seeking damages and a jury trial. Cigna disputes the allegations, claiming the process expedites physician reimbursement and does not result in care denials.
-
University Student Reportedly Received Zero After Turnitin AI Detector Flagged Essay AIID ↗
An anonymized university student said Turnitin’s AI detector flagged 67% of an essay as AI-generated, despite the student claiming to have written the assignment by hand. The student reportedly received a zero and said attempts to appeal to the professor, department head, and Turnitin support had not resolved the accusation.
-
AI Photo Filter Lightens Skin, Changes Eye Color in Student's 'Professional' Image AIID ↗
An AI application modified an MIT student's photo to appear 'professional' by lightening her skin and changing her eye color to blue, highlighting the racial bias in the training data of the program.
-
Never Back Down Super PAC for Ron DeSantis Uses AI Donald Trump Voice in Attack Ad Against Kim Reynolds AIID ↗
A pro-Ron DeSantis super PAC released an ad featuring an AI-generated voice of Donald Trump. The ad, created by Never Back Down, aimed to criticize Trump’s treatment of Iowa Gov. Kim Reynolds. The AI-generated voice was confirmed to be based on Trump's post from his social media. This incident is an example of potential deception in political advertising through AI-generated content.
-
Shein Accused of AI-Driven Art Theft on Merchandise AIID ↗
Artists Krista Perry, Larissa Martinez, and Jay Baron filed a lawsuit against Shein, alleging the company used AI to replicate their art on merchandise. The artists claim Shein's algorithm identifies trending online art, creating near-identical copies for their products without credit or compensation.
-
AI-Generated Articles at G/O Media Allegedly Diminishes Reputation of Human Staff AIID ↗
G/O Media began publishing AI-generated articles, against staff advice, that contained errors and quality issues. The first such article, a list of Star Wars movies, failed to maintain chronological order, causing internal concerns over journalistic credibility and ethics. Staff expressed that the AI was "actively hurting our reputations and credibility" and accused management of "wasting everyone's time."
-
Harmful Stereotyping of Non-Cisgendered People via Text-to-Image Systems AIID ↗
Text-to-image systems such as DALL-E are allegedly generating biased and often insulting representations of non-cisgender identities. The systems tend to generate stereotypical and sexualized images when prompted with gender identity terms like "trans," "nonbinary," or "queer," highlighting systemic issues of bias.
-
Bankrate's Resumption of AI-Generated Content Allegedly Continuing to Produce Inaccurate and Misleading Information AIID ↗
Bankrate, and its sister site CNET, both owned by Red Ventures, resumed publishing AI-generated articles claiming thorough human fact-checking. However, new articles are alleged to contain numerous factual errors, including inaccurate statistics and misleading information. Despite public criticism, the company defended its use of AI and blamed out-of-date datasets for the errors. In addition to the errors, the incident raises questions about the ethical use of AI in journalism, especially given
-
Grant Reviewers Reportedly Fed Applications into Generative AI to Produce Reports, Allegedly Breaching Confidentiality AIID ↗
Peer reviewers of Australian government grant applications reportedly inserted applicants' work into generative AI systems such as ChatGPT to generate assessment reports, which allegedly posed confidentiality and security issues.
-
Amazon Rife with Many Allegedly AI-Generated Books of Suspect Quality AIID ↗
Amazon’s Kindle Unlimited young adult romance bestseller list was flooded with allegedly AI-generated books that made little to no sense, disrupting the rankings. These books were reported to be "clearly there to click farm." Despite being removed from the bestseller list, many remained available for purchase. The incident raised concerns about the integrity of the platform, and the potential financial impact on legitimate authors.
-
Alleged Exploitation of Meta's Open-Source LLaMA Model for NSFW and Violent Content AIID ↗
Meta's open-source large language model, LLaMA, is allegedly being used to create graphic and explicit chatbots that indulge in violent and illegal sexual fantasies. The Washington Post highlighted the example of "Allie," a chatbot that participates in text-based role-playing allegedly involving violent scenarios like rape and abuse. The issue raises ethical questions about open-source AI models, their regulation, and the responsibility of developers and deployers in mitigating harmful usage.
-
Google Ads Allegedly Serving Content on AI-Generated Misinformation Sites AIID ↗
Google’s advertising platform, Google Ads, has allegedly been found to be serving ads on AI-generated content farms that often disseminate misinformation. Despite policies prohibiting such practices, reportedly there are approximately 356 out of 393 ads from major brands that were found to be served by Google on these problematic sites. Particularly concerning according to the reporting were instances where Google Ads were found on sites like MedicalOutline.com, which spreads harmful health misi
-
Purported Deepfake Image Allegedly Circulating of Donald Trump with Underage Girl at Jeffrey Epstein's Private Island AIID ↗
A purported deepfake image allegedly depicting Donald Trump with an underage girl at Jeffrey Epstein's private island in 1992 has reportedly been circulating on social media.
-
Tesla on Autopilot Struck Parked Work Truck on Highway in Pennsylvania AIID ↗
A 2016 Tesla on Autopilot crashed into the rear of a parked 2007 Freightliner truck providing traffic control on the Pennsylvania Turnpike highway.
-
Reported Accidental Exposure of 38TB of Data by Microsoft's AI Research Team AIID ↗
Microsoft's AI research team reportedly accidentally exposed 38TB of sensitive data while publishing open-source training material on GitHub. The exposure allegedly included secrets, private keys, passwords, and internal Microsoft Teams messages. The team reportedly utilized Azure's Shared Access Signature (SAS) tokens for sharing, which were purportedly misconfigured, leading to the wide exposure of data.
-
Bing Chat Solved CAPTCHAs with Image Analysis Feature Despite Safeguards AIID ↗
Microsoft was reported by a Twitter user for deploying image analysis feature capable of solving CAPTCHAs for its GPT-based chatbot despite it being safeguarded against solving them for users.
-
Colorado Lawyer Filed a Motion Citing Hallucinated ChatGPT Cases AIID ↗
A Colorado Springs attorney, Zachariah Crabill, mistakenly used hallucinated ChatGPT-generated legal cases in court documents. The AI software provided false case citations, leading to the denial of a motion and legal repercussions for Crabill, highlighting risks in using AI for legal research.
-
Alleged Gender Discrimination in Facebook Job Ads Algorithm AIID ↗
Facebook's ad delivery algorithm allegedly disproportionately showed job advertisements to one gender. Despite claims of non-discrimination, the algorithm's actions seem to perpetuate societal biases, which in turn could potentially limit opportunities for certain groups and hinder gender equity in the workplace.
-
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content AIID ↗
An investigation disclosed that Instagram's recommendation algorithms are promoting accounts that facilitate and sell child sexual abuse material (CSAM). The study, conducted by The Wall Street Journal and researchers at Stanford University and the University of Massachusetts Amherst, indicates that Instagram's algorithms not only allow for the discovery of such accounts through keyword searches but also actively recommend them to users within the network. The issue is especially concerning give
-
Ron DeSantis's Presidential Campaign Released Twitter Video Containing AI Images of Donald Trump Hugging Anthony Fauci AIID ↗
Ron DeSantis’s presidential campaign shared a video on Twitter featuring some AI-generated images of Donald Trump hugging former White House coronavirus advisor Anthony Fauci, allegedly as a smear campaign. This incident is possibly the first time a major U.S. presidential campaign deployed deepfakes with the intention of misleading the electorate.
-
Racial Bias in Lung Function Diagnostic Algorithm Leads to Underdiagnosis in Black Men AIID ↗
A study published in JAMA Network Open reveals that racial bias built into a commonly used medical diagnostic algorithm for lung function may be leading to underdiagnoses of breathing problems in Black men. The study suggests that as many as 40% more Black male patients might have been accurately diagnosed if the software were not racially biased. The software algorithm adjusts diagnostic thresholds based on race, affecting medical treatments and interventions.
-
AI-Generated Voices Amplify Conspiracy Theories on TikTok AIID ↗
NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.
-
Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders AIID ↗
The National Eating Disorders Association (NEDA) has shut down its chatbot named Tessa after it gave weight-loss advice to users seeking help for eating disorders. The incident has raised concerns about the risks of using chatbots and AI assistants in healthcare settings, particularly in addressing sensitive issues like eating disorders. NEDA is investigating the matter, emphasizing the need for caution and accuracy when utilizing technology to provide mental health support.
-
Unrepresented Litigant Misled by ChatGPT-Generated False Legal Citations in Manchester Court AIID ↗
A litigant in person (LiP) in a Manchester civil case presented false legal citations generated by ChatGPT. It fabricated one case name and provided fictitious excerpts for three real cases, misleadingly supporting the LiP's argument. The judge, upon investigation, found the submissions to be inadvertent and did not penalize the LiP.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.