AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Nonfiction Book 'The Future of Truth' Reportedly Included AI-Generated and Misattributed Quotations AIID ↗
Steven Rosenbaum's nonfiction book The Future of Truth reportedly included AI-generated or misattributed quotations after he used ChatGPT and Claude while working on the book. The New York Times reported that more than half a dozen quotations in reviewed sections were synthetic or wrongly attributed, including passages assigned to named writers and scholars. Rosenbaum later acknowledged the errors as accidental and said affected passages would be reviewed for correction.
-
Claude Console Reportedly Generated Phantom Legal Quotations in Trump Layoffs Court Filing AIID ↗
A Binnall Law Group attorney reportedly used Anthropic's Claude Console to draft a motion to quash a subpoena in litigation over Trump administration layoffs, then filed a version containing "phantom" quotations that did not appear in the cited cases. The attorney apologized to U.S. District Judge Susan Illston, and the firm said it would add safeguards and training after calling the AI-generated errors unacceptable.
-
Purportedly AI-Enhanced Images of Iranian Women Protesters Were Reportedly Spread With Unverified Execution Claims AIID ↗
A purportedly AI-edited collage of eight Iranian women political prisoners was reportedly amplified by President Donald Trump and U.S. government accounts alongside an unverified claim that all faced imminent execution. Reporting said the images were of real women but had been AI-enhanced, while later Iranian official mockery used AI-generated women. The episode reportedly blurred authentic human-rights documentation with synthetic material and helped Iran dismiss underlying abuses.
-
South Africa Draft National AI Policy Reportedly Included Fictitious References Believed to Be AI Hallucinations AIID ↗
South Africa's Draft National AI Policy, gazetted for public comment, reportedly contained at least six fictitious academic references. Several cited articles or journals reportedly did not exist or were disclaimed by journal editors, and experts said the errors were consistent with AI hallucinations. The Department of Communications and Digital Technologies said it was reviewing the discrepancies but argued they did not affect the draft's substance.
-
Purportedly AI-Generated Image Reportedly Misled Daejeon Authorities Searching for Escaped Wolf Neukgu AIID ↗
South Korean police alleged that a 40-year-old man used ChatGPT's image-generation capabilities to add escaped wolf Neukgu to a Daejeon street photo, then posted the purportedly fabricated image in a company group chat. Authorities reportedly used the image in alerts and briefings, redirecting search resources and disrupting public-safety operations before police identified him through CCTV and AI-use records.
-
Gemini and Grok Reportedly Misidentified Authentic Minab School-Strike Graveyard Photo as Unrelated Disaster Imagery AIID ↗
Gemini and Grok reportedly gave false provenance claims about an authentic photo of graves prepared for victims of the Minab school strike, identifying it as disaster imagery from Turkey or Indonesia. Researchers verified the photo's location through satellite imagery and related visual evidence.
-
Grok Reportedly Misclassified Netanyahu Proof-of-Life Video as AI-Generated Deepfake Amid Iran War Rumors AIID ↗
During the Iran war, Grok reportedly told users that a café video posted by Israeli Prime Minister Benjamin Netanyahu was AI-generated or a deepfake, after the clip was released to counter rumors that he was dead or injured. Reuters verified the video's location and date and later reported that Netanyahu publicly dispelled the death rumors. Reports said Grok's answers amplified doubts about the clip.
-
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations AIID ↗
The U.S. Court of Appeals for the Sixth Circuit sanctioned attorneys Van Irion and Russ Egli after reportedly finding more than two dozen fake citations and alleged factual misrepresentations in appellate briefs in Whiting v. City of Athens. The court asked whether generative AI had been used, but the attorneys reportedly did not answer that question. Public reporting described the filings as bearing hallmarks of AI hallucinations.
-
Purported Gemini-Generated AI Images Reportedly Claimed U.S. Delta Force Soldiers Were Captured by the IRGC AIID ↗
Images purportedly generated by Gemini were reportedly circulated on X and Facebook in multiple languages claiming U.S. soldiers had been captured by the Iranian Revolutionary Guard Corps during the war in Iran. AFP said the images contained Gemini markers and other visual inconsistencies. Their circulation allegedly contributed to wartime misinformation and risked distorting public understanding of the conflict, including reported amplification by Jill Stein.
-
DOJ Attorney Reportedly Used AI to File Brief With Purportedly Fabricated Quotes and Misstated Case Holdings AIID ↗
In Fivehouse v. U.S. Department of Defense, Assistant U.S. Attorney Rudy Renfer filed a response brief that the court reportedly said contained fabricated quotations and misstatements of case holdings. Renfer reportedly admitted he had used AI to help draft the inaccurate filing after losing an earlier draft. The court reportedly also identified similar fabricated quotations in other filings signed by Renfer.
-
Ars Technica Retracted Article After Purportedly AI-Generated Text Was Presented as Direct Quotes From Matplotlib Maintainer AIID ↗
Ars Technica retracted an article after purportedly AI-generated text was presented as direct quotations from a source who disputed having said them. The editor-in-chief reportedly acknowledged a standards failure and said the publication was not consistent with Ars policy on AI-generated material, and apologized to readers and to matplotlib maintainer Scott Shambaugh. An author reportedly later said he had inadvertently used an AI-paraphrased version of the source text as quotes.
-
Woolworths' Olive Chatbot Reportedly Generated 'Angry Mother' Anecdotes During Support Calls After Gemini Upgrade AIID ↗
Woolworths customers reported that its digital shopping assistant Olive allegedly generated humanlike personal anecdotes (e.g., claiming to have an angry mother) during customer-support interactions such as delivery rescheduling. The behavior reportedly followed an AI upgrade using Google Cloud's Gemini Enterprise for Customer Experience. Woolworths said it was adjusting Olive's responses to reduce irrelevant, misleading banter.
-
NZ News Hub Reportedly Used AI-Rewritten News Posts and Synthetic Images to Mislead New Zealand Facebook Users AIID ↗
NZ News Hub, a Facebook page that reportedly imitated the style of a New Zealand news outlet, allegedly used AI to rewrite real news stories and pair them with unlabeled synthetic images. According to 1News, the page published manipulated depictions of real people, including a deceased minor and bereaved parents, and dramatized emergency-related scenes in ways that could distort public understanding of local events and undermine trust in legitimate news and emergency information.
-
Purportedly AI-Generated Tasmania Tours Content Reportedly Misled Tourists Into Traveling to Nonexistent Weldborough Hot Springs AIID ↗
A purportedly AI-generated travel article on the Tasmania Tours website reportedly invented "Weldborough Hot Springs" and promoted them as a real attraction. Tourists allegedly traveled to the remote town of Weldborough in search of the site, while local businesses reportedly received repeated calls and visits from confused travelers asking how to find the nonexistent springs.
-
Grok Reportedly Generated False 'Unmasked' Images of ICE Agent, Purportedly Triggering Online Misidentification and Harassment in Minneapolis AIID ↗
After the fatal shooting of Renee Nicole Good in Minneapolis by an ICE officer, users on X reportedly asked Grok to "unmask" the masked agent shown in eyewitness footage. Grok reportedly generated a fabricated face that spread widely online, along with the false name "Steve Grove." The output and claim allegedly led to harassment and reputational harm against at least two uninvolved men.
-
Perplexity AI Reportedly Misstated CLL Research, Allegedly Contributing to Delayed Treatment and Prolonged Suffering AIID ↗
Joseph Neal Riley reportedly used Perplexity AI to self-diagnose a rare complication of chronic lymphocytic leukemia (CLL) and, based on that output, allegedly delayed an oncologist-recommended Ven-Obi treatment for about a year. His son, Benjamin Riley, alleges that Perplexity misstated the medical research it cited, a conclusion he purportedly later confirmed with the study's authors.
-
Purportedly AI-Generated Images and Videos Reportedly Spread Misinformation About Nicolás Maduro's Capture on X AIID ↗
Following the January 2026 U.S. raid and arrest of Venezuelan leader Nicolás Maduro, purportedly AI-generated images and videos circulated widely on platforms including X, reportedly depicting Maduro in fabricated scenarios. NewsGuard identified at least seven manipulated or synthetic visuals reaching over 14 million views, including AI-generated photos detected via Google Gemini's SynthID watermark.
-
National Weather Service Reportedly Published AI-Generated Forecast Map With Fabricated Idaho Town Names AIID ↗
A U.S. National Weather Service office reportedly posted an AI-generated wind forecast map for Camas Prairie, Idaho that contained fabricated and misspelled place names, including non-existent towns. The image was reportedly shared publicly on social media before being deleted and corrected. NWS confirmed a generative AI tool had been used to create the base map.
-
Purported Deepfake Impersonation of Elon Musk Used to Promote Fraudulent '17-Hour' Diabetes Treatment Claims AIID ↗
A purported deepfake video reportedly circulated online falsely depicting Elon Musk endorsing a nonexistent "17-hour" diabetes cure. The reported video promoted unverified health claims and appears to have been part of a scam ecosystem exploiting Musk's public credibility. Rapper Boosie Badazz reportedly encountered and amplified the video before its purported falsity was identified.
-
Google AI-Generated Search Summary Reportedly Falsely Implicated Canadian Musician in Sexual Offenses, Leading to Concert Cancellation AIID ↗
A Google Search AI-generated summary reportedly falsely stated that Canadian musician Ashley MacIsaac had been convicted of sexual offenses, apparently due to mistaken identity. After a venue reportedly relied on the AI-generated information, a scheduled concert was cancelled. The reported false summary caused reputational and economic harm and left the musician concerned for his personal safety. Google later amended the search results after the error was identified.
-
Attorney in Fletcher v. Experian Information Solutions, Inc. Reportedly Submitted Reply Brief with Purportedly AI-Generated Material Misrepresentations AIID ↗
In Fletcher v. Experian Information Solutions, Inc., the Fifth Circuit found that attorney Heather Hersh had used generative AI to draft a substantial portion of a reply brief that contained fabricated legal support and factual representations. The court first issued a show-cause order and later imposed a $2,500 sanction, linking the filing errors to unverified AI-generated output.
-
Grok AI Reportedly Generated Fabricated Civilian Hero Identity During Bondi Beach Shooting AIID ↗
Grok reportedly generated and repeated a fabricated civilian hero identity, "Edward Crabtree," following the Bondi Beach shooting in Sydney, Australia. The system reportedly cited a fake news article and misattributed heroic actions to this fictional individual during the unfolding emergency. Contemporaneous reporting identified Ahmed Al Ahmed as the real bystander who intervened and was injured during the attack.
-
Purportedly AI-Generated 'Eric Langford' Missing Boy Scout Hoax Circulating Across Multiple Social Media Platforms AIID ↗
A purportedly AI-generated fictional story falsely claimed that a Boy Scout named Eric Langford disappeared in New York in 1989 and reappeared in 2001 after being kidnapped. The reported hoax originated on the UNKNOWN Files YouTube channel and was repackaged into viral TikTok videos and AI-written blog posts promoted on Facebook, misleading millions of viewers and searchers about a fabricated missing-person case.
-
Reported Viral AI-Generated Photo Purportedly Shows Donald Trump Using a Walker AIID ↗
A fabricated image purporting to show U.S. President Donald Trump using a walker reportedly circulated widely on social media in mid-December 2025. Fact-checkers determined the image was AI-generated, citing visual anomalies and detection of Google's SynthID watermark. The image reportedly spread across multiple platforms and was shared by a political strategist, prompting public confusion and debunking by news outlets and AI detection tools.
-
Purported AI-Generated Image Depicting JD Vance and Usha Vance in Public Altercation Circulated on Social Media AIID ↗
A fabricated image purportedly depicting U.S. Vice President JD Vance arguing with his wife, Usha Vance, in a restaurant circulated on Facebook and X in December 2025. The image was later confirmed by its creator to have been generated using ChatGPT and falsely presented as an authentic photograph. The image was shared alongside speculative claims about the Vances' marriage.
-
Prominent AI Chatbots Allegedly Produced Incorrect UK Financial and ISA Guidance AIID ↗
Several major AI chatbots, including ChatGPT, Copilot, Gemini, and Meta AI, were reportedly found to have provided incorrect or misleading financial and insurance guidance for UK users. The systems allegedly advised exceeding ISA limits, misstated tax rules, gave wrong travel insurance requirements, and pointed users toward costly refund services.
-
NTB Report on Telenor Security Findings Was Withdrawn After AI Tool Allegedly Introduced Fabricated Quotes AIID ↗
NTB allegedly published a news story about Telenor's annual security report that contained purportedly AI-generated errors, including five reportedly fabricated quotes and a nonexistent "security director." The article was reportedly created with an external AI tool and was withdrawn the same morning. Telenor alerted NTB to the inaccuracies, and NTB apologized, citing improper AI use and initiating internal review of its newsroom practices.
-
Purportedly AI-Generated Fake Videos of Louvre Heist Reportedly Circulated Widely Online AIID ↗
After the October 19, 2025 jewel heist at the Louvre, purported deepfakes were reported to have circulated widely online, allegedly depicting the robbery despite being fabricated.. The clips were reportedly posted on Facebook, Douyin and RedNote, and they were noted to have featured morphing artifacts, disappearing objects, and partial Sora watermarks. AI Forensics and independent checks reportedly found the scenes inconsistent with the real Apollo Gallery, confirming the footage was not real.
-
West Midlands Police Reportedly Relied on Erroneous Copilot-Generated Intelligence in Maccabi Tel Aviv Away-Fan Ban Decision AIID ↗
West Midlands Police reportedly included inaccurate intelligence purportedly generated using Microsoft Copilot in materials used to justify banning Maccabi Tel Aviv supporters from attending a November 2025 Europa League match against Aston Villa. The reported Copilot-linked error, which referred to a match that had not taken place, was later acknowledged by Chief Constable Craig Guildford.
-
Google's Bard, Gemini, and Gemma AI Systems Allegedly Generated Defamatory Claims About Activist Robby Starbuck, Prompting Lawsuit AIID ↗
Conservative activist Robby Starbuck reportedly filed a defamation lawsuit against Google, alleging its Bard, Gemini, and Gemma AI systems generated false statements linking him to sexual assault and extremist activity. Starbuck claims the outputs caused reputational harm and sought over $15 million in damages. Google acknowledged the hallucinations as known LLM behavior and stated it works to minimize such inaccuracies. See also Incident 1247.
-
Purportedly AI-Generated Hunting Regulation Errors Reportedly Lead to Idaho Citation and Multi-State Warnings from Wildlife Agencies AIID ↗
A hunter in Idaho was reportedly cited for hunting a day early after relying on an AI-generated search result that misrepresented state regulations, pulling information from a failed proposal. Wildlife agencies in Idaho, Wyoming, Illinois, and Maine later warned of similar AI errors.
-
Purportedly AI-Generated Home Intruder Videos Allegedly Prompt Dozens of Dutch Police Call-Outs AIID ↗
Dutch police reported that children used purported AI tools to generate fake videos showing a homeless intruder inside their homes, which parents believed were real. The clips allegedly triggered dozens of emergency call-outs and at least two helicopter searches for nonexistent burglars. Police posted a TikTok warning after repeated false alarms, noting the strain on resources and urging families to stop the prank.
-
Bodycam Footage Reportedly Contradicted Purportedly ChatGPT-Generated Use-of-Force Narrative by Immigration Agent AIID ↗
Body-worn camera footage released in litigation over Operation Midway Blitz reportedly showed that an immigration agent used ChatGPT to generate a long-form use-of-force narrative based on minimal inputs. A federal judge found that multiple AI-assisted reports conflicted with contemporaneous video evidence, undermining their accuracy and credibility and raising concerns about the use of generative AI in official law enforcement reporting.
-
YouTube Channel Reportedly Posts Purported Deepfake Video of Rajat Sharma Announcing India-Bangladesh Conflict AIID ↗
A purported deepfake video depicting Indian journalist Rajat Sharma reporting on a potential India-Bangladesh war was uploaded to the YouTube channel The Real Report. Fact-checkers reportedly found no such broadcast existed and, according to their metrics, verified that the clip was likely AI-generated.
-
Multiple Generative AI Systems Reportedly Amplify False Information During Charlie Kirk Assassination Coverage AIID ↗
Multiple AI systems allegedly spread false claims in the aftermath of Charlie Kirk's assassination at Utah Valley University. Perplexity and Grok chatbots reportedly stated Kirk was alive, mischaracterized authentic video as satire, and wrongly identified Utah Democrat Michael Mallinson as the suspect. A Google AI Overview allegedly claimed Kirk was on Ukraine's Myrotvorets "enemies" list, a reported falsehood that echoed pro-Kremlin narratives.
-
Purportedly Taxpayer-Funded Deloitte Report for Australian Government Contains Alleged AI-Generated Citations and Fabricated Legal Quote AIID ↗
Australian academics reportedly identified fabricated references and a misattributed legal quote in a $439,000 Deloitte report for the Department of Employment and Workplace Relations on welfare compliance. Deleted citations allegedly referred to non-existent works, and a Federal Court judgment was misstated. Deloitte later acknowledged limited use of generative AI in preparing the report and issued a corrected version with a partial refund.
-
Google AI Overviews Reportedly Misrepresented Pizza Specials at Stefanina's in Wentzville, Missouri AIID ↗
Stefanina's, a family-owned restaurant in Wentzville, Missouri, reported that Google's AI Overviews displayed false specials, including nonexistent pizza deals. Customers allegedly misled by the AI became angry when the offers were not honored, leading the restaurant to publicly warn patrons not to rely on Google AI for menu information.
-
Purported Fictitious AI-Generated Citations in Supreme Court of Victoria Murder Case Filing Lead to Delay and King's Counsel Apology AIID ↗
Australian defense lawyer Rishi Nathwani KC reportedly filed submissions in a Supreme Court of Victoria murder case that included allegedly fictitious quotes and nonexistent case citations purportedly generated by AI. The errors were reportedly discovered by the judge's associates, causing a 24-hour delay in the proceedings. Nathwani apologized in court, taking full responsibility, while Justice James Elliott criticized the incident and reiterated that AI outputs must be independently verified.
-
Alleged Marine Park Orca Attack on 'Jessica Radcliffe' Reportedly an AI-Generated Hoax AIID ↗
Fact-checkers reported that a viral video claiming to show a marine trainer named Jessica Radcliffe killed by an orca was purportedly fabricated. Investigations found no record of Radcliffe's existence or of such an attack. The video reportedly used AI-generated voiceovers and unrelated footage, borrowing details from real orca incidents to appear credible. The hoax reportedly spread widely online over social media.
-
Chris Cuomo Amplifies Reportedly Labeled Deepfake Video of Alexandria Ocasio-Cortez, Purportedly Contributing to Misleading Political Narrative AIID ↗
NewsNation host Chris Cuomo reportedly shared on Instagram a video of Alexandria Ocasio-Cortez that was prominently labeled as a parody deepfake created with AI technology. In his commentary, Cuomo purportedly treated the statements in the video as genuine, using them to criticize Ocasio-Cortez for his audience.
-
ChatGPT Reportedly Suggests Sodium Bromide as Chloride Substitute, Leading to Bromism and Hospitalization AIID ↗
A published medical case report describes a 60-year-old man hospitalized for three weeks with severe bromide toxicity (bromism) after replacing dietary sodium chloride with sodium bromide purchased online. The patient reported making this substitution following consultation with ChatGPT, which allegedly suggested bromide as a chloride substitute without safety warnings. The harm included psychosis, electrolyte imbalances, dermatologic changes, and micronutrient deficiencies.
-
Purportedly AI-Generated Video of Tigers at Barasat Madrasa in West Bengal Reportedly Causes Panic and Student Absenteeism AIID ↗
A purportedly AI-generated video circulated on Facebook allegedly showing tigers roaming the campus of Ula Kalsara Qadria High Madrasa in Barasat, West Bengal. The video was reportedly created by a geography teacher using AI tools and allegedly led to panic among parents and students, with a sharp drop in attendance. The madrasa reportedly issued a show-cause notice to the teacher, who claimed the video was intended as an awareness exercise.
-
ChatGPT Reportedly Misleads Users About Soundslice Features, Allegedly Prompting Unplanned Product Development AIID ↗
ChatGPT reportedly misinformed users that Soundslice's music software could import ASCII tablature, a feature the company did not offer. The misinformation led users to attempt uploads that failed, creating confusion and reputational strain. Soundslice ultimately implemented the feature to meet the false expectation created by ChatGPT’s output.
-
Purported AI‑Edited Police Evidence Image Posted to Facebook by Westbrook Police Department in Maine AIID ↗
An evidence photo from a Westbrook, Maine, drug bust was reported to have been unintentionally altered by an AI‑powered editing tool before being posted to Facebook, changing packaging details and creating false visual elements. The altered image reportedly led to questions and concerns over the authenticity of police evidence. The Westbrook Police Department later confirmed the use of AI, explained the error occurred while adding their patch to the photograph, and issued a public apology.
-
Judges in New Jersey and Mississippi Admit AI Tools Produced Erroneous Federal Court Filings AIID ↗
Two U.S. federal judges, Julien Neals (D.N.J.) and Henry Wingate (S.D. Miss.), reportedly admitted that staff in their chambers used AI tools, ChatGPT and Perplexity, to draft rulings containing purportedly fabricated quotes, cases, and parties. The erroneous filings were reportedly docketed before review, prompting Senate and judicial inquiries. Both rulings were retracted.
-
South African Legal Team for Northbound Processing Reportedly Admits Legal Genius AI Produced Purportedly Non-Existent Case Law in Urgent Court Filing AIID ↗
In South Africa, the legal team for Northbound Processing reportedly admits that non-existent case citations in an urgent licensing dispute with the South African Diamond and Precious Metals Regulator were purportedly produced by the Legal Genius AI tool. The Johannesburg High Court found the fake references undermined the credibility of Northbound's submissions and referred the lawyers' conduct to the Legal Practice Council for investigation.
-
Purported AI-Generated Video Reportedly Depicts Illegal Tiger Sales in Bagerhat, Bangladesh AIID ↗
A purportedly AI-generated video circulating online in summer 2025 reportedly claimed to depict a "tiger market" in Bagerhat, Bangladesh, where Bengal tigers were allegedly being sold. The footage was reportedly generated using Google's Veo AI tool. The reported viral spread of this video allegedly misled viewers about the existence of illegal wildlife trafficking in Bangladesh.
-
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda AIID ↗
On June 25, 2025, the American Security Project produced a report outlining how several major U.S. LLMs, including ChatGPT, Microsoft Copilot, Google Gemini, and Grok, sometimes generated responses aligned with Chinese Communist Party propaganda or censorship when prompted in English and Simplified Chinese on sensitive topics. The study also found similar patterns in the Chinese-developed DeepSeek-R1 model.
-
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations AIID ↗
'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems,' published by Springer Nature in June 2025, reportedly contains numerous purportedly untraceable academic citations. Independent analyses by multiple researchers allegedly found that a substantial share of references in certain chapters could not be verified, including citations to journals that do not exist. Citation patterns reportedly appear consistent with known large language model hallucination behaviors.
-
Philippine Officials Reportedly Share Veo 3-Generated Video to Support Vice President Sara Duterte During Impeachment AIID ↗
Philippine Senator Ronald "Bato" dela Rosa and Davao City Mayor Sebastian "Baste" Duterte reportedly shared an AI-generated video made with Google's Veo 3, depicting fake students opposing Vice President Sara Duterte's impeachment. The clip was reportedly styled as a street interview and went viral with millions of views. Reportedly, dela Rosa faced backlash for spreading disinformation but defended the video's message, allegedly ignoring its fabrication.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.