AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report AIID ↗
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
-
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response AIID ↗
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing
-
Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money AIID ↗
Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.
-
Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool AIID ↗
In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.
-
Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida AIID ↗
A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.
-
Starship Technologies Delivery Robot Reportedly Injures Arizona State University Employee AIID ↗
A semi-autonomous delivery robot operated by Starship Technologies reportedly struck a pedestrian employed by Arizona State University on the campus sometime in September 2023, purportedly causing injuries after abruptly reversing into her. The robot is reported to have initially knocked the pedestrian down, then moved toward her again while she was still on the ground. The company reportedly offered the victim promo codes and insurance information as an apology. On September 19, 2024, 404 Media
-
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba AIID ↗
Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.
-
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims AIID ↗
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
-
AI-Generated Media Reportedly Used in Russian Disinformation Campaign in Moldova AIID ↗
Russian-linked entities allegedly deployed AI-generated images and videos to spread disinformation aimed at swaying Moldova’s referendum on E.U. membership. The AI-enhanced media campaign included fabricated stories and doctored visuals, the purpose of which was reportedly designed to amplify fear and undermine pro-E.U. sentiment in the days leading up to the referendum.
-
Purportedly AI-Generated Audio Allegedly Fabricates Biden's Admission of Role in Pakistani Political Crisis AIID ↗
A purported deepfake audio file is alleged to have falsely claimed that U.S. President Joe Biden conspired with Pakistan's Army Chief, General Syed Asim Munir, to remove former Prime Minister Imran Khan in 2022. Widely shared online, the audio is reported to have exploited generative AI to spread political misinformation.
-
Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang AIID ↗
A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.
-
Purported Deepfake of Brian May Allegedly Exploited in Scam Offering Fake Queen Backstage Tickets AIID ↗
Scammers allegedly created an AI-generated deepfake of Queen guitarist Brian May, reportedly posting a video on TikTok in which the fake May offers backstage tickets to a Queen concert. The real Brian May reportedly warned fans about this "disgusting" scam, emphasizing that Queen has no tour dates planned and does not sell backstage access.
-
Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise AIID ↗
Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.
-
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion AIID ↗
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
-
ESPN's AI Coverage Reportedly Overlooks Alex Morgan in Her Final Match Recap AIID ↗
ESPN's AI-generated recap of Alex Morgan's final professional soccer match reportedly failed to mention her significant retirement moment, instead providing a standard rundown that missed the emotional context.
-
Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam AIID ↗
Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.
-
Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries AIID ↗
Amazon's Alexa was found to provide politically biased responses when asked about the 2024 presidential candidates. It refused to give reasons to vote for Donald Trump, citing neutrality, while offering detailed endorsements for Kamala Harris. Amazon labeled the discrepancy an "error" and reportedly corrected it.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook AIID ↗
A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.
-
53% of American and British Businesses Report Attacks by AI-Powered Deepfake Scams in 2024 AIID ↗
According to Medius, Deepfake scams have targeted 53% of businesses in the U.S. and U.K., with 43% falling victim. Using AI to create realistic fake videos and audio of corporate executives, scammers have successfully stolen millions, including $25 million from British engineering group Arup.
-
Clearview AI Reportedly Faces $33.7 Million Fine for Violating GDPR with Biometric Data Harvesting AIID ↗
Clearview AI was reportedly fined $33.7 million by the Dutch data protection authority for allegedly creating an illegal facial recognition database by scraping billions of images from the Internet without consent. The company allegedly used AI to convert these images into biometric data and sold the service to law enforcement. This act was reportedly in violation of privacy laws and the GDPR.
-
Russian Disinformation Campaign Allegedly Used Fake News Site 'KBSF-San Francisco News' and Deepfake Video to Falsely Accuse Kamala Harris of 2011 Hit-and-Run AIID ↗
A Russian disinformation campaign allegedly used a fake news site, "KBSF-San Francisco News," and an AI-generated deepfake video to falsely accuse Kamala Harris of a 2011 hit-and-run accident in San Francisco. The deepfake featured a fabricated African-American victim, whose AI-generated testimony spread widely across social media. Microsoft identified the hoax as part of Russian cyber influence operations targeting the 2024 U.S. election, with the site registered in Iceland.
-
Bias in AI Deepfake Detection Undermines Election Security in Global South AIID ↗
AI deepfake detection tools are reportedly failing voters in the Global South due to biases in their training data. These tools, which prioritize English language and Western faces, show reduced accuracy when detecting manipulated content from non-Western regions. As a result of this detection gap, election integrity faces threats from and the amplification of misinformation, which leaves journalists and researchers with inadequate resources to combat the issue.
-
Elon Musk Reportedly Shared an AI-Generated Image Depicting Kamala Harris Dressed as a Communist Ruler AIID ↗
Elon Musk reportedly shared an AI-generated image on X depicting Kamala Harris as a "communist dictator" in response to her post about Donald Trump's political intentions.
-
AkiraBot Reportedly Used OpenAI to Spam Website Chats and Contact Forms at Scale AIID ↗
SentinelLabs reported that unknown operators used AkiraBot, a Python framework, plus OpenAI's chat API to generate customized SEO spam and bypass CAPTCHAs, posting via SMB websites' contact forms and Reamaze-style chat widgets. Researchers assessed >400k domains were targeted and ≥80k successfully spammed since 09/01/2024. OpenAI said the API key was disabled after disclosure.
-
National Company Law Tribunal Reportedly Relied on AI-Hallucinated Precedents in Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd AIID ↗
In Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd., India's National Company Law Tribunal (NCLT) reportedly admitted insolvency proceedings against Essel Infraprojects after relying on six purported precedents later found to be fabricated or materially inaccurate. The appellate tribunal upheld the ruling, but the Supreme Court later invalidated both decisions and sent the insolvency petition back to the NCLT for a new ruling.
-
Purportedly AI-Manipulated Video Reportedly Misrepresented Bulgarian DPS Figure Ahmed Dogan and Spread via TikTok and Facebook AIID ↗
A reportedly AI-manipulated video appeared to repurpose footage of Ahmed Dogan, honorary chairman of Bulgaria's Movement for Rights and Freedoms (DPS), by overlaying synthetic audio that made him seem to urge party members to protest in defense of his wealth. The clip reportedly originated from a satirical TikTok account and was later circulated on Facebook by anonymous profiles.
-
South Korea Reportedly Experienced a Surge of Explicit Deepfake Pornography AIID ↗
At the end of August 2024, South Korean authorities reportedly began investigating a significant surge in the creation and dissemination, often via Telegram, of explicit deepfake pornography created without consent from the stolen social media content of female classmates, teachers, and neighbors.
-
Video with Reportedly AI-Generated Media Purported to Show Croatian Immunologist Stipan Jonjić Promoting Anti-Parasite Product on Facebook AIID ↗
A Facebook page reportedly posted a video that purported to show Croatian immunologist Stipan Jonjić endorsing an anti-parasite product and recommending it over conventional treatment. The clip was reported to use AI-generated or manipulated media, and Jonjić denied involvement. A woman was reported to have purchased the product after seeing the ad.
-
Florida Police Reportedly Wrongfully Arrested Commercial Crabber Robert Dillon After Allegedly False Facial Recognition Match AIID ↗
Florida police reportedly arrested commercial crabber Robert Dillon in August 2024 after the statewide FACES facial recognition system purportedly identified him as a possible match to a suspect shown in grainy surveillance images from Jacksonville Beach. Dillon reportedly lived more than 300 miles away and said he had never visited the city. He reportedly spent a night in jail and posted bond using his truck title.
-
Generative AI Allegedly Used to Facilitate $255,000 Real Estate Fraud Scheme AIID ↗
A real estate scam is reported to have used AI-generated phishing emails to impersonate a title company lawyer, tricking homebuyer Raegan Bartlo into wiring $255,000 to a fraudulent account. The emails were alleged to be convincing, with no grammatical errors or tone issues. Bartlo recovered part of the funds but lost $112,000.
-
Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography AIID ↗
Seth Herrera, a U.S. Army soldier at Joint Base Elmendorf-Richardson (JBER), is accused of using artificial intelligence to generate pornography depicting minors with whom he was in contact.
-
Megalopolis Trailer Included Fake AI-Generated Quotes Attributed to Film Critics AIID ↗
Lionsgate pulled the trailer for "Megalopolis" after it was discovered to contain fake quotes from well-known film critics, generated by AI. The quotes falsely criticized Francis Ford Coppola's previous films. The incident was attributed to an error in vetting by marketing consultant Eddie Egan. Lionsgate has since parted ways with Egan and apologized to Coppola and the critics affected by the fabricated content.
-
Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case AIID ↗
During workplace training at Bunbury Prison in Western Australia, a trainer used Microsoft's Copilot AI chatbot to generate case study scenarios. The chatbot produced a scenario that included the real name of a former employee involved in a sexual harassment case, revealing sensitive information.
-
AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump AIID ↗
Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.
-
Trump Reportedly Shares Purportedly AI-Generated Images Falsely Suggesting Taylor Swift Endorsement AIID ↗
Donald Trump reportedly shared images that were purportedly generated by AI on social media that are alleged to have depicted Taylor Swift endorsing him for the upcoming election. The images reportedly included Swift dressed as Uncle Sam and fans wearing "Swifties for Trump" shirts.
-
Microsoft Copilot Falsely Accuses Journalist Martin Bernklau of Crimes AIID ↗
Microsoft's Copilot is reported to have falsely accused veteran court reporter Martin Bernklau of committing serious crimes, including child abuse and fraud. The tool is described as having generated defamatory content that not only accused Bernklau of multiple crimes he covered as a journalist but also provided his personal contact details. Attempts by Microsoft to remove the false entries were only temporarily successful, as the defamatory information reportedly reappeared.
-
San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law AIID ↗
In August 2024, the San Francisco City Attorney’s Office filed a first-of-its-kind lawsuit against 16 websites accused of using generative AI to create and distribute nonconsensual pornographic deepfakes, including images of minors. The sites, which had over 200 million visits in six months, invited users to upload real images to generate explicit fakes. By March 2025, 11 of the targeted websites had shut down following legal pressure.
-
ChatGPT Allegedly Defamed Norwegian User by Inventing Child Homicide and Imprisonment AIID ↗
In August 2024, ChatGPT is reported to have falsely claimed that Norwegian citizen Arve Hjalmar Holmen had killed his two sons and been sentenced to 21 years in prison. The fabricated response allegedly included specific details about the supposed crime, despite Holmen never being accused or convicted of any offense. The incident prompted a GDPR complaint for defamation and inaccurate personal data.
-
Deepfake Elon Musk Videos Have Reportedly Contributed to Billions in Fraud AIID ↗
Scammers used AI to create deepfake videos of Elon Musk promoting fraudulent investment opportunities. Over time, these scams have reportedly led to billions in investor losses. The deepfakes also use voice cloning technology. They have been distributed on social media and YouTube. In particular, they target the elderly, such as 82-year-old Steve Beauchamp, to invest significant sums. Despite efforts by platforms to remove these videos, the scams continue to proliferate.
-
Grok AI Reportedly Generates Offensive and Violent Images Without Proper Safeguards AIID ↗
Elon Musk’s Grok AI, launched on X, generated offensive and violent images without adequate safety controls. The AI produced deepfakes of public figures like Taylor Swift, Kamala Harris, and Alexandria Ocasio-Cortez, as well as copyrighted characters such as Mickey Mouse in inappropriate scenarios. Despite claiming adherence to certain content guidelines, Grok's outputs included politically charged and explicit imagery
-
Reported Glitch in Waymo Self-Driving Cars Purportedly Triggers Regular All-Night Honking in San Francisco AIID ↗
Waymo self-driving cars in San Francisco's South of Market neighborhood reportedly began honking at each other late at night, disturbing residents' sleep. The autonomous vehicles, reportedly using a parking lot for ride pauses, triggered honking due to a purported glitch in their algorithms. Despite residents' complaints, the issue allegedly persisted for weeks until Waymo acknowledged the problem and began working on a fix.
-
Grok AI Chatbot Reportedly Spreads Unfounded Rumors About Trump’s Dentures AIID ↗
Grok, X’s AI-powered chatbot, reportedly spread unsubstantiated claims about former President Trump’s alleged dentures during his interview with Elon Musk. The AI-generated summary is alleged to have falsely stated that Trump’s speech issues were due to missing dentures, despite no evidence. The post was quickly removed, but the incident is an example of concerns over Grok's tendency to amplify misinformation.
-
TikTok AI System Used to Amplify Election Disinformation by Foreign Networks AIID ↗
AI-generated misinformation on TikTok, driven by foreign networks, has flooded the platform with false narratives about the 2024 U.S. presidential election. Thousands of videos spreading political lies were identified, potentially influencing millions of users. Despite TikTok’s efforts to remove these accounts, the AI-driven disinformation campaign continues to challenge the integrity of the election.
-
Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China AIID ↗
In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensiv
-
Apple Intelligence Allegedly Flags Scam Messages as High Priority AIID ↗
Apple’s AI notification summarization and prioritization feature, part of the Apple Intelligence update, has reportedly flagged scam and phishing messages as high-priority, and is allegedly misleading users into trusting fraudulent communications. By rephrasing and condensing messages, the system is allegedly amplifying scam risks inadvertently and reportedly increasing the likelihood of financial harm for users.
-
Reported AI-Manipulated Video Depicts Donald Trump Endorsing Peter Obi and Criticizing Bola Tinubu AIID ↗
A widely circulated video reportedly falsely depicts Donald Trump endorsing Nigerian politician Peter Obi and criticizing President Bola Tinubu. FactCheckAfrica confirmed the video was false, originally sourced from a 2017 U.S. presidential interview about Trump's first 100 days in office. AI-generated audio and altered visuals were reportedly used to fabricate a politically charged statement unrelated to the original content.
-
Norwegian Student Reportedly Used AI-Generated Deepfake Videos in Spanish Coursework at University of South-Eastern Norway AIID ↗
A student at the University of South-Eastern Norway reportedly submitted multiple deepfake videos for Spanish coursework, featuring an AI-generated likeness and synthetic voice. Faculty reportedly noted unnatural facial movements and inconsistent language ability. The case was reportedly ruled academic misconduct, resulting in annulled grades and a year-long suspension, marking one of Norway's first confirmed deepfake-related cheating cases.
-
South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations AIID ↗
Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.
-
AI-Generated Fake 'True Crime' Video About Non-Existent Littleton Murder Goes Viral AIID ↗
An AI-generated "true crime" video on YouTube falsely depicted a Littleton man's "secret gay love affair" and murder by his stepson. The 25-minute video, which garnered nearly 2 million views, fabricated details and used deepfake technology to deceive viewers into believing the story was real. Despite being flagged as false by local authorities and lacking credible sources, the video sparked widespread misinformation and outrage online.
-
TikTok Network Amplifies AI-Generated Nazi Propaganda and Hate Speech AIID ↗
A coordinated neo-Nazi network on TikTok used AI-generated media, including Hitler speeches, to spread Nazi propaganda and extremist content, violating TikTok’s hate speech policies. The network evaded platform moderation through coded language, imagery, and music, with some accounts accumulating millions of views. TikTok’s algorithm further amplified the reach of this content, despite community guidelines.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.