AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
Filter incidents (1 active)
-
AI incident: sexual content (Meta, Apr 2025) AIID ↗
An AI Incident Database record involving sexual content, dated 11 April 2025. Risk classification, related incidents and the laws on record for this risk area.
-
Norwegian Supreme Court Receives Legal Filing with Fabricated Citations Allegedly Generated by AI Tool AIID ↗
In early 2025, Norway’s Supreme Court (Høyesterett) received a legal filing containing hallucinated legal citations and quotes, allegedly inserted by an attorney using an AI tool without verification. The fabricated sources were detected during standard review. While no sanctions were issued, the Court updated its guidance to lawyers, warning that AI use does not exempt them from professional responsibility.
-
Alleged AI-Generated Clone of Exante Brokerage Used to Defraud U.S. Investor via JPMorgan Account AIID ↗
Scammers used AI tools to clone the broker Exante and defraud at least one U.S. victim by registering a JPMorgan Chase account and replicating Exante’s trading interface. AI-generated fake documents, deepfakes, and cloned websites enabled the scheme. Exante, which does not operate in the U.S., confirmed the fraud and filed reports with multiple U.S. agencies.
-
Jailbroken Lovable AI Allegedly Used to Generate and Host Phishing Pages, Steal Credentials, and Bypass Security AIID ↗
The generative AI platform Lovable, which is used for building web apps, was reportedly jailbroken to create and host full phishing campaigns. These campaigns allegedly included credential-harvesting login pages, evasion techniques, and real-time exfiltration via services like Telegram and Firebase. The AI system was reportedly used for generating the phishing content and and then deploying it live on a URL hosted under its own subdomain.
-
Jiushi Autonomous Delivery Vehicle Reportedly Dragged Fallen Electric Scooter During Delivery Run in Xianyang, Shaanxi AIID ↗
A Jiushi autonomous delivery vehicle reportedly operating on a delivery route in Xianyang, Shaanxi, was filmed dragging a fallen electric scooter that had allegedly been left in the road after an earlier traffic incident. Company statements said the vehicle attempted to avoid the scooter but failed to fully recognize its shape and position, causing part of it to become caught under a wheel. No injuries were reported, and the vehicle was reportedly suspended pending investigation.
-
Malaysian Teenager Allegedly Arrested for Creating and Selling AI-Generated Deepfake Images of Schoolmates and Alumni in Johor AIID ↗
Authorities in Johor, Malaysia reportedly arrested a 16-year-old student who allegedly used AI-enabled tools to generate and sell deepfake images depicting schoolmates and former students. According to police, the images were created from social media photos and distributed online for payment. The alleged activity affected dozens of victims, including minors, some of whom may have been unaware of the misuse.
-
Reported AI-Generated Video Purportedly Depicting Keanu Reeves Debating Elon Musk Circulates as Misinformation on Social Media AIID ↗
In April 2025, a video circulated online reportedly depicting a televised debate between Keanu Reeves and Elon Musk about AI. The video, posted by the YouTube channel Voices of Change, purportedly used AI-generated voice and visual content to simulate the event. Independent analysis found signs of deepfake audio and imagery, and no credible evidence supported the event's existence.
-
Deepfake Job Applicant Allegedly Used AI Tools to Apply for Remote Role at U.S. Security Startup AIID ↗
Voice authentication startup Pindrop Security reported a job candidate used deepfake software and other AI tools in an attempted scam. This is part of a growing trend in international scammers using AI tools to apply for remote US-based jobs, sometimes successfully.
-
Purported Deepfake Depicts Altercation Between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape AIID ↗
A purported AI‑generated deepfake video circulated online falsely depicting a physical altercation between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape. The footage reportedly caused public confusion and risked damaging relations between Bougainville and Papua New Guinea. Toroama reportedly condemned the video as false and malicious, as well as potentially destabilizing, urging stronger action against misleading AI‑generated content.
-
Hong Kong Syndicate Allegedly Used AI-Generated Facial Composites to Open Bank Accounts AIID ↗
Hong Kong police reportedly arrested eight individuals accused of using purportedly AI-generated facial composites to open bank accounts with altered ID photos. Of 44 applications, 30 reportedly succeeded after passing online identity checks. The accounts were then allegedly used to apply for loans and make credit card purchases totaling HK$860,000, and to launder over HK$1.2 million in suspected criminal proceeds. Police linked the operation to local triad-affiliated fraud networks.
-
Alleged Deepfake Investment Scam in Spain Defrauds 208 Victims of €19 million ($20.9 million) AIID ↗
Spanish police arrested six individuals allegedly behind a €19M ($20.9M) global investment scam powered by AI. The operation used deepfake ads featuring national celebrities to deceive victims, many of whom were selected through targeting algorithms. Scammers posed as financial advisors and fake officials, cycling through romance baiting, investment fraud, and recovery scams. AI-generated content amplified trust and engagement.
-
Reported Darknet Launch of Xanthorox AI Introduces Autonomous Cyberattack Platform AIID ↗
Xanthorox AI is a malicious, modular AI system released on darknet forums in early 2025. Designed from scratch for offensive cyber operations, it runs on private infrastructure and includes models for code generation, phishing, malware, social engineering, and real-time voice/image input. Its release represents a deliberate deployment of an autonomous attack platform.
-
Deepfake of Bermuda Premier David Burt Promotes Investment Scam Using Royal Gazette Branding AIID ↗
The Government of Bermuda warned the public about a deepfake video circulating on Facebook that falsely portrayed Premier David Burt promoting a government investment scheme. The deepfake video reportedly mimicked the branding of The Royal Gazette and was linked to fraudulent social media accounts. Authorities confirmed the content was fake and urged the public to report such scams and to be vigilant about them.
-
AI incident: sexual content (Apr 2025) AIID ↗
An AI Incident Database record involving sexual content, dated 4 April 2025. Risk classification, related incidents and the laws on record for this risk area.
-
Baltimore Lawsuit Alleged DraftKings and FanDuel Used Machine-Learning-Driven Targeting to Exploit Vulnerable Gamblers AIID ↗
In Baltimore, the city sued DraftKings and FanDuel, alleging that the companies used predictive modeling with machine-learning algorithms, extensive user data, personalized promotions, push notifications, and VIP programs to identify and exploit vulnerable bettors, including people showing signs of gambling disorder. The complaint alleges these systems were designed to maximize user lifetime value and contributed to financial and public-health harms among Baltimore residents.
-
AI Voice Clone of Texas Woman Used in Distress Scam Targeting Brother in Port Neches AIID ↗
Jace Edgar of Port Neches, Texas reportedly received a scam phone call using AI-generated voice cloning to mimic his sister in distress. Believing she had been in an accident, Edgar began to act before noticing the caller avoided direct questions. When he contacted his sister, she was unharmed and unaware of the call. Authorities confirmed this was part of a broader rise in AI-powered scams, urging the public to stay vigilant and avoid sharing personal info with unknown callers.
-
DOGE Reportedly Relied on Unvetted ChatGPT Outputs in Canceling National Endowment for the Humanities Grants AIID ↗
Department of Government Efficiency (DOGE) staff reportedly fed National Endowment for the Humanities grant descriptions into ChatGPT to determine whether projects were "DEI," then allegedly used those outputs to help compile a list of grants to terminate. Beginning in April 2025, NEH canceled awards and clawed back funding, reportedly disrupting humanities organizations and projects nationwide after officials allegedly relied on a purportedly flawed, insufficiently vetted AI screening process.
-
Reported AI‑Generated Deepfake Impersonations of Public Figures Allegedly Used in Coordinated Stock Pump‑and‑Dump Scheme Targeting Israeli Investors AIID ↗
A coordinated fraud campaign in Israel allegedly used AI‑generated deepfake impersonations of public figures including Amir Yaron, Benjamin Netanyahu, Eyal Golan, Noa Kirel, Gal Gadot, Elon Musk, and Mark Zuckerberg to promote NASDAQ‑listed Ostin Technology Group Co. Ltd. (OST) in a pump‑and‑dump scheme. Paid social media ads, WhatsApp groups, and fake investment platforms reportedly lured investors before the stock collapsed in early July 2025, causing major reported losses.
-
Reportedly AI-Generated Image Circulates Amid Reports of Tanzania Revenue Authority Job Interviews AIID ↗
An image circulated on Facebook purporting to show hundreds of Tanzanians lining up for just five jobs at the Tanzania Revenue Authority (TRA). The photo, reportedly AI-generated, gained traction shortly after TRA invited over 100,000 applicants for interviews on March 29–30. Though TRA had announced more than 1,500 openings, the image misrepresented the situation, stoking public anxiety during a period of high unemployment.
-
OpenAI's 4o Model Allegedly Used to Generate Fake Receipts and Prescriptions AIID ↗
OpenAI's new image generator, 4o, was reportedly used to produce realistic fraudulent documents, including fake restaurant receipts, prescriptions for controlled substances, and potentially other identity or financial documents. Users demonstrated how the model could be prompted to bypass safety restrictions to be misused for expense fraud, medical forgery, and other various forms of document falsification.
-
AI incident: sexual content (Gennomis By Ai Nomis, Mar 2025) AIID ↗
An AI Incident Database record involving sexual content, dated 31 March 2025. Risk classification, related incidents and the laws on record for this risk area.
-
GPT-4o Allegedly Reinforced California Man Michael Lines's Delusions Before Suicide Attempt AIID ↗
In March 2025, Michael Lines, a 34-year-old California man, allegedly spent weeks discussing religious delusions with GPT-4o after disclosing his bipolar disorder and medication use. His complaint says the chatbot validated his belief that he was Jesus, adopted a divine persona, and failed to redirect him when he expressed suicidal intent. Lines later overdosed and survived after law enforcement found him.
-
AI incident: sexual content (Mar 2025) AIID ↗
An AI Incident Database record involving sexual content, dated 25 March 2025. Risk classification, related incidents and the laws on record for this risk area.
-
Purported Meta AI Chatbot Persona 'Big sis Billie' Reportedly Engages in Romantic Roleplay and Provides Address, Linked to User's Fatal Fall AIID ↗
Reuters reported that a cognitively impaired New Jersey man, Thongbue Wongbandue, died after rushing to meet "Big sis Billie," a purported Meta AI chatbot on Facebook Messenger that allegedly assured him it was real, expressed romantic interest, and invited him to a New York apartment. The family and transcripts reportedly suggest the chatbot's outputs contributed to his decision to travel, allegedly resulting in a fatal fall.
-
Fact-Checking Finds Reportedly AI-Generated Video Misattributed Hypertension Cure Endorsements to Taiwo Ajai-Lycett and Chinonso Egemba AIID ↗
Fact-checking reports that a purported AI-generated video circulated on Facebook depicting veteran actor Taiwo Ajai-Lycett discussing a hypertension diagnosis and promoting an unproven treatment by influencer Chinonso Egemba. According to the report, the video exhibited signs of AI generation, including unnatural speech and mismatched lip movements. Both Ajai-Lycett and Egemba have denied involvement, and no credible medical evidence supports the claimed cure.
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
What is recorded in each incident?
What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
Does an incident mean wrongdoing was proven?
No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
How current is the incident data?
It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
Does this page include the full incident reports?
No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.