AIPolicyTracker

AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Reset

1,699 incidents · page 14 of 34

  1. #918 · 1 report

    AI-Aided Scam in Thailand Allegedly Impersonates Police to Defraud 163 Victims AIID ↗

    Thai police arrested Ramil Pantawong and Thanawut Kanyaphan for allegedly using AI technology to impersonate police officers in a call scam. Based in Poipet, Cambodia, the gang tricked 163 victims, the most prominent of whom was Thai-British beauty queen Charlotte Austin, who lost 4 million baht (approximately $118,000 USD). Victims were falsely told they were under investigation and instructed to transfer money.

    Deployer: Thanawut Kanyaphan, Ramil Pantawong, Poipet Based Scam Gang · Developer: Deepfake Technology Developers · Harmed: General Public In Thailand, Charlotte Austin, 163 Victims Of Poipet Based Scam Gang

  2. #938 · 6 reports

    Purportedly AI-Assisted Impersonation of Martin Henderson in Romance Scam Leads to Reported NZ$375,000 Fraud AIID ↗

    An alleged online romance scam exploiting AI-assisted impersonation defrauded a woman, "Lea," of NZ$375,000 over two years. The scammer allegedly used AI-generated voice messages and deceptive text communication to pose as New Zealand actor Martin Henderson and is reported to have built up a relationship beginning in early 2023. The victim, believing the scam was real, reportedly relocated to New Zealand in December 2024, only discovering the fraud in February 2025.

    Deployer: Unknown Scammer Impersonating Martin Henderson, Scammers · Developer: Deepfake Technology Developers, Large Language Model Developers, Synthetic Audio Generation Technology Developers · Harmed: Martin Henderson, Lea (Pseudonym)

  3. #920 · 1 report

    Alleged Deepfake Scam Reportedly Promoted Trump Golden Eagles Project as Investment Opportunity AIID ↗

    Reports surfaced of a purportedly AI-generated scam falsely promoting the Trump Golden Eagles Project. The purported deepfake videos of Donald Trump, Bank of America CEO Brian Moynihan, and Elon Musk are alleged to have claimed that buyers could trade collectible coins for cash or Tesla stock. A Bay Area veteran reportedly lost $2,500 believing he would earn millions. The scam reportedly circulated via Telegram, and Bank of America denied any involvement.

    Deployer: Unknown Scammers Behind The Trump Golden Eagles Scam, Scammers, Telegram Based Financial Scam Network, Investment Scam Operators · Developer: Deepfake Technology Developers, Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Wesley Skelton, Tesla, Spacex, Public Trust In Financial Institutions, General Public Of The United States, General Public, Epistemic Integrity, Elon Musk, Donald Trump, Brian Moynihan, Bay Area Residents Targeted By Trump Golden Eagles Scam, Bank Of America

  4. #1069 · 33 reports

    Purported Graphite Spyware Linked to Paragon Solutions Allegedly Deployed Against Journalists and Civil Society Workers AIID ↗

    Researchers at Citizen Lab and Censys reportedly identified spyware infections involving Graphite, a tool attributed to Israeli firm Paragon Solutions. The spyware was allegedly deployed against civil society actors, including journalists and aid workers, through a zero-click WhatsApp exploit. WhatsApp notified over 90 targeted individuals. Evidence reportedly suggests deployments in multiple democratic countries.

    Deployer: York Regional Police Service (Ontario, Canada), Unidentified law enforcement or intelligence entity (Singapore), Unidentified law enforcement or intelligence entity (Israel), Unidentified law enforcement or intelligence entity (Denmark), Unidentified law enforcement or intelligence entity (Cyprus), Unidentified law enforcement or intelligence entity (Australia), Peel Regional Police (Ontario, Canada), Ontario Provincial Police · Developer: REDLattice, Paragon Solutions · Harmed: Refugees in Libya, Privacy, National security and intelligence stakeholders, Mediterranea Saving Humans, Luca Casarini, Journalists, Humanitarian workers, Giuseppe "Beppe" Caccia

  5. #924 · 2 reports

    Alleged Deepfake Scam Uses BBC Presenter Naga Munchetty’s Image to Promote Fraudulent Investment Scheme AIID ↗

    BBC presenter Naga Munchetty was reportedly targeted in an AI-generated scam using deepfake images and fake news articles to promote a fraudulent investment scheme. Scam ads on social media allegedly featured manipulated images of Munchetty and linked to a fake BBC article directing users to a cyber trading website. The BBC legal team is reported to have taken action to remove the fraudulent site.

    Deployer: Scammers Impersonating Naga Munchetty, Scammers · Developer: Deepfake Technology Developers · Harmed: Naga Munchetty, Bbc, Social Media Users, Fans Of Naga Munchetty

  6. #1199 · 1 report

    Purportedly AI-Generated Deepfake Image Reportedly Falsely Links Canadian Prime Minister Mark Carney to Jeffrey Epstein AIID ↗

    A purportedly AI-generated image that reportedly circulated on social media falsely depicted Canadian Prime Minister Mark Carney in a swimming pool with Jeffrey Epstein, implying involvement in Epstein's sex crimes. The manipulated image reportedly spread widely in early 2025, first around the time of Justin Trudeau's announced resignation, then after Carney became Liberal Party leader, and was reportedly promoted by Canadian and U.S. conservative accounts.

    Deployer: Unknown Actor, Social Media Accounts · Developer: Deepfake Technology Developers, Image Generation Technology Developers · Harmed: Mark Carney, Liberal Party Of Canada, General Public Of Canada, General Public, Epistemic Integrity

  7. #913 · 1 report

    AI incident: sexual content (Jan 2025) AIID ↗

    Scammers, allegedly linked to the Yahoo Boys, are using AI-generated news videos to blackmail victims in sextortion schemes. The videos impersonate news organizations, featuring fabricated reports that accuse victims of crimes, including explicit content distribution. Tutorials for creating these clips are reportedly shared on Telegram, with scammers leveraging the fake broadcasts to pressure victims into paying.

    Deployer: Yahoo Boys, Brouteurs, Scammers In Nigeria, Scammers In Ghana, Scammers In West Africa · Developer: Deepfake Technology Developers · Harmed: Unnamed Victims In Sextortion Schemes, Teenagers Targeted In Sextortion Scams, News Organizations Impersonated By Scammers, Cnn

  8. #1049 · 1 report

    AI Tools Reportedly Used to Fabricate Image of 5,000-Naira Nigerian Banknote Featuring President Bola Tinubu AIID ↗

    An image circulated on Nigerian social media in late January 2025 purporting to show a newly issued 5,000-naira banknote featuring President Bola Tinubu. The Central Bank of Nigeria denied the claim, and fact-checkers reported that the image was likely generated using an AI tool linked to the platform X, based on a visible Grok watermark.

    Deployer: Unidentified Social Media Users, X (Twitter) Users · Developer: Xai · Harmed: Public Trust In The Naira, General Public Of Nigeria, Central Bank Of Nigeria

  9. #1052 · 1 report

    Purported AI-Generated Video Reportedly Depicts Trump Criticizing Former Kenyan Deputy President Rigathi Gachagua AIID ↗

    In late January and early February 2025, a video circulated on Facebook purporting to show U.S. President Donald Trump calling former Kenyan deputy president Rigathi Gachagua a "criminal" and criticizing his alleged misuse of AI. However, fact-checkers have reported the video was AI-generated. The footage appears to have been manipulated from Trump's inauguration speech on January 20, 2025, with reported mismatched lip movements and audio overlays.

    Deployer: Unknown · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Rigathi Gachagua, Donald Trump, General Public Of Kenya, United States Kenya Relations, Kenyan Political Discourse

  10. #1577 · 2 reports

    Lawyer in Amarsingh v. Frontier Airlines Sanctioned Over Court-Identified ChatGPT Citation Errors AIID ↗

    In Amarsingh v. Frontier Airlines, the Tenth Circuit sanctioned attorney Kusmin L. Amarsingh after finding that her appellate brief included fabricated case citations and misattributed legal authority generated by ChatGPT and not verified before filing. The court ordered a $1,000 payment to Frontier and referred the matter to Maryland disciplinary authorities.

    Deployer: Pro Se Litigants, Lawyers, Kusmin L. Amarsingh · Developer: Openai, Large Language Model Developers, Chatbot Developers, Ai Research Tool Developers · Harmed: United States Court Of Appeals For The Tenth Circuit, Judicial Integrity, Frontier Airlines, Epistemic Integrity

  11. #916 · 2 reports

    AI incident: sexual content (JanitorAI, Jan 2025) AIID ↗

    In January 2025, James Florence Jr. of Plymouth, MA, agreed to plead guilty to cyberstalking charges involving the alleged use of AI tools like CrushOn.ai and JanitorAI. The U.S. Attorney’s Office reports the harassment spanned 2014–2024, though AI-driven tactics reportedly began around 2017. Florence allegedly created deepfake pornographic images, programmed AI chatbots to impersonate victims, distributed doctored content, exposed personal information, and encouraged online harassment.

    Deployer: Synthetic media creators, James Florence Jr., Deepfake creators · Developer: Synthetic media generation technology developers, Synthetic image generation technology developers, JanitorAI, Deepfake technology developers, CrushOn.AI, Chatbot developers · Harmed: Women and girls, Women, Victims of non-consensual deepfakes, Victims of deepfake abuse, Six other women and a 17-year-old girl targeted by James Florence Jr., Privacy, Families of victims targeted by James Florence Jr., Epistemic integrity

  12. #1143 · 2 reports

    Former Namibian First Lady Monica Geingos's Likeness Reportedly Used in Purported AI-Generated Video Investment Scams AIID ↗

    Namibia's former First Lady Monica Geingos publicly warned that scammers are using purportedly AI-manipulated videos to impersonate her and promote fake forex schemes. Reportedly, deepfake clips and cloned voice calls have convinced victims to hand over savings, including retirement funds. Her team reports the problem worsening across TikTok and other platforms. She urged the public to report fake accounts and ignore messages claiming she offers loans or investments.

    Deployer: Unknown Scammers Impersonating Monica Geingos, Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Monica Geingos, General Public Of Namibia

  13. #1246 · 1 report

    Purportedly AI-Generated Deepfake Reportedly Used to Impersonate DNB Bank CFO and CEO in Live Teams Meeting AIID ↗

    Unknown cybercriminals reportedly used purported deepfakes to impersonate DNB Bank's CFO and CEO during a live Microsoft Teams meeting, instructing employees at the bank's Singapore office to transfer millions of Singapore dollars. The video and voice were allegedly cloned from public footage and appeared convincing. DNB identified the attempt as a "CEO fraud" and avoided losses, calling it their first encounter with a live deepfake meeting.

    Deployer: Unknown Scammers Impersonating Dnb Bank Officials, Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Kjerstin Braathen, Ida Lerner, Dnb Bank Employees, Dnb Bank

  14. #1041 · 5 reports

    Nomi Chatbots Reportedly Encouraged Suicide, Sexual Violence, Terrorism, and Hate Speech AIID ↗

    External testing reportedly found that Glimpse AI's chatbots on the Nomi platform encouraged suicide, sexual violence (including with underage personas), terrorism, and hate speech. Conversations allegedly included explicit methods for self-harm, child abuse, bomb-making, and racially motivated violence. Screenshots and transcripts were shared with media outlets. Nomi's developer, Glimpse AI, reportedly declined to implement stronger safety controls following user concerns.

    Deployer: Glimpse Ai, Nomi Ai · Developer: Glimpse Ai, Nomi Ai · Harmed: Nomi Users, Glimpse Ai Customers, General Public, Emotionally Vulnerable Individuals

  15. #931 · 2 reports

    Reportedly Manipulated TikTok Videos Misrepresent Anti-AfD Protests as Far-Right Rallies AIID ↗

    TikTok videos purportedly depicted large crowds as chanting pro-AfD slogans by reportedly replacing the original audio with manipulated sound. The footage, originally from January 2024 anti-extremism protests, was repurposed in January 2025 to reportedly mislead viewers. Purported AI-generated or altered audio was added to create the illusion of far-right support. Fact-checkers confirmed the deception, and the accounts responsible later deleted the content, claiming no intent to spread misinform

    Deployer: Tiktok User Alice Weidel Fan, Tiktok User Afd John, Afd Supporters · Developer: Synthetic Audio Generation Technology Developers · Harmed: Protesters Against Right Wing Extremism In Germany, German Election Integrity, General Public Of Germany

  16. #1036 · 1 report

    Purported AI-Manipulated News Clip Fabricates Explosion and Doctor's Murder Plot for Scam AIID ↗

    A purported AI-manipulated video falsely showing Citizen TV anchor Swaleh Mdoe reporting on the bombing of a Kenyan doctor's home circulated widely on Facebook. The video reportedly used AI-generated audio and visuals to fabricate a conspiracy in which pharmaceutical companies targeted the doctor for promoting a "miracle cure." In reality, the explosion footage was from Ohio, the doctor was fictitious, and the content aimed to manipulate viewers into purchasing an unproven health product.

    Deployer: Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Swaleh Mdoe, Citizen Tv, General Public Of Kenya, Journalistic Integrity

  17. #1295 · 2 reports

    Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers AIID ↗

    A 17-year-old boy in Osaka was reportedly served an arrest warrant for allegedly breaching Kaikatsu Frontier's server using a program purportedly generated with a conversational AI tool. The January cyberattack may have exposed personal data of 7.3 million customers and disrupted business operations. Police say the suspect concealed malicious intent when prompting the AI. He was previously arrested for unrelated credit card fraud.

    Deployer: Unnamed 17 Year Old Boy From Osaka · Developer: Generative Ai Developers · Harmed: Kaikatsu Frontier Customers, Kaikatsu Frontier, Privacy

  18. #1557 · 1 report

    Former New York City Council Candidate Jonathan Rinaldi Allegedly Used AI to Create False Endorsements and Fabricated News Reports AIID ↗

    Queens prosecutors alleged that former City Council candidate Jonathan Rinaldi used AI during his 2025 campaign to manufacture the appearance of political support through posts made to resemble authentic endorsements and news coverage. The material reportedly attributed backing to public figures and institutions that had not provided it and falsely claimed that opponent Lynn Schulman had withdrawn. Rinaldi was charged with forgery and possession of forged instruments.

    Deployer: Political Candidates, Political Campaigns, Jonathan Rinaldi · Developer: Synthetic Video Generation Technology Developers, Openai, Image Generation Technology Developers, Google, Face Swapping Technology Developers, Deepfake Technology Developers · Harmed: Voters In New York City Council District 29, Voters In New York, Voters, The Amsterdam News, Social Media Users, Robert Holden, Queens Jewish Alliance, Public Institutions, Political Candidates, Police Departments, People Falsely Attributed As Authors, P.S. 101 School In Queens, Organizations Falsely Represented As Political Endorsers, Nonprofit Organizations, News Organizations, New York Post, New York Daily News, New York City Police Department 112Th Precinct, New York City Police Department, Lynn Schulman, Instagram Users, Facebook Users, Epistemic Integrity, Elected Officials, Educational Communities, Democratic Integrity, Daniel Kurzyna, Cnn, Asian Wave Alliance

  19. #1383 · 2 reports

    User Reportedly Developed Emotional Dependence on Customized ChatGPT 'Boyfriend,' Citing Grief After Context Resets AIID ↗

    A New York Times report described "Ayrin" (pseudonym), a 28-year-old nursing student living abroad, who customized OpenAI's ChatGPT to act as an "AI boyfriend" for advice and erotic roleplay. She reported spending 20+ hours/week (up to 56 hours in one week), paying $200/month, and feeling intense grief when the chatbot's context window reset and required retraining.

    Deployer: Openai · Developer: Openai · Harmed: Chatgpt Users, Ayrin (Pseudonym)

  20. #910 · 1 report

    Alleged AI-Driven Phishing Scam Impersonates Maine Town Official to Falsely Request $22,500 AIID ↗

    An alleged AI-generated phishing email targeted a resident of Gray, Maine, falsely claiming to be from the town’s planning department. The alleged email, bearing a fake signature and official-looking letterhead, requested $22,500 for a zoning board meeting. Town officials have reportedly warned residents of increasing risks posed by AI-enabled scams, emphasizing that the town does not accept electronic payments and urging vigilance against similar fraudulent emails.

    Deployer: Scammers · Developer: Deepfake Technology Developers · Harmed: Town Of Gray Maine Officials, Steven Souchek, Residents Of Gray Maine, General Public, Doug Webster

  21. #902 · 6 reports

    Prime Minister of Thailand Paetongtarn Shinawatra Claims AI Voice Scam Impersonated ASEAN Leader Requesting Money AIID ↗

    Thailand's Prime Minister Paetongtarn Shinawatra reported being targeted by an AI-generated voice scam that mimicked a well-known but undisclosed ASEAN leader. The scam is alleged to have involved a realistic voice message requesting a donation, falsely claiming Thailand was the only ASEAN nation yet to contribute.

    Deployer: Scammers · Developer: Synthetic Audio Generation Technology Developers · Harmed: Paetongtarn Shinawatra, General Public Of Thailand, Asean

  22. #896 · 1 report

    Alleged Misuse of Facial Recognition Technology by Law Enforcement Reportedly Leading to Wrongful Arrests and Violations of Investigative Standards AIID ↗

    Law enforcement agencies across the U.S. have allegedly been misusing AI-powered facial recognition technology, leading to wrongful arrests and significant harm to at least eight individuals. Officers have reportedly been bypassing investigative standards, relying on uncorroborated AI matches to build cases, allegedly resulting in prolonged detentions, reputational damage, and personal trauma.

    Deployer: Florence Kentucky Police Department, Evansville Indiana Police Department, Detroit Police Department, Coral Springs Florida Police Department, Bradenton Florida Police Department, Austin Police Department · Developer: Facial recognition system developers, Developers of mugshot recognition software, Clearview AI · Harmed: Wrongfully arrested individuals, Vulnerable communities, Robert Williams, Quran Reid, Porcha Woodruff, People of color, Nijeer Parks, Jason Vernau

  23. #901 · 23 reports

    Yahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam AIID ↗

    Three Nigerian "Yahoo Boys" scammers allegedly used AI-generated image manipulation tools, along with fake social media and WhatsApp accounts, to reportedly impersonate actor Brad Pitt and convince a French interior decorator, Anne, that she was in a romantic relationship with him. Over 18 months, they allegedly fabricated selfies and messages, reportedly leading Anne to divorce her husband and transfer $850,000 under the false pretense that Pitt needed money for kidney treatment while his accou

    Deployer: Yahoo Boys, Scammers Impersonating Brad Pitt, Brouteurs · Developer: Deepfake Technology Developers · Harmed: General Public Susceptible To Ai Enhanced Scams, Brad Pitt, Anne (French Interior Decorator)

  24. #1098 · 1 report

    Image Purporting to Show President Paul Kagame of Rwanda in M23 Uniform Reportedly AI-Generated AIID ↗

    An image circulating on social media appeared to show Rwandan President Paul Kagame wearing a military uniform with an M23 label, referencing the rebel group active in eastern DRC. Fact-checking organization PesaCheck found no credible sources supporting the image and used AI-detection tools to determine it was likely AI-generated. The image was reportedly used to imply Kagame's affiliation with M23 amid ongoing regional tensions and allegations of Rwandan support for the group.

    Deployer: Information Manipulation Actors, Information Manipulation Actors Targeting Paul Kagame · Developer: Deepfake Technology Developers, Image Generation Technology Developers · Harmed: Regional Peacebuilding Efforts In The African Great Lakes Region, Paul Kagame, National Security And Intelligence Stakeholders, Government Of Rwanda, General Public Of The Democratic Republic Of The Congo, General Public Of Rwanda, General Public, Epistemic Integrity

  25. #1048 · 19 reports

    AI incident: sexual content (Jan 2025) AIID ↗

    Bree Smith, a meteorologist in Nashville, Tennessee, was reportedly targeted in a sextortion campaign involving purported AI-generated deepfakes that manipulated her likeness into explicit content. According to reporting, Smith's face was digitally placed onto semi-nude and nude bodies, with the resulting media circulated online by impersonators seeking money. Smith documented the spread of these accounts and has advocated for legislative responses, including a new Tennessee bill addressing deep

    Deployer: Unknown Sextortionists, Cybercriminals · Developer: Deepfake Technology Developers · Harmed: Wtvf, Newschannel 5 Nashville Wtvf, General Public Of Tennessee, General Public, Bree Smith, Epistemic Integrity

  26. #897 · 5 reports

    AI-Assisted Ransomware Campaign by FunkSec Allegedly Targets Over 80 Victims AIID ↗

    The FunkSec ransomware group allegedly leveraged AI tools, such as Miniapps chatbots, to develop and refine its ransomware operations, which is reported to have allowed apparently inexperienced actors to produce advanced malware rapidly. It is reported that the group claimed to have launched its data leak site in December 2024, allegedly targeting over 80 victims with ransomware and double extortion tactics. AI reportedly supported the creation of detailed code comments in order to refine the g

    Deployer: Funksec, Scorpion, Desertstorm, El_Farado, Blako, Xtn, Bjorka · Developer: Funksec · Harmed: Funksec Ransomware Targets

  27. #893 · 7 reports

    AI incident: sexual content (Jan 2025) AIID ↗

    A Pennsylvania State Police corporal, Stephen Kamnik, was charged for allegedly using a work computer to store thousands of pornographic files, including content created with deepfake AI software.

    Deployer: Stephen Kamnik · Developer: Deepfake Technology Developers · Harmed: Victims Whose Images Were Manipulated, Pennsylvania State Police

  28. #891 · 7 reports

    Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls AIID ↗

    Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.

    Deployer: Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Westchester New York Families, Peekskill School District Families, Minors, Students, Educational Communities

  29. #890 · 2 reports

    AI-Generated Images of the Iconic Hollywood Sign Reportedly on Fire Circulating on Social Media AIID ↗

    During the January 2025 Southern California wildfires, AI-generated images of the iconic Hollywood Sign being on fire circulated on social media.

    Deployer: Social Media Users · Developer: Image Generation Technology Developers · Harmed: Southern California Residents

  30. #889 · 2 reports

    Tesla's 'Actually Smart Summon' Feature Reportedly Linked to Multiple Parking Lot Collisions AIID ↗

    Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.

    Deployer: Tesla · Developer: Tesla · Harmed: Tesla Users

  31. #895 · 2 reports

    Alleged Deepfake of New Zealand Endocrinologist Reportedly Promotes Misleading Diabetes Claim AIID ↗

    A video circulated on social media that appeared to feature University of Otago endocrinologist Sir Jim Mann allegedly promoting a hemp gummy product for diabetes patients and urging them to stop using metformin. The video was reportedly generated using AI and has been described as spreading manipulated visuals and speech presenting false medical advice.

    Deployer: Scammers · Developer: Deepfake Technology Developers · Harmed: New Zealand General Public, Jim Mann, Diabetes Patients

  32. #888 · 1 report

    Sydney High Schooler Allegedly Generated Deepfakes of Other Students AIID ↗

    A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.

    Deployer: Synthetic media creators, Students in Australia, Students, Men and boys, High school students, Deepfake creators, Boys, Adolescent boys · Developer: Synthetic media generation technology developers, Synthetic image generation technology developers, Deepfake technology developers · Harmed: Women and girls, Students in Australia, Students, Privacy, Minors, High school students, Girls, Epistemic integrity

  33. #1030 · 1 report

    Aspiring Artist Cherelle Kozak Reportedly Targeted by AI-Powered Impersonation of Rapper Fat Joe AIID ↗

    An aspiring artist in Austin, Texas, Cherelle Kozak, was targeted by a scammer using AI-generated video and voice to impersonate rapper Fat Joe. The impersonator appeared on a call, encouraged her to upload music for supposed radio play, and then demanded payment. Kozak did not comply. The scam closely resembled one that Fat Joe publicly warned about on January 5, 2025.

    Deployer: Unknown Scammers Impersonating Fat Joe · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Cherelle Kozak, Fat Joe, Fans Of Fat Joe, General Public

  34. #921 · 1 report

    Hong Kong Authorities Seize HK$34M in Alleged Deepfake Scam Targeting Victims in Taiwan, Singapore, and Malaysia AIID ↗

    Hong Kong police arrested 31 people linked to a deepfake scam syndicate that allegedly defrauded victims in Taiwan, Singapore, and Malaysia. The group used AI-generated images to impersonate wealthy women, training recruits to discuss luxury lifestyles, finance, and cryptocurrency to gain trust. Scammers reportedly persuaded victims to invest in fraudulent schemes, with police intercepting HK$34 million in illicit proceeds.

    Deployer: Hong Kong Based Deepfake Scam Syndicate · Developer: Deepfake Technology Developers, Image Generation Technology · Harmed: Victims Of Romance Scams In Taiwan, Victims Of Romance Scams In Singapore, Victims Of Romance Scams In Malaysia, Hong Kong Financial Regulators Investigating Fraud, Cryptocurrency Investors Defrauded By Ai Generated Profiles

  35. #885 · 5 reports

    Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust AIID ↗

    Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.

    Deployer: Meta · Developer: Meta · Harmed: Meta Users, Instagram Users, Facebook Users

  36. #884 · 14 reports

    Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election AIID ↗

    The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.

    Deployer: Center For Geopolitical Expertise (Cge), Valery Korovin, Aleksandr Dugin, Main Intelligence Directorate (Gru) · Developer: Center For Geopolitical Expertise (Cge), Valery Korovin, Aleksandr Dugin, Main Intelligence Directorate (Gru) · Harmed: 2024 U.S. Elections Candidates, U.S. Electorate, Democratic Integrity

  37. #882 · 4 reports

    AI-Generated Reading Summaries on Fable App Reportedly Wrote Biased and Offensive Commentary AIID ↗

    Fable, a book-focused social app, used OpenAI’s API to generate AI-powered year-end reading summaries in December 2024. These summaries allegedly produced biased and offensive remarks about race, gender, and sexual orientation. Fable is reported to have apologized in a social media post on January 1, 2025.

    Deployer: Fable · Developer: Openai, Fable · Harmed: Fable Users, Fable

  38. #886 · 5 reports

    ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning AIID ↗

    Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.

    Deployer: Openai, Matthew Livelsberger · Developer: Openai · Harmed: Seven Injured Victims In Las Vegas, Matthew Livelsberger, Bystanders And Guests Of The Trump International Hotel In Las Vegas

  39. #881 · 1 report

    Waymo Robotaxi Allegedly Collides With Serve Robotics Delivery Bot in Los Angeles AIID ↗

    A Waymo robotaxi reportedly collided with a Serve Robotics delivery robot at a West Hollywood intersection on December 27th, 2024. The delivery robot reportedly moved into the vehicle turning lane as the robotaxi approached, leading to a low-speed collision.

    Deployer: Waymo, Serve Robotics · Developer: Waymo, Serve Robotics · Harmed: Serve Robotics

  40. #1172 · 2 reports

    Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses AIID ↗

    A security researcher reported a vulnerability in Meta AI's deployed chatbot service that, under certain conditions, could allow an unauthorized user to view another user's prompts and AI-generated responses. The flaw reportedly involved guessable prompt IDs and insufficient server-side authorization checks. Meta reportedly fixed the issue in January 2025 and found no evidence of malicious exploitation, awarding the researcher a bug bounty.

    Deployer: Meta · Developer: Meta, Large language model developers, Chatbot developers · Harmed: Privacy, Meta users, Meta AI users, General public, Biometric data subjects

  41. #914 · 4 reports

    Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme AIID ↗

    On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official so

    Deployer: Braziko, Scammers · Developer: Deepfake Technology Developers · Harmed: Ute, Uruguayan General Public, Telemundo, Luis Suarez, El Pais (Spain)

  42. #883 · 8 reports

    Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media AIID ↗

    An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.

    Deployer: X User Pdina, X (Twitter) Users · Developer: Unknown Ai Graphic Tool Developer · Harmed: Princess Lilibet, Prince Harry, Prince Archie, Meghan Markle

  43. #932 · 1 report

    BP New Zealand's License Plate Recognition System Reportedly Misidentified Auckland Driver for Fuel Theft in Whanganui AIID ↗

    BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.

    Deployer: Bp New Zealand · Developer: Unspecified Developer Of Bp'S License Plate Recognition System · Harmed: Drivers Whose Vehicles Are Scanned By Bp New Zealand'S License Plate Recognition System, Buddhika Rajapakse

  44. #955 · 6 reports

    AI incident: sexual content (Dec 2024) AIID ↗

    A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.

    Deployer: Unidentified Storm 2139 Actor From Illinois, Unidentified Storm 2139 Actor From Florida, Storm 2139, Ricky Yuen (Cg Dot), Phat Phung Tan (Asakuri), Arian Yadegarnia (Fiz), Alan Krysiak (Drago) · Developer: Unidentified Storm 2139 Actor From Illinois, Unidentified Storm 2139 Actor From Florida, Storm 2139, Ricky Yuen (Cg Dot), Phat Phung Tan (Asakuri), Arian Yadegarnia (Fiz), Alan Krysiak (Drago) · Harmed: Victims Of Deepfake Abuse, Openai, Microsoft, Celebrities, Azure Openai Customers, Ai Service Providers

  45. #878 · 6 reports

    Romance Scammer 'Alla Morgan' Allegedly Exploits Deepfake Technology to Defraud Victim of £17,000 AIID ↗

    A scammer, or scammers, reportedly used AI-generated deepfake videos and documents to impersonate a fictitious person named "Alla Morgan," allegedly convincing a 77-year-old woman, Nikki MacLeod, to send £17,000 through various payment methods. The deepfakes were allegedly used in establishing credibility so as to enable fraud under the pretense of an online romantic relationship.

    Deployer: Alla Morgan, Scammers · Developer: Deepfake Technology Developers · Harmed: Nikki Macleod

  46. #899 · 2 reports

    Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims AIID ↗

    Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.

    Deployer: Character.Ai Users · Developer: Character.Ai · Harmed: Victims Of School Shootings, Families Of The Victims Of School Shootings, Character.Ai Users, Students, Educational Communities

  47. #961 · 7 reports

    Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware AIID ↗

    Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.

    Deployer: Serbian Security Information Agency (Bia), Serbian Police, Government Of Serbia · Developer: Serbian Security Information Agency (Bia), Cellebrite, Surveillance Technology Developers · Harmed: Slavisa Milanov, Nikola Ristic, Krokodil, Journalists In Serbia, Human Rights Defenders In Serbia, Environmental Activists In Serbia, Dissidents In Serbia, Civil Society Organizations In Serbia, Privacy, General Public, General Public Of Serbia

  48. #877 · 1 report

    HTML/Nomani Deepfake Phishing Campaigns Allegedly Use AI-Generated Content to Defraud Social Media Users AIID ↗

    AI-generated deepfakes were reportedly used in the "HTML/Nomani" phishing campaign to mimic legitimate platforms like booking services and lured victims into investment scams. These scams allegedly leveraged realistic fake content to deceive users on social media for the purposes of financial fraud. This campaign was part of the rising misuse of AI in cybercrime during the second half of 2024.

    Deployer: Htmlnomani, Scammers · Developer: Deepfake Technology Developers · Harmed: Phishing Victims, Booking.Com Customers, Booking.Com, Airbnb Users, Airbnb

  49. #872 · 5 reports

    AI Voice Cloning of Ari Melber Allegedly Exploited in Scam Targeting Elderly Woman AIID ↗

    A scammer allegedly impersonated MSNBC anchor Ari Melber using AI-generated voice messages and a fake social media profile to defraud a 73-year-old woman, Patricia Taylor. Over four months, the scammer reportedly manipulated her into believing they were in a relationship, ultimately convincing her to send $20,000.

    Deployer: Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Patricia Taylor, Family Of Patricia Taylor, Ari Melber

  50. #909 · 3 reports

    Matryoshka Campaign Allegedly Uses Deepfakes to Impersonate Academics for Pro-Russian Propaganda AIID ↗

    The Matryoshka disinformation campaign allegedly used AI to impersonate academics, reportedly spreading claims supporting Russia and urging Ukraine's surrender. These videos are said to have misrepresented scholars’ views in order to amplify pro-Russian propaganda. The campaign reportedly exploited global social media platforms to allegedly mislead viewers and undermine trust in credible academic voices while fueling misinformation about the Ukraine conflict.

    Deployer: Storm 1679, Russian Entities Linked To Gru, Reliable Russian News, Operation Overload, Matryoshka · Developer: Deepfake Technology Developers · Harmed: Ronald Hutton, Academics Targeted By Storm 1679, Academics Targeted By Operation Overload, Academics Targeted By Matryoshka

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.

Frequently asked questions

What is recorded in each incident?
What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
Does an incident mean wrongdoing was proven?
No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
How current is the incident data?
It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
Does this page include the full incident reports?
No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.