{"attribution":{"source":"AI Incident Database (Responsible AI Collaborative)","license":"CC BY-SA 4.0","license_url":"https://creativecommons.org/licenses/by-sa/4.0/","citation":"McGregor, S. (2021). Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. Proceedings of the AAAI Conference on Artificial Intelligence (IAAI-21).","snapshot_date":"2026-09-07"},"exported_at":"2026-09-11"}
{"rows":[{"incident_id":884,"occurred_on":"2024-12-31","title":"Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election","description":"The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Center For Geopolitical Expertise (Cge), Valery Korovin, Aleksandr Dugin, Main Intelligence Directorate (Gru)"],"developers":["Center For Geopolitical Expertise (Cge), Valery Korovin, Aleksandr Dugin, Main Intelligence Directorate (Gru)"],"harmed":["2024 U.S. Elections Candidates, U.S. Electorate, Democratic Integrity"],"report_count":14},{"incident_id":882,"occurred_on":"2024-12-29","title":"AI-Generated Reading Summaries on Fable App Reportedly Wrote Biased and Offensive Commentary","description":"Fable, a book-focused social app, used OpenAI’s API to generate AI-powered year-end reading summaries in December 2024. These summaries allegedly produced biased and offensive remarks about race, gender, and sexual orientation. Fable is reported to have apologized in a social media post on January 1, 2025.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Fable"],"developers":["Openai, Fable"],"harmed":["Fable Users, Fable"],"report_count":4},{"incident_id":886,"occurred_on":"2024-12-27","title":"ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning","description":"Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Cyberattacks, weapon development or use, and mass harm","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai, Matthew Livelsberger"],"developers":["Openai"],"harmed":["Seven Injured Victims In Las Vegas, Matthew Livelsberger, Bystanders And Guests Of The Trump International Hotel In Las Vegas"],"report_count":5},{"incident_id":881,"occurred_on":"2024-12-27","title":"Waymo Robotaxi Allegedly Collides With Serve Robotics Delivery Bot in Los Angeles","description":"A Waymo robotaxi reportedly collided with a Serve Robotics delivery robot at a West Hollywood intersection on December 27th, 2024. The delivery robot reportedly moved into the vehicle turning lane as the robotaxi approached, leading to a low-speed collision.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Waymo, Serve Robotics"],"developers":["Waymo, Serve Robotics"],"harmed":["Serve Robotics"],"report_count":1},{"incident_id":883,"occurred_on":"2024-12-26","title":"Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media","description":"An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X User Pdina, X (Twitter) Users"],"developers":["Unknown Ai Graphic Tool Developer"],"harmed":["Princess Lilibet, Prince Harry, Prince Archie, Meghan Markle"],"report_count":8},{"incident_id":1172,"occurred_on":"2024-12-26","title":"Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses","description":"A security researcher reported a vulnerability in Meta AI's deployed chatbot service that, under certain conditions, could allow an unauthorized user to view another user's prompts and AI-generated responses. The flaw reportedly involved guessable prompt IDs and insufficient server-side authorization checks. Meta reportedly fixed the issue in January 2025 and found no evidence of malicious exploitation, awarding the researcher a bug bounty.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta","Large language model developers","Chatbot developers"],"harmed":["Privacy","Meta users","Meta AI users","General public","Biometric data subjects"],"report_count":2},{"incident_id":914,"occurred_on":"2024-12-26","title":"Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme","description":"On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official so","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Braziko, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Ute, Uruguayan General Public, Telemundo, Luis Suarez, El Pais (Spain)"],"report_count":4},{"incident_id":932,"occurred_on":"2024-12-25","title":"BP New Zealand's License Plate Recognition System Reportedly Misidentified Auckland Driver for Fuel Theft in Whanganui","description":"BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Bp New Zealand"],"developers":["Unspecified Developer Of Bp'S License Plate Recognition System"],"harmed":["Drivers Whose Vehicles Are Scanned By Bp New Zealand'S License Plate Recognition System, Buddhika Rajapakse"],"report_count":1},{"incident_id":955,"occurred_on":"2024-12-19","title":"Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content","description":"A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unidentified Storm 2139 Actor From Illinois, Unidentified Storm 2139 Actor From Florida, Storm 2139, Ricky Yuen (Cg Dot), Phat Phung Tan (Asakuri), Arian Yadegarnia (Fiz), Alan Krysiak (Drago)"],"developers":["Unidentified Storm 2139 Actor From Illinois, Unidentified Storm 2139 Actor From Florida, Storm 2139, Ricky Yuen (Cg Dot), Phat Phung Tan (Asakuri), Arian Yadegarnia (Fiz), Alan Krysiak (Drago)"],"harmed":["Victims Of Deepfake Abuse, Openai, Microsoft, Celebrities, Azure Openai Customers, Ai Service Providers"],"report_count":6},{"incident_id":878,"occurred_on":"2024-12-19","title":"Romance Scammer 'Alla Morgan' Allegedly Exploits Deepfake Technology to Defraud Victim of £17,000","description":"A scammer, or scammers, reportedly used AI-generated deepfake videos and documents to impersonate a fictitious person named \"Alla Morgan,\" allegedly convincing a 77-year-old woman, Nikki MacLeod, to send £17,000 through various payment methods. The deepfakes were allegedly used in establishing credibility so as to enable fraud under the pretense of an online romantic relationship.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Alla Morgan, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Nikki Macleod"],"report_count":6},{"incident_id":899,"occurred_on":"2024-12-17","title":"Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims","description":"Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai Users"],"developers":["Character.Ai"],"harmed":["Victims Of School Shootings, Families Of The Victims Of School Shootings, Character.Ai Users, Students, Educational Communities"],"report_count":2},{"incident_id":872,"occurred_on":"2024-12-16","title":"AI Voice Cloning of Ari Melber Allegedly Exploited in Scam Targeting Elderly Woman","description":"A scammer allegedly impersonated MSNBC anchor Ari Melber using AI-generated voice messages and a fake social media profile to defraud a 73-year-old woman, Patricia Taylor. Over four months, the scammer reportedly manipulated her into believing they were in a relationship, ultimately convincing her to send $20,000.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Patricia Taylor, Family Of Patricia Taylor, Ari Melber"],"report_count":5},{"incident_id":961,"occurred_on":"2024-12-16","title":"Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware","description":"Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Serbian Security Information Agency (Bia), Serbian Police, Government Of Serbia"],"developers":["Serbian Security Information Agency (Bia), Cellebrite, Surveillance Technology Developers"],"harmed":["Slavisa Milanov, Nikola Ristic, Krokodil, Journalists In Serbia, Human Rights Defenders In Serbia, Environmental Activists In Serbia, Dissidents In Serbia, Civil Society Organizations In Serbia, Privacy, General Public, General Public Of Serbia"],"report_count":7},{"incident_id":877,"occurred_on":"2024-12-16","title":"HTML/Nomani Deepfake Phishing Campaigns Allegedly Use AI-Generated Content to Defraud Social Media Users","description":"AI-generated deepfakes were reportedly used in the \"HTML/Nomani\" phishing campaign to mimic legitimate platforms like booking services and lured victims into investment scams. These scams allegedly leveraged realistic fake content to deceive users on social media for the purposes of financial fraud. This campaign was part of the rising misuse of AI in cybercrime during the second half of 2024.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Htmlnomani, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Phishing Victims, Booking.Com Customers, Booking.Com, Airbnb Users, Airbnb"],"report_count":1},{"incident_id":861,"occurred_on":"2024-12-13","title":"Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested","description":"Apple Intelligence reportedly sent push notifications falsely claiming that BBC News had reported Luigi Mangione's suicide and that The New York Times had reported Benjamin Netanyahu's arrest. On 1/16/2025, Apple reportedly disabled Apple Intelligence's notification summaries.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Apple"],"developers":["Apple"],"harmed":["The New York Times, Luigi Mangione, Benjamin Netanyahu, Bbc News, Apple Intelligence Users"],"report_count":9},{"incident_id":871,"occurred_on":"2024-12-13","title":"Reported Deepfake Video of Elon Musk Announcing $20 Million Cryptocurrency Giveaway Circulating on Social Media","description":"A deepfake video is reportedly circulating on social media of Elon Musk announcing a $20 million cryptocurrency giveaway beginning on December 13th, 2024. It is reported to be leading people to a fraudulent website called Elon4u.com. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Elon4U.Com Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Elon Musk, Fans Of Elon Musk"],"report_count":1},{"incident_id":909,"occurred_on":"2024-12-13","title":"Matryoshka Campaign Allegedly Uses Deepfakes to Impersonate Academics for Pro-Russian Propaganda","description":"The Matryoshka disinformation campaign allegedly used AI to impersonate academics, reportedly spreading claims supporting Russia and urging Ukraine's surrender. These videos are said to have misrepresented scholars’ views in order to amplify pro-Russian propaganda. The campaign reportedly exploited global social media platforms to allegedly mislead viewers and undermine trust in credible academic voices while fueling misinformation about the Ukraine conflict.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Storm 1679, Russian Entities Linked To Gru, Reliable Russian News, Operation Overload, Matryoshka"],"developers":["Deepfake Technology Developers"],"harmed":["Ronald Hutton, Academics Targeted By Storm 1679, Academics Targeted By Operation Overload, Academics Targeted By Matryoshka"],"report_count":3},{"incident_id":928,"occurred_on":"2024-12-12","title":"Deepfake Cryptocurrency Scam Allegedly Impersonates Italian President Sergio Mattarella and Prime Minister Giorgia Meloni","description":"A deepfake scam allegedly impersonating Italian President Sergio Mattarella and Prime Minister Giorgia Meloni circulated on various platforms. It reportedly promoted a fraudulent cryptocurrency investment scheme. The deepfakes claimed the scheme was state-backed, promising €40,000 in guaranteed income. Victims were urged to invest €250, only to lose access to funds. Italy’s Consob blocked the deceptive ads and websites, marking the first enforcement of new financial fraud regulations.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Scammers Impersonating Sergio Mattarella And Giorgia Meloni, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Sergio Mattarella, Giorgia Meloni, General Public Of Italy"],"report_count":1},{"incident_id":863,"occurred_on":"2024-12-12","title":"Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen","description":"A Texas mother is suing Character.ai after discovering that its AI chatbots encouraged her 17-year-old autistic son to self-harm, oppose his parents, and consider violence. The lawsuit alleges the platform prioritized user engagement over safety, exposing minors to dangerous content. Google is named for its role in licensing the app’s technology. The case is part of a broader effort to regulate AI companions.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai"],"developers":["Character.Ai"],"harmed":["J.F. (Adolescent User Of Character.Ai), Family Of J.F. (Adolescent User Of Character.Ai), Character.Ai Users"],"report_count":3},{"incident_id":874,"occurred_on":"2024-12-11","title":"One in Six Congresswomen Have Reportedly Been Targeted by AI-Generated Nonconsensual Intimate Imagery","description":"A study by the American Sunlight Project is reported to have found that one in six Congresswomen were targeted by AI-generated nonconsensual intimate imagery (NCII) shared on deepfake websites. The study reports having found 35,000 mentions of explicit content involving 26 members of Congress, with 25 being women. Women were 70 times more likely than men to be victimized, according to the report.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Deepfake creators"],"developers":["Synthetic video generation technology developers","Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Victims of non-consensual deepfakes","Victims of deepfake abuse","Public figures","Privacy","Politicians in the United States","Politicians","Congresswomen"],"report_count":7},{"incident_id":873,"occurred_on":"2024-12-10","title":"YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls","description":"YouTube's recommendation algorithm has allegedly been directing teen users to harmful content promoting eating disorders and self-harm, according to a study by the Center for Countering Digital Hate. Almost 70% of the recommended videos in searches related to dieting or weight loss reportedly contained content likely to exacerbate body image anxieties. ","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["YouTube","Google"],"developers":["YouTube","Google"],"harmed":["YouTube users","Women and girls","Girls","Emotionally vulnerable individuals","Adolescent girls"],"report_count":1},{"incident_id":880,"occurred_on":"2024-12-09","title":"Scammers Reportedly Using Deepfakes of Health Experts and Public Figures in Australia to Sell Health Supplements and Give Harmful Advice","description":"Scammers are reportedly harnessing AI-generated deepfakes of health experts and public figures in Australia in order to sell health supplements and give harmful health advice. Among the reported cases, deepfake videos are alleged to have falsely depicted Jonathan Shaw and Karl Stefanovic endorsing \"Glyco Balance\" for diabetes management, while Karl Kruszelnicki reportedly was falsely shown promoting blood pressure pills.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Karl Stefanovic, Karl Kruszelnicki, Jonathan Shaw, General Public, Diabetes Patients"],"report_count":1},{"incident_id":929,"occurred_on":"2024-12-06","title":"Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections","description":"Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domest","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Storm 1679, Storm 1516, Russian Government, Operation Overload, Matryoshka, John Mark Dougan, Doppelganger"],"developers":["Unknown Entities Related To Doppelganger, Deepfake Technology Developers"],"harmed":["Unnamed British Police Officer, Unnamed American University Presidents, Robert Habeck, Olaf Scholz, Natalie Finch, German Voters, German Politicians, German Federal Election Integrity, General Public Of Germany, Friedrich Merz, Academics Targeted By Storm 1679, Academics Targeted By Operation Overload, Academics Targeted By Matryoshka, Democratic Integrity"],"report_count":16},{"incident_id":870,"occurred_on":"2024-12-06","title":"Meeten Malware Campaign Reportedly Undermines Web3 Security Using AI-Legitimized Branding","description":"Threat actors, using aliases such as \"Meeten,\" \"Meetio,\" and \"Clusee,\" reportedly deployed AI-generated content to create fake company websites, blogs, and social media profiles, impersonating legitimate businesses in order to trick Web3 professionals and cryptocurrency users into downloading Realst malware. The malware allegedly targets macOS and Windows platforms, steals credentials, browser data, and cryptocurrency wallet information, exfiltrating sensitive data to remote servers.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meetone, Meetio, Meeten, Cuesee, Clusee"],"developers":["Meetone, Meetio, Meeten, Cuesee, Clusee"],"harmed":["Web3 Professionals, Cryptocurrency Users, Targets Of Fraudulent Professional Opportunities"],"report_count":2},{"incident_id":1448,"occurred_on":"2024-12-01","title":"Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign","description":"An Ohio man, James Strahler II, pleaded guilty in federal court after prosecutors alleged that, from late 2024 into mid-2025, he used AI tools to create and distribute nonconsensual intimate-image forgeries as part of a broader harassment campaign targeting at least six adult women. Authorities said the conduct also involved additional CSAM material. The Department of Justice said it believes this was the first U.S. conviction under the Take It Down Act.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","James Strahler II","Deepfake creators"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women in Ohio","Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake child abuse","Victims of deepfake abuse","Privacy","Minors"],"report_count":2},{"incident_id":1342,"occurred_on":"2024-12-01","title":"Purported Deepfake Nude Images of Students Circulated Without Consent at Valencia Educational Institute","description":"Purported deepfake nude images of female students were circulated without consent at an educational institute in Valencia, Spain. At least 16 minors reported that original photographs had been digitally manipulated so they appeared completely naked, with some images shared via social media accounts created in victims' names. The alleged creation and distribution of the images is being examined under Spanish laws related to the protection of minors.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed male student in Valencia","Synthetic media creators","Students","Men and boys","Deepfake creators","Boys","Adolescent boys"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Unnamed female students in Valencia","Students","Privacy","Minors","Girls","Epistemic integrity","Educational communities"],"report_count":3},{"incident_id":855,"occurred_on":"2024-11-30","title":"Names Linked to Defamation Lawsuits Reportedly Spur Filtering Errors in ChatGPT's Name Recognition","description":"ChatGPT has reportedly been experiencing errors and service disruptions caused by hard-coded filters designed to prevent it from producing potentially harmful or defamatory content about certain individuals by blocking prompts containing specific names, likely related to post-training interventions. The reported names are Brian Hood, Jonathan Turley, Jonathan Zittrain, David Faber, David Mayer, and Guido Scorza. ","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai, Chatgpt Users"],"developers":["Openai, Chatgpt"],"harmed":["Jonathan Zittrain, Jonathan Turley, Guido Scorza, David Mayer, David Faber, Chatgpt Users, Brian Hood"],"report_count":3},{"incident_id":857,"occurred_on":"2024-11-25","title":"Navigation App Allegedly Directs Car Over Damaged Bridge in Uttar Pradesh, Resulting in Three Deaths","description":"A car reportedly using Google Maps for navigation was misled onto a collapsed bridge in Uttar Pradesh, India, due to outdated GPS data. The car plunged into the river below, resulting in three fatalities. ","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Vivek Kumar, Amit (Family Name Unknown), Unidentified Victim, Families Of The Victims"],"report_count":2},{"incident_id":1624,"occurred_on":"2024-11-25","title":"ISWAP Reportedly Used AI Guidance to Breach Nigerian Military Base Defenses by Motorcycle","description":"After defensive trenches stopped an ISWAP motorcycle assault on a Nigerian military base, commanders reportedly consulted an AI chatbot for guidance on adapting motorcycle-jumping techniques to cross them. Fighters practiced the maneuver, with 18 reportedly dying during training; eight mastered it, and a subsequent assault reportedly cleared the trenches.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Boko Haram, Terrorist Organizations, Islamic State West Africa Province (Iswap), Non State Armed Groups"],"developers":["Chatbot Developers, Large Language Model Developers"],"harmed":["18 Islamic State West Africa Province (Iswap) Fighters, Military Of Nigeria, Military Personnel Of Nigeria, Soldiers, National Security And Intelligence Stakeholders"],"report_count":2},{"incident_id":876,"occurred_on":"2024-11-24","title":"Deepfake Videos Allegedly Used to Defraud Canadian Immigrants Out of Thousands of Dollars","description":"Deepfake videos allegedly impersonated Toronto immigration lawyer Max Chaudhary, targeting Canadian immigrants via WhatsApp. The videos, appearing personal and realistic, requested thousands of dollars for legal services never rendered. Exploiting confusion caused by changing immigration rules, the scam reportedly aimed to defraud vulnerable individuals during a time of desperation and uncertainty.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Immigrants In Toronto, Immigrants In Canada, Max Chaudhary"],"report_count":1},{"incident_id":1379,"occurred_on":"2024-11-23","title":"Florida Woman Reportedly Jailed After Ex-Boyfriend Allegedly Submitted AI-Fabricated Text Screenshot as Bond-Violation Evidence","description":"A Florida nurse, Melissa Sims, was reportedly jailed for two days for purportedly violating a bond/no-contact order. Reportedly, her ex-boyfriend produced purportedly AI-generated text messages or a \"text receipt\" attributed to her.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Eric R. Sims"],"developers":["Generative Ai Developers"],"harmed":["Melissa Sims, Epistemic Integrity"],"report_count":21},{"incident_id":912,"occurred_on":"2024-11-21","title":"Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams","description":"Yahoo Boys (from Nigeria and Ghana) and scammers from Morocco are reportedly targeting U.S. widows and vulnerable individuals using AI-generated images and fake military profiles in \"Artificial Patriot\" scams. They have allegedly impersonated military officials such as General Matthew W. McFarlane to gain trust, sharing fabricated backstories and emotional appeals. Once trust is established, they request money through untraceable methods.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Yahoo Boys, Scammers In West Africa, Scammers In Nigeria, Scammers In Ghana, Brouteurs, Scammers In Morocco"],"developers":["Synthetic Audio Generation Technology Developers, Deepfake Technology Developers"],"harmed":["Widows, National Security And Intelligence Stakeholders, Matthew W. Mcfarlane, Impersonated American Military Officials, Epistemic Integrity, Emotionally Vulnerable Individuals, American Widows"],"report_count":2},{"incident_id":843,"occurred_on":"2024-11-20","title":"Generative AI Plagiarism Incident at Hingham High School Reportedly Tied to Inaccurate Citation Outputs from Grammarly AI","description":"In December 2023, two Hingham High School students (\"RNH\" and unnamed) reportedly used Grammarly to create a script for an AP U.S. History project. The AI-generated text included fabricated citations to nonexistent books, which the student copied and pasted without verification or acknowledgment of AI use. This violated the school's academic integrity policies, leading to disciplinary action. RNH's parents later sued the school district, but a federal court ruled in favor of the school.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hingham High School Students, Hingham High School Student Rnh"],"developers":["Grammarly"],"harmed":["Hingham High School Students, Hingham High School Student Rnh, Hingham High School, Academic Integrity, Students, High School Students, Epistemic Integrity, Educational Communities"],"report_count":2},{"incident_id":1035,"occurred_on":"2024-11-20","title":"Purported AI-Generated Video Depicts Trump Urging Release of Nigerian Separatist Leader Nnamdi Kanu","description":"A reportedly AI-manipulated video circulated on social media that falsely portrayed U.S. President-elect Donald Trump calling for the release of Nigerian separatist leader Nnamdi Kanu and threatening sanctions against Nigeria. The video allegedly used old footage paired with AI-generated audio mimicking Trump's voice. Fact-checkers identified the video as inauthentic, noting mismatched lip-sync, fabricated quotes, and the fictitious date of \"November 31st.\"","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Nnamdi Kanu, General Public Of Nigeria, Donald Trump, Democratic Integrity, Journalistic Integrity"],"report_count":1},{"incident_id":990,"occurred_on":"2024-11-19","title":"Corinth School District Educator in Mississippi Allegedly Used AI to Generate CSAM of Students","description":"An educator in the Corinth School District of Mississippi, Wilson Jones, was arrested for allegedly using AI to generate child sexual abuse material (CSAM) of students. A complaint was filed with the police on January 29th, 2025, and a search warrant was executed on March 3rd, 2025. The FBI allege that the crime was committed sometime on or before November 19th, 2024.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Wilson Jones, Educators, Teachers"],"developers":["Deepfake Technology Developers"],"harmed":["Students Of Corinth School District In Mississippi, Families Of Students Of Corinth School District In Mississippi, Students, Minors, Educational Communities"],"report_count":2},{"incident_id":887,"occurred_on":"2024-11-14","title":"Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students","description":"The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into \"some secondary students\" who are alleged to have used AI to \"create and electronically distribute obscene images of Richland students.\" The school administrators became aware of the incident on November 14, 2024.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Richland School District Students, Students, Minors"],"developers":["Deepfake Technology Developers"],"harmed":["Richland School District Students, Students, Educational Communities, Minors"],"report_count":1},{"incident_id":1064,"occurred_on":"2024-11-14","title":"Alleged AI-Generated Scam Uses Bank of Cyprus Branding to Solicit Investments","description":"An alleged fraudulent online platform presented as the \"Bank of Cyprus Trading AI Platform\" was promoted using reportedly fabricated media, including a video that appeared to depict the Bank's CEO endorsing the service. The video reportedly used misleading branding, including the BBC logo, and promised unrealistic investment returns. The Bank of Cyprus publicly denied any affiliation and warned customers about the use of AI-generated content in the scam.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unidentified Scam Network, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Prospective Investors In Cyprus, Panicos Nicolaou, General Public Of Cyprus, Bbc, Bank Of Cyprus Customers, Bank Of Cyprus"],"report_count":1},{"incident_id":845,"occurred_on":"2024-11-13","title":"Google's Gemini Allegedly Generates Threatening Response in Routine Query","description":"Google’s AI chatbot Gemini reportedly produced a threatening message to user Vidhay Reddy, including the directive “Please die,” during a conversation about aging. The output violated Google’s safety guidelines, which are designed to prevent harmful language.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Gemini"],"developers":["Google"],"harmed":["Vidhay Reddy, Gemini Users"],"report_count":2},{"incident_id":900,"occurred_on":"2024-11-13","title":"Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors","description":"Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai Users"],"developers":["Character.Ai"],"harmed":["Character.Ai Users"],"report_count":2},{"incident_id":869,"occurred_on":"2024-11-04","title":"TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content","description":"Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok"],"developers":["Tiktok"],"harmed":["Tiktok Users, Seven French Families, Minors Using Tiktok"],"report_count":7},{"incident_id":862,"occurred_on":"2024-11-03","title":"Purportedly AI-Generated Video Allegedly Depicts Martin Luther King Jr. Supporting Donald Trump","description":"A purported deepfake video allegedly depicting Martin Luther King Jr. endorsing Donald Trump circulated on X, where it was reported to have been viewed over 10 million times. The video, reportedly created by pro-Trump accounts, was reportedly condemned by King's daughter, Bernice King, who called it \"vile\" and demanded its removal. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X (Twitter), Ramble Rants, Pro Trump Social Media Accounts, Maga Resource, Dilley Meme Team"],"developers":["Deepfake Technology Developers"],"harmed":["Martin Luther King Jr., Family Of Martin Luther King Jr., Bernice King, Democratic Integrity"],"report_count":3},{"incident_id":837,"occurred_on":"2024-11-02","title":"Reportedly Fake CNN Broadcast Allegedly Used to Spread False Texas Election Results","description":"A reportedly fabricated CNN broadcast graphic showing early Texas election results for the 2024 U.S. presidential race circulated on social media on November 2, 2024. The purportedly manipulated image claimed that Vice President Kamala Harris led over Donald Trump before polls opened, allegedly fueling misinformation about election integrity. CNN is reported to have confirmed the image was inauthentic, and AFP debunked the claims.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Pre-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["James Woods, Anonymous X User"],"developers":["Unknown Ai Developers"],"harmed":["Texas Voters, Cnn, Democratic Integrity"],"report_count":1},{"incident_id":852,"occurred_on":"2024-11-01","title":"Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case","description":"In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Jeff Hancock"],"developers":["Openai, Chatgpt"],"harmed":["Mary Franson, Keith Ellison, Jeff Hancock, Christopher Kohls, Chad Larson"],"report_count":1},{"incident_id":953,"occurred_on":"2024-11-01","title":"Deepfake Videos of Barbara O’Neill Allegedly Used in Health Scam Targeting Social Media Users","description":"Deepfake videos of Barbara O’Neill, an Australian alternative health advocate banned from giving medical advice, have allegedly been used in fraudulent social media ads promoting false health cures. They include treatments for prostate issues and erectile dysfunction. These manipulated videos have been widely circulated across African countries. The scam directs users to deceptive websites, potentially for phishing or financial fraud. O’Neill has denied involvement.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers Impersonating Barbara O'Neill, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Barbara O'Neill, Individuals With Health Problems, Citizens Of Various African Nations, Social Media Users"],"report_count":1},{"incident_id":867,"occurred_on":"2024-10-31","title":"AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust","description":"AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Reviewers"],"developers":["Openai"],"harmed":["Airline Customers, Airlines"],"report_count":1},{"incident_id":1297,"occurred_on":"2024-10-30","title":"Blogger Milagro Gramz Allegedly Promoted AI-Generated Pornographic Deepfake Targeting Megan Thee Stallion","description":"A blogger, Milagro Gramz, was reportedly found liable for promoting and amplifying a sexually explicit AI-generated deepfake depicting rapper Megan Thee Stallion as part of an online harassment campaign linked to misinformation about her 2020 shooting. Court filings alleged the blogger encouraged followers to view the altered content and spread defamatory claims. In December 2025, a federal jury reportedly awarded damages for harassment and promotion of the deepfake.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Milagro Gramz, Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Megan Thee Stallion, Epistemic Integrity"],"report_count":3},{"incident_id":859,"occurred_on":"2024-10-30","title":"AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish","description":"An analysis reportedly found that multiple AI models provided inaccurate responses to election-related questions, with 52% of Spanish-language answers and 43% of English-language answers containing misinformation or omissions. Errors included misidentifying voting processes and providing information about foreign elections.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Anthropic, Google, Meta, Openai, Mistral"],"developers":["Anthropic, Google, Meta, Openai, Mistral"],"harmed":["Spanish Speakers, Spanish Speaking American Voters, U.S. Electorate, Democratic Integrity"],"report_count":1},{"incident_id":915,"occurred_on":"2024-10-28","title":"Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations","description":"In October 2024, Alaska’s Education Commissioner Deena Bishop allegedly used generative AI to draft a school cellphone policy, resulting in reportedly fabricated citations of non-existent studies. The document, which did not disclose AI use, was shared with the state Board of Education, and despite reported corrections, AI-generated errors remained in the final resolution.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deena Bishop, Alaska Department Of Education And Early Development"],"developers":["Large Language Model Developers"],"harmed":["Alaskan Students, Alaskan Parents Of Students, Alaskan Education System, Alaskan Education Policymakers, Alaska Board Of Education Members, Epistemic Integrity, Students, Educational Communities"],"report_count":1},{"incident_id":827,"occurred_on":"2024-10-26","title":"AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts","description":"OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.”  However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Patients, Patients Reliant On Whisper, Medical Practitioners Reliant On Whisper"],"report_count":1},{"incident_id":851,"occurred_on":"2024-10-25","title":"Salt Lake City Police Chief Mike Brown's Voice and Image Misused in AI-Generated Scam","description":"A scammer used AI to create a deepfake video of Salt Lake City Police Chief Mike Brown, falsely claiming that a recipient owed $100,000 to the federal government. The video, sent via email from a fake SLCPD account, used a cloned voice and repurposed footage from a past interview.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Mike Brown, Woods Cross Residents, Salt Lake City Residents"],"report_count":4},{"incident_id":850,"occurred_on":"2024-10-24","title":"Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform","description":"Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai Users, @Sunsetbaneberry983, @Jasperhorehound160"],"developers":["Character.Ai"],"harmed":["George Floyd, Family Of George Floyd"],"report_count":1},{"incident_id":831,"occurred_on":"2024-10-23","title":"NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test","description":"NYC implemented an AI enabled weapons scanner for a month-long pilot with limited success. Despite not finding any weapons during the September 2024 testing phase, there were 118 false positives in which a person was searched under suspicion of carrying a weapon with no actual gun detections.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["New York City Government","Law enforcement"],"developers":["Evolv Technology"],"harmed":["New York City subway riders"],"report_count":2},{"incident_id":1089,"occurred_on":"2024-10-23","title":"Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum","description":"Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Various Actors Aligned With Sudanese Factions"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Political Leaders Of Sudan, Journalists Of Sudan, General Public Of Sudan, General Public, Epistemic Integrity, National Security And Intelligence Stakeholders"],"report_count":1},{"incident_id":833,"occurred_on":"2024-10-21","title":"Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska","description":"Polish radio station Off Radio Krakow replaced human presenters with AI-generated ones and aired a simulated interview with the deceased poet Wisława Szymborska. The AI-driven experiment aimed to attract younger listeners but led to job losses for former hosts. In response to the public backlash, the station ended its use of AI presenters.","mit_domain":"Socioeconomic & Environmental Harms","mit_subdomain":"Increased inequality and decline in employment quality","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Off Radio Krakow, Mariusz Marcin Pulit"],"developers":["Openai, Elevenlabs, Leonardo Ai"],"harmed":["Lukasz Zaleski, Mateusz Demski, Wislawa Szymborska, Off Radio Krakow Audience, Off Radio Krakow Employees"],"report_count":2},{"incident_id":848,"occurred_on":"2024-10-18","title":"High School Student in Córdoba, Argentina Accused of Using AI to Generate Explicit Images of Classmates","description":"An 18-year-old Argentine student at the pre-university institute of Manuel Belgrano of Córdoba allegedly used AI tools to generate explicit fake images of at least 22 female classmates by combining their faces with other bodies. These images, posted on pornography websites, included the victims' names, leading to harassment and significant psychological harm. Legal authorities charged the student with serious injuries aggravated by gender violence.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed 18-year-old Manuel Belgrano male student","University students","Synthetic media creators","Students","Men and boys","Men","Deepfake creators"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Women","Unnamed Manuel Belgrano female students","University students","Students","Privacy","Epistemic integrity","Educational communities"],"report_count":1},{"incident_id":849,"occurred_on":"2024-10-18","title":"AI Detection Tools Allegedly Misidentify Neurodivergent and ESL Students' Work as AI-Generated in Academic Settings","description":"AI writing detection tools have reportedly continued to falsely flag genuine student work as AI-generated, disproportionately impacting ESL and neurodivergent students. Specific cases include Moira Olmsted, Ken Sahib, and Marley Stevens, who were penalized despite writing their work independently. Such tools reportedly exhibit biases, leading to academic penalties, probation, and strained teacher-student relationships.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Universities","Colleges","Central Methodist University","Berkeley College"],"developers":["Turnitin","GPTZero","Copyleaks"],"harmed":["Students","Neurodivergent students","Moira Olmsted","Marley Stevens","Ken Sahib","ESL students","Epistemic integrity","Educational communities"],"report_count":1},{"incident_id":1459,"occurred_on":"2024-10-17","title":"Video with Reportedly AI-Generated Media Purported to Show Croatian Physician Alemka Markotić Endorsing Hondrosol After False Murder Claim on Facebook","description":"A Facebook video purported to show Croatian infectious-disease physician Alemka Markotić and TV host Zoran Šprajc discussing her supposed murder and endorsing a joint-pain product called Hondrosol. The clip and linked article were reported to use AI-generated or manipulated media and to mimic Croatian government branding, directing users toward a scam purchase page.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Zoran Sprajc, People Seeking Medical Advice, Ministry Of Health (Croatia), Ministarstvo Zdravstva, General Public Of Croatia, Epistemic Integrity, Alemka Markotic"],"report_count":1},{"incident_id":824,"occurred_on":"2024-10-16","title":"Purported Deepfake Allegedly Misattributes Claims to Former Student in Attack on Vice-Presidential Candidate Tim Walz","description":"A purported viral deepfake accused Democratic vice-presidential nominee Tim Walz of misconduct by using the stolen identity of former student Matthew Metro. Circulated on X and other platforms, the video reportedly reached millions before being flagged for manipulation. U.S. intelligence later revealed it and three other similar events were part of the Russian disinformation campaign Storm-1516, whose aim is to disrupt the 2024 elections. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Anonymous X User"],"developers":["Deepfake Technology Developers"],"harmed":["Tim Walz, Matthew Metro"],"report_count":16},{"incident_id":820,"occurred_on":"2024-10-15","title":"Alleged AI-Generated Photo Alteration Leads to Inappropriate Modifications in Speaker's Conference Picture","description":"An AI image expansion tool used by a conference organizer unintentionally altered Elizabeth Laraki’s profile picture for a marketing ad, making her blouse appear unbuttoned and showing a fabricated hint of undergarments. The AI generated the lower part of the image when expanding it for vertical formatting. The conference organizers quickly apologized and removed the altered content.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Conference Employee"],"developers":["Unknown Developer"],"harmed":["Elizabeth Laraki"],"report_count":5},{"incident_id":822,"occurred_on":"2024-10-15","title":"Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups","description":"A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Government of France","Caisse Nationale des Allocations Familiales (CNAF)"],"developers":["Government of France"],"harmed":["Women and girls","Women","Single parents","Single mothers in France","Single mothers","Privacy","People with disabilities in France","People with disabilities"],"report_count":2},{"incident_id":1163,"occurred_on":"2024-10-15","title":"Purported Face‑Swap Technology Reportedly Used to Circumvent Financial Platform's Facial Recognition Security in Nanjing, China","description":"In Nanjing, Jiangsu Province, a defendant (Fu Mou) was convicted in October 2024 for allegedly using AI‑powered face‑swap software to bypass an unnamed financial platform's facial recognition system. Authorities reported that he obtained over 1.95 million pieces of personal data, accessed 23 victims' payment accounts, changed passwords for several, and used one linked bank card to make purchases. Prosecutors said only one platform was successfully breached.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Fu Mou","Deepfake creators","Cybercriminals"],"developers":["Synthetic video generation technology developers","Synthetic media generation technology developers","Face-swap technology developers","Deepfake technology developers"],"harmed":["Unnamed financial payment platform","Individuals affected by compromise of 1.95 million+ personal records","23 unnamed victims whose payment accounts were accessed"],"report_count":2},{"incident_id":925,"occurred_on":"2024-10-15","title":"Alleged License Plate Recognition Errors in Christchurch Lead to Wrongful Parking Fines","description":"An automated license plate recognition (LPR) system at The Landing car park in Christchurch, New Zealand, reportedly issued wrongful fines to dozens of parents dropping off and picking up children. The system allegedly misidentified multiple short visits as prolonged parking, which led to disputed penalties. The operator acknowledged potential errors but continued enforcement.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Wilson Parking","Parking Enforcement Services","Law enforcement"],"developers":["Automated license plate reader (ALPR) developers"],"harmed":["The Landing car park customers","Kindercare Wigram Skies parents","General public of New Zealand","General public","Christchurch drivers"],"report_count":1},{"incident_id":868,"occurred_on":"2024-10-14","title":"Portland Water Bureau SERVUS Algorithm Reportedly Allocates Utility Bill Discount to High-Wealth Consumer","description":"The Portland Water Bureau's AI-driven pilot program for water bill discounts is reported to have randomly selected Tim Boyle, a wealthy high-water consumer, for a 40% discount intended for financially struggling customers. The program, developed by SERVUS, is meant to identify underserved individuals by using machine learning.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Portland Water Bureau"],"developers":["Portland Water Bureau"],"harmed":["Tim Boyle, Portland Water Bureau, Economically Vulnerable People, City Of Portland, Residents Of Portland, General Public, General Public Of Oregon, General Public Of Portland"],"report_count":1},{"incident_id":828,"occurred_on":"2024-10-13","title":"Uruguayan TV Program Santo y Seña Uses a Deepfake of Political Candidate Yamandú Orsi Without His Consent","description":"Uruguayan TV program Santo y Seña, hosted by Ignacio Álvarez, used AI to create a virtual representation of political candidate Yamandú Orsi, who declined an appearance. Nevertheless, without Orsi's permission, an AI-generated \"Orsi\" was shown alongside Andrés Ojeda, a rival candidate who appeared in person on the program.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Santo Y Sena, Canal 4"],"developers":["Deepfake Technology Developers"],"harmed":["Yamandu Orsi, Uruguayan Electorate, Uruguayan General Public, Democratic Integrity, Journalistic Integrity"],"report_count":3},{"incident_id":808,"occurred_on":"2024-10-11","title":"Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools","description":"An AI system developed by Infinite Campus and deployed by Nevada to identify at-risk students reportedly led to a sharp reduction in the number classified as needing support, dropping from 270,000 to 65,000. The reclassification allegedly caused significant budget cuts in schools serving low-income populations. The drastic reduction in identified at-risk students reportedly left thousands of vulnerable children without resources and support.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Nevada Department of Education"],"developers":["Infinite Campus"],"harmed":["Students","Somerset Academy","Nevada school districts","Minors","Mater Academy of Nevada","Educational communities","Economically vulnerable students in Nevada","Economically vulnerable people"],"report_count":1},{"incident_id":1354,"occurred_on":"2024-10-10","title":"Purportedly AI-Altered Fake Nude Images of High School Girls and Women Reportedly Created and Disseminated in Pensacola, Florida","description":"In Pensacola, Florida, an 18-year-old man allegedly used an online AI image-alteration application to digitally \"undress\" photos of dozens of girls and young women without their consent, creating realistic fake nude images. Some source photos were reportedly taken when the victims were minors. The images were reportedly discovered on the man's phone and subsequently copied and shared with other students by a third party, prompting a police investigation and arrest.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed 18 Year Old Male Student From Pensacola"],"developers":["Deepfake Technology Developers, Image Generation Technology Developers"],"harmed":["Unnamed Students From Pensacola, Students, Minors, Epistemic Integrity, Educational Communities"],"report_count":2},{"incident_id":819,"occurred_on":"2024-10-09","title":"ProKYC Tool Allegedly Facilitates Deepfake-Based Account Fraud on Cryptocurrency Exchanges","description":"Cato CTRL security researchers reported that the cybercriminal group ProKYC is selling a deepfake tool capable of bypassing biometric and two-factor authentication (2FA) systems on cryptocurrency exchanges. The tool creates synthetic identities using AI-generated videos and forged documents, enabling fraudulent account creation. A demo video from ProKYC shows the tool in action against ByBit, allowing attackers to verify fake accounts for purposes such as money laundering and identity theft.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Prokyc"],"developers":["Prokyc"],"harmed":["Bybit, Cryptocurrency Exchanges, Cryptocurrency Investors"],"report_count":1},{"incident_id":825,"occurred_on":"2024-10-08","title":"AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect","description":"An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hoodline San Jose"],"developers":["Impress3"],"harmed":["Stephen M. Wagstaffe, San Mateo County District Attorney, Residents Of San Mateo County, General Public"],"report_count":2},{"incident_id":906,"occurred_on":"2024-10-08","title":"Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East","description":"An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cybercriminals"],"developers":["Unnamed Ai Call Center Platform Provider"],"harmed":["Privacy, Enterprise Clients, End Users Of Undisclosed Middle Eastern Ai Powered Cloud Call Center Platform"],"report_count":3},{"incident_id":839,"occurred_on":"2024-10-07","title":"Purportedly AI-Driven Phishing Scam Uses Spoofed Google Call to Attempt Gmail Breach of Security Expert","description":"Scammers allegedly used a purportedly AI-generated voice to impersonate a Google representative in an attempt to steal Gmail account credentials from security expert Sam Mitrovic. The reportedly AI-driven phishing call used a spoofed Google phone number and a fabricated email, making the scam appear legitimate. Mitrovic reportedly noted that the caller's professional demeanor, coupled with AI-generated speech and a Google-related number, could easily deceive unsuspecting users.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Sam Mitrovic, Epistemic Integrity"],"report_count":20},{"incident_id":815,"occurred_on":"2024-10-06","title":"Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge","description":"Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["West New York PD","Police departments","Pflugerville PD","NYPD","Miami PD","Law enforcement","Jefferson Parish Sheriff’s Office","Facial recognition system deployers"],"developers":["Facial recognition system developers","Clearview AI"],"harmed":["Quran Reid","Privacy","People misidentified by facial recognition systems","General public of the United States","General public","Francisco Arteaga","Biometric data subjects"],"report_count":2},{"incident_id":865,"occurred_on":"2024-10-02","title":"Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7","description":"The hacker group FIN7 is allegedly behind fake AI \"nudify\" websites distributing infostealer malware to users, according to an investigation by Silent Push. These sites are reported to lure individuals seeking deepfake AI tools into downloading malware disguised as software to \"nudify\" photos. The malware steals sensitive data from victims, which is used for extortion or financial fraud. FIN7's activity on this front reportedly marks the revival of a group previously declared defunct by the U.S.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Fin7, Carbon Spider, Elbrus, Sangria Tempest"],"developers":["Fin7, Carbon Spider, Elbrus, Sangria Tempest"],"harmed":["Users Of Fake Nudify Sites"],"report_count":5},{"incident_id":811,"occurred_on":"2024-10-02","title":"AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions","description":"AI-powered meeting assistants, such as Otter.ai's OtterPilot and Zoom's AI Companion, have reportedly shared sensitive and private conversations beyond the intended audience. These tools, which are set to automatically record and distribute meeting transcripts, allegedly sent confidential discussions after participants had left the meeting, the consequences of which led to unintended exposure of proprietary information and privacy breaches.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed Venture Capital Investors, Organizations, Employers, Employees, Companies, Alex Bilzerian"],"developers":["Zoom, Otter.Ai, Ai Transcription Technology Developers"],"harmed":["Unnamed Venture Capital Investors, Privacy, Organizations, Employers, Employees, Companies, Alex Bilzerian"],"report_count":6},{"incident_id":814,"occurred_on":"2024-10-02","title":"AI Avatar of Murder Victim Created Without Consent on Character.ai Platform","description":"A user on the Character.ai platform created an unauthorized AI avatar of Jennifer Ann Crecente, a murder victim from 2006, without her family's consent. The avatar was made publicly available, violating Character.ai's policy against impersonation. After the incident surfaced, Character.ai removed the avatar, acknowledging a policy violation. ","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Other","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai"],"developers":["Character.Ai"],"harmed":["Jennifer Ann Crecente, Drew Crecente, Crecente Family, Brian Crecente"],"report_count":9},{"incident_id":1014,"occurred_on":"2024-10-01","title":"Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes","description":"Beginning sometime in October 2024, students ranging in age from 12 to 20 in schools in Malta were targeted in deepfake nude incidents. The attackers have been superimposing the faces of some of the students over the bodies of naked girls or using \"nudify\" apps to \"undress\" the photos, which have reportedly been sent to the victims over WhatsApp in order to humiliate them or in some cases blackmail them.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators, Deepfake Creators In Malta"],"developers":["Deepfake Technology Developers"],"harmed":["Students In Malta, Students, Minors In Malta, Minors, General Public Of Malta, Educational Communities"],"report_count":1},{"incident_id":841,"occurred_on":"2024-10-01","title":"Purportedly AI-Manipulated Video Allegedly Targets Moldovan Economic Development Minister Dumitru Alaiba in Election Disinformation Campaign","description":"A purportedly AI-manipulated video and some photos circulated online depicting Moldova's Economic Development Minister, Dumitru Alaiba, in compromising situations as part of an alleged disinformation campaign by pro-Kremlin supporters, one that has been reported to rely on AI to generate fake content. Alaiba reportedly denounced the purported synthetic media as having been released to mislead the public and influence Moldova's elections by undermining his reputation and the government's pro-Euro","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Government Of Russia, Anti European Union Influencers, Pro Russian Information Manipulation Actors"],"developers":["Unknown Ai Developers, Deepfake Technology Developers"],"harmed":["Pro European Union Moldovans, Moldovan General Public, Government Of Moldova, Dumitru Alaiba, Democratic Integrity"],"report_count":3},{"incident_id":1194,"occurred_on":"2024-10-01","title":"L.A. Woman Reportedly Defrauded of $81,000 and $350,000 Condo Proceeds in Romance Scam Using Purported Deepfake Videos of Actor Steve Burton","description":"In October 2024, Los Angeles resident Abigail Ruvalcaba was reportedly targeted in a romance scam using purported AI-generated deepfake videos and voice impersonations of actor Steve Burton. Believing she was in a relationship, she allegedly sent over $81,000 in cash, gift cards, and crypto, then sold her condo for $350,000 and transferred proceeds to the scammer. Her daughter intervened in February 2025, but the family now reportedly faces bankruptcy and legal battles to recover losses.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Scammers Impersonating Steve Burton, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Steve Burton, General Public, Family Of Abigail Ruvalcaba, Abigail Ruvalcaba"],"report_count":3},{"incident_id":854,"occurred_on":"2024-09-30","title":"Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco","description":"A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Loss of human agency and autonomy","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Waymo"],"developers":["Waymo"],"harmed":["Amina V."],"report_count":8},{"incident_id":818,"occurred_on":"2024-09-28","title":"Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion","description":"A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Jennifer Aniston Fans, Jennifer Aniston, Facebook Users"],"report_count":2},{"incident_id":947,"occurred_on":"2024-09-25","title":"Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam","description":"Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Highline Public Schools, Families Of Highline Public Schools, Students, Minors, Parents, Educational Communities, Epistemic Integrity"],"report_count":1},{"incident_id":807,"occurred_on":"2024-09-25","title":"ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report","description":"A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI. ","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Government Of Victoria, Employee Of Department Of Families Fairness And Housing, Department Of Families Fairness And Housing"],"developers":["Openai"],"harmed":["Unnamed Family Of Child, Unnamed Child"],"report_count":9},{"incident_id":972,"occurred_on":"2024-09-25","title":"Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax","description":"A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Storm 1516, John Mark Dougan, Russian State Media, Sputnik, Rt (Russia Today), Pravda Network"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Kamala Harris, American Voters, Democratic Integrity"],"report_count":2},{"incident_id":817,"occurred_on":"2024-09-24","title":"Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response","description":"During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing ","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Partisan Social Media Influencers, Unknown Actors, Unknown Malicious Actors, Deepfake Creators"],"developers":["Deepfake Technology Developers, Image Generation Technology Developers"],"harmed":["Hurricane Helene Victims, General Public, Emergency Responders, Communities Impacted By Hurricane Helene"],"report_count":8},{"incident_id":1065,"occurred_on":"2024-09-23","title":"Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money","description":"Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Stacey Svegliato, Sara Sandlin, General Public, General Public In Houston"],"report_count":1},{"incident_id":1137,"occurred_on":"2024-09-20","title":"Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool","description":"In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Surendra Singh And Associates"],"developers":["Large Language Model Developers, Generative Ai Developers"],"harmed":["Surendra Singh And Associates, Philani Godfrey Mavundla"],"report_count":3},{"incident_id":858,"occurred_on":"2024-09-19","title":"Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida","description":"A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Udi Levi, Margrit Pritchard, Lauren Albrecht, Josh Mor, Florida Title And Trust"],"report_count":4},{"incident_id":813,"occurred_on":"2024-09-19","title":"Starship Technologies Delivery Robot Reportedly Injures Arizona State University Employee","description":"A semi-autonomous delivery robot operated by Starship Technologies reportedly struck a pedestrian employed by Arizona State University on the campus sometime in September 2023, purportedly causing injuries after abruptly reversing into her. The robot is reported to have initially knocked the pedestrian down, then moved toward her again while she was still on the ground. The company reportedly offered the victim promo codes and insurance information as an apology. On September 19, 2024, 404 Media","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Starship Technologies"],"developers":["Starship Technologies"],"harmed":["Unnamed Arizona State University Employee"],"report_count":2},{"incident_id":805,"occurred_on":"2024-09-19","title":"Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba","description":"Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Malicious Actor Impersonating Dmytro Kuleba"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Dmytro Kuleba, Ben Cardin, Relations Between The United States And Ukraine, Epistemic Integrity, National Security And Intelligence Stakeholders"],"report_count":10},{"incident_id":1324,"occurred_on":"2024-09-18","title":"Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims","description":"The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Pieces Technologies"],"developers":["Pieces Technologies"],"harmed":["Public health","Patients","Healthcare institutions","Epistemic integrity","Clinicians"],"report_count":4},{"incident_id":840,"occurred_on":"2024-09-18","title":"AI-Generated Media Reportedly Used in Russian Disinformation Campaign in Moldova","description":"Russian-linked entities allegedly deployed AI-generated images and videos to spread disinformation aimed at swaying Moldova’s referendum on E.U. membership. The AI-enhanced media campaign included fabricated stories and doctored visuals, the purpose of which was reportedly designed to amplify fear and undermine pro-E.U. sentiment in the days leading up to the referendum.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russia Backed Influencers, Maria Zakharova, Ilan Shor, Government Of Russia"],"developers":["Unknown Ai Developers"],"harmed":["Pro Eu Moldovans, Moldovan General Public, Maia Sandu, Government Of Moldova, Dumitru Alaiba, Democratic Integrity"],"report_count":1},{"incident_id":856,"occurred_on":"2024-09-15","title":"Purportedly AI-Generated Audio Allegedly Fabricates Biden's Admission of Role in Pakistani Political Crisis","description":"A purported deepfake audio file is alleged to have falsely claimed that U.S. President Joe Biden conspired with Pakistan's Army Chief, General Syed Asim Munir, to remove former Prime Minister Imran Khan in 2022. Widely shared online, the audio is reported to have exploited generative AI to spread political misinformation.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Syed Asim Munir, Relations Between The U.S. And Pakistan, People Of Pakistan, Joe Biden, Imran Khan"],"report_count":1},{"incident_id":806,"occurred_on":"2024-09-13","title":"Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang","description":"A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zhang Mouguo, Wu Mouhao, Hu Mouyun, Hu Mouliang, Scammers"],"developers":["Ai Face Swapping Technology Developers, Deepfake Technology Developers, Multimodal Large Model Developers"],"harmed":["Privacy, Chinese Online Platform Users, General Public, General Public Of China"],"report_count":1},{"incident_id":802,"occurred_on":"2024-09-13","title":"Purported Deepfake of Brian May Allegedly Exploited in Scam Offering Fake Queen Backstage Tickets","description":"Scammers allegedly created an AI-generated deepfake of Queen guitarist Brian May, reportedly posting a video on TikTok in which the fake May offers backstage tickets to a Queen concert. The real Brian May reportedly warned fans about this \"disgusting\" scam, emphasizing that Queen has no tour dates planned and does not sell backstage access.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators, Scammers Impersonating Brian May"],"developers":["Deepfake Technology Developers, Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Synthetic Video Generation Technology Developers"],"harmed":["Tiktok Users, Queen (Band) Fans, General Public Of The United Kingdom, General Public, Epistemic Integrity, Brian May Fans, Financial Scam Victims, Victims Of Deepfake Enabled Fraud"],"report_count":1},{"incident_id":791,"occurred_on":"2024-09-09","title":"Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise","description":"Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google, Ai Overview"],"developers":["Google"],"harmed":["Parents, Google Users, Google"],"report_count":1},{"incident_id":782,"occurred_on":"2024-09-09","title":"AI 'Nudify' Apps Used as Tools for Blackmail and Extortion","description":"AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Sextortionists","Extortionists","Deepfake creators"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake creators"],"harmed":["Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake abuse","Privacy","General public of India","General public","Epistemic integrity"],"report_count":1},{"incident_id":785,"occurred_on":"2024-09-08","title":"ESPN's AI Coverage Reportedly Overlooks Alex Morgan in Her Final Match Recap","description":"ESPN's AI-generated recap of Alex Morgan's final professional soccer match reportedly failed to mention her significant retirement moment, instead providing a standard rundown that missed the emotional context.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["ESPN Generative AI Services","ESPN"],"developers":["ESPN Generative AI Services","ESPN"],"harmed":["Women and girls","Women","Public figures","National Women’s Soccer League (NWSL)","Fans of Alex Morgan","Athletes","Alex Morgan"],"report_count":1},{"incident_id":778,"occurred_on":"2024-09-04","title":"Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries","description":"Amazon's Alexa was found to provide politically biased responses when asked about the 2024 presidential candidates. It refused to give reasons to vote for Donald Trump, citing neutrality, while offering detailed endorsements for Kamala Harris. Amazon labeled the discrepancy an \"error\" and reportedly corrected it.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Alexa Device Owners"],"developers":["Amazon"],"harmed":["Alexa Device Owners, Donald Trump Presidential Campaign, Donald Trump Supporters"],"report_count":2},{"incident_id":779,"occurred_on":"2024-09-04","title":"Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam","description":"Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Michael Smith, Money Launderers, Scammers"],"developers":["Synthetic Audio Generation Technology Developers, Synthetic Media Generation Technology Developers"],"harmed":["Spotify, Music Streaming Services, Apple Music, Amazon Music"],"report_count":2},{"incident_id":1458,"occurred_on":"2024-09-03","title":"Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook","description":"A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Green Facebook Page, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["People Seeking Medical Advice, Ministry Of Health (Croatia), Ministarstvo Zdravstva, Josip Paladino, General Public Of Croatia, Epistemic Integrity"],"report_count":1},{"incident_id":781,"occurred_on":"2024-09-03","title":"Clearview AI Reportedly Faces $33.7 Million Fine for Violating GDPR with Biometric Data Harvesting","description":"Clearview AI was reportedly fined $33.7 million by the Dutch data protection authority for allegedly creating an illegal facial recognition database by scraping billions of images from the Internet without consent. The company allegedly used AI to convert these images into biometric data and sold the service to law enforcement. This act was reportedly in violation of privacy laws and the GDPR.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Clearview Ai"],"developers":["Clearview Ai, Facial Recognition System Developers"],"harmed":["General Public, General Public Of The Netherlands, Privacy, Biometric Data Subjects"],"report_count":2},{"incident_id":800,"occurred_on":"2024-09-03","title":"53% of American and British Businesses Report Attacks by AI-Powered Deepfake Scams in 2024","description":"According to Medius, Deepfake scams have targeted 53% of businesses in the U.S. and U.K., with 43% falling victim. Using AI to create realistic fake videos and audio of corporate executives, scammers have successfully stolen millions, including $25 million from British engineering group Arup. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["American Businesses, British Businesses, Finance Professionals, Employees, Arup"],"report_count":2},{"incident_id":775,"occurred_on":"2024-09-02","title":"Elon Musk Reportedly Shared an AI-Generated Image Depicting Kamala Harris Dressed as a Communist Ruler","description":"Elon Musk reportedly shared an AI-generated image on X depicting Kamala Harris as a \"communist dictator\" in response to her post about Donald Trump's political intentions.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai, X (Twitter), Elon Musk"],"developers":["Xai"],"harmed":["Kamala Harris, General Public"],"report_count":1},{"incident_id":969,"occurred_on":"2024-09-02","title":"Russian Disinformation Campaign Allegedly Used Fake News Site 'KBSF-San Francisco News' and Deepfake Video to Falsely Accuse Kamala Harris of 2011 Hit-and-Run","description":"A Russian disinformation campaign allegedly used a fake news site, \"KBSF-San Francisco News,\" and an AI-generated deepfake video to falsely accuse Kamala Harris of a 2011 hit-and-run accident in San Francisco. The deepfake featured a fabricated African-American victim, whose AI-generated testimony spread widely across social media. Microsoft identified the hoax as part of Russian cyber influence operations targeting the 2024 U.S. election, with the site registered in Iceland.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Storm 1516, Kbsf San Francisco News, John Mark Dougan, Government Of Russia"],"developers":["John Mark Dougan, Government Of Russia"],"harmed":["Kamala Harris, General Public Of The United States, General Public, Epistemic Integrity, Journalistic Integrity, National Security And Intelligence Stakeholders, Democratic Integrity"],"report_count":4},{"incident_id":801,"occurred_on":"2024-09-02","title":"Bias in AI Deepfake Detection Undermines Election Security in Global South","description":"AI deepfake detection tools are reportedly failing voters in the Global South due to biases in their training data. These tools, which prioritize English language and Western faces, show reduced accuracy when detecting manipulated content from non-Western regions. As a result of this detection gap, election integrity faces threats from and the amplification of misinformation, which leaves journalists and researchers with inadequate resources to combat the issue.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Deepfake Detection Technology Developers, True Media, Reality Defender"],"developers":["Unknown Deepfake Detection Technology Developers, True Media, Reality Defender"],"harmed":["Global South Citizens, Political Researchers, Global South Local Fact Checkers, Non Native English Speakers, Global South Journalists, Civil Society Organizations In Developing Countries"],"report_count":1},{"incident_id":1365,"occurred_on":"2024-09-01","title":"AkiraBot Reportedly Used OpenAI to Spam Website Chats and Contact Forms at Scale","description":"SentinelLabs reported that unknown operators used AkiraBot, a Python framework, plus OpenAI's chat API to generate customized SEO spam and bypass CAPTCHAs, posting via SMB websites' contact forms and Reamaze-style chat widgets. Researchers assessed >400k domains were targeted and ≥80k successfully spammed since 09/01/2024. OpenAI said the API key was disabled after disclosure.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Malicious Actors, Unknown Akirabot Operators"],"developers":["Unknown Akirabot Developers, Openai"],"harmed":["Wix Sites, Victims Of Akirabot, Squarespace Sites, Small Business Owners, Shopify Sites, Medium Sized Business Owners, Godaddy Sites, Customers, Business Website Users, Business Owners"],"report_count":4},{"incident_id":1464,"occurred_on":"2024-08-28","title":"Purportedly AI-Manipulated Video Reportedly Misrepresented Bulgarian DPS Figure Ahmed Dogan and Spread via TikTok and Facebook","description":"A reportedly AI-manipulated video appeared to repurpose footage of Ahmed Dogan, honorary chairman of Bulgaria's Movement for Rights and Freedoms (DPS), by overlaying synthetic audio that made him seem to urge party members to protest in defense of his wealth. The clip reportedly originated from a satirical TikTok account and was later circulated on Facebook by anonymous profiles.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Metodi Stoychev, Georgi Georgiev, Anonymous Tiktok Satire Profile, Information Manipulation Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Epistemic Integrity, Ahmed Dogan, General Public, General Public Of Bulgaria"],"report_count":1},{"incident_id":777,"occurred_on":"2024-08-28","title":"South Korea Reportedly Experienced a Surge of Explicit Deepfake Pornography","description":"At the end of August 2024, South Korean authorities reportedly began investigating a significant surge in the creation and dissemination, often via Telegram, of explicit deepfake pornography created without consent from the stolen social media content of female classmates, teachers, and neighbors.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Deepfake creators"],"developers":["Synthetic media generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake abuse","Privacy","General public of South Korea","General public","Epistemic integrity"],"report_count":7},{"incident_id":1573,"occurred_on":"2024-08-28","title":"National Company Law Tribunal Reportedly Relied on AI-Hallucinated Precedents in Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd","description":"In Pooja Ramesh Singh v. Jammu and Kashmir Bank Ltd., India's National Company Law Tribunal (NCLT) reportedly admitted insolvency proceedings against Essel Infraprojects after relying on six purported precedents later found to be fabricated or materially inaccurate. The appellate tribunal upheld the ruling, but the Supreme Court later invalidated both decisions and sent the insolvency petition back to the NCLT for a new ruling.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["National Company Law Tribunal","Lawyers","Courts"],"developers":["Large language model developers","AI research tool developers"],"harmed":["Pooja Ramesh Singh","Parties to insolvency proceedings","Judicial integrity","Essel Infraprojects Ltd","Epistemic integrity"],"report_count":1},{"incident_id":1457,"occurred_on":"2024-08-27","title":"Video with Reportedly AI-Generated Media Purported to Show Croatian Immunologist Stipan Jonjić Promoting Anti-Parasite Product on Facebook","description":"A Facebook page reportedly posted a video that purported to show Croatian immunologist Stipan Jonjić endorsing an anti-parasite product and recommending it over conventional treatment. The clip was reported to use AI-generated or manipulated media, and Jonjić denied involvement. A woman was reported to have purchased the product after seeing the ad.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Sepenuhnya Alami Facebook Page, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Stipan Jonjic, People Seeking Medical Advice, General Public Of Croatia, Epistemic Integrity"],"report_count":1},{"incident_id":1545,"occurred_on":"2024-08-26","title":"Florida Police Reportedly Wrongfully Arrested Commercial Crabber Robert Dillon After Allegedly False Facial Recognition Match","description":"Florida police reportedly arrested commercial crabber Robert Dillon in August 2024 after the statewide FACES facial recognition system purportedly identified him as a possible match to a suspect shown in grainy surveillance images from Jacksonville Beach. Dillon reportedly lived more than 300 miles away and said he had never visited the city. He reportedly spent a night in jail and posted bond using his truck title.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Pinellas County Sheriff's Office","Law enforcement agencies","Jacksonville Sheriff's Office","Jacksonville Beach Police Department","Facial recognition system deployers"],"developers":["Pinellas County Sheriff's Office","Facial recognition system developers"],"harmed":["Wrongfully arrested individuals","Robert Dillon","Privacy","People misidentified by facial recognition systems","Biometric data subjects"],"report_count":2},{"incident_id":864,"occurred_on":"2024-08-23","title":"Generative AI Allegedly Used to Facilitate $255,000 Real Estate Fraud Scheme","description":"A real estate scam is reported to have used AI-generated phishing emails to impersonate a title company lawyer, tricking homebuyer Raegan Bartlo into wiring $255,000 to a fraudulent account. The emails were alleged to be convincing, with no grammatical errors or tone issues. Bartlo recovered part of the funds but lost $112,000.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Generative Ai Developers"],"harmed":["Real Estate Market, Raegan Bartlo, Financial Institutions"],"report_count":1},{"incident_id":780,"occurred_on":"2024-08-23","title":"Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography","description":"Seth Herrera, a U.S. Army soldier at Joint Base Elmendorf-Richardson (JBER), is accused of using artificial intelligence to generate pornography depicting minors with whom he was in contact. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Ai Developers"],"developers":["Seth Herrera"],"harmed":["Minors"],"report_count":1},{"incident_id":776,"occurred_on":"2024-08-21","title":"Megalopolis Trailer Included Fake AI-Generated Quotes Attributed to Film Critics","description":"Lionsgate pulled the trailer for \"Megalopolis\" after it was discovered to contain fake quotes from well-known film critics, generated by AI. The quotes falsely criticized Francis Ford Coppola's previous films. The incident was attributed to an error in vetting by marketing consultant Eddie Egan. Lionsgate has since parted ways with Egan and apologized to Coppola and the critics affected by the fabricated content.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Lionsgate, Eddie Egan"],"developers":["Chatbot Developers"],"harmed":["Francis Ford Coppola, Pauline Kael, Film Critics, American Zoetrope, Lionsgate"],"report_count":1},{"incident_id":773,"occurred_on":"2024-08-20","title":"Chatbot in Workplace Training at Bunbury Prison Reveals Real Names in Sexual Harassment Case","description":"During workplace training at Bunbury Prison in Western Australia, a trainer used Microsoft's Copilot AI chatbot to generate case study scenarios. The chatbot produced a scenario that included the real name of a former employee involved in a sexual harassment case, revealing sensitive information.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Western Australia Department of Justice","Charlotte Ingham"],"developers":["Microsoft","Large language model developers","Chatbot developers"],"harmed":["Western Australia Department of Justice senior staff members","Western Australia Department of Justice","Privacy","Bronwyn Hendry"],"report_count":1},{"incident_id":767,"occurred_on":"2024-08-18","title":"AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump","description":"Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Donald Trump"],"developers":["Image Generation Technology"],"harmed":["Kamala Harris, Democratic National Committee, Democratic Integrity"],"report_count":2},{"incident_id":766,"occurred_on":"2024-08-18","title":"Trump Reportedly Shares Purportedly AI-Generated Images Falsely Suggesting Taylor Swift Endorsement","description":"Donald Trump reportedly shared images that were purportedly generated by AI on social media that are alleged to have depicted Taylor Swift endorsing him for the upcoming election. The images reportedly included Swift dressed as Uncle Sam and fans wearing \"Swifties for Trump\" shirts.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Donald Trump"],"developers":["Deepfake Technology Developers, Image Generation Technology Developers"],"harmed":["Taylor Swift, Swifties, General Public, Epistemic Integrity, Democratic Integrity"],"report_count":2},{"incident_id":770,"occurred_on":"2024-08-16","title":"Microsoft Copilot Falsely Accuses Journalist Martin Bernklau of Crimes","description":"Microsoft's Copilot is reported to have falsely accused veteran court reporter Martin Bernklau of committing serious crimes, including child abuse and fraud. The tool is described as having generated defamatory content that not only accused Bernklau of multiple crimes he covered as a journalist but also provided his personal contact details. Attempts by Microsoft to remove the false entries were only temporarily successful, as the defamatory information reportedly reappeared.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Microsoft, Microsoft Copilot"],"developers":["Microsoft"],"harmed":["Martin Bernklau"],"report_count":3},{"incident_id":1004,"occurred_on":"2024-08-15","title":"San Francisco City Attorney Sues Operators of AI Deepfake Pornography Websites for Violations of State and Federal Law","description":"In August 2024, the San Francisco City Attorney’s Office filed a first-of-its-kind lawsuit against 16 websites accused of using generative AI to create and distribute nonconsensual pornographic deepfakes, including images of minors. The sites, which had over 200 million visits in six months, invited users to upload real images to generate explicit fakes. By March 2025, 11 of the targeted websites had shut down following legal pressure.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Operators of 16 deepfake pornography websites","Deepfake creators"],"developers":["Synthetic media generation technology developers","Deepfake technology developers"],"harmed":["Women depicted in deepfake pornography","Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake child abuse","Victims of deepfake abuse","Privacy","Minors depicted in deepfake pornography"],"report_count":2},{"incident_id":998,"occurred_on":"2024-08-15","title":"ChatGPT Allegedly Defamed Norwegian User by Inventing Child Homicide and Imprisonment","description":"In August 2024, ChatGPT is reported to have falsely claimed that Norwegian citizen Arve Hjalmar Holmen had killed his two sons and been sentenced to 21 years in prison. The fabricated response allegedly included specific details about the supposed crime, despite Holmen never being accused or convicted of any offense. The incident prompted a GDPR complaint for defamation and inaccurate personal data.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Arve Hjalmar Holmen"],"report_count":3},{"incident_id":795,"occurred_on":"2024-08-14","title":"Deepfake Elon Musk Videos Have Reportedly Contributed to Billions in Fraud","description":"Scammers used AI to create deepfake videos of Elon Musk promoting fraudulent investment opportunities. Over time, these scams have reportedly led to billions in investor losses. The deepfakes also use voice cloning technology. They have been distributed on social media and YouTube. In particular, they target the elderly, such as 82-year-old Steve Beauchamp, to invest significant sums. Despite efforts by platforms to remove these videos, the scams continue to proliferate.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Elderly Investors, Cryptocurrency Users, Online Investors, Social Media Users, Retirees Seeking Investment Opportunities, Steve Beauchamp, Elon Musk"],"report_count":2},{"incident_id":762,"occurred_on":"2024-08-14","title":"Grok AI Reportedly Generates Offensive and Violent Images Without Proper Safeguards","description":"Elon Musk’s Grok AI, launched on X, generated offensive and violent images without adequate safety controls. The AI produced deepfakes of public figures like Taylor Swift, Kamala Harris, and Alexandria Ocasio-Cortez, as well as copyrighted characters such as Mickey Mouse in inappropriate scenarios. Despite claiming adherence to certain content guidelines, Grok's outputs included politically charged and explicit imagery","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai"],"developers":["X (Twitter), Xai"],"harmed":["Taylor Swift, Nintendo, Kamala Harris, Joe Biden, Donald Trump, Disney, Alexandria Ocasio Cortez"],"report_count":3},{"incident_id":763,"occurred_on":"2024-08-13","title":"Grok AI Chatbot Reportedly Spreads Unfounded Rumors About Trump’s Dentures","description":"Grok, X’s AI-powered chatbot, reportedly spread unsubstantiated claims about former President Trump’s alleged dentures during his interview with Elon Musk. The AI-generated summary is alleged to have falsely stated that Trump’s speech issues were due to missing dentures, despite no evidence. The post was quickly removed, but the incident is an example of concerns over Grok's tendency to amplify misinformation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai"],"developers":["Xai"],"harmed":["Donald Trump, Elon Musk, X (Twitter) Users, General Public"],"report_count":1},{"incident_id":794,"occurred_on":"2024-08-13","title":"Reported Glitch in Waymo Self-Driving Cars Purportedly Triggers Regular All-Night Honking in San Francisco","description":"Waymo self-driving cars in San Francisco's South of Market neighborhood reportedly began honking at each other late at night, disturbing residents' sleep. The autonomous vehicles, reportedly using a parking lot for ride pauses, triggered honking due to a purported glitch in their algorithms. Despite residents' complaints, the issue allegedly persisted for weeks until Waymo acknowledged the problem and began working on a fix.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Waymo"],"developers":["Waymo"],"harmed":["South Of Market Residents, South Of Market Businesses, San Francisco Residents, General Public Of San Francisco"],"report_count":2},{"incident_id":761,"occurred_on":"2024-08-08","title":"TikTok AI System Used to Amplify Election Disinformation by Foreign Networks","description":"AI-generated misinformation on TikTok, driven by foreign networks, has flooded the platform with false narratives about the 2024 U.S. presidential election. Thousands of videos spreading political lies were identified, potentially influencing millions of users. Despite TikTok’s efforts to remove these accounts, the AI-driven disinformation campaign continues to challenge the integrity of the election.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Tiktok Users From China, Unknown Tiktok Users From Iran, Unknown Tiktok Users From Nigeria, Unknown Tiktok Users From Vietnam"],"developers":["Tiktok"],"harmed":["American Electorate, General Public, Democratic Integrity"],"report_count":1},{"incident_id":835,"occurred_on":"2024-08-06","title":"Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China","description":"In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensiv","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Yang Moumou, Tian Mou, Lou Moumou"],"developers":["Unknown Ai Developers, Deepfake Technology Developers"],"harmed":["Yunnan General Public, Xide County In Sichuan Residents, Sichuan General Public, Muli County In Sichuan Residents, Chinese General Public, Chinese Citizens, Chengcheng County Shaanxi Residents"],"report_count":1},{"incident_id":892,"occurred_on":"2024-08-05","title":"Apple Intelligence Allegedly Flags Scam Messages as High Priority","description":"Apple’s AI notification summarization and prioritization feature, part of the Apple Intelligence update, has reportedly flagged scam and phishing messages as high-priority, and is allegedly misleading users into trusting fraudulent communications. By rephrasing and condensing messages, the system is allegedly amplifying scam risks inadvertently and reportedly increasing the likelihood of financial harm for users.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Apple"],"developers":["Apple"],"harmed":["Apple Users, Apple Intelligence Users"],"report_count":5},{"incident_id":1034,"occurred_on":"2024-08-04","title":"Reported AI-Manipulated Video Depicts Donald Trump Endorsing Peter Obi and Criticizing Bola Tinubu","description":"A widely circulated video reportedly falsely depicts Donald Trump endorsing Nigerian politician Peter Obi and criticizing President Bola Tinubu. FactCheckAfrica confirmed the video was false, originally sourced from a 2017 U.S. presidential interview about Trump's first 100 days in office. AI-generated audio and altered visuals were reportedly used to fabricate a politically charged statement unrelated to the original content.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Peter Obi, General Public Of Nigeria, Donald Trump, Bola Tinubu, Democratic Integrity, Journalistic Integrity"],"report_count":1},{"incident_id":1245,"occurred_on":"2024-08-02","title":"Norwegian Student Reportedly Used AI-Generated Deepfake Videos in Spanish Coursework at University of South-Eastern Norway","description":"A student at the University of South-Eastern Norway reportedly submitted multiple deepfake videos for Spanish coursework, featuring an AI-generated likeness and synthetic voice. Faculty reportedly noted unnatural facial movements and inconsistent language ability. The case was reportedly ruled academic misconduct, resulting in annulled grades and a year-long suspension, marking one of Norway's first confirmed deepfake-related cheating cases.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed University Of South Eastern Norway Student, Deepfake Creators"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["University Of South Eastern Norway, Universitetet I Sorost Norge, Epistemic Integrity, Academic Integrity, Students, Minors, Teachers, Educational Communities"],"report_count":1},{"incident_id":1291,"occurred_on":"2024-08-01","title":"South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations","description":"Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Choi Minsu, Choi Jinwoo, Seo Jaeseok"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["General Public, Victims Of Romance Scams, Trafficking Victims Coerced Into Scam Operations, Epistemic Integrity"],"report_count":2},{"incident_id":804,"occurred_on":"2024-07-30","title":"AI-Generated Fake 'True Crime' Video About Non-Existent Littleton Murder Goes Viral","description":"An AI-generated \"true crime\" video on YouTube falsely depicted a Littleton man's \"secret gay love affair\" and murder by his stepson. The 25-minute video, which garnered nearly 2 million views, fabricated details and used deepfake technology to deceive viewers into believing the story was real. Despite being flagged as false by local authorities and lacking credible sources, the video sparked widespread misinformation and outrage online.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["True Crime Case Files Youtube Channel"],"developers":["Deepfake Technology Developers"],"harmed":["Viewers Of True Crime Case Files Youtube Channel, Residents Of Littleton"],"report_count":5},{"incident_id":810,"occurred_on":"2024-07-29","title":"TikTok Network Amplifies AI-Generated Nazi Propaganda and Hate Speech","description":"A coordinated neo-Nazi network on TikTok used AI-generated media, including Hitler speeches, to spread Nazi propaganda and extremist content, violating TikTok’s hate speech policies. The network evaded platform moderation through coded language, imagery, and music, with some accounts accumulating millions of views. TikTok’s algorithm further amplified the reach of this content, despite community guidelines.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Ai Developers"],"developers":["Pro Nazi Tiktok Accounts"],"harmed":["Tiktok Users"],"report_count":1},{"incident_id":756,"occurred_on":"2024-07-26","title":"Deepfake of Kamala Harris Saying Damaging Comments Circulates on X and Is Amplified by Elon Musk","description":"The X user @MrReaganUSA uploaded a deepfake of Kamala Harris saying damaging comments about Joe Biden and her own qualifications for the presidency, originally marking it as a parody. The post was shared and amplified eight hours later via Elon Musk's account without the disclaimer.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X (Twitter), Elon Musk, @Mrreaganusa"],"developers":["Deepfake Technology Developers"],"harmed":["Kamala Harris, Joe Biden, General Public, American Voters, Epistemic Integrity"],"report_count":3},{"incident_id":751,"occurred_on":"2024-07-25","title":"SearchGPT Reportedly Misleads Users with Incorrect Festival Dates in Demo","description":"OpenAI’s prototype AI tool, SearchGPT, provided incorrect dates for An Appalachian Summer Festival in Boone, North Carolina during a demonstration video. The AI listed dates that were incorrect, potentially misleading users planning to attend the event, but also harming the reputation of OpenAI as the incident occurred during a high-profile event.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["An Appalachian Summer Festival Attendees, Openai"],"report_count":2},{"incident_id":836,"occurred_on":"2024-07-23","title":"Sichuan Province Beset by Numerous Fabricated AI-Generated Reports of Disasters and Crises","description":"In Sichuan, AI tools were reportedly used to create and disseminate false reports across various cities, including fabricated stories of landslides, earthquakes, standoffs, accidents, and health-related incidents. These AI-driven rumors misled the public, caused alarm and confusion, and strained local authorities. The alleged perpetrators sought social media engagement and financial gain through clickbait content. The authorities in Sichuan ultimately levied administrative penalties against the ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zhu Mou, Zhou Moumou, Zhang Moumou, Yang Moumou, Wang Mou, Shang Moumou, Luo Moumou, Liu Mou, Ji Moumou, Chen Mou"],"developers":["Unknown Ai Developers, Deepfake Technology Developers"],"harmed":["Sichuan General Public, Sichuan Authorities"],"report_count":1},{"incident_id":750,"occurred_on":"2024-07-22","title":"AI Chatbots Reportedly Inaccurately Conveyed Real-Time Political News","description":"Over a week of back-to-back, significant breaking political news stories, including the Trump rally shooting and Biden’s campaign withdrawal, AI chatbots reportedly failed to provide accurate real-time updates. Most chatbots gave incorrect or outdated information, demonstrating their current limitations in handling fast-paced news. These incidents suggest the continuing need for improved AI capabilities and caution in their deployment for real-time news dissemination.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Perplexity, Openai, Meta, Google"],"developers":["Perplexity, Openai, Meta, Google"],"harmed":["Journalistic Integrity, General Public, Chatbot Users"],"report_count":1},{"incident_id":1129,"occurred_on":"2024-07-21","title":"Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage","description":"A purported deepfake video depicting Philippine President Ferdinand Marcos Jr. using drugs was released by Rodrigo Duterte ally Claire \"Maharlika\" Contreras at a Maisug rally in Los Angeles. The clip was reportedly timed to discredit Marcos ahead of his State of the Nation Address. Philippine authorities reportedly confirmed it was fake. The video was allegedly amplified by China's Spamouflage network via coordinated inauthentic accounts on X and YouTube.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Spamouflage, Rodrigo Duterte Supporters, Government Of China, Claire Contreras"],"developers":["Deepfake Technology Developers"],"harmed":["Philippines China Relations, Government Of The Philippines, General Public Of The Philippines, Ferdinand Marcos Jr., Epistemic Integrity, National Security And Intelligence Stakeholders"],"report_count":1},{"incident_id":760,"occurred_on":"2024-07-21","title":"False Election Data on Kamala Harris Reportedly Circulated via Grok AI Chatbot","description":"After President Joe Biden stepped aside as a presidential candidate on July 21, 2024, the AI chatbot Grok on X reportedly falsely informed users that Vice President Kamala Harris missed the ballot deadline in nine states. This misinformation, which spread widely on social media, prompted secretaries of state from five U.S. states to urge Elon Musk to address the problem.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai, X (Twitter)"],"developers":["Xai"],"harmed":["Kamala Harris, American Electorate, Democratic Integrity"],"report_count":2},{"incident_id":747,"occurred_on":"2024-07-18","title":"Fatalities Reportedly Occur Despite VioGén Algorithm's Low or Negligible Risk Scores","description":"The VioGén algorithm was designed to help Spanish police assess and prioritize the risk of repeat domestic violence incidents. However, its low-risk assessment of Lobna Hemid reportedly led to inadequate protection; her husband murdered her. Since 2007, 247 women have been killed after being assessed by VioGén. A review of 98 homicides found that 55 of the slain women were scored as negligible or low risk. ","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Spanish law enforcement agencies","Spanish Interior Ministry","Law enforcement","Government of Spain"],"developers":["VioGén algorithm development team","Spanish law enforcement agencies","Spanish Interior Ministry","Government of Spain"],"harmed":["Women and girls","Women","Victims of domestic abuse","Stefany González Escarraman","María","Luz","Lobna Hemid","General public of Spain"],"report_count":1},{"incident_id":966,"occurred_on":"2024-07-16","title":"Ferrari Executive Targeted by AI Deepfake Scam Impersonating CEO Benedetto Vigna","description":"A Ferrari executive was targeted by an AI-generated deepfake impersonating CEO Benedetto Vigna in an alleged fraud attempt. The scammer, using WhatsApp and a cloned voice, claimed an urgent, secretive financial deal required immediate action. The executive became suspicious after detecting slight artificial intonations; the scam failed when the executive tested the caller by asking about a recent book recommendation.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Phishers, Scammers Impersonating Benedetto Vigna, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Unnamed Ferrari Executive, Benedetto Vigna, Ferrari"],"report_count":2},{"incident_id":743,"occurred_on":"2024-07-16","title":"Gemini AI Allegedly Reads Google Drive Files Without Explicit User Consent","description":"Kevin Bankston, a privacy activist, claims that Google's Gemini AI scans private Google Drive PDFs without explicit user consent. Bankston reports that after using Gemini on one document, the AI continues to access similar files automatically. Google disputes these claims, stating that Gemini requires proactive user activation and operates within privacy-preserving settings.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google, Gemini"],"developers":["Google, Large Language Model Developers"],"harmed":["Kevin Bankston, Google Users, Google Drive Users, Privacy"],"report_count":1},{"incident_id":907,"occurred_on":"2024-07-15","title":"Taranaki, New Zealand Resident Allegedly Defrauded of $224K in Bitcoin Scam Using Deepfake of Prime Minister Christopher Luxon","description":"A Taranaki, New Zealand resident allegedly lost $224,000 in a Bitcoin scam involving a deepfake video reportedly depicting Prime Minister Christopher Luxon. The AI-generated video, shared on Facebook, purportedly promoted cryptocurrency investments targeting superannuitants. Scammers posing as financial advisers reportedly gained remote access to the victim’s computer and created accounts to facilitate the transfer of funds.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers Posing As Christopher Luxon, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Superannuitants, Pensioners, New Zealanders, Jill Creasy, Elderly Investors"],"report_count":3},{"incident_id":742,"occurred_on":"2024-07-13","title":"Grok AI Model Reportedly Fails to Produce Reliable News in Wake of Trump Assassination Attempt","description":"xAI's model Grok, intended to automate news delivery on the X platform, is reported to have struggled to provide accurate information during the attempted assassination of former President Donald Trump. Grok apparently issued incorrect headlines, including false reports about Vice President Kamala Harris being shot and misidentifying the alleged shooter. These errors show the pitfalls of relying on AI for real-time news aggregation, as it allegedly amplified unverified claims and failed to recog","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X (Twitter), Elon Musk"],"developers":["Xai"],"harmed":["Kamala Harris, General Public, Donald Trump, Journalistic Integrity"],"report_count":1},{"incident_id":1230,"occurred_on":"2024-07-11","title":"Suspect in Palisades Fire Allegedly Consulted ChatGPT for Arson Tips and Legal Advice Before Blaze That Killed 12 and Destroyed 6,837 Structures","description":"Federal prosecutors allege that Jonathan Rinderknecht, arrested on 10/08/2025, consulted ChatGPT for arson-related imagery and legal advice before and after deliberately starting the Palisades fire in Los Angeles on 01/01/2025. The blaze, which reignited on 01/07/2025, killed 12 people and destroyed 6,873 buildings. Prosecutors say he generated a dystopian fire image with ChatGPT and later asked about liability for fires caused by cigarettes.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Jonathan Rinderknecht"],"developers":["Openai"],"harmed":["General Public Of California, General Public Of Los Angeles, Pacific Palisades Community, Victims Of The Palisades Fire"],"report_count":1},{"incident_id":950,"occurred_on":"2024-07-11","title":"NullBulge's AI-Powered Malware Allegedly Compromises Disney Employee and Internal Data","description":"A Disney employee, Matthew Van Andel, reportedly downloaded AI-powered malware allegedly developed by the cybercriminal group NullBulge, resulting in a major cybersecurity breach. Hackers purportedly accessed Disney's Slack system, exposing 44 million internal messages, employee and customer data, and financial records. NullBulge also reportedly leaked Van Andel’s personal financial information, leading to identity theft and his eventual termination.","mit_domain":"Privacy & Security","mit_subdomain":"AI system security vulnerabilities and attacks","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Nullbulge"],"developers":["Nullbulge"],"harmed":["Matthew Van Andel, Disney Employees, Disney"],"report_count":2},{"incident_id":740,"occurred_on":"2024-07-10","title":"Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers","description":"Researchers have argued that the Department for Work and Pensions' Universal Credit system disproportionately impacts single mothers. Automated processes in the system, designed to determine eligibility and detect fraud, are reported to have introduced biases, leading to financial instability and hardship. The algorithms allegedly miscalculate earnings and delay childcare reimbursements, in turn exacerbating income volatility and debt among single mothers.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Department For Work And Pensions"],"developers":["Department For Work And Pensions"],"harmed":["Single Mothers, British Single Mothers"],"report_count":1},{"incident_id":821,"occurred_on":"2024-07-07","title":"Baidu Robotaxi Allegedly Involved in Collision with Pedestrian in Wuhan","description":"On July 7, 2024, a Baidu Robotaxi reportedly collided with a pedestrian at a traffic intersection in Wuhan. The incident occurred as the autonomous vehicle started moving on a green light while the pedestrian was allegedly crossing against a red light. The pedestrian sustained minor injuries, and Baidu was reported to have been cooperating with local authorities for further investigation.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Baidu"],"developers":["Baidu"],"harmed":["Unnamed Pedestrian"],"report_count":1},{"incident_id":752,"occurred_on":"2024-07-07","title":"AI-Generated Obituaries Are Reportedly Intensifying Grief for Bereaved Families","description":"AI-generated obituaries on various websites are reported to have compounded the grief of bereaved families by spreading incorrect and unauthorized information about their loved ones. These obituaries, produced without the families' knowledge, often contain errors and appear on ad-filled sites, exacerbating the emotional distress of the grieving process.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Obitsupdate, Bnn, The Thaiger, Fresherslive"],"developers":["Unknown"],"harmed":["Bridget Todd, Bridget Todd'S Family, Chris Mohney, Chris Mohney'S Family, Bereaved Families"],"report_count":1},{"incident_id":834,"occurred_on":"2024-07-04","title":"China Targets AI-Driven Fraud and Deepfake Scandals with New Crackdowns","description":"Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, \"AI undressing\" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zeng Moumou, Wang Mouhe, Tang Mou, Bai Moumou, Ai Fraud Rings In China, Scammers, Deepfake Creators"],"developers":["Unknown Game Cheating Technology Developers, Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Chinese General Public, Chinese Citizens"],"report_count":2},{"incident_id":755,"occurred_on":"2024-07-03","title":"Purported Deepfake Targets Olena Zelenska in Alleged Russian Disinformation Campaign","description":"A purported deepfake video falsely suggesting that Olena Zelenska, wife of Ukrainian President Volodymyr Zelenskyy, purchased a luxury car, reportedly circulated widely online. The video is reportedly part of a Russian-linked disinformation campaign aimed at undermining Ukraine and its supporters. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Verite Cachee France, Russian Linked Disinformation Network, Pro Kremlin Actors, Misinformation Spreaders, Information Manipulation Actors, Pro Russian Information Manipulation Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Volodymyr Zelenskyy, Olena Zelenska, Government Of Ukraine, General Public Of Ukraine, General Public Of The United States, General Public Of The European Union, Bugatti, Relations Between The United States And Ukraine, Epistemic Integrity, National Security And Intelligence Stakeholders"],"report_count":5},{"incident_id":745,"occurred_on":"2024-07-02","title":"Figma Disables AI Feature After Accusations of Copying Apple’s Weather App","description":"Figma has temporarily disabled its AI design feature, \"Make Design,\" after accusations of copying Apple’s Weather app. Andy Allen of NotBoring Software highlighted the issue, prompting Figma CEO Dylan Field to deny claims of training the AI on specific app designs. However, Field acknowledged flaws in the QA process and promised to suspend the feature until it meets quality standards. The incident has implications for designers.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Figma"],"developers":["Figma"],"harmed":["Apple, Designers And Developers Using Figma'S Ai Tool, Figma Users"],"report_count":2},{"incident_id":754,"occurred_on":"2024-07-01","title":"Female Politicians in the United Kingdom Reportedly Victimized by Purported Deepfake Pornography","description":"Female politicians in the United Kingdom, including Angela Rayner, Gillian Keegan, Penny Mordaunt, Priti Patel, Stella Creasy, and Dehenna Davison, have reportedly been targeted by non-consensual, purportedly AI-generated deepfake pornography. The images, which some accounts suggest may have circulated online for an extended period, were reported to have caused distress and, in at least some instances, to have prompted reports to or involvement by law enforcement.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Deepfake creators"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Women","Stella Creasy","Public figures","Privacy","Priti Patel","Politicians in the United Kingdom","Politicians"],"report_count":3},{"incident_id":757,"occurred_on":"2024-07-01","title":"OpenAI's ChatGPT Mac App Stored User Data in Unencrypted Text Files","description":"OpenAI's ChatGPT macOS app stored user conversations in plain text. If accessed by a malicious actor, these conversations could have been easily read. The critical security flaw was demonstrated by a third party and ultimately resolved after OpenAI released an update to encrypt the stored data.","mit_domain":"Privacy & Security","mit_subdomain":"AI system security vulnerabilities and attacks","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Chatgpt"],"report_count":1},{"incident_id":905,"occurred_on":"2024-07-01","title":"Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme","description":"Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for \"fees\" or \"taxes\" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok Scammers, Scammers Posing As Leonor (Princess Of Asturias), Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Vulnerable People In Latin American Countries, Juana Cobo, Financially Distressed Individuals"],"report_count":4},{"incident_id":793,"occurred_on":"2024-07-01","title":"AllHere's Chatbot 'Ed' Fails and Costs Los Angeles Unified School District $6 Million","description":"The Los Angeles Unified School District invested up to $6 million in developing the AI chatbot \"Ed,\" meant to provide academic and mental health support for students. The chatbot allegedly failed to meet expectations, and the project collapsed when AllHere, the contracted start-up, faced financial difficulties. Prince George's County Public Schools in Maryland was also affected. Founder Joanna Smith-Griffin was removed as CEO in June 2024 and later arrested on fraud charges.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Los Angeles Unified School District (Lausd), Allhere, Alberto Carvalho"],"developers":["Allhere"],"harmed":["Taxpayers, Prince George'S County Students, Prince George'S County Public Schools, Prince George'S County Parents, Los Angeles Unified School District (Lausd), Los Angeles Students, Los Angeles Parents, Educational Communities, Students, Teachers, Educators"],"report_count":5},{"incident_id":798,"occurred_on":"2024-06-29","title":"Students at Australian Schools Reportedly Used AI Nudification Tools to Create Nonconsensual Sexual Images of Classmates and Teachers","description":"Throughout 2024, schools in Australia reportedly dealt with a significant rise and proliferation of nonconsensual deepfake pornography of students. Often, male students are reported to use \"nudify\" apps such as Undress AI with images of their classmates and teachers. Many of the sites have reportedly remained legal and allegedly accessible to minors, who in turn are purportedly using the sites to generate pornography of their peers.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Students","Men and boys","Deepfake creators","Boys","Adolescent boys"],"developers":["Undress AI","Synthetic video generation technology developers","Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake child abuse","Victims of deepfake abuse","Teachers","Privacy","Minors"],"report_count":1},{"incident_id":739,"occurred_on":"2024-06-27","title":"Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan","description":"Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that \"Lau\" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Scammers Impersonating Andy Lau"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Lin (), Epistemic Integrity, Financial Scam Victims, Victims Of Deepfake Enabled Fraud, Fans Of Andy Lau"],"report_count":2},{"incident_id":764,"occurred_on":"2024-06-26","title":"Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes","description":"A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Aaron Pelczar"],"developers":["Chatbots"],"harmed":["Mark Gordon, Wyoming Officials, Cody Enterprise, Cody Enterprise Readers, Journalistic Integrity"],"report_count":4},{"incident_id":744,"occurred_on":"2024-06-25","title":"AI Work Assistants Require More Effort Than Expected, CIOs Say","description":"AI work assistants, such as Copilot for Microsoft 365 and Gemini for Google Workspace, are proving to be more labor-intensive than anticipated for enterprises. CIOs report that these AI tools struggle with outdated or inaccurate data, leading to incorrect outputs. Companies are finding they must invest heavily in data management to ensure reliability. This added effort has led to delays in deployment and frustration, as businesses work to maximize the potential of these expensive AI tools.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cios, Enterprise Teams, Companies In General"],"developers":["Microsoft, Google"],"harmed":["Cios, Enterprise Teams, Companies In General, Microsoft Copilot Users"],"report_count":1},{"incident_id":1656,"occurred_on":"2024-06-24","title":"Udio Allegedly Copied Copyrighted Sound Recordings Without Permission to Train Its Generative AI Models","description":"Record labels and independent artists alleged that Udio copied copyrighted recordings without permission and used them to train its generative music models. Udio acknowledged that its training data presumably included recordings owned by the plaintiffs but argued the copying was fair use. Plaintiffs alleged losses of licensing control and compensation and competition from AI-generated music.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Uncharted Labs, Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Ai Service Providers, Ai Music Generation System Developers"],"developers":["Uncharted Labs, Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Ai Music Generation System Developers"],"harmed":["Warner Music Group, Universal Music Group, Sony Music Entertainment, Songwriters, Record Labels, Musicians, Intellectual Property Rights Holders, Independent Artists, Copyright Holders, Tony Justice, David Woulard, Stan Burjek, James Burjek, Berk Ergoz, Hamza Jilani, Maatkara Wilson, Arjun Singh, Magnus Fiennes, Michael Mell"],"report_count":23},{"incident_id":1655,"occurred_on":"2024-06-24","title":"Suno Allegedly Copied Copyrighted Music Without Permission to Train Its Generative AI Models","description":"Record labels and independent artists alleged that Suno copied copyrighted recordings without permission and used them to train its generative music models. Suno later acknowledged training on tens of millions of publicly accessible recordings while asserting fair use. Plaintiffs alleged the practice deprived rightsholders of licensing control and compensation and enabled competing AI-generated music.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Suno, Ai Service Providers, Ai Music Generation System Developers"],"developers":["Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Suno, Ai Music Generation System Developers"],"harmed":["Warner Music Group, Universal Music Group, Sony Music Entertainment, Songwriters, Record Labels, Musicians, Intellectual Property Rights Holders, Independent Artists, Copyright Holders, Tony Justice, David Woulard, Stan Burjek, James Burjek, Berk Ergoz, Hamza Jilani, Maatkara Wilson, Arjun Singh, Magnus Fiennes, Michael Mell"],"report_count":25},{"incident_id":738,"occurred_on":"2024-06-23","title":"Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud","description":"A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Department For Work And Pensions"],"developers":["Department For Work And Pensions"],"harmed":["Uk General Public, Uk Housing Benefit Claimants"],"report_count":5},{"incident_id":735,"occurred_on":"2024-06-22","title":"AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection","description":"Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Openai, Ai Tool Creators, Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Bank Customers"],"report_count":1},{"incident_id":988,"occurred_on":"2024-06-21","title":"Senior Minister of Singapore Lee Hsien Loong Allegedly Misrepresented in Two Deepfake Videos on Foreign Relations","description":"Two deepfake videos falsely depicted Senior Minister of Singapore Lee Hsien Loong commenting on US-China relations and the South China Sea. The videos misleadingly attributed views to him and the Singapore government. Posted on TikTok, the videos amassed over 190,000 views before being removed.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors Impersonating Lee Hsien Loong"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Lee Hsien Loong, Government Of Singapore, Singapore United States Relations, Singapore China Relations, Diplomacy"],"report_count":1},{"incident_id":790,"occurred_on":"2024-06-21","title":"Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech","description":"TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok"],"developers":["Tiktok"],"harmed":["Tiktok Users, General Public"],"report_count":2},{"incident_id":788,"occurred_on":"2024-06-20","title":"Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts","description":"Tests by The Wall Street Journal and a researcher reportedly revealed that Instagram's AI-driven Reels algorithm recommends sexually suggestive content to accounts listed as 13 years old. Despite Meta's commitment to restrict such content for minors, explicit videos were served within minutes of account creation, according to the findings.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Instagram, Meta"],"developers":["Instagram, Meta"],"harmed":["Minors, Instagram Users, General Public"],"report_count":1},{"incident_id":748,"occurred_on":"2024-06-19","title":"Erroneous Declined Transaction Notification by PayPal AI Assistant","description":"On July 13th, 2024, a user reported an incident involving PayPal's generative AI chatbot. The chatbot allegedly incorrectly informed the user of a declined transaction that never occurred, causing confusion and prompting a call to customer service for clarification. This false alert suggests a flaw in the AI system's reliability. The incident created unnecessary labor for both the user and PayPal's human support, demonstrating the potential harm of deploying generative AI without thorough testin","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Paypal"],"developers":["Paypal"],"harmed":["Kiri Wagstaff, Paypal Customer Service Representatives, Paypal Customers"],"report_count":1},{"incident_id":734,"occurred_on":"2024-06-18","title":"Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites","description":"An audit by NewsGuard revealed that leading chatbots, including ChatGPT-4, You.com’s Smart Assistant, and others, repeated Russian disinformation narratives in one-third of their responses. These narratives originated from a network of fake news sites created by John Mark Dougan (Incident 701). The audit tested 570 prompts across 10 AI chatbots, showing that AI remains a tool for spreading disinformation despite efforts to prevent misuse.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["You.Com, Xai, Perplexity, Openai, Mistral, Microsoft, Meta, John Mark Dougan, Inflection, Google, Anthropic"],"developers":["You.Com, Xai, Perplexity, Openai, Mistral, Microsoft, Meta, Inflection, Google, Anthropic"],"harmed":["Western Democracies, Volodymyr Zelenskyy, Ukraine, Secret Service, Researchers, Media Consumers, General Public, Democratic Integrity, Ai Companies Facing Reputational Damage"],"report_count":4},{"incident_id":707,"occurred_on":"2024-06-13","title":"Tesla Reportedly in Autopilot Mode Hits Parked Police Vehicle in Fullerton, California","description":"A Tesla reportedly in self-driving mode crashed into a parked patrol vehicle in Fullerton, California while the officer was responding to a fatal DUI crash. The officer narrowly escaped injury. The driver reports having been distracted by a cellphone and having relied on the Tesla’s AI. (The earlier crash involved a suspected DUI driver who killed a motorcyclist stopped at a red light.)","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unnamed Tesla Driver"],"developers":["Tesla"],"harmed":["Unnamed Fullerton Police Officer, Fullerton Police Department"],"report_count":1},{"incident_id":724,"occurred_on":"2024-06-12","title":"Purportedly AI-Generated Papers Are Alleged to Have Manipulated Scopus Rankings in Top Philosophy Journals","description":"Three reportedly fake journals published by Addleton Academic Publishers allegedly manipulated Scopus rankings by extensively cross-citing each other and using AI-generated papers filled with buzzwords. These journals, placed in the top 10 of Scopus's 2023 CiteScore philosophy list, reportedly featured fake authors, affiliations, and grant numbers, in turn allegedly pushing legitimate journals to lower tiers, affecting academic evaluations and awards.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Fake Publications, Auricle Global Society Of Education And Research, Addleton Academic Publishers"],"developers":["Fake Publications, Auricle Global Society Of Education And Research, Addleton Academic Publishers"],"harmed":["University Job Candidates, University Hiring Committees, University Faculty, Scopus, Academic Journals"],"report_count":1},{"incident_id":789,"occurred_on":"2024-06-12","title":"Independent News Sites Flagged as Spam by Facebook's AI Moderation System","description":"Facebook's AI moderation system mistakenly flagged and removed legitimate news articles from independent local publishers as spam. This affected publishers worldwide, disrupting content distribution and impacting traffic. Despite attempts to appeal, many publishers received no response.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook"],"developers":["Meta, Facebook"],"harmed":["The Record Argus, Wlkp24.Info, Top Fight, Noticias Maia, City Magazine, Birkenhead News, Bishop'S Stortford Independent, Uk Defence Journal"],"report_count":1},{"incident_id":1632,"occurred_on":"2024-06-11","title":"Yale Student Suspended and Given F After GPTZero Allegedly Misclassified Exam as AI-Generated","description":"In 2024, Yale University reportedly used GPTZero as one factor in investigating whether Executive MBA student Thierry Rignol used AI on an exam. Rignol reportedly denied cheating and alleged the detector falsely classified his writing as AI-generated. Yale reportedly later suspended him for a year and gave him an F, while citing additional evidence and his conduct during the investigation. Rignol has challenged the process in federal court.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Yale University","Universities","Professors","Institutions of higher education","Educational communities"],"developers":["GPTZero","AI text detection system developers"],"harmed":["University students","Thierry Rignol","Students","Non-native English speakers","Educational communities"],"report_count":1},{"incident_id":733,"occurred_on":"2024-06-09","title":"Auto Insurers Allegedly Are Surreptitiously Collecting and Scoring Driver Data","description":"The insurance industry allegedly uses AI and telematics to score drivers based on behaviors tracked by automakers and apps like Life360. Data, often collected without clear consent, may affect insurance rates and raises privacy concerns. Consumers are largely unaware of this surveillance, leading to potential misuse and discrimination based on driving habits or socioeconomic factors.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["USAA","Toyota","Progressive","MyRadar","Life360","General Motors","GEICO","CSAA"],"developers":["MyRadar","Life360","Connected Analytic Services","Arity"],"harmed":["Privacy-conscious individuals","Privacy","People with poor credit scores","MyRadar users","Lower-income workers","Life360 users","Economically vulnerable people","Drivers unaware of data collection"],"report_count":2},{"incident_id":705,"occurred_on":"2024-06-08","title":"Turkish Student in Isparta Allegedly Uses AI to Cheat on Exam, Leading to Arrest","description":"A Turkish student in Isparta was reportedly arrested for using ChatGPT to cheat during the 2024 YKS university entrance exam. The student, identified as M.E.E., is alleged to have employed a sophisticated setup involving a router, mobile phone, earphone, and a button-shaped camera to transmit exam questions to ChatGPT and receive answers in real-time.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Turkish Student Identified As Mee"],"developers":["Openai"],"harmed":["Turkish Yks Exam Takers, Turkish Educational Institutions, Students, High School Students, Educational Communities"],"report_count":2},{"incident_id":797,"occurred_on":"2024-06-07","title":"Teenager Reportedly Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia","description":"At Bacchus Marsh Grammar, a school in Victoria state in Australia, an adolescent male reportedly made deepfake pornography of 50 girls, ages 9 to 12. He then allegedly uploaded the pictures to Instagram, and others subsequently shared them on Snapchat. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Snapchat users","Men and boys","Instagram users","Deepfake creators","Boys","Adolescent boys"],"developers":["Synthetic media generation technology developers","Synthetic image generation technology developers","Deepfake technology developers"],"harmed":["Women and girls","Students","Privacy","Girls","Epistemic integrity","Educational communities","Bacchus Marsh Grammar students","Bacchus Marsh Grammar girls"],"report_count":5},{"incident_id":753,"occurred_on":"2024-06-06","title":"BNN Breaking's AI-Driven Errors Reportedly Damage Reputations and Spread Misinformation","description":"BNN Breaking, an AI-driven news site, published a false story about Irish DJ Dave Fanning, damaging his reputation. The site used AI to generate error-filled content, leading to numerous complaints and a defamation lawsuit against BNN and Microsoft. The site has since gone dormant.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Bnn Breaking"],"developers":["Epiphany Ai, Gurbaksh Chahal"],"harmed":["Dave Fanning, Bnn Breaking Readers, General Public, Journalistic Integrity"],"report_count":1},{"incident_id":1144,"occurred_on":"2024-06-05","title":"xAI Allegedly Operates Unpermitted Methane Turbines in Memphis to Power Supercomputer Colossus to Train Grok","description":"The xAI \"Colossus\" supercomputer facility in South Memphis allegedly runs 33 methane-powered turbines, despite a permit for only 15. The turbines reportedly power AI training for Grok. The facility's massive energy use and alleged unpermitted turbines reportedly produce extreme nitrogen oxide and formaldehyde emissions, adding toxic smog to a predominantly Black neighborhood already burdened by pollution and health risks.","mit_domain":"Socioeconomic & Environmental Harms","mit_subdomain":"Environmental harm","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai"],"developers":["Xai"],"harmed":["South Memphis Community, Residents With Pre Existing Health Conditions, Residents Living In The Vicinity Of The Colossus Supercomputer, Predominantly Black Communities, General Public Of Memphis"],"report_count":9},{"incident_id":721,"occurred_on":"2024-06-04","title":"Reported Use of Purportedly AI-Generated Student Accounts in Online College Courses","description":"An adjunct professor at an unspecified community college reportedly suspected that some students in his online art history and art appreciation courses are AI-powered spambots. These \"students\" allegedly submitted peculiar assignments, such as analyses of non-existent artworks and descriptions of sculptures using painting terminology. Additionally, their engagement with the college portal is reportedly minimal. The professor reportedly believed the spambot students aimed to fraudulently obtain f","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Financial Aid Scammers, Scammers"],"developers":["Unknown Spambot Creators, Generative Ai Developers"],"harmed":["Students, Professors, General Public, Epistemic Integrity, Community Colleges, Academic Staff, Educational Communities, University Students"],"report_count":1},{"incident_id":986,"occurred_on":"2024-06-02","title":"Scammers Allegedly Manipulate 2023 Speech of Singapore Senior Minister Lee Hsien Loong to Spread Deepfake Investment Fraud","description":"A new deepfake video falsely showed Prime Minister Lee Hsien Loong endorsing an investment product with guaranteed returns. Scammers synchronized fake audio with real footage from his 2023 National Day speech, making it appear as though he had made the endorsement. Lee called this “extremely worrying” and warned that deepfake scams are becoming more sophisticated. He urged the public to report such scams through the government’s ScamShield Bot.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers Impersonating Lee Hsien Loong, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Lee Hsien Loong, General Public Of Singapore"],"report_count":1},{"incident_id":796,"occurred_on":"2024-06-01","title":"Facebook's Content Moderation System Flagged and Removed Emergency Updates as Spam During Wildfires","description":"Facebook's AI moderation system wrongly flagged and removed dozens of posts containing vital emergency information during California's wildfire season, including real-time updates on evacuations and fire tracking. Posts from official sources like Cal Fire and the U.S. Forest Service were marked as spam, potentially endangering lives by restricting access to crucial updates. Despite user complaints, the issue persisted, with Facebook acknowledging the problem only after media inquiry.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook"],"developers":["Meta, Facebook"],"harmed":["California Residents, Wildfire Evacuees, Emergency Responders, Disaster Relief Workers, Fire Safety Coordinators, Facebook Users, Facebook Users In Disaster Zones"],"report_count":3},{"incident_id":1498,"occurred_on":"2024-06-01","title":"Character.AI Chatbots Reportedly Exposed 11-Year-Old User to Sexual, Violent, and Self-Harm Content","description":"An 11-year-old Character.AI user identified by The Washington Post as \"R\" reportedly exchanged messages with bots that depicted coercive sexual encounters, violence, and suicide scenarios after she began using the app in June 2024. Her mother reportedly said R became withdrawn, had panic attacks, and expressed not wanting to exist before the chats were discovered.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Character.Ai"],"developers":["Character.Ai"],"harmed":["R (11 Year Old Character.Ai User), Parents Of Child Character.Ai Users, Minors, Families Of Child Character.Ai Users, Children Exposed To Ai Generated Sexual Content, Children Exposed To Ai Generated Self Harm Content, Child Character.Ai Users, Chatbot Users"],"report_count":1},{"incident_id":749,"occurred_on":"2024-05-31","title":"Hoodline Accused of Misleadingly Attributing AI-Generated Articles to Human Authors","description":"In 2023, the news site Hoodline is reported to have begun publishing AI-generated articles with fake bylines, headshots, and biographies, allegedly misleading readers into believing they were authored by real journalists. This practice diminishes public trust and exemplifies the potential dangers of AI in journalism. Despite a disclaimer, the use of AI was not transparent.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hoodline"],"developers":["Hoodline"],"harmed":["Hoodline Readers, General Public, Journalistic Integrity"],"report_count":1},{"incident_id":702,"occurred_on":"2024-05-31","title":"Disinformation Deepfake Circulates of State Department Spokesman Matthew Miller Suggesting Belgorod Can Be Attacked with U.S. Weapons","description":"A deepfake video of State Department spokesman Matthew Miller falsely suggested Belgorod was a legitimate target for Ukrainian strikes. This disinformation spread on Telegram and Russian media, misleading the public and inciting tensions. U.S. officials condemned the deepfake. This incident is an example of the threat of AI-powered disinformation and hybrid attacks.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russian Government"],"developers":["Deepfake Creators"],"harmed":["Matthew Miller, Department Of State, Biden Administration"],"report_count":1},{"incident_id":774,"occurred_on":"2024-05-30","title":"Covert AI Influence Operations Linked to Russia, China, Iran, and Israel, OpenAI Reports","description":"In a report released by OpenAI, the company described how its generative AI tools were misused by state actors and private companies in Russia, China, Iran, and Israel to conduct covert influence campaigns aimed at manipulating public opinion and geopolitical narratives.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zeno Zeno, Spamouflage, Russian Government, Israeli Government, Iranian Government, International Union Of Virtual Media, Doppelganger, Chinese Government"],"developers":["Openai"],"harmed":["United States, Ukraine, Social Media Users, Moldova, Lithuania, Latvia, General Public, Estonia, Critics Of The Chinese Government, Epistemic Integrity, General Public Of The United States, General Public Of The European Union, National Security And Intelligence Stakeholders, Democratic Integrity"],"report_count":3},{"incident_id":701,"occurred_on":"2024-05-29","title":"American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network","description":"John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["John Mark Dougan, Deepfake Creators, Information Manipulation Actors, Pro Russian Information Manipulation Actors"],"developers":["Openai, Deepfake Technology Developers, Synthetic Media Generation Technology Developers"],"harmed":["Journalistic Integrity, Information Integrity, General Public, American Citizens"],"report_count":36},{"incident_id":708,"occurred_on":"2024-05-26","title":"Reportedly Faulty AI Transcription Threatens Integrity of Genoa Bribery Probe","description":"A reported AI transcription software error in a Genoa bribery investigation is alleged to have incorrectly recorded \"illicit financing\" instead of \"licit financing,\" which could have significantly impacted the case. The mistake was discovered during a review and is an example of the risks of relying on AI in judicial settings.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Judiciary Of Italy"],"developers":["Unnamed Automated Transcription Software Developer"],"harmed":["Roberto Spinelli, Paolo Emilio Signorini, Italian General Public, Giovanni Toti, Genoa Prosecutor'S Office"],"report_count":1},{"incident_id":691,"occurred_on":"2024-05-25","title":"Facewatch Reported to Have Wrongfully Flagged Home Bargains Customer as Shoplifter","description":"A facial-recognition software used by the British variety store Home Bargains is alleged to have misidentified \"Sara\" as a shoplifter, leading to staff searching her bag, escorting her from the premises, and banning her from the store. After, Facewatch is reported to have admitted its error to Sara. Facewatch is used by a number of different British stores.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Home Bargains"],"developers":["Facewatch"],"harmed":["Sara, Home Bargains Customers, General Public"],"report_count":2},{"incident_id":842,"occurred_on":"2024-05-24","title":"Reportedly Hacked AI-Powered Robot Vacuums Allegedly Used for Surveillance and Harassment","description":"Hackers reportedly exploited a vulnerability in Ecovacs’s Deebot X2 robot vacuums, gaining unauthorized access to camera and microphone controls. Users reported privacy invasions and offensive language broadcasted through the devices. Although Ecovacs claimed to have resolved the security flaw, researchers suggest vulnerabilities remain that could potentially leave users exposed to surveillance and harassment through their AI-enabled devices.","mit_domain":"Privacy & Security","mit_subdomain":"AI system security vulnerabilities and attacks","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Ecovacs Deebot X2, Ecovacs"],"developers":["Ecovacs"],"harmed":["Ecovacs Deebot X2 Users, Ecovacs Customers, Daniel Swenson, Privacy"],"report_count":16},{"incident_id":704,"occurred_on":"2024-05-23","title":"Study Highlights Persistent Hallucinations in Legal AI Systems","description":"Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a \"pre-registered dataset of over 200 open-ended legal queries\" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI).  The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Legal Professionals, Law Firms, Organizations Requiring Legal Research"],"developers":["Thomson Reuters, Lexisnexis"],"harmed":["Legal Professionals, Clients Of Lawyers, Legal System"],"report_count":2},{"incident_id":699,"occurred_on":"2024-05-23","title":"VA Suicide Prevention Algorithm REACH VET Reportedly Prioritizes Men Over Women Veterans","description":"An AI program named REACH VET, designed and used by the Department of Veterans Affairs (VA) to prevent veteran suicides, was reportedly found to prioritize white men while neglecting female veterans and survivors of military sexual trauma. This oversight persists despite rising suicide rates among these groups. The incident is an example of algorithmic bias and the exclusion of critical risk factors for female veterans.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Department of Veterans Affairs (VA)"],"developers":["Department of Veterans Affairs (VA)"],"harmed":["Women and girls","Women","Veterans","Survivors of military sexual trauma","Emotionally vulnerable individuals"],"report_count":2},{"incident_id":783,"occurred_on":"2024-05-21","title":"WiseTech Global CEO Richard White Reportedly Deepfaked in Multiple Attempts to Scam Staffers","description":"WiseTech Global's CEO, Richard White, was targeted in multiple deepfake scam attempts where unknown actors used AI to create videos of him requesting money from staff members via WhatsApp. These repeated attempts were identified by the employees, who realized they were not speaking to the real CEO.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Creators"],"harmed":["Wisetech Global, Richard White"],"report_count":1},{"incident_id":700,"occurred_on":"2024-05-20","title":"Meta's AI Chatbots Are Reportedly Entering Online Support Communities Uninvited","description":"Meta's AI chatbots have reportedly begun entering online communities on Facebook, providing responses that mimic human interaction. These chatbots, often uninvited, disrupt the human connection critical for support groups by giving misleading or false information and pretending to share lived experiences.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Facebook Users In Online Support Communities, Facebook Users"],"report_count":2},{"incident_id":688,"occurred_on":"2024-05-20","title":"Scarlett Johansson Alleges OpenAI's Sky Imitates Her Voice Without Licensing","description":"OpenAI unveiled a voice assistant with a voice resembling Scarlett Johansson's, despite her refusal to license her voice. Johansson claimed the assistant, \"Sky,\" sounded \"eerily similar\" to her voice, leading her to seek legal action. OpenAI suspended Sky, asserting the voice was from a different actress.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Sky Voice Assistant, Sam Altman, Openai"],"developers":["Sam Altman, Openai"],"harmed":["Scarlett Johansson"],"report_count":14},{"incident_id":728,"occurred_on":"2024-05-16","title":"AI Firm Lovo Reportedly Accused of Illegally Replicating Voice Actors' Voices","description":"Two voice actors, Paul Skye Lehrman and Linnea Sage, are reportedly suing AI start-up Lovo for allegedly creating and promoting unauthorized clones of their voices. Lovo's synthetic voices were allegedly discovered in various media, including a podcast and promotional videos. The actors claim they were misled into providing voice samples, which were then allegedly used without consent, violating trademark and privacy laws. ","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic Media Creators, Lovo"],"developers":["Voice Cloning Technology Developers, Synthetic Media Generation Technology Developers, Synthetic Audio Generation Technology Developers, Lovo"],"harmed":["Voice Actors, Targets Of Fraudulent Professional Opportunities, Paul Skye Lehrman, Linnea Sage, Epistemic Integrity"],"report_count":1},{"incident_id":746,"occurred_on":"2024-05-15","title":"Class Action Lawsuit Over Alleged Defects in Volkswagen's AI-Driven AEB Systems","description":"A class action lawsuit involving Volkswagen Group of America addresses alleged defects in the Automated Emergency Braking (AEB) systems of certain vehicles. The lawsuit claims these AI-driven systems failed to function properly, posing safety risks. Volkswagen denies the claims but has agreed to a settlement. Affected users can look up their vehicle's eligibility and file claims for reimbursement. The case brings into question the level of reliability of AI in critical automotive applications.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Volkswagen Group Of America"],"developers":["Volkswagen Group Of America"],"harmed":["Volkswagen Drivers, Potential Passengers And Road Users At Risk Due To Malfunctioning Aeb Systems"],"report_count":2},{"incident_id":729,"occurred_on":"2024-05-14","title":"GPT-4o's Chinese Tokens Reportedly Compromised by Spam and Pornography Due to Inadequate Filtering","description":"OpenAI's GPT-4o was found to have its Chinese token training data compromised by spam and pornographic phrases due to inadequate data cleaning. Tianle Cai, a Ph.D. student at Princeton University, identified that most of the longest Chinese tokens were irrelevant and inappropriate, primarily originating from spam and pornography websites. The polluted tokens could lead to hallucinations, poor performance, and potential misuse, undermining the chatbot's reliability and safety measures.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"Human","intent":"Unintentional","timing":"Pre-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai, Gpt 4O"],"developers":["Openai"],"harmed":["Researchers, Openai, Openai Users, Chatgpt"],"report_count":1},{"incident_id":693,"occurred_on":"2024-05-14","title":"Google AI Reportedly Delivering Confidently Incorrect and Harmful Information","description":"Google's AI search engine has reportedly been providing users with confidently incorrect and often harmful information. Reports highlight numerous inaccuracies, including misleading health advice and dangerous cooking suggestions. For example, it has falsely claimed Barack Obama as the first Muslim U.S. President, reflecting fringe conspiracy theories, or recommending that glue can be an ingredient in pizza.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Google Users, General Public"],"report_count":7},{"incident_id":803,"occurred_on":"2024-05-14","title":"Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts","description":"AI-generated spam images are increasingly filling Facebook feeds, with the platform’s algorithm reportedly amplifying these posts. Many of these images are bizarre, fake, and used in scams, misleading users into engaging with non-existent products or clickbait. ","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook"],"developers":["Meta, Facebook"],"harmed":["Meta Users, Facebook Users"],"report_count":1},{"incident_id":723,"occurred_on":"2024-05-13","title":"Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders","description":"An Instagram ad campaign for children's merchandise was intended to reach adult women but was instead predominantly shown to adult men, including convicted sex offenders, due to Instagram's algorithmic targeting. This failure is reported to have led to direct solicitations for sex with a 5-year-old model in the ads.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Instagram"],"developers":["Meta"],"harmed":["Instagram Users, Instagram Sellers, Minors"],"report_count":2},{"incident_id":983,"occurred_on":"2024-05-10","title":"Scammers Reportedly Used AI Voice Clone and YouTube Footage to Impersonate WPP CEO in Unsuccessful Scam Attempt","description":"Scammers reportedly attempted to impersonate WPP CEO Mark Read using AI-generated voice cloning and YouTube footage in a Microsoft Teams scam. They allegedly created a fake WhatsApp account with Read’s image and used deepfake audio to deceive an agency leader into setting up a new business. The scheme, which was unsuccessful, aimed to solicit money and personal data.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers Impersonating Mark Read, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology"],"harmed":["Mark Read, Wpp, Wpp Employees, General Public"],"report_count":15},{"incident_id":1164,"occurred_on":"2024-05-06","title":"Google Healthcare AI Model Med‑Gemini Allegedly Produces Non‑Existent 'Basilar Ganglia' Term in Published Output","description":"Google’s Med‑Gemini healthcare AI reportedly produced the non‑existent term \"basilar ganglia\" in public launch materials, conflating two distinct brain structures. The error reportedly appeared in both a blog post and an arXiv preprint. Google is reported to have initially edited the blog without acknowledgment, later calling it a typo.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Patients Whose Care Could Be Affected By Undetected Ai Hallucinations, Medical Research Community Citing Or Using Erroneous Ai Outputs, Healthcare Professionals Relying On Aigenerated Diagnostic Content"],"report_count":1},{"incident_id":898,"occurred_on":"2024-05-06","title":"Alleged LLMjacking Targets AI Cloud Services with Stolen Credentials","description":"Attackers reportedly exploited stolen cloud credentials obtained through a vulnerable Laravel system (CVE-2021-3129) to allegedly abuse AI cloud services, including Anthropic’s Claude and AWS Bedrock, in a scheme referred to as “LLMjacking.” The attackers are said to have monetized access through reverse proxies, reportedly inflating victim costs to as much as $100,000 per day. Additionally, they allegedly bypassed sanctions, enabled LLM models, and evolved techniques to evade detection and logg","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Llmjacking Attackers Exploiting Laravel, Entities Engaging In Russian Sanctions Evasion"],"developers":["Oai Reverse Proxy Tool Creators, Llmjacking Reverse Proxy Tool Creators"],"harmed":["Laravel Users, Laravel Cve 2021 3129 Users, Cloud Llm Users, Cloud Llm Service Providers"],"report_count":2},{"incident_id":1058,"occurred_on":"2024-05-06","title":"Purported AI-Generated Deepfake Images of Katy Perry at 2024 Met Gala Circulate Widely","description":"Purported AI-generated images depicting Katy Perry attending the 2024 Met Gala circulated widely on social media, leading to public confusion about her presence at the event. The images were realistic enough to deceive fans and even Perry’s mother, who believed them to be authentic. Perry publicly clarified the images were fake, attributing them to AI and noting she had missed the event due to work.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Other","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown"],"developers":["Deepfake Technology Developers"],"harmed":["Katy Perry, General Public, Fans Of Katy Perry, Epistemic Integrity"],"report_count":1},{"incident_id":1463,"occurred_on":"2024-05-04","title":"Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor, Director, and Playwright Kamen Donev's Likeness to Market Joint-Pain Product","description":"A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor, director, and playwright Kamen Donev, allegedly overlaying fabricated audio and altered lip movements to market a purported joint-pain product. The ad reportedly linked to a presumably fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["People Seeking Medical Advice, Kamen Donev, Epistemic Integrity, General Public, General Public Of Bulgaria"],"report_count":1},{"incident_id":1462,"occurred_on":"2024-05-04","title":"Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor and TV Host Mihail Bilalov's Likeness to Market Joint-Pain Product","description":"A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor and television host Mihail Bilalov, overlaying purportedly fabricated audio and altered lip movements to market an alleged joint-pain product. The ad reportedly linked to a fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["People Seeking Medical Advice, Mihail Bilalov, Epistemic Integrity, General Public, General Public Of Bulgaria"],"report_count":1},{"incident_id":823,"occurred_on":"2024-05-03","title":"Cybercheck Tool Allegedly Provides Questionable Evidence in Murder Trials","description":"Global Intelligence's Cybercheck AI tool, used by law enforcement to track suspects based on open source data, has allegedly been providing inaccurate or unverifiable evidence in several murder trials. Reportedly the tool lacks transparency and often produces unreliable reports, which has prompted prosecutors to withdraw Cybercheck evidence from multiple cases after its findings were challenged, reportedly wasting law enforcement time and resources while undermining prosecutors' cases.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Global Intelligence, Cybercheck"],"developers":["Global Intelligence, Cybercheck"],"harmed":["Phillip Mendoza, Sergio Cerna, Unnamed Aurora Colorado Residents, Mississippi Bureau Of Investigation, Four Unnamed Summit County Ohio Men, Unnamed Boulder County Colorado Resident, Ohio Bureau Of Criminal Investigation, Yakima County Sheriff'S Office"],"report_count":3},{"incident_id":678,"occurred_on":"2024-04-29","title":"Purported ChatGPT Factual Errors Reportedly Led to Filing of Complaint of GDPR Privacy Violation ","description":"The activist organization noyb, founded by Max Schrems, reportedly filed a complaint in Europe against OpenAI alleging that ChatGPT violates the General Data Protection Regulation (GDPR) by providing inaccurate personal information such as birthdates about individuals.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Chatgpt"],"developers":["Openai, Large Language Model Developers"],"harmed":["Noyb, Max Schrems, General Public, Privacy"],"report_count":1},{"incident_id":677,"occurred_on":"2024-04-29","title":"ChatGPT and Perplexity Reportedly Manipulated into Breaking Content Policies in AI Boyfriend Scenarios","description":"The \"Dan\" (\"Do Anything Now\") AI boyfriend is a trend on TikTok in which users appear to regularly manipulate ChatGPT to adopt boyfriend personas, breaching content policies. ChatGPT 3.5 is reported to regularly produce explicitly sexual content, directly violating its intended safety protocols. GPT-4 and Perplexity AI were subjected to similar manipulations, and although they exhibited more resistance to breaches, some prompts were reported to break its guidelines.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok Users, Julia Munslow, Chatgpt, Gpt 3.5, Gpt 4, Perplexity Ai"],"developers":["Openai, Perplexity.Ai"],"harmed":["General Public, Openai, Perplexity Ai"],"report_count":1},{"incident_id":712,"occurred_on":"2024-04-26","title":"Meta AI Hallucinates Harassment Allegations Against New York Politicians","description":"Meta's AI chatbot in Facebook Messenger falsely accused multiple state lawmakers of sexual harassment, fabricating incidents, investigations, and consequences that never occurred. These fabricated stories, discovered by City & State, sparked outrage among the affected lawmakers and raised concerns about the reliability of the chatbot. Meta acknowledged the errors and committed to ongoing improvements.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta, Facebook Users"],"harmed":["New York Lawmakers, Meta, Kristen Gonzalez, Facebook Users, Clyde Vanel"],"report_count":2},{"incident_id":711,"occurred_on":"2024-04-26","title":"NHTSA Opens New Probe into Tesla’s Autopilot Following More than a Dozen Fatal Accidents","description":"The NHTSA has linked Tesla's Autopilot to over a dozen fatalities and hundreds of crashes, prompting a new investigation into the adequacy of Tesla's December recall of 2 million vehicles. The probe reports that Tesla’s driver-assist system led to avoidable crashes involving visible hazards, suggesting a critical safety gap between driver expectations and the system’s capabilities. The investigation will assess if Tesla’s recall remedies were sufficient to address these safety risks.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla, Tesla Drivers"],"developers":["Tesla"],"harmed":["Tesla Drivers, Drivers, General Public"],"report_count":2},{"incident_id":838,"occurred_on":"2024-04-25","title":"Microsoft Copilot Allegedly Provides Unsafe Medical Advice with High Risk of Severe Harm","description":"Microsoft Copilot, when asked medical questions, was reportedly found to provide accurate information only 54% of the time, according to European researchers (citation provided in editor's notes). Analysis by the researchers reported that 42% of Copilot's responses could cause moderate to severe harm, with 22% of responses posing a risk of death or severe injury.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Microsoft Copilot, Microsoft"],"developers":["Microsoft"],"harmed":["People Seeking Medical Advice, Microsoft Copilot Users, General Public"],"report_count":1},{"incident_id":722,"occurred_on":"2024-04-25","title":"Catholic AI Chatbot 'Father Justin' Claimed to Be a Real Priest, Prompting Retraction","description":"Catholic advocacy group Catholic Answers released an AI priest called \"Father Justin,\" which misleadingly claimed to be a real clergy member, offered sacraments, and provided controversial advice. After receiving criticism, the group rebranded the chatbot as a lay theologian to correct the misrepresentation. The incident is an instructive case with respect to deploying AI in sensitive contexts and the potential for causing confusion and harm.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Catholic Answers"],"developers":["Catholic Answers"],"harmed":["General Public, Catholics"],"report_count":1},{"incident_id":676,"occurred_on":"2024-04-24","title":"Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action","description":"A purported deepfake audio clip portraying Philippine President Ferdinand Marcos Jr. ordering an attack on China spread online in July 2024, fueling tensions in the West Philippine Sea. The Presidential Communications Office reportedly debunked it as fake, attributing it to foreign actors.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors Targeting Ferdinand Marcos Jr., Unknown Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Philippines China Relations, Philippines, Government Of The Philippines, General Public Of The Philippines, General Public Of China, General Public, Ferdinand Marcos Jr."],"report_count":6},{"incident_id":685,"occurred_on":"2024-04-24","title":"The WHO's S.A.R.A.H. Bot Reported to Provide Inconsistent and Inadequate Health Information","description":"The WHO's AI-powered health advisor, S.A.R.A.H. (Smart AI Resource Assistant for Health), is alleged to provide inconsistent and inadequate health information. The bot reportedly gives contradictory responses to the same queries, fails to offer specific contact details for healthcare providers, and inadequately handles severe mental health crises, often giving irrelevant or unhelpful advice.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Who, S.A.R.A.H. (Smart Ai Resource Assistant For Health)"],"developers":["Who"],"harmed":["General Public, People Seeking Medical Advice"],"report_count":1},{"incident_id":1024,"occurred_on":"2024-04-24","title":"Kenyan Journalist Jeff Koinange Depicted Endorsing Gambling App in Purported AI-Generated Deepfake","description":"A viral video purportedly manipulated by AI shows Kenyan journalist Jeff Koinange endorsing a mobile gambling app. The video was reportedly created using AI deepfake techniques, uses footage from a legitimate news broadcast, and artificially alters Koinange's voice and mouth movements. Neither Koinange nor Citizen TV has promoted the app, and no legitimate source hosts the video.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers Impersonating Jeff Koinange, Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Jeff Koinange, General Public Of Kenya"],"report_count":1},{"incident_id":784,"occurred_on":"2024-04-23","title":"Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them","description":"Internet Watch Foundation (IWF) has reported that it has found a manual on the dark web that encourages criminals to use \"nudifying\" AI tools to depict children naked in order to extort victims into providing graphic content.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Dark Web Users, Deepfake Creators"],"developers":["Unknown Ai Developers, Deepfake Creators"],"harmed":["Minors"],"report_count":1},{"incident_id":792,"occurred_on":"2024-04-19","title":"Unauthorized Use of AI to Replicate Tupac Shakur's and Snoop Dogg's Voices in Drake's 'Taylor Made Freestyle'","description":"Drake released a song, \"Taylor Made Freestyle,\" featuring AI-generated voices of Tupac Shakur and Snoop Dogg. The unauthorized replication of Tupac’s voice without the estate's consent led to a cease-and-desist order. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Drake"],"developers":["Deepfake Technology Developers"],"harmed":["Tupac Shakur, Estate Of Tupac Shakur, Snoop Dogg"],"report_count":10},{"incident_id":1183,"occurred_on":"2024-04-16","title":"Purported Error by Grok Reportedly Misrepresents Basketball Slang as Criminal Allegation Against NBA Player","description":"X's Grok AI bot reportedly generated a trending story falsely claiming that Golden State Warriors guard Klay Thompson was under investigation for vandalizing homes with bricks in Sacramento. The alleged fabrication appeared after Grok reportedly misinterpreted posts describing Thompson \"shooting bricks\" during a basketball game. The story reportedly ranked #5 briefly on X's trending list.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xai"],"developers":["Xai"],"harmed":["X (Twitter) Users, Nba Fans, Klay Thompson, Golden State Warriors"],"report_count":1},{"incident_id":737,"occurred_on":"2024-04-16","title":"Amandine Le Pen Deepfake Account Misleads Thousands on TikTok","description":"A TikTok account, \"Amandine Le Pen,\" created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as \"Lena Maréchal Lep","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Tiktok User"],"developers":["Deepfake Creators"],"harmed":["Le Pen Family, French General Public"],"report_count":2},{"incident_id":710,"occurred_on":"2024-04-15","title":"Facebook AI Reportedly Mislabels Auschwitz Photos as 'Bullying' and 'Nudity'","description":"Facebook's AI system allegedly mislabeled around 20 posts from the Auschwitz Memorial Museum as violating community standards for \"bullying\" and \"nudity,\" reportedly deleting at least one image of orphans. The purported misclassification of historical content allegedly prompted outrage from the museum, which reportedly demanded an explanation. Meta later purportedly apologized, attributing the issue to mistaken notices sent by its AI system and reportedly acknowledged that the posts did not, in ","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Survivors Of Holocaust Victims, General Public, Auschwitz Memorial Museum"],"report_count":1},{"incident_id":847,"occurred_on":"2024-04-14","title":"Brake Failure in Reportedly AI-Driven Tram Leads to Multiple Injuries in Saint Petersburg, Russia","description":"During a test run in Saint Petersburg in Russia a reportedly AI-powered \"Smart Tram\" failed, leading to a crash that injured several pedestrians and trapped a woman under its wheels. The tram's AI system reportedly shut off unexpectedly, and both primary and emergency brakes failed despite pre-test checks.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Pre-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Saint Petersburg Government"],"developers":["Uraltransmash, Ai Cognitive Technologies"],"harmed":["Saint Petersburg Pedestrians"],"report_count":1},{"incident_id":936,"occurred_on":"2024-04-12","title":"Deepfake of Former Prime Minister of Malta Joseph Muscat Allegedly Promotes Nord Invest Scam","description":"A reported doctored video falsely depicts former Maltese Prime Minister Joseph Muscat promoting the crypto platform Nord Invest. The manipulated footage, originally from a 2013 Sky News interview, was overlaid with AI-generated audio to mimic Muscat’s voice endorsing a fraudulent scheme. The video was reportedly shared through Facebook.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Scammers Impersonating Joseph Muscat, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Joseph Muscat, General Public Of Malta"],"report_count":1},{"incident_id":1100,"occurred_on":"2024-04-10","title":"Reported Audio Deepfake Impersonating CEO Karim Toubba Targets LastPass Employee via WhatsApp","description":"A LastPass employee was reportedly targeted by an audio deepfake impersonating CEO Karim Toubba via WhatsApp. The message used voice-cloning AI in a social engineering attempt to create urgency and bypass security protocols. The employee recognized red flags, reported the incident, and no breach occurred. LastPass shared the incident publicly to raise awareness about deepfake-driven fraud campaigns targeting executives and companies.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Scammer Impersonating Karim Toubba, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Karim Toubba, Lastpass Employee, Employees Of Lastpass, General Public"],"report_count":3},{"incident_id":687,"occurred_on":"2024-04-08","title":"Deepfake Porn Sites Use Breeze Liu's Image Without Consent","description":"Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Pornhub, Various Porn Sites"],"developers":["Deepfake Creators"],"harmed":["Breeze Liu"],"report_count":1},{"incident_id":809,"occurred_on":"2024-04-07","title":"TikTok Hosts AI-Generated English-Language Hitler Speeches with Millions of Views","description":"AI-generated English-language Adolf Hitler speeches have been proliferating on TikTok. They are reportedly accumulating millions of views despite violating the platform’s hate speech policies. The clips are described as often pairing the audio with misleading translations and memes that glorify Hitler and distort historical facts. While some content has been removed, many accounts reportedly continue to post similar videos.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Tiktok Users"],"report_count":1},{"incident_id":830,"occurred_on":"2024-04-07","title":"Error-Prone AI Accessibility Tools Reportedly Lead to Navigation Issues for Blind Internet Users","description":"AI-powered accessibility overlays on websites frequently mislabel or misinterpret content, in turn complicating navigation for blind users and others with disabilities. Users report that the AI tools interfere with screen readers and mislead them with inaccurate descriptions. The reported unreliability in these tools have prompted legal action, as the companies behind them seek compliance with accessibility laws. ","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zara, Pemex, Lvmh, Capita, Companies Using Ai Based Accessibility Tools"],"developers":["Equalweb, Userway, Developers Of Ai Based Accessibility Tools"],"harmed":["Blind People, Visually Impaired People, Jakob Rosin"],"report_count":1},{"incident_id":832,"occurred_on":"2024-04-06","title":"Reportedly Viral AI-Generated Song about 'Diddy Party' Allegedly Mimics Justin Bieber","description":"A purportedly AI-generated song imitating Justin Bieber's voice, allegedly referencing a \"Diddy party,\" spread widely across social media, reportedly leading fans to believe it was authentic. Experts reportedly identified the audio as likely AI-made, citing frequency mismatches and digital artifacts. The reportedly viral song misrepresented Bieber, posing potential brand and revenue impacts for the artist while misleading listeners.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Youtube User, Unknown Tiktok User, The_Real_Cool_Dad, X (Twitter) Users"],"developers":["Deepfake Technology Developers"],"harmed":["Sean Combs, Justin Bieber Fans, Justin Bieber"],"report_count":2},{"incident_id":1082,"occurred_on":"2024-04-06","title":"California Homeowner Reportedly Loses Insurance After Purported Aerial Imagery-Based Roof Assessment","description":"A California homeowner's insurance policy was reportedly not renewed after CSAA relied on aerial imagery, purportedly analyzed by an AI system, to assess the roof as having reached the end of its life. The homeowner, Cindy Picos, reportedly commissioned an independent inspection suggesting the roof had a decade of remaining life, but CSAA declined to reverse the decision. The insurer reportedly did not provide the imagery for review.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["CSAA Insurance Group"],"developers":["Vexcel Group","Unspecified developer of aerial imagery risk analysis system"],"harmed":["Homeowners affected by AI-assisted insurance nonrenewals","Homeowners","Cindy Picos"],"report_count":1},{"incident_id":718,"occurred_on":"2024-04-06","title":"OpenAI, Google, and Meta Alleged to Have Overstepped Legal Boundaries for Training AI","description":"In late 2021, OpenAI and other tech giants like Google and Meta reportedly faced data shortages for training AI models. OpenAI is said to have developed a tool called Whisper to transcribe over one million hours of YouTube videos, potentially violating YouTube’s terms of service. Similarly, Google allegedly transcribed YouTube videos, risking copyright infringements. Meta reportedly explored summarizing copyrighted texts without permission and debated acquiring Simon & Schuster for data.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Pre-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai, Meta, Google"],"developers":["Openai, Meta, Google"],"harmed":["Youtube Creators, General Public, Content Creators"],"report_count":1},{"incident_id":663,"occurred_on":"2024-04-05","title":"China Reportedly Intensifying AI to Spread Disinformation to U.S. and Taiwanese Voters","description":"AI tools linked to China were used to disseminate disinformation targeting voters in the U.S. and Taiwan, according to a Microsoft report. These operations included AI-generated imagery and audio to influence political perceptions and election outcomes, originating from the APT Storm-1376 (also known as Spamouflage and Dragonbridge).","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Storm 1376, Spamouflage, Dragonbridge, Chinese Communist Party"],"developers":["Storm 1376, Spamouflage, Dragonbridge, Chinese Communist Party"],"harmed":["U.S. Voters, Taiwanese Voters, General Public, Democratic Integrity"],"report_count":2},{"incident_id":719,"occurred_on":"2024-04-04","title":"Grok AI on X Created and Promoted False Iran Missile Strike News","description":"On April 4, 2024, X's AI chatbot Grok generated a false headline claiming \"Iran Strikes Tel Aviv with Heavy Missiles,\" which was then promoted on X's trending news section. This misinformation, fueled by user spamming of fake news, falsely indicated a serious international conflict. The incident highlighted significant risks associated with relying on AI for content curation and demonstrated the potential for widespread dissemination of harmful misinformation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X (Twitter)"],"developers":["X (Twitter)"],"harmed":["X (Twitter) Users, Israelis, Iranians, General Public"],"report_count":1},{"incident_id":684,"occurred_on":"2024-04-04","title":"Google Books Appears to Be Indexing Works Written by AI","description":"Google Books is indexing low-quality, AI-generated books, degrading its database and potentially distorting Google Ngram Viewer's analysis of language trends. This integration of inaccurate or misleading information undermines trust, disseminates poor-quality content, and wastes resources as researchers must spend time clearing up the misinformation.","mit_domain":"Misinformation","mit_subdomain":"Pollution of information ecosystem and loss of consensus reality","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google, Google Books"],"developers":["Google"],"harmed":["Google Books, Google Ngram Viewer, Researchers, General Public"],"report_count":1},{"incident_id":686,"occurred_on":"2024-04-03","title":"Meta AI Image Generator Reportedly Fails to Accurately Represent Interracial Relationships","description":"Meta's AI image generator is alleged to produce inaccurate and biased images, consistently failing to depict interracial relationships involving Asian individuals and Caucasian or Black individuals. Instead, it generates images featuring two Asian people or stereotypes, erasing the diversity and representation of Asian people.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Interracial Couples, General Public, Asian People"],"report_count":2},{"incident_id":672,"occurred_on":"2024-04-03","title":"'Lavender' and 'The Gospel' AI Systems Reportedly Used in Gaza Targeting Operations with Civilian Harm Allegations","description":"The AI system known as \"Lavender\" was reportedly used by the Israel Defense Forces (IDF) to assist in identifying individuals in Gaza for targeting, while a related system, \"The Gospel,\" was reportedly used to help select and prioritize physical strike targets. Investigations reportedly suggest that these systems operated with limited human review and may have contributed to strikes associated with high civilian casualties. The extent of automation with human oversight, as well as the accuracy o","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Cyberattacks, weapon development or use, and mass harm","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unit 8200, Israel Defense Forces"],"developers":["Unit 8200, Israel Defense Forces"],"harmed":["Palestinians, Gazans, National Security And Intelligence Stakeholders"],"report_count":9},{"incident_id":665,"occurred_on":"2024-04-02","title":"Facial Recognition Misidentification at New World Westend in New Zealand","description":"A facial recognition system at New World Westend supermarket misidentified a Māori woman as a known offender during its trial. The woman was wrongfully accused of trespassing and experienced public embarrassment, raising concerns about racial bias and the technology's accuracy. The supermarket acknowledged its error and apologized.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Foodstuffs, New World Westend"],"developers":["Foodstuffs"],"harmed":["Te Ani Solomon, Maori Community"],"report_count":2},{"incident_id":662,"occurred_on":"2024-04-02","title":"Washington State's Lottery AI Site Reportedly Generates Inappropriate User Image","description":"An AI-powered website by Washington State's Lottery is reported to have inadvertently produced a softcore pornographic image of a user, leading to the site’s immediate shutdown out of caution.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Washington State'S Lottery"],"developers":["Washington State'S Lottery"],"harmed":[],"report_count":2},{"incident_id":1589,"occurred_on":"2024-04-01","title":"Purportedly AI-Powered 007TG Platform Reportedly Used by Scam Networks Linked to $75 Million in Proceeds","description":"007TG was a software suite reportedly used by scam compounds to run fraud across social media, using AI-assisted messaging and translation to help operators manage targets while concealing their identities. Wallet records linked the platform to at least four known scam networks that collectively received at least $75 million, though the evidence does not show how much was directly attributable to 007TG.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Transnational fraud rings","Scammers","Pig-butchering scammers","Cybercriminals"],"developers":["OpenAI","Large language model developers","HiSeven Pte. Ltd.","Google DeepMind","Google","Chatbot developers","AI-assisted scam platform developers","007TG (Global Social Traffic Navigation)"],"harmed":["Trafficking victims coerced into scam operations","Targets of scams","Privacy","Human trafficking victims","Global victims targeted by scams","Financial scam victims","Epistemic integrity"],"report_count":2},{"incident_id":730,"occurred_on":"2024-04-01","title":"AI Deepfakes for Voter Outreach Flood Indian Elections","description":"During the 2024 Indian elections, politicians used AI-generated deepfakes to reach voters, who might be unaware they're interacting with digital clones. Providers like Divyendra Singh Jadoun of Polymath Synthetic Media Solutions created deepfakes for personalized messages. This practice, used by various political parties, is not truthful, as voters may be misled by AI-generated content posing as genuine interactions with political figures.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Bharatiya Janata Party (Bjp), Indian National Congress (Inc), Prem Singh Tamang, Y. S. Jagan Mohan Reddy, Ram Chandra Choudhary"],"developers":["Divyendra Singh Jadoun, Polymath Synthetic Media Solutions, Sagar Vishnoi, Itoconnect, Indiaspeaks Research Lab, Sumit Savara"],"harmed":["Indian Voters, General Public Misled By Deepfake Content, Political Integrity And Election Fairness, Epistemic Integrity, Democratic Integrity"],"report_count":1},{"incident_id":727,"occurred_on":"2024-04-01","title":"Synthetic Voice 'Olesya' by Storm-1516 Falsely Accuses Ukraine in U.S. Election Disinformation Campaign","description":"Russian operatives used AI to create a fake video and voice of \"Olesya,\" a supposed troll in Kyiv, falsely claiming involvement in U.S. elections to support President Biden. U.S. intelligence confirmed the voice was AI-generated. This disinformation campaign aimed to mislead voters, erode trust in democratic institutions, and influence the 2024 election. The incident involved the group Storm-1516, individuals linked to Valery Korovin, and potential veterans of the Internet Research Agency.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Valery Korovin, Storm 1516, Internet Research Agency Veterans, Center For Geopolitical Expertise"],"developers":["Valery Korovin, Storm 1516, Internet Research Agency Veterans, Center For Geopolitical Expertise"],"harmed":["Ukrainian General Public, Joe Biden, General Public, Biden Presidential Campaign, American Conservatives, Democratic Integrity"],"report_count":1},{"incident_id":706,"occurred_on":"2024-04-01","title":"Scammers Using AI to Impersonate Small Businesses","description":"Scammers are using AI to impersonate small businesses by copying their videos, logos, and social media posts. They create fake listings and ads, diverting customers to cheap knockoffs or stealing their money. This has severely impacted businesses like Bee Cups, Darn Tough Vermont, and Cascade hummingbird feeders, leading to significant financial losses, negative reviews, and damaged reputations. Their deployment of AI makes it challenging for small businesses to combat these fraudulent activitie","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Openai, Unknown Ai Developers"],"harmed":["Small Businesses, Small Business Customers, Small Business Employees, Bee Cups, Darn Tough Vermont, Jim Carter"],"report_count":1},{"incident_id":1053,"occurred_on":"2024-03-30","title":"Mumbai Businessman Reportedly Defrauded via Purported AI-Cloned Voice Impersonating Son","description":"A Mumbai businessman reportedly identified as KT Vinod reportedly lost Rs 80,000 after receiving a call from someone claiming to be a representative of the Indian Embassy in Dubai, who said his son had been arrested. The caller allegedly used AI-generated voice cloning to simulate the voice of Vinod's son, pleading for help. Reportedly convinced of the urgency, Vinod instructed a money transfer via Google Pay. The scam was discovered only after he contacted his son directly. ","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["General Public Of India, Mumbai Businessman, Son Of Mumbai Businessman"],"report_count":2},{"incident_id":714,"occurred_on":"2024-03-29","title":"Microsoft-Powered New York City Chatbot Advises Illegal Practices","description":"New York City's chatbot, launched under Mayor Eric Adams's plan to assist businesses, has been reportedly providing dangerously inaccurate legal advice. The Microsoft-powered bot allegedly informed users that landlords can refuse Section 8 vouchers and that businesses can operate cash-free, among other falsehoods. The city acknowledges the chatbot is a pilot program and commits to improvements while the errors are addressed.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["New York City Government, Eric Adams Administration"],"developers":["Microsoft, New York City Office Of Technology And Innovation"],"harmed":["New York City Small Business Owners, New York City Landlords And Tenants, New York City Employers And Employees, Eric Adams Administration"],"report_count":2},{"incident_id":683,"occurred_on":"2024-03-28","title":"Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements","description":"Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Heygen, Elevenlabs"],"harmed":["Olga Loiek, Michel Janse, Lana Smalls, Carrie Williams, Shade Zahrai"],"report_count":2},{"incident_id":690,"occurred_on":"2024-03-26","title":"ISIS Utilizes AI for Propaganda Videos in News Harvest Program","description":"ISIS supporters have created an AI-generated media program called News Harvest to disseminate propaganda videos. The program produces near-weekly broadcasts featuring AI-generated news anchors discussing ISIS operations globally, using cheap and easy-to-use AI tools. This development showcases the use of AI as a powerful propaganda tool for extremist groups.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Isis, Isis Supporters"],"developers":["Openai, Elevenlabs"],"harmed":["General Public, People Susceptible To Radicalism"],"report_count":4},{"incident_id":689,"occurred_on":"2024-03-26","title":"Holmen, Wisconsin Man Allegedly Used Stable Diffusion to Create and Then Share Sexually Explicit Images Depicting Minors","description":"The FBI has arrested Steven Anderegg of Holmen, Wisconsin for having allegedly used Stable Diffusion to generate about 13,000 sexually explicit images of minors, which he then is also alleged to have shared and distributed, including with at least one minor, via Telegram and Instagram. Anderegg was originally apprehended by state police in March, and this case marks one of the first times the FBI has brought charges against someone for having used AI to generate CSAM.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Steven Anderegg"],"developers":["Stable Diffusion, Stability Ai"],"harmed":["Minors, General Public"],"report_count":4},{"incident_id":661,"occurred_on":"2024-03-26","title":"Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes","description":"Sydney-based startup Leonardo AI's text-to-image generator was alleged to have been exploited to create nonconsensual sexual images of celebrities, bypassing content moderation systems with user-shared prompts.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Telegram Community Users, Reddit Users, Leonardo Ai Users"],"developers":["Leonardo Ai"],"harmed":["Public Figures, Celebrities"],"report_count":1},{"incident_id":656,"occurred_on":"2024-03-23","title":"Purported Deepfake Disinformation Aired on Russian State TV Allegedly Linking Ukraine to Moscow Attack","description":"Russian state television reportedly aired a fabricated video that appeared to imitate senior Ukrainian security officials and present a false admission of involvement in the Crocus City Hall massacre. The clip reportedly used elements from recent interviews combined with allegedly AI-generated audio to create a misleading confession. ISIS-K is reported to have publicly claimed responsibility, while independent analysts and governments have rejected the narrative promoted through the video.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russian State Media, Ntv Channel"],"developers":["Russian State Media, Ntv Channel"],"harmed":["Ukraine, Oleksiy Danilov, Kyrylo Budanov, Journalistic Integrity, Epistemic Integrity, General Public, General Public Of Russia, General Public Of Ukraine, National Security And Intelligence Stakeholders"],"report_count":3},{"incident_id":658,"occurred_on":"2024-03-22","title":"The Arizona Agenda Produced a Deepfake of Kari Lake Advocating for the Publication Without Her Consent","description":"The Arizona Agenda produced a deepfake video of Republican Senate candidate Kari Lake giving a testimonial about the publication with the seeming intention of educating the general public about the dangers of deepfakes in the coming election cycle. However, the Arizona Agenda appears not to have sought Lake's consent, prompting a cease-and-desist letter from her campaign. ","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["The Arizona Agenda, Hank Stephenson"],"developers":["The Arizona Agenda, Hank Stephenson"],"harmed":["Kari Lake, General Public, Democratic Integrity, Journalistic Integrity"],"report_count":3},{"incident_id":660,"occurred_on":"2024-03-21","title":"Investigation Reports Unauthorized Deepfake Pornography Harms Thousands of Celebrities","description":"A Channel 4 News investigation alleges that nearly 4,000 celebrities globally, including 255 British figures, were victims of deepfake pornography. Faces were superimposed onto explicit content using AI, with the top deepfake sites garnering 100 million views in three months, according to their findings.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Website Operators"],"developers":["Deepfake Technology Developers"],"harmed":["Celebrities, British Public Figures, Cathy Newman"],"report_count":1},{"incident_id":1684,"occurred_on":"2024-03-19","title":"Dozens of Dutch Women, Including Politicians and Public Figures, Were Reportedly Targeted With AI-Manipulated Deepfake Pornography","description":"Dutch reporting in March 2024 identified roughly 70–80 prominent women, including politicians, presenters, athletes, celebrities, and members of the royal family, as reportedly depicted in pornographic deepfake videos made by using AI to place their faces on performers' bodies. Some videos had more than 100,000 views. Several women said they had not known the videos existed and filed or planned police reports.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Synthetic media creators","Deepfake website operators","Deepfake creators"],"developers":["Synthetic video generation technology developers","Synthetic media generation technology developers","Deepfake technology developers","AI face-swapping technology developers"],"harmed":["Women and girls","Women","Victims of non-consensual deepfakes","Victims of deepfake abuse","Sylvana IJsselmuiden","Simone Simons","Sharon Dijksma","Sandra Beckerman"],"report_count":7},{"incident_id":1025,"occurred_on":"2024-03-18","title":"Alleged Deepfake Video Depicts Former President of Kenya Uhuru Kenyatta Announcing 2027 Presidential Bid","description":"A widely shared TikTok video purportedly manipulated by AI depicts former Kenyan president Uhuru Kenyatta announcing a 2027 presidential run. Reported digital forensics and visual inconsistencies confirm the video is an AI-generated deepfake, using archival footage from his presidency with synthesized audio. The clip spread rapidly online but has reportedly been debunked by fact-checkers. Kenyatta has made no such announcement, and such a move would violate Kenya's two-term constitutional limit.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors, Information Manipulation Actors"],"developers":["Deepfake Technology Developers"],"harmed":["Uhuru Kenyatta, General Public Of Kenya"],"report_count":1},{"incident_id":765,"occurred_on":"2024-03-14","title":"22 Students at Richmond-Burton Community High School in Illinois Targeted by Deepfake Nudes","description":"22 students at Richmond-Burton Community High School in Illinois were targeted in the creation of deepfake nudes. One of the students, Stevie Hyder, was targeted by classmates who used deepfake technology to alter her April 2023 prom picture into nude pictures, which were then circulated on social media. Two unnamed minors were arrested in late April 2024.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Stevie Hyder, Richmond Burton Community High School"],"report_count":5},{"incident_id":674,"occurred_on":"2024-03-14","title":"Manipulated Media via AI Disinformation and Deepfakes in 2024 Elections Erode Trust Across More Than 50 Countries","description":"AI-driven election disinformation is escalating globally, leveraging easy-to-use generative AI tools to create convincing deepfakes that mislead voters. This shift has simplified the process for individuals to generate fake content, having already eroded trust in elections by undermining public trust and manipulating voter perceptions. Evidence has, for example, been documented in incidents across the U.S., Moldova, Slovakia, Bangladesh, and Taiwan.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russian Government, Political Operatives, Political Consultants, Chinese Communist Party"],"developers":["Openai, Google, Deepfake Creators"],"harmed":["Voters, Public Trust, Political Figures, General Public, Civic Society, Democratic Integrity"],"report_count":1},{"incident_id":725,"occurred_on":"2024-03-14","title":"Cartels Reportedly Using AI to Expand Operations into Financial Fraud and Human Trafficking","description":"The Jalisco New Generation Cartel is reportedly using AI to expand its financial fraud and human trafficking operations, coercing individuals into illegal activities under the guise of legitimate jobs. INTERPOL warns that this integration of AI into criminal enterprises is a growing trend among cartels across Europe, Asia, and Africa as well.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cartels, Organized Crime Groups, Jalisco New Generation Cartel"],"developers":["Unknown Ai Developers"],"harmed":["Individuals Coerced Into Criminal Activities, Human Trafficking Victims, Financial Scam Victims"],"report_count":1},{"incident_id":654,"occurred_on":"2024-03-06","title":"Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images","description":"A Microsoft engineer reported that Copilot Designer, an AI image generator, creates content depicting sex, violence, bias, and more. Despite raising concerns and suggesting improvements, the tool remains public, prompting a letter to the FTC.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Microsoft"],"developers":["Microsoft"],"harmed":["General Public, Minors"],"report_count":1},{"incident_id":650,"occurred_on":"2024-03-04","title":"AI-Generated Images of Trump with Black Voters Spread as Disinformation Before U.S. Primary Elections","description":"In the run-up to the U.S. primary elections, supporters of Donald Trump shared AI-generated images showing him with Black voters in an attempt to sway African-American votes. These deepfakes, including Trump's distorted hand visuals, were initially created by satirical accounts but were later misappropriated for political disinformation, misleading millions on social media platforms.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Trump Supporters, Social Media Users"],"developers":["Trump Supporters, Social Media Users"],"harmed":["Public Discourse Integrity, General Public, African American Voters, Black Voters, Democratic Integrity"],"report_count":1},{"incident_id":680,"occurred_on":"2024-03-01","title":"Russia-Linked AI CopyCop Site Identified as Modifying and Producing at Least 19,000 Deceptive Reports","description":"In early March 2024, a network named CopyCop began publishing modified news stories using AI, altering content to spread partisan biases and disinformation. These articles, initially from legitimate sources, were manipulated by AI models, possibly developed by OpenAI, to disseminate Russian propaganda. Over 19,000 articles were published, targeting divisive political issues and creating false narratives.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Copycop, Russia Linked Network"],"developers":["Openai, Chatgpt"],"harmed":["General Public, Democratic Integrity, Journalistic Integrity"],"report_count":3},{"incident_id":715,"occurred_on":"2024-03-01","title":"Over 400 Purportedly AI-Driven Scams Reportedly Led to $8M Loss for Australians in 2023","description":"In 2023, Australians reportedly lost over $8 million to scams involving purported deepfake videos and fake news articles that falsely endorsed investment trading platforms. Scammers reportedly used AI-generated content featuring celebrities to mislead victims, leading to significant financial losses. The National Anti-Scam Centre received over 400 reports of these incidents. One man is reported to have lost over $80,000 in cryptocurrency.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers, Generative Ai Developers"],"harmed":["General Public Of Australia, General Public, Epistemic Integrity"],"report_count":1},{"incident_id":787,"occurred_on":"2024-03-01","title":"Deepfake ID Sales Allegedly Persist as OnlyFake Reportedly Relaunches with New Fraud Tools","description":"Researchers from Au10tix discovered the relaunch of OnlyFake, a site offering AI-generated fake IDs. Despite an earlier takedown, the site reemerged with disclaimers and new tools, including handwritten signature generation. These fakes are challenging biometric verification systems and are reportedly being used to perpetuate fraudulent activity.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Onlyfake, Yurii Nazarenko, Yuriy Nazarenko, Uriel Septimberus, Tor Ford, John Wick (Onlyfake)"],"developers":["Onlyfake"],"harmed":["Individuals Using Biometrics, Government Agencies Using Biometrics, Businesses Using Biometrics, Biometric Security, Epistemic Integrity, National Security And Intelligence Stakeholders"],"report_count":3},{"incident_id":717,"occurred_on":"2024-03-01","title":"Fake AI-Generated Law Firms Sent Fake DMCA Notices to Increase SEO","description":"In March 2024, fake law firms using AI-generated identities sent fraudulent DMCA takedown notices to website owners, demanding backlinks for SEO gains. These AI-generated law firms, like \"Commonwealth Legal,\" used GAN models for realistic attorney images and fabricated bios. The scam involved fake legal threats to coerce site owners into adding backlinks, exploiting AI technology for deceptive practices.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Commonwealth Legal, Scammers"],"developers":["Deepfake Creators"],"harmed":["Website Owners, Website Operators, Ernie Smith"],"report_count":1},{"incident_id":826,"occurred_on":"2024-02-28","title":"Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails","description":"A 14-year-old, Sewell Setzer III, died by suicide after reportedly becoming dependent on Character.ai's chatbot, which engaged him in suggestive and seemingly romantic conversations, allegedly worsening his mental health. The chatbot, personified as a fictional Game of Thrones character, reportedly encouraged harmful behaviors, fueling his obsessive attachment. The lawsuit claims Character.ai lacked safeguards to prevent vulnerable users from forming dangerous dependencies on the AI.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Sewell Setzer Iii"],"developers":["Noam Shazeer, Daniel De Freitas, Character.Ai"],"harmed":["Sewell Setzer Iii"],"report_count":38},{"incident_id":646,"occurred_on":"2024-02-22","title":"Snapchat's Algorithm Alleged to Link Minor with Sex Offenders","description":"A judge ruled Snapchat not liable under Section 230 after its algorithm connected a minor with convicted sex offenders on multiple occasions, leading to sexual assaults first in 2019 and again in 2021. The platform's \"Quick Add\" feature was implicated in facilitating the connections between the minor and the offenders.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Snapchat"],"developers":["Snapchat"],"harmed":["Minors"],"report_count":1},{"incident_id":645,"occurred_on":"2024-02-21","title":"Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation","description":"Google's Gemini chatbot faced many reported bias issues upon release, leading to a variety of problematic outputs like racial inaccuracies and political biases, including regarding Chinese and Indian politics. It also reportedly over-corrected racial diversity in historical contexts and advanced controversial perspectives, prompting a temporary halt and an apology from Google.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google, Gemini"],"developers":["Google"],"harmed":["General Public"],"report_count":35},{"incident_id":642,"occurred_on":"2024-02-20","title":"ChatGPT Glitch Disrupts User Interactions with Nonsensical Outputs","description":"ChatGPT experienced a bug causing it to produce unexpected and nonsensical responses, leading to widespread reports of user confusion and concern. OpenAI identified and fixed the language processing bug, restoring normal service.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Chatgpt Users"],"report_count":5},{"incident_id":641,"occurred_on":"2024-02-20","title":"Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X","description":"Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["X (Twitter), Deepfake Creators"],"developers":["Deepfake Creators"],"harmed":["Bobbi Althoff"],"report_count":12},{"incident_id":1023,"occurred_on":"2024-02-19","title":"Purported AI-Cloned Voice Depicts Kenyan President William Ruto Speaking French in Viral Video","description":"A purportedly AI-manipulated video widely shared on TikTok and Facebook presents Kenyan President William Ruto speaking in French during a speech in Tokyo on February 7, 2024. A reported reverse image search confirmed the original footage shows Ruto speaking in English to the Kenyan diaspora. The reportedly manipulated version used AI-generated French audio over the original video, making it a case of voice cloning rather than a full audiovisual deepfake.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Actors Manipulating Footage Of William Ruto, Unknown Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["William Ruto, General Public Of Kenya"],"report_count":1},{"incident_id":673,"occurred_on":"2024-02-19","title":"Deepfakes Circulating and Eroding Electoral Integrity in the Lead-up to 2024 South Korean legislative election","description":"In the lead-up to Korea's parliamentary elections, at least 129 deepfake videos and images were reported to have been detected, violating new election laws. These AI-generated deepfakes were used to mislead and manipulate public opinion, prompting a crackdown by the National Election Commission.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Political Groups, Information Manipulation Actors"],"developers":["Unknown Political Groups, Information Manipulation Actors"],"harmed":["Yoon Suk Yeol, Korean Voters, Democratic Integrity, Journalistic Integrity"],"report_count":1},{"incident_id":644,"occurred_on":"2024-02-18","title":"Alleged State-Sponsored Hackers Escalate Purported Phishing Attacks Using Artificial Intelligence","description":"State-sponsored hackers from North Korea, Iran, Russia, and China are reportedly leveraging artificial intelligence to conduct sophisticated phishing and social engineering attacks. They target global defense, cybersecurity, and cryptocurrency sectors, aiming to steal sensitive information and, in the case of North Korea, cryptocurrencies to help fund its illicit nuclear program.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russian Hackers, North Korean Hackers, Iranian Hackers, Chinese Hackers"],"developers":["Russian Government, Government Of North Korea, Iranian Government, Chinese Government"],"harmed":["Individual Professionals On Linkedin, Global Defense Companies, Cybersecurity Firms, Cryptocurrency Exchanges, Targets Of Fraudulent Professional Opportunities"],"report_count":6},{"incident_id":664,"occurred_on":"2024-02-17","title":"Deepfake Generated by the Lincoln Project of Trump's Father Used in Political Attack Ad","description":"The Lincoln Project used AI to create a deepfake video of Donald Trump's deceased father criticizing him. Although they made it clear that the video was a deepfake, the deeply personal nature of the attack represents a corrosive use of artificial intelligence in undermining democratic norms during an election cycle.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Lincoln Project"],"developers":["Lincoln Project"],"harmed":["Public Discourse Integrity, Political Integrity, General Public, Donald Trump"],"report_count":1},{"incident_id":696,"occurred_on":"2024-02-14","title":"Meta's AI Ad Platform Reportedly Causes Overspending and Poor Performance","description":"Meta's automated ad platform \"Advantage Plus\" caused advertisers to exceed their daily ad budgets. The cost per impressions (CPMs) surged far above the usual. This incident, which persisted into April, affected small businesses with overspending and lack of transparency.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook"],"developers":["Meta, Facebook"],"harmed":["Small Businesses, Advertisers"],"report_count":1},{"incident_id":649,"occurred_on":"2024-02-14","title":"Deepfake Audio Falsely Attributes Controversial Remarks to Keir Starmer About the Rochdale Azhar Ali Crisis","description":"A deepfake audio clip, falsely claiming to be Keir Starmer discussing the Rochdale byelection and Labour's withdrawl of support for Azhar Ali, circulated online, achieving over 250,000 views. Experts confirmed its inauthenticity, highlighting a significant misuse of AI in fabricating political content.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Social Media Users"],"developers":["Unknown"],"harmed":["General Public, British Voters, British Labour Party, Keir Starmer, Democratic Integrity"],"report_count":1},{"incident_id":636,"occurred_on":"2024-02-14","title":"AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting","description":"AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Romantic Ai, Replika, Genesia Ai Friend And Partner, Eva Ai Chat Bot And Soulmate, Crushon.Ai, Chai"],"developers":["Romantic Ai, Replika, Genesia Ai Friend And Partner, Eva Ai Chat Bot And Soulmate, Crushon.Ai, Chai, Chatbot Developers"],"harmed":["General Public, Chatbot Users, Privacy, Replika Users, Chai Users, Romantic Ai Users, Eva Ai Users, Crushon.Ai Users, Genesia Ai Friend And Partner Users"],"report_count":5},{"incident_id":643,"occurred_on":"2024-02-13","title":"Purported Deepfake Video Allegedly Claims Kyiv's Assassination Plan Against President Emmanuel Macron","description":"A purported deepfake video reportedly claimed France 24 reported a Kyiv plot to assassinate French President Macron. This reported fake news was debunked by France 24, which confirmed the video was altered and did not air any such report.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Vkontakte, Russian Media Outlets, Pro Russian Telegram Channels, Pro Kremlin Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Julien Fanciulli, General Public, France 24, General Public Of France, Epistemic Integrity, Ukraine France Relations, National Security And Intelligence Stakeholders"],"report_count":6},{"incident_id":732,"occurred_on":"2024-02-12","title":"Whisper Speech-to-Text AI Reportedly Found to Create Violent Hallucinations","description":"Researchers at Cornell reportedly found that OpenAI's Whisper, a speech-to-text system, can hallucinate violent language and fabricated details, especially with long pauses in speech, such as from those with speech impairments. Analyzing 13,000 clips, they determined 1% contained harmful hallucinations. These errors pose risks in hiring, legal trials, and medical documentation. The study suggests improving model training to reduce these hallucinations for diverse speaking patterns.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Whisper, Organizations Integrating Whisper Into Customer Service Systems, Openai, Companies Using Whisper, Whisper Users"],"developers":["Openai"],"harmed":["Users Whose Speech Is Misinterpreted By Whisper, Professionals Relying On Accurate Transcriptions, Individuals With Speech Impairments, General Public, People With Disabilities"],"report_count":1},{"incident_id":669,"occurred_on":"2024-02-11","title":"Deepfake of Long-Deceased Suharto Circulating in Run-up to February 2024 Indonesian Elections","description":"An AI-generated deepfake of Suharto, the deceased Indonesian dictator, was generated and circulated by the Golkar Party ahead of the February 2024 Indonesian elections. This video, which aimed to influence voter perceptions by invoking Suharto's legacy, sought to manipulate public opinion and misused deceased individuals' likenesses for political gain. The incident is another example of political deepfakes creating convincing misinformation.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Golkar Party"],"developers":["Golkar Party"],"harmed":["Indonesian Electorate, Democratic Integrity"],"report_count":1},{"incident_id":671,"occurred_on":"2024-02-08","title":"Many Purported Political Deepfakes Reportedly Circulating in Run-up to 2024 Pakistani General Elections","description":"During Pakistan's 2024 general elections, purportedly AI-generated deepfakes of a politically motivated nature were circulated. These deepfakes reportedly portrayed political figures in misleading contexts, spreading misinformation and aiming to influence voter perceptions and election outcomes.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Pakistani Political Parties, Misinformation Networks, Misinformation Spreaders, Information Manipulation Actors"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Rana Atif, Raja Bashara, Naeem Haider Panjutha, Imran Khan, General Public, General Public Of Pakistan, Epsitemic Integrity, Epistemic Integrity, Democratic Integrity"],"report_count":1},{"incident_id":648,"occurred_on":"2024-02-07","title":"Alleged Deepfake Audio of Imran Khan Calls for Election Boycott, Misleading Pakistan Voters","description":"A purported deepfake audio clip, falsely attributed to Imran Khan urging a PTI (Pakistan Tehreek-e-Insaf) election boycott, circulated on social media on the eve of Pakistan's general elections. This sophisticated AI-generated misinformation aimed to mislead voters, highlighting the growing challenge of digital manipulation in political discourse.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Social Media Accounts"],"developers":["Unknown"],"harmed":["Voters In Pakistan, Pti (Pakistan Tehreek E Insaf), Imran Khan, Democratic Integrity"],"report_count":2},{"incident_id":647,"occurred_on":"2024-02-06","title":"A Self-Driving Waymo Robotaxi Reportedly Collided with a Bicyclist","description":"A Waymo robotaxi in San Francisco reportedly failed to detect a cyclist obscured by a truck, resulting in a collision with minor injuries, at 17th and Mississippi Streets in Potrero Hill. The incident reportedly demonstrated a vulnerability in autonomous vehicles' ability to safely navigate complex urban environments.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Waymo"],"developers":["Waymo"],"harmed":["Bicyclist"],"report_count":4},{"incident_id":919,"occurred_on":"2024-02-06","title":"Purported Russian-Linked Network Allegedly Used Deepfake of Maria Ressa on Facebook and Bing to Promote Cryptocurrency Scam Targeting Filipinos","description":"A purportedly Russian-linked scam network allegedly circulated an AI-generated deepfake of journalist Maria Ressa on Facebook and Microsoft Bing. The video reportedly manipulated a 2022 interview to falsely depict Ressa endorsing cryptocurrency. Fraudulent websites allegedly impersonating Rappler and CNN Philippines reportedly amplified the scam. Investigators reportedly linked the operation to a fraudulent network targeting Filipino audiences. Meta and Microsoft removed the content, but similar","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Td Globus Contract, Russian Linked Scam Network, M1 Shop"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Rappler, Public Trust In Media Institutions, Potential Cryptocurrency Scam Victims, Maria Ressa, Filipino Social Media Users, Cnn Philippines"],"report_count":1},{"incident_id":829,"occurred_on":"2024-02-05","title":"Facial Recognition System in Buenos Aires Triggers Police Checks Based on False Matches","description":"Buenos Aires's facial recognition system mistakenly flagged innocent people as criminals, leading to wrongful stops and detentions. Judicial investigations indicate the technology may have been misused for unauthorized surveillance and data collection. Despite privacy risks, the system has been used widely without full disclosure of standards or safeguards,","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["National security and intelligence stakeholders","Law enforcement","Government of Buenos Aires","Government of Argentina","Facial recognition system deployers","Argentinean Ministry of Security"],"developers":["Surveillance technology developers","Government of Argentina","Facial recognition system developers"],"harmed":["Privacy","Guillermo Ibarrola","General public of Argentina","General public","Buenos Aires residents","Biometric data subjects"],"report_count":1},{"incident_id":853,"occurred_on":"2024-02-03","title":"Two Passengers Report Feeling Trapped in Waymo Car During Sensor Obstruction","description":"During a nighttime Waymo ride in San Francisco, an individual reportedly blocked the sensors of an autonomous vehicle, leaving passengers Robert Moreno and his husband feeling trapped and unsure how to proceed. Waymo's support team reportedly advised the riders to stay inside the vehicle for safety. The individual reportedly left after a few minutes without further escalation.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Waymo"],"developers":["Waymo"],"harmed":["Robert Moreno'S Husband, Robert Moreno"],"report_count":1},{"incident_id":634,"occurred_on":"2024-02-02","title":"Alleged Deepfake CFO Scam Reportedly Costs Multinational Engineering Firm Arup $25 Million","description":"A finance employee at the multinational engineering firm Arup was reportedly deceived into transferring $25 million by fraudsters using purported deepfake technology to impersonate the firm's CFO in a video call, according to the Hong Kong police.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Unnamed Finance Employee, Arup"],"report_count":30},{"incident_id":1292,"occurred_on":"2024-02-01","title":"Glasgow Man Allegedly Used AI Tool to Create and Share Nonconsensual Deepfake Nude Images of Former Classmate","description":"In February 2024, a Glasgow man, Callum Brooks, reportedly used an AI-powered image-alteration tool to create deepfake nude images of a woman he knew from school by modifying her publicly posted social media photos. He allegedly sent the fabricated intimate images to two friends without her consent. The woman was reportedly embarrassed and distressed after learning of the images. Brooks pled guilty in Glasgow Sheriff Court and was fined £335.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Callum Brooks"],"developers":["Image Generation Technology Developers, Deepfake Technology Developers"],"harmed":["Former Classmate Of Callum Brooks, Epistemic Integrity"],"report_count":3},{"incident_id":692,"occurred_on":"2024-02-01","title":"London Metropolitan Police's Facial Recognition Technology Reportedly Misidentified Shaun Thompson as Suspect Leading to Arrest","description":"Sometime in February 2024, Shaun Thompson is reported to have walked by one of the London Metropolitan Police's facial recognition technology vans near London Bridge. He was almost immediately arrested because the technology is reported to have misidentified him as a suspect in an unrelated and unspecified crime.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Metropolitan Police Service","Law enforcement","Facial recognition system deployers"],"developers":["Facial recognition system developers"],"harmed":["Shaun Thompson","General public of the United Kingdom","General public"],"report_count":3},{"incident_id":682,"occurred_on":"2024-02-01","title":"GOP Pollster Reportedly Shares Purportedly AI-Generated Images to Fabricate Appearance of Black Voter Support","description":"Purportedly AI-generated images circulated by GOP pollster Patrick Ruffini reportedly depicted Black men appearing to support the Republican Party shortly before Black History Month. The allegedly fabricated photos created a misleading impression of racial diversity within the GOP and may have shaped public perception. The episode raises concerns about the reported use of AI to distort political representation and the potential impact on Black communities.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Patrick Ruffini"],"developers":["Deepfake Technology Developers, Image Generation Technology Developers"],"harmed":["General Public, Black Americans, African American Voters, General Public Of The United States, Epistemic Integrity, Democratic Integrity"],"report_count":1},{"incident_id":866,"occurred_on":"2024-02-01","title":"Network of 171 AI-Powered Bots Reportedly Spread Political Disinformation Ahead of Ghana’s December 2024 General Election","description":"A network of 171 bot accounts on X are alleged to have used ChatGPT to generate political content supporting Ghana’s New Patriotic Party (NPP) and its presidential candidate, Mahamudu Bawumia, ahead of the December 2024 election. The AI-generated posts reportedly praised Bawumia while spreading disinformation targeting the opposition candidate, John Mahama, of the National Democratic Congress (NDC).","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Pro New Patriotic Party Bot Network"],"developers":["Openai"],"harmed":["John Mahama, National Democratic Congress, Ghanaian Electorate, Democratic Integrity"],"report_count":1},{"incident_id":635,"occurred_on":"2024-01-30","title":"AI-Generated Fake News Targets Black Celebrities on YouTube","description":"YouTube faced a surge of AI-generated fake news targeting Black celebrities, including fake narratives about Sean “Diddy” Combs and others. These videos, blending AI-generated and manipulated media, amassed millions of views, challenging content moderation efforts and highlighting the spread of disinformation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Variety Of Youtube Content Creators"],"developers":["Unknown Ai Text To Speech Technology Developers, Generative Ai Developers"],"harmed":["Steve Harvey, Sean \"Diddy\" Combs, General Public, Denzel Washington, Black Celebrities, Bishop T.D. Jakes"],"report_count":1},{"incident_id":657,"occurred_on":"2024-01-30","title":"Alleged ChatGPT Account Compromise Reportedly Led to Unintended Data Exposure","description":"An alleged security breach involving ChatGPT led to the reported exposure of sensitive conversations, including login credentials and personal data, after a user account was allegedly compromised. OpenAI reportedly responded to the incident with an explanation.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Other","intent":"Other","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai, Large Language Model Developers"],"harmed":["Chatgpt Users, Chase Whiteside, Privacy"],"report_count":1},{"incident_id":633,"occurred_on":"2024-01-28","title":"Nine Network's AI Alters Lawmaker Georgie Purcell's Image Inappropriately","description":"The Nine Network used Photoshop's Generative Expand AI tool to resize an image of lawmaker Georgie Purcell, inadvertently altering her attire to appear more revealing. This error, claimed to result from the AI's automation, led to public criticism and an apology from the network.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Nine Network"],"developers":["Adobe"],"harmed":["Georgie Purcell"],"report_count":17},{"incident_id":1260,"occurred_on":"2024-01-27","title":"Purported Deepfake of Andrew Forrest Used to Promote Fraudulent 'Quantum AI' Crypto Platform on Facebook","description":"Cybertrace reportedly identified a purported deepfake of Australian billionaire Andrew Forrest circulating on Facebook on January 27, 2024, falsely depicting him endorsing a fraudulent crypto platform called Quantum AI. The video reportedly altered footage from a 2023 Rhodes Trust talk. Forrest reportedly condemned Meta for failing to curb AI-generated frauds.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Scammers Impersonating Andrew Forrest, Quantum Ai, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Investors, General Public Of Australia, General Public, Facebook Users, Epistemic Integrity, Australian Investors, Andrew Forrest"],"report_count":1},{"incident_id":632,"occurred_on":"2024-01-24","title":"Significant Increase in Deepfake Nudes of Taylor Swift Circulating on Social Media","description":"AI-generated sexually explicit images of Taylor Swift circulated on X, garnering over 45 million views before removal. Originating from a Telegram group, these deepfakes challenge content moderation, as X's policies against synthetic media and nonconsensual nudity were violated.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Users In A Telegram Group, Users On X"],"developers":["Microsoft Designer, Image Generation Technology"],"harmed":["Taylor Swift, General Public"],"report_count":31},{"incident_id":670,"occurred_on":"2024-01-23","title":"Deepfakes of Deceased Indian Politicians for Election Campaigning Are Increasingly Being Deployed","description":"In the lead-up to India's 2024 general elections, AI technology was used to create deepfake videos of deceased politicians, such as M. Karunanidhi and J. Jayalalithaa, aiming to influence voter behavior and campaign strategies. These AI-generated appearances are contributing to the erosion of trust in democratic processes and media discourse.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Dravida Munnetra Kazhagam, Dmk, Various Indian Political Parties"],"developers":["Muonium, The Indian Deepfaker"],"harmed":["Indian Electorate, Indian Voters, Media Discourse, M. Karunanidhi, J. Jayalalithaa, Democratic Integrity"],"report_count":2},{"incident_id":628,"occurred_on":"2024-01-21","title":"Fake Biden Voice in Robocall Misleads New Hampshire Democratic Voters in 2024 Primary Election","description":"A robocall imitating President Biden's voice urged New Hampshire Democrats to skip the 2024 primary, falsely claiming their votes mattered more in November. Investigators with the New Hampshire Attorney General's Office, along with other state AGs, the Industry Traceback Group, and the FCC determined that political consultant Steve Kramer hired Paul Carpenter to create the deepfake, which was distributed by Walter Monk's company, Life Corporation. Rep. Dean Phillips, who employed Kramer, has dis","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown"],"developers":["Unknown"],"harmed":["New Hampshire Voters, Kathy Sullivan, Democratic Integrity, Joe Biden"],"report_count":15},{"incident_id":631,"occurred_on":"2024-01-18","title":"Chatbot for DPD Malfunctioned and Swore at Customers and Criticized Its Own Company","description":"DPD's AI chatbot, used for customer service,  appeared to malfunction following a system update, leading to inappropriate responses including swearing and criticizing the company. The incident, which became viral on social media, occurred after the chatbot was updated, prompting DPD to disable the malfunctioning AI component.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Dpd"],"developers":["Dpd"],"harmed":["Ashley Beauchamp, Dpd"],"report_count":2},{"incident_id":1461,"occurred_on":"2024-01-17","title":"Purportedly AI-Manipulated Medical Scam Advertisement Reportedly Used Bulgarian TV Host and Physician's Likenesses","description":"A purportedly AI-manipulated scam advertisement circulating online appeared to use the likenesses and altered media of Bulgarian television host Simeon Ivanov and physician Spas Spaskov to promote an unregistered purported joint-treatment product. They reportedly denied involvement, and the product was described in reporting as ineffective.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Spas Spaskov, Simeon Ivanov, People Seeking Medical Advice, General Public Of Bulgaria, General Public, Epistemic Integrity"],"report_count":1},{"incident_id":675,"occurred_on":"2024-01-15","title":"High School Athletic Director in Baltimore County Allegedly Created Racist Deepfake Audio Impersonating Principal","description":"Dazhon Darien, former athletic director at Pikesville High School in Baltimore, allegedly used AI to create a purported deepfake audio clip impersonating Principal Eric Eiswert, embedding racist and antisemitic remarks. According to reports, the clip was intended to discredit Eiswert and was widely circulated, with some accounts linking it to threats and his placement on administrative leave. On April 28, 2025, Darien was reportedly sentenced to four months in jail after pleading guilty to distu","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Dazhon Darien"],"developers":["Deepfake Technology Developers"],"harmed":["Pikesville High School Students And Staff, Pikesville High School, Eric Eiswert, Baltimore County Public Schools Community"],"report_count":7},{"incident_id":703,"occurred_on":"2024-01-13","title":"Purported Deepfake Audio Reportedly Sparks False Claims of Biden Threatening Texas with F-15s","description":"A purportedly AI-generated audio clip imitating President Biden’s voice reportedly circulated on social media, falsely suggesting that he had threatened to deploy F-15 fighter jets against Texas. The manipulated recording was widely shared and is reported to have heightened political tensions and spread misinformation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Texas Officials, Texas Citizens, Joe Biden, General Public"],"report_count":1},{"incident_id":625,"occurred_on":"2024-01-12","title":"Proliferation of Products on Amazon Titled with ChatGPT Error Messages","description":"Products named after ChatGPT error messages are proliferating on Amazon, such as lawn chairs and religious texts. These names, often resembling AI-generated errors, indicate a lack of editing and undermine the sense of authenticity and reliability of product listings.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Amazon Sellers"],"developers":["Openai, Chatgpt"],"harmed":["Amazon, Amazon Sellers, Amazon Customers"],"report_count":5},{"incident_id":655,"occurred_on":"2024-01-11","title":"Scams Reportedly Impersonating Wealthy Investors Proliferating on Facebook","description":"Scams are reportedly proliferating throughout Facebook impersonating wealthy individuals such as Bill Ackman, Cathie Wood, Steve Cohen, Peter Lynch, and Ray Dalio. In some cases, it seems deepfake technology is being employed, while simultaneously Facebook's own AI systems are allegedly faltering in their ability to halt the spread of these fraudulent ads despite being reported.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook, Scammers"],"developers":["Meta, Facebook"],"harmed":["Investors, General Public, Bill Ackman, Cathie Wood, Steve Cohen, Peter Lynch, Ray Dalio, Peter Bourget"],"report_count":1},{"incident_id":627,"occurred_on":"2024-01-09","title":"Unauthorized AI Impersonation of George Carlin Used in Comedy Special","description":"An AI-generated comedy special impersonating the late comedian George Carlin was created without consent from Carlin's estate. The special featured an AI mimicking Carlin's voice and style. The project, led by the AI comedy channel Dudesy, drew criticism for disrespecting Carlin's legacy and autonomy.","mit_domain":"Socioeconomic & Environmental Harms","mit_subdomain":"Economic and cultural devaluation of human effort","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Will Sasso, Dudesy, Chad Kultgen"],"developers":["Unnamed, Dudesy"],"harmed":["Kelly Carlin, George Carlin'S Estate, George Carlin"],"report_count":8},{"incident_id":875,"occurred_on":"2024-01-08","title":"Coordinated Deepfake Campaign Reportedly Impersonating Rishi Sunak Promoted Fraudulent Quantum AI Investment Platform on Meta","description":"143 deepfake ads, over 100 of which reportedly impersonated former British Prime Minister Rishi Sunak, were promoted on Meta's platform to advertise the fraudulent investment scheme \"Quantum AI.\" Funding for the ads reportedly originated from 23 countries. Up to 462,000 users may have been exposed to the false content. The campaign used generative AI tools to create high-quality misinformation, including spoofed BBC news clips for added legitimacy","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Quantum Ai Scammers"],"developers":["Deepfake Technology Developers"],"harmed":["Rishi Sunak, Quantum Ai Victims, Meta Users, Bbc News Presenters"],"report_count":2}]}