{"attribution":{"source":"AI Incident Database (Responsible AI Collaborative)","license":"CC BY-SA 4.0","license_url":"https://creativecommons.org/licenses/by-sa/4.0/","citation":"McGregor, S. (2021). Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Database. Proceedings of the AAAI Conference on Artificial Intelligence (IAAI-21).","snapshot_date":"2026-09-07"},"exported_at":"2026-09-11"}
{"rows":[{"incident_id":436,"occurred_on":"2022-12-28","title":"Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany","description":"A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Traffic Participants"],"report_count":9},{"incident_id":448,"occurred_on":"2022-12-28","title":"AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch","description":"An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Vedal"],"developers":["Vedal"],"harmed":["Twitch Users, Vedal"],"report_count":1},{"incident_id":443,"occurred_on":"2022-12-21","title":"ChatGPT Abused to Develop Malicious Softwares","description":"OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Cyberattacks, weapon development or use, and mass harm","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Internet Users"],"report_count":25},{"incident_id":432,"occurred_on":"2022-12-21","title":"Southwest Airlines Crew Scheduling Solver Degenerates Flight Network","description":"Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Southwest Airlines"],"developers":["General Electric"],"harmed":["Airline Passengers"],"report_count":1},{"incident_id":447,"occurred_on":"2022-12-19","title":"Footballer's \"X-Rated\" Comment Created by Instagram's Mistranslation","description":"Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem \"racy\" and \"X-rated,\" which some fans found amusing.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Instagram"],"developers":["Instagram"],"harmed":["Spanish Speaking Instagram Users"],"report_count":2},{"incident_id":430,"occurred_on":"2022-12-19","title":"Lawyers Denied Entry to Performance Venue by Facial Recognition","description":"Lawyers were barred from entry to Madison Square Garden after a facial recognition system matched them as employed by a law firm currently engaged in litigation with the venue.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Madison Square Garden Entertainment"],"developers":["Unknown"],"harmed":["Kelly Conlon, Alexis Majano"],"report_count":21},{"incident_id":449,"occurred_on":"2022-12-01","title":"Startup Misled Research Participants about GPT-3 Use in Mental Healthcare Support","description":"OpenAI's GPT-3 was deployed by a mental health startup without ethical review to support peer-to-peer mental healthcare, and whose interactions with the help providers were \"deceiving\" for research participants.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Koko"],"developers":["Openai"],"harmed":["Research Participants, Koko Customers"],"report_count":4},{"incident_id":416,"occurred_on":"2022-12-01","title":"Facebook's Job Ad Algorithm Allegedly Biased against Older and Female Workers","description":"Facebook's algorithm was alleged in a complaint by Real Women in Trucking to have selectively shown job advertisements disproportionately against older and female workers in favor of younger men for blue-collar positions.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Women and girls","Women","Social media users","Real Women in Trucking","Facebook users"],"report_count":3},{"incident_id":419,"occurred_on":"2022-12-01","title":"Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted","description":"Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Facebook"],"developers":["Facebook"],"harmed":["Facebook Users"],"report_count":3},{"incident_id":486,"occurred_on":"2022-12-01","title":"AI Video-Making Tool Abused to Deploy Pro-China News on Social Media","description":"Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Spamouflage Dragon"],"developers":["Synthesia"],"harmed":["Youtube Users, Synthesia, Facebook Users, X (Twitter) Users"],"report_count":5},{"incident_id":413,"occurred_on":"2022-11-30","title":"Thousands of Incorrect ChatGPT-Produced Answers Posted on Stack Overflow","description":"Thousands of incorrect answers produced by OpenAI's ChatGPT were submitted to Stack Overflow, which swamped the site's volunteer-based quality curation process and harmed users looking for correct answers.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Stack Overflow Users, Stack Overflow"],"report_count":3},{"incident_id":464,"occurred_on":"2022-11-30","title":"ChatGPT Provided Non-Existent Citations and Links when Prompted by Users","description":"When prompted about providing references, ChatGPT was reportedly generating non-existent but convincing-looking citations and links, which is also known as \"hallucination\".","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Chatgpt Users"],"report_count":5},{"incident_id":562,"occurred_on":"2022-11-30","title":"Uptick in Low-Quality AI-Produced Content Degraded Publishers' Submission Management","description":"A surge in low-standard AI-generated content such as by ChatGPT was reported by publishers, which negatively impacted submission management process and editors' workflow.","mit_domain":"Misinformation","mit_subdomain":"Pollution of information ecosystem and loss of consensus reality","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Publishing Editors, Publishers"],"report_count":1},{"incident_id":420,"occurred_on":"2022-11-30","title":"Users Bypassed ChatGPT's Content Filters with Ease","description":"Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Chatgpt Users, Openai"],"report_count":11},{"incident_id":411,"occurred_on":"2022-11-27","title":"Chinese Accounts Spammed Twitter Feed Allegedly to Obscure News of Protests","description":"Twitter Feed was flooded by content from Chinese-language accounts which allegedly aimed to manipulate and reduce social media coverage about widespread protests against coronavirus restrictions in China.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Twitter"],"developers":["Twitter"],"harmed":["Twitter, X (Twitter) Users"],"report_count":1},{"incident_id":598,"occurred_on":"2022-11-25","title":"False Arrest of Georgia Man Due to Louisiana Police's Faulty Facial Recognition Technology","description":"The Jefferson Parish Sheriff’s Office in Louisiana relied on facial recognition technology to identify suspects for the alleged theft of luxury purses, resulting in a man in Georgia, Randal Reid, being arrested. However, the technology produced a false match, leading to Reid's arrest and subsequent release. This incident highlights the potential pitfalls of facial recognition technology in law enforcement.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Law enforcement","Jefferson Parish Sheriff’s Office","Facial recognition system deployers"],"developers":["Unknown","Facial recognition system developers"],"harmed":["Randal Reid","Minority groups","Black people"],"report_count":1},{"incident_id":515,"occurred_on":"2022-11-25","title":"Facial Recognition Error Reportedly Leads to Wrongful Arrest of Georgia Man and $200K Settlement in Louisiana","description":"In November 2022, Randal \"Quran\" Reid was arrested in Georgia based on warrants from Louisiana that reportedly stemmed from a purportedly faulty facial recognition match using Clearview AI. Despite reportedly having never visited Louisiana, Reid was jailed for six days before authorities withdrew the warrants. No corroborating evidence had been gathered, and the technology's use was omitted from legal documents. In May 2025, Jefferson Parish settled with Reid for $200,000 in a federal civil righ","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Jefferson Parish Sheriff’s Office"],"developers":["Clearview AI"],"harmed":["Randal Quran Reid"],"report_count":3},{"incident_id":440,"occurred_on":"2022-11-25","title":"Louisiana Police Wrongfully Arrested Black Man Using False Face Match","description":"Louisiana police reportedly used a false facial recognition match and secured an arrest warrant for a Black man for thefts he did not commit.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Baton Rouge Police Department"],"developers":["Morphotrak","Clearview AI"],"harmed":["Randall Reid","Black people in Louisiana","Black people"],"report_count":6},{"incident_id":434,"occurred_on":"2022-11-24","title":"Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel","description":"A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Traffic Participants, Tesla Drivers"],"report_count":8},{"incident_id":423,"occurred_on":"2022-11-22","title":"Lensa AI's Produced Unintended Sexually Explicit or Suggestive \"Magic Avatars\" for Women","description":"Lensa AI's \"Magic Avatars\" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Lensa AI"],"developers":["Stability AI","Runway","Lensa AI","LAION","EleutherAI","CompVis LMU"],"harmed":["Women and girls","Women","Lensa AI users","Asian women","Asian people"],"report_count":5},{"incident_id":422,"occurred_on":"2022-11-22","title":"Deepfake of FTX's Former CEO Posted on Twitter Aiming to Scam FTX Collapse Victims","description":"A visual and audio deepfake of former FTX CEO Sam Bankman-Fried was posted on Twitter to scam victims of the exchange's collapse by urging people to transfer funds into an anonymous cryptocurrency wallet.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown"],"developers":["Unknown"],"harmed":["Victims Of Ftx'S Collapse, X (Twitter) Users"],"report_count":1},{"incident_id":421,"occurred_on":"2022-11-20","title":"Stable Diffusion Allegedly Used Artists' Works without Permission for AI Training","description":"Text-to-image model Stable Diffusion was reportedly using artists' original works without permission for its AI training.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stability Ai, Lensa Ai, Midjourney, Deviantart"],"developers":["Stability Ai, Runway, Lensa Ai, Laion, Eleutherai, Compvis Lmu"],"harmed":["Digital Artists, Artists Publishing On Social Media, Artists"],"report_count":12},{"incident_id":463,"occurred_on":"2022-11-15","title":"Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls ","description":"Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Apple"],"developers":["Apple"],"harmed":["Apple Watch Users Doing Winter Activities, Ski Patrols, Emergency Dispatchers"],"report_count":3},{"incident_id":399,"occurred_on":"2022-11-15","title":"Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content","description":"Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta, Facebook"],"developers":["Meta, Facebook"],"harmed":["Minority Groups, Meta, Facebook, Minority Groups"],"report_count":3},{"incident_id":455,"occurred_on":"2022-11-11","title":"CNET's Published AI-Written Articles Ran into Quality and Accuracy Issues","description":"AI-written articles published by CNET reportedly contained factual errors which bypassed human editorial review, prompting the company to issue corrections and updates.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cnet"],"developers":["Unknown"],"harmed":["Cnet Readers"],"report_count":7},{"incident_id":457,"occurred_on":"2022-11-11","title":"Article-Writing AI by CNET Allegedly Committed Plagiarism","description":"CNET's use of generative AI to write articles allegedly ran into plagiarism issues, reproducing verbatim phrases from other published sources or making minor changes to existing texts such as altering capitalization, swapping out words for synonyms, and changing minor syntax.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"none","sectors":["information and communication"],"countries":[],"deployers":["Cnet"],"developers":["Unknown"],"harmed":["Plagiarized Entities, Cnet Readers"],"report_count":6},{"incident_id":639,"occurred_on":"2022-11-11","title":"Air Canada Chatbot Reportedly Provides Inaccurate Bereavement Fare Information, Leading to Customer Overpayment","description":"A Canadian small claims tribunal reportedly ordered Air Canada to pay $812.02 in damages and court fees after its website chatbot allegedly provided inaccurate information about bereavement fare eligibility, leading a customer to overpay for flights. The tribunal reportedly found the airline responsible for information presented by its chatbot, rejecting the argument that the chatbot was a separate legal entity, and characterized the error as negligent misrepresentation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Air Canada"],"developers":["Air Canada"],"harmed":["Jake Moffatt"],"report_count":6},{"incident_id":410,"occurred_on":"2022-11-09","title":"KFC Sent Insensitive Kristallnacht Promotion via Holiday Detection System","description":"KFC cited an error in an automated holiday detection system which identified the anniversary of Kristallnacht and prompted an insensitive push notification promoting its chicken.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"none","sectors":["accommodation and food service activities","information and communication"],"countries":["DE"],"deployers":["Kfc"],"developers":["Kfc"],"harmed":["Jewish People"],"report_count":1},{"incident_id":904,"occurred_on":"2022-10-21","title":"Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked","description":"Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown Twitter User"],"developers":["Deepfake Technology Developers"],"harmed":["Kate Isaacs"],"report_count":8},{"incident_id":451,"occurred_on":"2022-10-16","title":"Stable Diffusion's Training Data Contained Copyrighted Images","description":"Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stability Ai"],"developers":["Runway, Laion, Eleutherai, Compvis Lmu, Stability Ai"],"harmed":["Getty Images, Getty Images Contributors"],"report_count":5},{"incident_id":377,"occurred_on":"2022-10-11","title":"Weibo Model Had Difficulty Detecting Shifts in Censored Speech","description":"Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Weibo"],"developers":["Weibo"],"harmed":["Weibo, Chinese Government"],"report_count":1},{"incident_id":383,"occurred_on":"2022-10-04","title":"Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud","description":"Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google Home"],"developers":["Google Home"],"harmed":["Black Google Home Mini Users, Google Home Mini Users"],"report_count":2},{"incident_id":385,"occurred_on":"2022-10-04","title":"Canadian Police's Release of Suspect's AI-Generated Facial Photo Reportedly Reinforced Racial Profiling","description":"The Edmonton Police Service (EPS) in Canada released a facial image of a Black male suspect generated by an algorithm using DNA phenotyping, which was denounced by the local community as racial profiling.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Edmonton Police Service"],"developers":["Parabon Nanolabs"],"harmed":["Black Residents In Edmonton"],"report_count":6},{"incident_id":384,"occurred_on":"2022-10-03","title":"Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident","description":"Delivery company Glovo's automated system sent an email terminating an employee for \"non-compliance terms and conditions\" after the employee was killed in a car accident while making a delivery on Glovo's behalf.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Glovo"],"developers":["Glovo"],"harmed":["Sebastian Galassi's family","Sebastian Galassi"],"report_count":2},{"incident_id":426,"occurred_on":"2022-09-23","title":"XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving","description":"An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Xpeng"],"developers":["Xpeng"],"harmed":["Xpeng Driver"],"report_count":1},{"incident_id":352,"occurred_on":"2022-09-15","title":"GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks","description":"Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.","mit_domain":"Privacy & Security","mit_subdomain":"AI system security vulnerabilities and attacks","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stephan De Vries"],"developers":["Openai, Stephan De Vries"],"harmed":["Stephan De Vries"],"report_count":4},{"incident_id":339,"occurred_on":"2022-09-15","title":"Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams","description":"Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":"none","sectors":["education","information and communication"],"countries":[],"deployers":["Students"],"developers":["Sudowrite, Openai"],"harmed":["Teachers, Educational Communities, Students, Epistemic Integrity"],"report_count":15},{"incident_id":351,"occurred_on":"2022-09-13","title":"\"The Little Mermaid\" Clip Doctored Using Generative AI to Replace Black Actress with White Character","description":"A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of \"The Little Mermaid,\" replacing a Black actress with a white digital character.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["@Tengazillioiniq"],"developers":["Unknown"],"harmed":["Halle Bailey, Black Actresses"],"report_count":1},{"incident_id":350,"occurred_on":"2022-09-13","title":"Delivery Robot Rolled Through Crime Scene","description":"A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Serve Robotics"],"developers":["Serve Robotics"],"harmed":["Police Investigators"],"report_count":2},{"incident_id":397,"occurred_on":"2022-09-11","title":"Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human","description":"TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok"],"developers":["Tiktok"],"harmed":["Young Tiktok Users, Tiktok Users, Gen Z Tiktok Users"],"report_count":2},{"incident_id":786,"occurred_on":"2022-09-07","title":"Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube","description":"Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers, Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Tim Cook, Apple, Youtube Viewers, Cryptocurrency Investors, General Public"],"report_count":2},{"incident_id":369,"occurred_on":"2022-08-29","title":"GAN Artwork Won First Place at State Fair Competition","description":"An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which raised concerns surrounding labor displacement and unfair competition.","mit_domain":"Socioeconomic & Environmental Harms","mit_subdomain":"Economic and cultural devaluation of human effort","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Jason Allen"],"developers":["Midjourney"],"harmed":["Artists Submitting In The Digital Arts Category, Digital Artists, Artists"],"report_count":1},{"incident_id":313,"occurred_on":"2022-08-25","title":"BlenderBot 3 Cited Dutch Politician as a Terrorist","description":"Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was confused about its association.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"none","sectors":["information and communication"],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Marietje Schaake"],"report_count":2},{"incident_id":529,"occurred_on":"2022-08-22","title":"Stable Diffusion Reportedly Exhibited Biases for Prompts Featuring Professions","description":"Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stability AI"],"developers":["Stability AI","Runway","LAION","EleutherAI","CompVis LMU"],"harmed":["Women and girls","Women","Minority groups"],"report_count":3},{"incident_id":303,"occurred_on":"2022-08-21","title":"Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child","description":"Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["A Software Engineer Named Mark, Parents Using Telemedicine Services"],"report_count":2},{"incident_id":314,"occurred_on":"2022-08-17","title":"Stable Diffusion Abused by 4chan Users to Deepfake Celebrity Porn","description":"Stable Diffusion, an open-source image generation model by Stability AI, was reportedly leaked on 4chan prior to its release date, and was used by its users to generate pornographic deepfakes of celebrities.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stability Ai"],"developers":["Stability Ai, Runway, Laion, Eleutherai, Compvis Lmu"],"harmed":["Stability Ai, Deepfaked Celebrities"],"report_count":1},{"incident_id":398,"occurred_on":"2022-08-15","title":"Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage","description":"Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Tesla Drivers, Horse Drawn Carriages"],"report_count":3},{"incident_id":1222,"occurred_on":"2022-08-10","title":"CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty","description":"Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a \"no overdraft\" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hello Digit, Oportun Financial Corporation"],"developers":["Hello Digit, Oportun Financial Corporation"],"harmed":["Hello Digit Customers, Bank Account Holders Enrolled In Auto Saves, Consumers Charged Overdraft Fees Due To Auto Saves, Consumers Denied Overdraft Reimbursement, Consumers Whose Accrued Interest Was Retained"],"report_count":1},{"incident_id":278,"occurred_on":"2022-08-07","title":"Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments","description":"The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to have “occasionally” made offensive and inconsistent remarks such as invoking Jewish stereotypes.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Meta"],"developers":["Meta"],"harmed":["Jewish People, Blenderbot 3 Users"],"report_count":3},{"incident_id":391,"occurred_on":"2022-07-26","title":"Facial Recognition Trial by UK Southern Co-op Alleged as Unlawful","description":"Southern Co-op's use of facial recognition reportedly to curb violent crime in UK supermarkets was alleged by civil society and privacy groups as \"unlawful\" and \"complete\" invasion of privacy.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Southern Co Op"],"developers":["Hikvision"],"harmed":["Souther Co Op Customers"],"report_count":2},{"incident_id":271,"occurred_on":"2022-07-24","title":"Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah","description":"A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Landon Embry, Motorcyclists, Tesla Drivers"],"report_count":3},{"incident_id":372,"occurred_on":"2022-07-22","title":"Users Reported Security Issues with Google Pixel 6a's Fingerprint Unlocking","description":"Google Pixel 6a's fingerprint recognition feature was reported by users for security issues, in which phones were mistakenly unlocked by unregistered fingerprints.","mit_domain":"Privacy & Security","mit_subdomain":"AI system security vulnerabilities and attacks","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Google Pixel 6A Users"],"report_count":3},{"incident_id":241,"occurred_on":"2022-07-21","title":"Chess-Playing Robot Broke Child's Finger in Russia","description":"A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Russian Chess Federation"],"developers":["Unknown"],"harmed":["Child Named Christopher"],"report_count":5},{"incident_id":285,"occurred_on":"2022-07-18","title":"Google Lens’s Camera-Based Translation Feature Provided an Offensive Mistranslation of a Book Title in Korean","description":"A book title by Korea’s first minister of culture was mistranslated into an offensive phrase by Google Lens’s camera-based translation feature allegedly due to its training on internet communications and a lack of context.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Google Lens Users"],"report_count":1},{"incident_id":390,"occurred_on":"2022-06-28","title":"Deepfakes Reportedly Deployed in Online Interviews for Remote Work Positions","description":"Voice and video deepfakes were reported by FBI Internet Crime Complaint Center (IC3) in complaint reports to have been deployed during online interviews of the candidates for remote-work positions.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown"],"developers":["Unknown"],"harmed":["Interviewers Of Remote Work Positions, Employers Of Remote Work Positions"],"report_count":1},{"incident_id":1436,"occurred_on":"2022-06-23","title":"AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure","description":"Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Marc Dean, Surgical Teams Using Trudi Navigation System"],"developers":["Acclarent, Ai Enabled Surgical Navigation System Developers, Ai Enabled Healthcare System Developers, Johnson And Johnson, Integra Lifesciences"],"harmed":["Erin Ralph, Surgical Patients, Patients, Patients Undergoing Ai Assisted Procedures, Sinus Surgery Patients"],"report_count":2},{"incident_id":1559,"occurred_on":"2022-06-22","title":"Kalibrate Fuel Pricing Allegedly Enabled California Gas Station Operators to Coordinate Higher Pump Prices","description":"Major gas station operators in California allegedly used Kalibrate Fuel Pricing to automate pump prices using competitor data and reduce price competition. A June 2026 complaint said the AI-based system increased gasoline prices by as much as 30 cents per gallon where adoption was widespread.","mit_domain":null,"mit_subdomain":null,"entity":null,"intent":null,"timing":null,"harm_level":null,"sectors":[],"countries":[],"deployers":["Marathon Petroleum, 7 Eleven, Speedway, Eg America, Bp Products North America, Travelcenters Of America, Walmart, Sam'S Club, Circle K, Albertsons Companies, Gas Station Operators, Fuel Retailers"],"developers":["Kalibrate, Algorithmic Pricing System Developers, Software Developers"],"harmed":["California Gasoline Purchasers, California Drivers, Drivers, Road Users, Consumers, Retail Gasoline Market Competition In California, General Public, General Public Of California"],"report_count":21},{"incident_id":460,"occurred_on":"2022-06-12","title":"Cruise AV Ran Over Fire Hose in Active Fire Scene","description":"A Cruise AV ran over a fire hose that was being used in an active firefighting area.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["San Francisco Firefighters, San Francisco Fire Department"],"report_count":2},{"incident_id":262,"occurred_on":"2022-06-11","title":"DALL-E Mini Reportedly Reinforced or Exacerbated Societal Biases in Its Outputs as Gender and Racial Stereotypes","description":"Publicly deployed open-source model DALL-E Mini was acknowledged by its developers and found by its users to have produced images which reinforced racial and gender biases.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Boris Dayma"],"developers":["Boris Dayma, Suraj Patil, Pedro Cuenca, Khalid Saifullah, Tanishq Abraham, Phuc Le Khac, Luke Melas, Ritobrata Ghosh"],"harmed":["Minority Groups, Underrepresented Groups"],"report_count":4},{"incident_id":293,"occurred_on":"2022-06-03","title":"Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection","description":"A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["Cruise Passengers, Toyota Prius Passengers"],"report_count":7},{"incident_id":290,"occurred_on":"2022-06-03","title":"False Negatives for Water Quality-Associated Beach Closures","description":"Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"AI tangible harm near-miss","sectors":["human health and social work activities","public administration"],"countries":["CA"],"deployers":["Toronto City Government"],"developers":["Toronto Public Health"],"harmed":["Sunnyside Beachgoers, Marie Curtis Beachgoers, Toronto Citizens"],"report_count":3},{"incident_id":259,"occurred_on":"2022-06-03","title":"YouTuber Built, Made Publicly Available, and Released Model Trained on Toxic 4chan Posts as Prank","description":"A YouTuber built GPT-4chan, a model based on OpenAI’s GPT-J and trained on posts containing racism, misogyny, and antisemitism collected from 4chan’s “politically incorrect” board, which he made publicly available, and deployed as multiple bots posting thousands of messages on the same 4chan board as a prank.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Yannic Kilcher"],"developers":["Yannic Kilcher"],"harmed":["Internet Social Platform Users"],"report_count":2},{"incident_id":252,"occurred_on":"2022-06-01","title":"Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US","description":"Axon Enterprise considered development of remotely operated drones capable of tasering at a target a short distance away as a defense mechanism for mass shootings, despite its internal AI ethics board’s previous objection and condemnation as dangerous and fantastical.","mit_domain":"Socioeconomic & Environmental Harms","mit_subdomain":"Governance failure","entity":"Human","intent":"Intentional","timing":"Pre-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["None"],"developers":["Axon Enterprise"],"harmed":["Schools, Educational Communities, Students"],"report_count":1},{"incident_id":844,"occurred_on":"2022-05-25","title":"SafeRent AI Screening Tool Allegedly Discriminated Against Housing Voucher Applicants","description":"SafeRent’s AI-powered tenant screening tool used credit history and non-rental-related debts to assign scores, disproportionately penalizing Black and Hispanic renters and those using housing vouchers. The reported discriminatory housing outcomes violated the Fair Housing Act and Massachusetts law. A class action lawsuit (Louis, et al. v. SafeRent Solutions, et al.) resulted in a $2.275 million settlement and changes to SafeRent’s practices.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Landlords"],"developers":["Saferent Solutions"],"harmed":["Renters, Monica Douglas, Massachusetts Renters, Mary Louis, Hispanic Renters, Black Renters"],"report_count":5},{"incident_id":253,"occurred_on":"2022-05-18","title":"Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco","description":"Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["San Francisco Traffic Participants, San Francisco Public"],"report_count":4},{"incident_id":638,"occurred_on":"2022-05-16","title":"Fatal Crash Involving Tesla Full Self-Driving Claims Employee's Life","description":"A Tesla employee, Hans von Ohain, was killed in a crash while allegedly using the Full Self-Driving feature. The car failed to navigate mountain curves, leading to a fatal collision, possibly making von Ohain the first known fatality of the Full Self-Driving feature.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hans Von Ohain"],"developers":["Tesla"],"harmed":["Hans Von Ohain, Erik Rossiter"],"report_count":17},{"incident_id":258,"occurred_on":"2022-05-13","title":"Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent","description":"Major Australian retailers reportedly analyzed in-store footage to capture facial features of their customers without consent, which was criticized by consumer groups as creepy and invasive.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["The Good Guys","Kmart","Bunnings"],"developers":["Unknown"],"harmed":["The Good Guys customers","Privacy","Kmart customers","Bunnings customers","Biometric data subjects"],"report_count":2},{"incident_id":520,"occurred_on":"2022-05-08","title":"Amazon Fresh Cameras Failed to Register Purchased Items","description":"Amazon Fresh's system of tracking cameras in its cashier-less stores was reported by shoppers for failing to detect items they purchased.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"AI tangible harm issue","sectors":["wholesale and retail trade"],"countries":["US"],"deployers":["Amazon Fresh"],"developers":["Amazon Fresh"],"harmed":["Amazon Fresh"],"report_count":2},{"incident_id":911,"occurred_on":"2022-05-01","title":"Yahoo Boys Allegedly Employ Real-Time Deepfake Technology in Romance Scams","description":"Scammers from Nigeria, known as \"Yahoo Boys,\" are reportedly utilizing real-time deepfake technology to impersonate individuals during video calls, deceiving victims in romance scams. By allegedly altering their appearance with face-swapping software, they build trust under false identities to defraud targets of substantial sums.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Yahoo Boys, Scammers In Nigeria, Brouteurs"],"developers":["Deepfake Technology Developers"],"harmed":["Targets Of The Yahoo Boys, Targets Of Scammers In Nigeria, Targets Of Romance Scams, Targets Of Brouteurs"],"report_count":1},{"incident_id":178,"occurred_on":"2022-04-21","title":"Tesla Owner Activated \"Smart Summon\" Feature, Causing a Collision with an Aircraft in a Washington Airport","description":" A Tesla Model Y was shown on video slowly crashing into a Vision Jet in Spokane, Washington, allegedly due to its owner activating the “Smart Summon” feature.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Tesla Owner, Vision Jet Owner"],"report_count":7},{"incident_id":431,"occurred_on":"2022-04-20","title":"Robbers Accessed Drugged Gay Men's Bank Accounts Using Their Phones' Facial Recognition","description":"Gay men in New York City were drugged by robbers who accessed their phones using facial recognition while they were unconscious to transfer funds out of their bank accounts.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Apple"],"developers":["Apple"],"harmed":["Gay Men In New York City, Julio Ramirez"],"report_count":3},{"incident_id":177,"occurred_on":"2022-04-19","title":"Google’s Assistive Writing Feature Provided Allegedly Unnecessary and Clumsy Suggestions","description":"Google’s “inclusive language” feature prompting writers to consider alternatives to non-inclusive words reportedly also recommend alternatives for words such as “landlord” and “motherboard,” which critics said was a form of obtrusive, unnecessary, and bias-reinforcing speech-policing.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google Docs"],"developers":["Google Docs"],"harmed":["Google Docs Users"],"report_count":5},{"incident_id":903,"occurred_on":"2022-04-15","title":"Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election","description":"Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Deepfake Creators"],"developers":["Deepfake Technology Developers"],"harmed":["Voters In Northern Ireland, Epistemic Integrity, East Londonderry Constituents, Cara Hunter, Democratic Integrity"],"report_count":18},{"incident_id":236,"occurred_on":"2022-04-13","title":"AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston","description":"GAN faces were allegedly used by scammers alongside a parked domain and a fake website to impersonate a Boston law firm.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Scammers"],"developers":["Unknown"],"harmed":["Email Account Holders"],"report_count":1},{"incident_id":378,"occurred_on":"2022-04-06","title":"TuSimple Truck Steered into Interstate Freeway Divide","description":"A TuSimple autonomous truck operating with backup drivers behind the wheel operated on an outdated command sequence and suddenly veered into the center divide on the interstate freeway.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tusimple"],"developers":["Tusimple"],"harmed":["Tusimple, State Of Arizona"],"report_count":2},{"incident_id":389,"occurred_on":"2022-04-05","title":"Cruise Autonomous Car Blocked Fire Truck Responding to Emergency","description":"A fire truck in San Francisco responding to a fire was blocked from passing a doubled-parked garbage truck by a self-driving Cruise car on the opposing lane which stayed put and did not reverse to clear the lane.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["San Francisco Firefighters, San Francisco Fire Department"],"report_count":4},{"incident_id":519,"occurred_on":"2022-04-03","title":"Starship Delivery Robot Ran into Problems Traversing Campus Terrains","description":"A Starship autonomous delivery robot struggled to navigate campus terrains of UCLA, reportedly getting stuck into a planter and falling off the stairs.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"AI tangible harm near-miss","sectors":["accommodation and food service activities","transportation and storage"],"countries":["US"],"deployers":["Starship Technologies"],"developers":["Starship Technologies"],"harmed":["Starship Technologies"],"report_count":1},{"incident_id":179,"occurred_on":"2022-04-01","title":"DALL-E 2 Reported for Gender and Racially Biased Outputs","description":"Developers of OpenAI's DALL-E 2 cited risks of the model, varying from misuse as disinformation and explicit content generation, to gender and racial bias.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Openai"],"developers":["Openai"],"harmed":["Underrepresented Groups, Minority Groups"],"report_count":3},{"incident_id":175,"occurred_on":"2022-04-01","title":"Cruise Autonomous Taxi Allegedly Bolted off from Police After Being Pulled over in San Francisco","description":"An autonomous Chevy Bolt operated by Cruise was pulled over in San Francisco, and as the police attempted to engage with the car, it reportedly bolted off, pulled over again, and put on its hazards lights on at a point farther down the road.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["San Francisco Public, Cruise Customers"],"report_count":5},{"incident_id":349,"occurred_on":"2022-03-22","title":"Evolv AI Weapons Detection System Allegedly Misrepresents Accuracy, Leading to School Security Gaps","description":"Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"AI tangible harm issue","sectors":["education","arts, entertainment and recreation"],"countries":["US"],"deployers":["Charlotte Mecklenburg School District"],"developers":["Evolv Technology"],"harmed":["teachers at Charlotte Mecklenburg Schools","students at Charlotte Mecklenburg Schools","Students","security officers at Charlotte Mecklenburg Schools","School administrators at Charlotte Mecklenburg Schools","Parents of students at Charlotte Mecklenburg Schools","Epistemic integrity","Educational communities"],"report_count":3},{"incident_id":192,"occurred_on":"2022-03-17","title":"Three Make-Up Artists Lost Jobs Following Black-Box Automated Decision by HireVue","description":"Three make-up artists lost their positions following an algorithmically-assessed video interview by HireVue who reportedly failed to provide adequate explanation of the findings.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Estee Lauder"],"developers":["Hirevue"],"harmed":["Pseudonymous Estee Lauder'S Former Staff"],"report_count":2},{"incident_id":198,"occurred_on":"2022-03-16","title":"Deepfake Video of Ukrainian President Yielding to Russia Posted on Ukrainian Websites and Social Media","description":" A quickly-debunked deepfaked video of the Ukrainian President Volodymyr Zelenskyy was posted on various Ukrainian websites and social media platforms encouraging Ukrainians to surrender to Russian forces during the Russia-Ukraine war.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Hackers"],"developers":["Unknown"],"harmed":["Volodymyr Zelenskyy, Ukrainian Social Media Users, Ukrainian Public"],"report_count":9},{"incident_id":427,"occurred_on":"2022-03-15","title":"Cruise Taxis' Sudden Braking Allegedly Put People at Risk","description":"Cruise's autonomous taxis slowed suddenly, braked, and were hit from behind, allegedly becoming unexpected roadway obstacles and potentially putting passengers and other people at risk.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["Traffic Participants, Emergency Vehicles, Cruise Passengers, Cruise"],"report_count":3},{"incident_id":221,"occurred_on":"2022-03-07","title":"A Road Engineer Killed Following a Collision Involving a Tesla on Autopilot","description":"In Taiwan, a Tesla Model 3 on Autopilot mode whose driver did not pay attention to the road collided with a road repair truck; a road engineer immediately placed crash warnings in front of the Tesla, but soon after got hit and was killed by a BMW when its driver failed to see the sign and crashed into the accident.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tesla"],"developers":["Tesla"],"harmed":["Road Engineer"],"report_count":2},{"incident_id":465,"occurred_on":"2022-03-03","title":"Private Medical Photos Were Reportedly Found in LAION-5B AI Training Dataset","description":"In September 2022, an artist using the name Lapine reported finding private post-operative medical photos of herself in LAION-5B, a web-scraped image-text dataset used in AI image-synthesis research. Ars Technica confirmed her images were referenced in the dataset and reported finding thousands of similar patient medical-record photos.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Stability Ai, Google"],"developers":["Stability Ai, Laion, Google"],"harmed":["Privacy, Lapine, Patients, Patients Whose Medical Photos Were Included In Laion 5B, People Whose Private Images Were Included In Ai Training Datasets"],"report_count":1},{"incident_id":176,"occurred_on":"2022-03-02","title":"Starship’s Autonomous Food Delivery Robot Allegedly Stranded at Railroad Crossing in Oregon, Run over by Freight Train","description":" A Starship food delivery robot deployed by Oregon State University reportedly failed to cross the railroad, becoming stranded, and ending up being struck by an oncoming freight train.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Oregon State University"],"developers":["Starship Technologies"],"harmed":["Oregon State University, Freight Train Crew"],"report_count":1},{"incident_id":168,"occurred_on":"2022-03-01","title":"Collaborative Filtering Prone to Popularity Bias, Resulting in Overrepresentation of Popular Items in the Recommendation Outputs","description":"Collaborative filtering prone to popularity bias, resulting in overrepresentation of popular items in the recommendation outputs.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Facebook, Linkedin, Youtube, Twitter, Netflix"],"developers":["Facebook, Linkedin, Youtube, Twitter, Netflix"],"harmed":["Facebook Users, Linkedin Users, Youtube Users, Netflix Users, X (Twitter) Users"],"report_count":2},{"incident_id":264,"occurred_on":"2022-03-01","title":"AI-Based Vehicle Speed Estimation App Denounced by UK Drivers as Surveillance Technology","description":"Speedcam Anywhere, an app allowing users to document and report traffic violations via AI-based videographic speed estimation of a vehicle, raised concerns for UK drivers about its capabilities for surveillance and abuse.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Speedcam Anywhere"],"developers":["Speedcam Anywhere"],"harmed":["Uk Drivers"],"report_count":1},{"incident_id":185,"occurred_on":"2022-03-01","title":"TikTok's \"For You\" Algorithm Directed New Users towards Disinformation about the War in Ukraine","description":" An investigation by NewsGuard into TikTok’s handling of content related to the Russia-Ukraine war showed its “For You” algorithm pushing new users towards false and misleading content about the war within less than an hour of signing up.","mit_domain":"Misinformation","mit_subdomain":"False or misleading information","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok"],"developers":["Tiktok"],"harmed":["Tiktok Users, Tiktok New Users"],"report_count":4},{"incident_id":174,"occurred_on":"2022-02-28","title":"Fake LinkedIn Profiles Created Using GAN Photos","description":"More than a thousand inauthentic LinkedIn profiles using allegedly GAN-generated photos were notified by researchers at Stanford to LinkedIn’s staff, and many of which were removed for violating rules against creating fake profiles and falsifying information.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Unknown"],"developers":["Unknown"],"harmed":["Linkedin Users"],"report_count":4},{"incident_id":205,"occurred_on":"2022-02-25","title":"AI-Generated Profiles Used in Disinformation Campaign Targeting Ukrainians","description":"According to security reports by Meta, fictitious personas with GAN-generated profile pictures were used by people operating in Russia and Ukraine to push a disinformation campaign targeting Ukrainian social media users, and were taken down.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":"none","sectors":["arts, entertainment and recreation","information and communication"],"countries":[],"deployers":["Individuals In The Donbass Region, Individuals In Russia, Media Organizations In Crimea"],"developers":["Unknown"],"harmed":["Ukrainian Social Media Users"],"report_count":6},{"incident_id":968,"occurred_on":"2022-02-24","title":"'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation","description":"A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called \"LLM grooming,\" manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation sinc","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Disinformation, surveillance, and influence at scale","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tigerweb, Storm 1516, Russian State Media, Pro Russian Information Manipulation Actors, Pravda Disinformation Network, Portal Kombat, John Mark Dougan, Information Manipulation Actors, Government Of Russia"],"developers":["You.Com, Xai, Perplexity, Openai, Mistral, Microsoft, Meta, Inflection, Google, Anthropic"],"harmed":["Policymakers, National Security And Intelligence Stakeholders, Media Consumers, Journalists, Journalistic Integrity, Governments, Government Of Ukraine, General Public Of Ukraine, General Public, Epistemic Integrity, Democratic Integrity, Chatbot Users"],"report_count":27},{"incident_id":400,"occurred_on":"2022-02-23","title":"Google Search Reportedly Returned Fewer Results for Abortion Services in Rural Areas","description":"Google Search reportedly returned fewer abortion clinics for searches from poorer and rural areas, particularly ones with Targeted Regulation of Abortion Providers (TRAP) laws.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unequal performance across groups","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Google"],"developers":["Google"],"harmed":["Women seeking abortion services","women having unexpected or crisis pregnancies","Women and girls","Women","Pregnant women","Pregnant patients","Pregnant individuals","Patients"],"report_count":1},{"incident_id":301,"occurred_on":"2022-02-15","title":"Honorlock's AI Proctoring System Reportedly Led Broward College to Accuse a Teenager of Cheating","description":"During a February 2022 online biology exam, Honorlock reportedly flagged a Florida teenager taking a Broward College class as suspicious. The student denied cheating, but Broward College allegedly relied on the remote-proctoring system's flag in pursuing an academic-dishonesty accusation that the student said was unfounded.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Broward College"],"developers":["Honorlock"],"harmed":["Unnamed Broward College student","University students","Students","Epistemic integrity","Educational communities"],"report_count":1},{"incident_id":204,"occurred_on":"2022-02-11","title":"A Chinese Tech Worker at Zhihu Fired Allegedly via a Resignation Risk Prediction Algorithm","description":"The firing of an employee at Zhihu, a large Q&A platform in China, was allegedly caused by the use of a behavioral perception algorithm which claimed to predict a worker’s resignation risk using their online footprints, such as browsing history and internal communication.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Zhihu"],"developers":["Sangfor Technologies"],"harmed":["Zhihu employees","Chinese tech workers"],"report_count":4},{"incident_id":181,"occurred_on":"2022-02-11","title":"BMW Sedan Made a Prohibited Left Turn, Colliding with a Cruise Autonomous Vehicle","description":"A BMW Sedan reportedly made an illegal left turn, causing a minor collision but no injuries with a Cruise autonomous vehicle (AV) operating in autonomous mode.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"Human","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Cruise"],"developers":["Cruise"],"harmed":["Cruise Vehicle"],"report_count":2},{"incident_id":203,"occurred_on":"2022-02-10","title":"Uber Launched Opaque Algorithm That Changes Drivers' Payments in the US","description":"Uber launched a new but opaque algorithm to determine drivers' pay in the US which allegedly caused drivers to experience lower fares, confusing fare drops, and a decrease in rides.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of transparency or interpretability","entity":"AI","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Uber"],"developers":["Uber"],"harmed":["Uber drivers"],"report_count":3},{"incident_id":156,"occurred_on":"2022-02-04","title":"Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts","description":"Despite complaints notifying Amazon about the sale of various products that had been used to aid suicide attempts, its recommendation system reportedly continued selling them and suggesting their frequently bought-together items.","mit_domain":"Human-Computer Interaction","mit_subdomain":"Overreliance and unsafe use","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"none","sectors":["wholesale and retail trade"],"countries":[],"deployers":["Amazon"],"developers":["Amazon"],"harmed":["People Attempting Suicides"],"report_count":2},{"incident_id":187,"occurred_on":"2022-02-04","title":"YouTuber Tested Tesla on Self Driving Mode, Colliding with Street Pylons","description":"A YouTuber who was a Tesla’s employee conducted an on-road review of Tesla's Full Self Driving (FSD) Beta, showing its navigation in various road environments in San Jose and collision with a bollards during Autopilot, allegedly causing his dismissal from the company.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Ai Addict"],"developers":["Tesla"],"harmed":["John Bernal, San Jose Public"],"report_count":3},{"incident_id":154,"occurred_on":"2022-01-26","title":"Justice Department’s Recidivism Risk Algorithm PATTERN Allegedly Caused Persistent Disparities Along Racial Lines","description":"Department of Justice’s inmate-recidivism risk assessment tool was reported to have produced racially uneven results, misclassifying risk levels for inmates of color.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Unfair discrimination and misrepresentation","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":"AI tangible harm event","sectors":["law enforcement"],"countries":["US"],"deployers":["United States Department of Justice"],"developers":["United States Department of Justice"],"harmed":["inmates of color","Incarcerated people"],"report_count":1},{"incident_id":630,"occurred_on":"2022-01-22","title":"Alleged Macy's Facial Recognition Error Leads to Wrongful Arrest and Subsequent Sexual Assault in Jail","description":"Harvey Murphy Jr. was wrongfully accused of robbing a Sunglass Hut due to an alleged misidentification by the facial recognition system operated by Macy's. While in custody for ten days, he was sexually assaulted. He is now suing Macy's, EssilorLuxottica (Sunglass Hut's parent), and others, for $10 million.","mit_domain":"AI system safety, failures, and limitations","mit_subdomain":"Lack of capability or robustness","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Macy's","Facial recognition system deployers"],"developers":["Facial recognition system developers"],"harmed":["Macy's customers","Harvey Murphy Jr","General public of the United States","General public","Consumers"],"report_count":3},{"incident_id":266,"occurred_on":"2022-01-15","title":"Replika's \"AI Companions\" Reportedly Abused by Its Users","description":"Replika's AI-powered \"digital companions\" was allegedly abused by their users, who posted on Reddit abusive behaviors and interactions such as using slurs, roleplaying violent acts, and stimulating sexual abuse.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Replika"],"developers":["Replika"],"harmed":["Replika Users, Replika Male Users, Replika"],"report_count":8},{"incident_id":300,"occurred_on":"2022-01-15","title":"TikTok's \"For You\" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate","description":"TikTok’s “For You” algorithm allegedly boosted or was manipulated by an online personality to artificially boost his content which promotes extreme misogynistic views towards teenagers and men, despite breaking its rules.","mit_domain":"Discrimination and Toxicity","mit_subdomain":"Exposure to toxic content","entity":"AI","intent":"Unintentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Tiktok"],"developers":["Tiktok"],"harmed":["Tiktok Male Teenager Users, Tiktok Male Users, Tiktok Teenage Users, Tiktok Users, Tiktok"],"report_count":2},{"incident_id":277,"occurred_on":"2022-01-14","title":"Voices Created Using Publicly Available App Stolen and Resold as NFT without Attribution","description":"An AI-synthetic audio sold as an NFT on Voiceverse’s platform was acknowledged by the company for having been created by 15.ai, a free web app specializing in text-to-speech and AI-voice generation, and reused without proper attribution.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["15.Ai"],"developers":["15.Ai"],"harmed":["15.Ai, 15.Ai Users"],"report_count":1},{"incident_id":276,"occurred_on":"2022-01-01","title":"Local South Korean Government’s Use of CCTV Footage Analysis via Facial Recognition to Track COVID Cases Raised Concerns about Privacy, Retention, and Potential Misuse","description":"Bucheon government's use of facial recognition in analyzing CCTV footage, despite gaining wide public support, was scrutinized by privacy advocates and some lawmakers for collecting data without consent, and retaining and misusing data beyond pandemic needs.","mit_domain":"Privacy & Security","mit_subdomain":"Compromise of privacy by obtaining, leaking or correctly inferring sensitive information","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Bucheon city government"],"developers":["Unknown"],"harmed":["Privacy","General public of South Korea","General public","Bucheon citizens","Biometric data subjects"],"report_count":1},{"incident_id":946,"occurred_on":"2022-01-01","title":"Arizona Residents Reportedly a Frequent Target of AI-Driven Romance Scams","description":"Arizona residents, especially senior citizens, are reportedly often the target of AI-driven romance scams. Between 2022 and 2023, reported losses from online romance scams in Arizona totaled over $47 million, ranking the state fifth highest in the nation behind California, Florida, Texas, and New York, according to FBI Internet Crime Complaint Center data. In 2023, it has been reported that Arizonans lost $325 million owing to these scams.","mit_domain":"Malicious Actors & Misuse","mit_subdomain":"Fraud, scams, and targeted manipulation","entity":"Human","intent":"Intentional","timing":"Post-deployment","harm_level":null,"sectors":[],"countries":[],"deployers":["Yahoo Boys, Romance Scammers Targeting Arizonans, Scammers"],"developers":["Deepfake Technology Developers, Synthetic Audio Generation Technology Developers"],"harmed":["Senior Citizens Of Arizona, General Public Of Arizona"],"report_count":11}]}