AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Buenos Aires Government Reportedly Used Children's Personal Data in Facial Recognition System for Fugitives AIID ↗
Beginning in April 2019, the Buenos Aires city government reportedly used data from Argentina’s CONARC fugitive database, including children’s identities and reference photos, in its live Facial Recognition System for Fugitives (SRFP). Human Rights Watch found at least 166 children had appeared in CONARC between 2017 and 2020 and warned that the system exposed them to privacy violations and elevated risks of false matches.
-
Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines AIID ↗
Facebook's housing and employment ad delivery process allegedly resulted in skews in exposure for some users along demographic lines such as gender and racial identity.
-
Ever AI Reportedly Deceived Customers about FRT Use in App AIID ↗
Ever AI, now Paravision AI, allegedly failed to inform customers about the development and use of facial recognition that facilitates the sale of customers’ data to various businesses, a business model that critics said was an egregious violation of privacy.
-
Tesla Autopilot’s Lane Recognition Allegedly Vulnerable to Adversarial Attacks AIID ↗
Tencent Keen Security Lab conducted security research into Tesla’s Autopilot system and identified crafted adversarial samples and remote controlling via wireless gamepad as vulnerabilities to its system, although the company called into question their real-world practicality. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
-
The Christchurch shooter and YouTube’s radicalization trap AIID ↗
A New Zealand government report released following a right-wing terrorist killing 51 worshippers at two New Zealand mosques which indicated that Youtube's recommendation algorithm played an important role in the terrorist's radicalization.
-
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent AIID ↗
OpenAI's products such as ChatGPT and DALL-E were alleged in a lawsuit using stolen private information from internet users without their informed consent or knowledge.
-
Tesla on Autopilot Crashed into Trailer Truck in Florida, Killing Driver AIID ↗
A Tesla Model 3 driver switched on Autopilot seconds before the crash into the underbelly of a tractor-trailer on a highway in Florida, killing the Tesla driver.
-
Model 3 Tesla on Autopilot Crashed into a Truck in Florida, Killing Driver AIID ↗
In Florida, a Model 3 Tesla on Autopilot mode crashed into a tractor-trailer truck, killing the 50-year-old driver.
-
Fraudsters Used AI to Mimic Voice of a UK-Based Firm's CEO's Boss AIID ↗
Fraudsters allegedly used AI voice technology to impersonate the boss of a UK-based firm's CEO, demanding a transfer of €220,000 over the phone.
-
GPT-2 Reportedly Reproduced Personal Data from Its Training Data AIID ↗
OpenAI's GPT-2 reportedly memorized and reproduced portions of its training data, including personal information such as names, email addresses, social media handles, and phone numbers. Researchers raised concerns that large language models could expose private or sensitive information when trained on web-scale datasets containing personal data.
-
YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm AIID ↗
Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.
-
YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content AIID ↗
YouTube’s recommendation system and its focus on views and watched time were alleged by an advocacy group to have driven people towards climate denial and misinformation videos.
-
Apple Maps Allegedly Directed Ski Trip Couple Onto Unpaved Road in the Mountains AIID ↗
Near Los Angeles, Apple Maps allegedly directed a couple on a ski trip in the mountains toward into an unconventional route out of town, where the drivers found themselves lost and stuck on an unpaved road in the snow.
-
New Jersey Police Wrongful Arrested Innocent Black Man via FRT AIID ↗
Woodbridge Police Department falsely arrested an innocent Black man following a misidentification by their facial recognition software, who was jailed for more than a week and paid thousands of dollar for his defense.
-
Two Investment Firms Charged with Making False Claims of Artificial Intelligence Capabilities in Case of AI Washing AIID ↗
In a case of AI washing, the SEC charged two investment advisers, Delphia and Global Predictions, for falsely stating their use of artificial intelligence in their investment strategies between 2019 and 2023. Their misleading claims resulted in a settlement whereby the firms agreed to pay a total of $400,000 in penalties, highlighting the critical consequences of misrepresenting AI capabilities on investment decisions and trust.
-
Warehouse robot ruptures can of bear spray and injures workers AIID ↗
Twenty-four Amazon workers in New Jersey were hospitalized after a robot punctured a can of bear repellent spray in a warehouse.
-
Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit AIID ↗
Tumblr’s automated tools to identify adult content were reported to have incorrectly flagged inoffensive images as explicit, following its announcement to ban all adult content on the platform.
-
Facial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People AIID ↗
Facial recognition deployed in a pilot project by the local government of Bahia despite having minimal hit rate reportedly targeted Black and poor people disproportionately.
-
Sleeping Driver on Tesla AutoPilot AIID ↗
A Tesla Model S remained on autopilot while being operated by a drunk, sleeping operator whose hands were not on the wheel. The police had to slow the car down by slowing in front of the vehicle to activate its 'driver assist' feature .
-
Schufa Credit Scoring in Germany Reported for Unreliable and Imbalanced Scores AIID ↗
Creditworthiness Schufa scores in Germany reportedly privileged older and female consumers, and people who changed addresses less frequently, and were unreliable depending on scoring version.
-
Reported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California AIID ↗
A purportedly automated license plate reader allegedly flagged a rental car in California as stolen, although reports indicate it had already been recovered. Police reportedly conducted a high-risk stop and detained the occupants at gunpoint before confirming their innocence. The driver later alleged excessive force and database errors in a federal lawsuit.
-
Emotion Detection Models Showed Disparate Performance along Racial Lines AIID ↗
Emotion detection tools by Face++ and Microsoft's Face API allegedly scored smiling or defaulted ambiguous facial photos for Black faces as negative emotion more often than for white faces.
-
Wrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification AIID ↗
New York Police Department (NYPD)’s facial recognition system falsely connected a Black teenager to a series of thefts at Apple stores, which resulted in his wrongful attempted arrest.
-
Picture of Woman on Side of Bus Shamed for Jaywalking AIID ↗
Facial recognition system in China mistakes celebrity's face on moving billboard for jaywalker
-
Crashes with Maneuvering Characteristics Augmentation System (MCAS) AIID ↗
A Boeing 737 crashed into the sea, killing 189 people, after faulty sensor data caused an automated manuevering system to repeatedly push the plane's nose downward.
-
Oregon’s Screening Tool for Child Abuse Cases Discontinued Following Concerns of Racial Bias AIID ↗
Oregon’s Department of Human Services (DHS) stopped using its Safety at Screening Tool, that is aimed to predict the risk that children wind up in foster care or be investigated in the future, and opted for a new process allegedly to reduce disparities and improve racially equitable decision-making.
-
Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric AIID ↗
After the “News Feed” algorithm had been overhauled to boost engagement between friends and family in early 2018, its heavy weighting of re-shared content was alleged found by company researchers to have pushed content creators to reorient their posts towards outrage and sensationalism, causing a proliferation of misinformation, toxicity, and violent content.
-
Dutch Families Wrongfully Accused of Tax Fraud Due to Discriminatory Algorithm AIID ↗
A childcare benefits system in the Netherlands falsely accused thousands of families of fraud, in part due to an algorithm that treated having a second nationality as a risk factor.
-
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar AIID ↗
Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.
-
HUD charges Facebook with enabling housing discrimination AIID ↗
In March 2019 the U.S. Department of Housing and Urban Development charged Facebook with violating the Fair Housing Act by allowing real estate sellers to target advertisements in a discriminatory manner.
-
Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products AIID ↗
Amazon tweaked product-search algorithm to boost and guide customers towards more profitable in-house products instead of showing mainly most-relevant and best-selling listings, which its internal engineers and lawyers alleged to violate company’s best-for-customer principle.
-
Amazon's Rekognition Falsely Matched Members of Congress to Mugshots AIID ↗
Rekognition's face comparison feature was shown by the ACLU to have misidentified members of congress, and particularly members of colors, as other people who have been arrested using a mugshot database built on publicly available arrest photos.
-
Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle AIID ↗
Some women using the contraceptive app, Natural Cycles, reported unwanted pregnancies, revealing its algorithm's difficulties in mapping menstrual cycles.
-
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims AIID ↗
Various Chinese firms were revealed by patent applications to have developed facial recognition capable of detecting people by race, which critics feared would enable persecution and discrimination of Uyghur Muslims.
-
Uber Allegedly Wrongfully Accused Drivers of Fraud via Automated Systems AIID ↗
Uber was alleged in a lawsuit to have wrongfully accused its drivers in the UK and Portugal of fraudulent activity through automated systems, which resulted in their dismissal without a right to appeal.
-
Transgender Uber Drivers Mistakenly Kicked off App for Appearance Change during Gender Transitions AIID ↗
Transgender Uber drivers reported being automatically deactivated from the app due to Real-Time ID Check failing to account for difference in appearance of people undergoing gender transitions.
-
Facebook’s Automated Content Moderation Tool Flagged a Post Containing Parts of the Declaration of Independence as Hate Speech by Mistake AIID ↗
Facebook’s content moderation algorithm was acknowledged by the company to have flagged excerpts of the Declaration of Independence posted by a small newspaper in Texas as hate speech by mistake.
-
Atlantic City Casino-Hotels Allegedly Used Cendyn's Rainmaker AI to Coordinate and Inflate Room Rates AIID ↗
Atlantic City casino-hotels were alleged to have used Cendyn's Rainmaker AI-powered pricing platform to coordinate room rates using competitors' non-public pricing and occupancy data. Plaintiffs alleged that the hotels accepted Rainmaker's recommendations about 90% of the time, resulting in anti-competitively high room prices for guests.
-
OpenAI's Training Data for LLMs Allegedly Comprised of Copyrighted Books AIID ↗
Two authors alleged in a class action lawsuit OpenAI infringed authors' copyrights by incorporating illegal "shadow libraries" offering copyrighted books without permission in the training data of its generative LLMs, such as ChatGPT.
-
Two Cruise Autonomous Vehicles Collided with Each Other in California AIID ↗
In San Francisco, an autonomous Cruise Chevrolet Bolt collided with another Cruise vehicle driven by a Cruise human employee, causing minor scuffs to the cars but no human injuries.
-
Calgary Malls Reportedly Deployed Facial Recognition Without Customer Consent AIID ↗
Facial recognition (FRT) was reportedly deployed in some Calgary-area malls to approximate customer age and gender without explicit consent, which a privacy expert warned was a cause for concern.
-
Tesla on Autopilot Crashed into Parked Police Car in California AIID ↗
A Tesla sedan on Autopilot mode collided with a parked Laguna Beach Police Department car, resulting in minor injuries for its driver in Laguna Beach, California.
-
Tesla Autopilot Allegedly Malfunctioned in a Non-Fatal Collision in Greece AIID ↗
Autopilot was alleged by its Tesla Model 3 driver to have unexpectedly malfunctioned, veering right without warning and crashing into a road divider near Thessaloniki, Greece, which resulted in damages to its wheel and door but no injury to the driver.
-
Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact AIID ↗
Amazon Echo misinterpreted a background conversation between a husband and wife as instructions for recording a message and sending it to one of the husband's employees.
-
Amazon Allegedly Violated Children's Privacy through Default Voice Collection Settings AIID ↗
Amazon's retention of children' voice recordings indefinitely as the default setting reportedly to train Alexa's voice recognition for Alexa-enabled devices was charged by the FTC and DOJ to violate COPPA Rule.
-
Facebook’s Automated Removal of Content Featuring Nudity-Containing Artworks Denounced as Censorship AIID ↗
Facebook’s removal of posts featuring renowned artworks by many historical artists and their promotional content due to nudity via both automated and human-moderated means were condemned by critics, such as museums and tourism boards, as cultural censorship and prevention of artwork promotion.
-
Tesla Model X on Autopilot Missed Parked Vehicles and Pedestrians, Killing Motorcyclist in Japan AIID ↗
A Tesla Model X operated on Autopilot reportedly failed to recognize the parked motorcycles, pedestrians, and van in its path in Kanagawa, Japan, and ran over a motorcyclist who previously stopped when a member of his motorcyclist group was involved in an accident.
-
Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System AIID ↗
YouTube’s thumbnail monitoring system was allegedly evaded by content farms such as ones in Cambodia who spike viewership and generate ad revenue using bestiality-themed thumbnails.
-
Investigative Journalist Rana Ayyub Targeted by AI-Generated Deepfake Pornography AIID ↗
Investigative journalist Rana Ayyub was targeted by a deepfake porn campaign, where AI-generated explicit content falsely depicted her in a pornographic video. This was part of a broader effort to discredit and silence her, which included a doxxing attack that exposed her personal information that resulted in severe harassment and emotional distress.
-
Facial Recognition Program in São Paulo Metro Stations Suspended for Illegal and Disproportionate Violation of Citizens' Right to Privacy AIID ↗
A facial recognition program rolled out by São Paulo Metro Stations was suspended following a court ruling in response to a lawsuit by civil society organizations, who cited fear of it being integrated with other electronic surveillance entities without consent, and lack of transparency about the biometric data collection process of metro users.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.