AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Thai Wallet App's Facial Recognition Errors Created Registration Issues for Government Programs AIID ↗
A Thai wallet app failed to recognize people’s faces, resulting in citizens and disproportionately elders unable to sign up for Thai government’s cash handout and co-pay programs or having to wait in long queues at local ATMs for authentication.
-
Waze Allegedly Frequently Routed Drivers through the Town of Los Gatos, Blocking Its Single Wildfire Escape Route AIID ↗
Waze app was blamed by Los Gatos town residents for contributing to high wildfire hazard risk via allegedly routing weekend beach-going drivers through their neighborhoods, effectively choking off their single escape route in the event of a medical emergency or wildfire.
-
Tesla Model 3 on Autopilot Crashed into a Ford Explorer Pickup, Killing a Fifteen-Year-Old in California AIID ↗
A Tesla Model 3 on Autopilot mode crashed into a pickup on a California freeway, where data and video from the company showed neither Autopilot nor the driver slowing the vehicle until seconds before the crash.
-
Detroit Police Wrongfully Arrested Black Man Due To Faulty Facial Recognition AIID ↗
A Black man was wrongfully detained by the Detroit Police Department as a result of a false facial recognition (FRT) result.
-
Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service AIID ↗
Seven channels were connected in a Telegram ecosystem centered around letting subscribers, as a paid service, generate non-consensual deepfake nudes using a bot from submitted photos of women, including underage girls and women who they know in real life.
-
Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach AIID ↗
Facebook's political ad delivery system reportedly differentiated the price of user reach based on their inferred political alignment, inhibiting political campaigns' ability to reach voters with diverse political views, which allegedly reinforces political polarization and creates informational filter bubbles.
-
Tesla Vehicle Running on Self-Driving Mode Crashes on City Streets AIID ↗
A Tesla vehicle running in self-driving mode outside the operating conditions supported by the software crashed and injured the driver. Subsequently, the driver filed a lawsuit against Tesla and a jury found no damages were warranted.
-
Amazon’s "Time Off Task" System Made False Assumptions about Workers' Time Management AIID ↗
Amazon’s warehouse worker “time off task" (TOT) tracking system was used to discipline and dismiss workers, falsely assuming workers to have wasted time and failing to account for breaks or equipment issues.
-
TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content AIID ↗
TikTok’s young users were allegedly exposed to community-guideline-violating pro-eating disorder content on their algorithmically curated “For You” page that serves videos from any user on its platform.
-
Sound Intelligence's Aggression Detector Misidentified Innocuous Sounds AIID ↗
Sound Intelligence's "aggression detection" algorithm deployed by schools reportedly contained high rates of false positive, misclassifying laughing, coughing, cheering, and loud discussions.
-
Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia AIID ↗
Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.
-
Length of Stay False Diagnosis Cut Off Insurer's Payment for Treatment of Elderly Woman AIID ↗
An elderly Wisconsin woman was algorithmically determined to have a rapid recovery, an output which the insurer based on to cut off payment for her treatment despite medical notes showing her still experiencing debilitating pain.
-
Workday's AI Tools Allegedly Enabled Employers to Discriminate against Applicants of Protected Groups AIID ↗
Workday's algorithmic screening systems were alleged in a lawsuit allowing employers to discriminate against African-Americans, people over 40, and people with disabilities.
-
South Korean Agencies Reportedly Shared Airport Travelers' Face Images with Companies to Train Immigration Facial Recognition System AIID ↗
Reporting in 2021 alleged that South Korea's Ministry of Justice shared roughly 170 million face images and related biometric data from Korean and foreign airport travelers with the Ministry of Science and Information and Communication Technology (ICT) and private companies for an AI identification and tracking system used in immigration screening. The data was reportedly used for AI training and algorithm testing without travelers' consent.
-
Algorithm to Distribute Social Welfare Reported for Oversimplifying Economic Vulnerability AIID ↗
Takaful cash transfer program's algorithm which ranks families by their economic vulnerability level to determine financial assistance reportedly oversimplified people's economic situation, fueling social tension and perceptions of unfairness.
-
Tesla Model S with Autopilot Reportedly Engaged Struck Parked SUV in Key Largo, Killing One Person and Seriously Injuring Another Standing Nearby AIID ↗
On April 25, 2019, George McGee's Tesla Model S, with Autopilot reportedly engaged, drove through a Key Largo intersection and struck a parked Chevrolet Tahoe, which then hit two people standing beside it: Naibel Benavides Leon, who was killed, and Dillon Angulo, who was seriously injured. McGee admitted distraction. In 2025, a federal jury found Tesla 33% responsible on defective-design and failure-to-warn claims. Tesla disputed liability and said it would appeal.
-
Buenos Aires Government Reportedly Used Children's Personal Data in Facial Recognition System for Fugitives AIID ↗
Beginning in April 2019, the Buenos Aires city government reportedly used data from Argentina’s CONARC fugitive database, including children’s identities and reference photos, in its live Facial Recognition System for Fugitives (SRFP). Human Rights Watch found at least 166 children had appeared in CONARC between 2017 and 2020 and warned that the system exposed them to privacy violations and elevated risks of false matches.
-
Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines AIID ↗
Facebook's housing and employment ad delivery process allegedly resulted in skews in exposure for some users along demographic lines such as gender and racial identity.
-
Ever AI Reportedly Deceived Customers about FRT Use in App AIID ↗
Ever AI, now Paravision AI, allegedly failed to inform customers about the development and use of facial recognition that facilitates the sale of customers’ data to various businesses, a business model that critics said was an egregious violation of privacy.
-
Tesla Autopilot’s Lane Recognition Allegedly Vulnerable to Adversarial Attacks AIID ↗
Tencent Keen Security Lab conducted security research into Tesla’s Autopilot system and identified crafted adversarial samples and remote controlling via wireless gamepad as vulnerabilities to its system, although the company called into question their real-world practicality. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
-
The Christchurch shooter and YouTube’s radicalization trap AIID ↗
A New Zealand government report released following a right-wing terrorist killing 51 worshippers at two New Zealand mosques which indicated that Youtube's recommendation algorithm played an important role in the terrorist's radicalization.
-
OpenAI Alleged by Lawsuit Violated Users' Privacy Rights by Training AI on Private Info without Informed Consent AIID ↗
OpenAI's products such as ChatGPT and DALL-E were alleged in a lawsuit using stolen private information from internet users without their informed consent or knowledge.
-
Tesla on Autopilot Crashed into Trailer Truck in Florida, Killing Driver AIID ↗
A Tesla Model 3 driver switched on Autopilot seconds before the crash into the underbelly of a tractor-trailer on a highway in Florida, killing the Tesla driver.
-
Model 3 Tesla on Autopilot Crashed into a Truck in Florida, Killing Driver AIID ↗
In Florida, a Model 3 Tesla on Autopilot mode crashed into a tractor-trailer truck, killing the 50-year-old driver.
-
Fraudsters Used AI to Mimic Voice of a UK-Based Firm's CEO's Boss AIID ↗
Fraudsters allegedly used AI voice technology to impersonate the boss of a UK-based firm's CEO, demanding a transfer of €220,000 over the phone.
-
GPT-2 Reportedly Reproduced Personal Data from Its Training Data AIID ↗
OpenAI's GPT-2 reportedly memorized and reproduced portions of its training data, including personal information such as names, email addresses, social media handles, and phone numbers. Researchers raised concerns that large language models could expose private or sensitive information when trained on web-scale datasets containing personal data.
-
YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm AIID ↗
Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.
-
YouTube’s Recommendation Algorithm Allegedly Promoted Climate Misinformation Content AIID ↗
YouTube’s recommendation system and its focus on views and watched time were alleged by an advocacy group to have driven people towards climate denial and misinformation videos.
-
Apple Maps Allegedly Directed Ski Trip Couple Onto Unpaved Road in the Mountains AIID ↗
Near Los Angeles, Apple Maps allegedly directed a couple on a ski trip in the mountains toward into an unconventional route out of town, where the drivers found themselves lost and stuck on an unpaved road in the snow.
-
New Jersey Police Wrongful Arrested Innocent Black Man via FRT AIID ↗
Woodbridge Police Department falsely arrested an innocent Black man following a misidentification by their facial recognition software, who was jailed for more than a week and paid thousands of dollar for his defense.
-
Two Investment Firms Charged with Making False Claims of Artificial Intelligence Capabilities in Case of AI Washing AIID ↗
In a case of AI washing, the SEC charged two investment advisers, Delphia and Global Predictions, for falsely stating their use of artificial intelligence in their investment strategies between 2019 and 2023. Their misleading claims resulted in a settlement whereby the firms agreed to pay a total of $400,000 in penalties, highlighting the critical consequences of misrepresenting AI capabilities on investment decisions and trust.
-
Warehouse robot ruptures can of bear spray and injures workers AIID ↗
Twenty-four Amazon workers in New Jersey were hospitalized after a robot punctured a can of bear repellent spray in a warehouse.
-
Tumblr Automated Pornography-Detecting Algorithms Erroneously Flagged Inoffensive Images as Explicit AIID ↗
Tumblr’s automated tools to identify adult content were reported to have incorrectly flagged inoffensive images as explicit, following its announcement to ban all adult content on the platform.
-
Facial Recognition Pilot in Bahia Reportedly Targeted Black and Poor People AIID ↗
Facial recognition deployed in a pilot project by the local government of Bahia despite having minimal hit rate reportedly targeted Black and poor people disproportionately.
-
Sleeping Driver on Tesla AutoPilot AIID ↗
A Tesla Model S remained on autopilot while being operated by a drunk, sleeping operator whose hands were not on the wheel. The police had to slow the car down by slowing in front of the vehicle to activate its 'driver assist' feature .
-
Schufa Credit Scoring in Germany Reported for Unreliable and Imbalanced Scores AIID ↗
Creditworthiness Schufa scores in Germany reportedly privileged older and female consumers, and people who changed addresses less frequently, and were unreliable depending on scoring version.
-
Reported Automated License Plate Reader Alert on Previously Stolen Rental Car Leads to Alleged Wrongful Detainment in California AIID ↗
A purportedly automated license plate reader allegedly flagged a rental car in California as stolen, although reports indicate it had already been recovered. Police reportedly conducted a high-risk stop and detained the occupants at gunpoint before confirming their innocence. The driver later alleged excessive force and database errors in a federal lawsuit.
-
Emotion Detection Models Showed Disparate Performance along Racial Lines AIID ↗
Emotion detection tools by Face++ and Microsoft's Face API allegedly scored smiling or defaulted ambiguous facial photos for Black faces as negative emotion more often than for white faces.
-
Wrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification AIID ↗
New York Police Department (NYPD)’s facial recognition system falsely connected a Black teenager to a series of thefts at Apple stores, which resulted in his wrongful attempted arrest.
-
Picture of Woman on Side of Bus Shamed for Jaywalking AIID ↗
Facial recognition system in China mistakes celebrity's face on moving billboard for jaywalker
-
Crashes with Maneuvering Characteristics Augmentation System (MCAS) AIID ↗
A Boeing 737 crashed into the sea, killing 189 people, after faulty sensor data caused an automated manuevering system to repeatedly push the plane's nose downward.
-
Oregon’s Screening Tool for Child Abuse Cases Discontinued Following Concerns of Racial Bias AIID ↗
Oregon’s Department of Human Services (DHS) stopped using its Safety at Screening Tool, that is aimed to predict the risk that children wind up in foster care or be investigated in the future, and opted for a new process allegedly to reduce disparities and improve racially equitable decision-making.
-
Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric AIID ↗
After the “News Feed” algorithm had been overhauled to boost engagement between friends and family in early 2018, its heavy weighting of re-shared content was alleged found by company researchers to have pushed content creators to reorient their posts towards outrage and sensationalism, causing a proliferation of misinformation, toxicity, and violent content.
-
Dutch Families Wrongfully Accused of Tax Fraud Due to Discriminatory Algorithm AIID ↗
A childcare benefits system in the Netherlands falsely accused thousands of families of fraud, in part due to an algorithm that treated having a second nationality as a risk factor.
-
Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar AIID ↗
Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.
-
HUD charges Facebook with enabling housing discrimination AIID ↗
In March 2019 the U.S. Department of Housing and Urban Development charged Facebook with violating the Fair Housing Act by allowing real estate sellers to target advertisements in a discriminatory manner.
-
Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products AIID ↗
Amazon tweaked product-search algorithm to boost and guide customers towards more profitable in-house products instead of showing mainly most-relevant and best-selling listings, which its internal engineers and lawyers alleged to violate company’s best-for-customer principle.
-
Amazon's Rekognition Falsely Matched Members of Congress to Mugshots AIID ↗
Rekognition's face comparison feature was shown by the ACLU to have misidentified members of congress, and particularly members of colors, as other people who have been arrested using a mugshot database built on publicly available arrest photos.
-
Swedish Contraceptive App, Natural Cycles, Allegedly Failed to Correctly Map Menstrual Cycle AIID ↗
Some women using the contraceptive app, Natural Cycles, reported unwanted pregnancies, revealing its algorithm's difficulties in mapping menstrual cycles.
-
Chinese Tech Firms Allegedly Developed Facial Recognition to Identify People by Race, Targeting Uyghur Muslims AIID ↗
Various Chinese firms were revealed by patent applications to have developed facial recognition capable of detecting people by race, which critics feared would enable persecution and discrimination of Uyghur Muslims.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.