AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
Filter incidents (1 active)
-
Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects AIID ↗
Data analysis by the American Civil Liberty Union (ACLU) on Allegheny County's decision-support Family Screening Tool to predict child abuse or neglect risk found the tool resulting in higher screen-in rates for Black families and higher risk scores for households with disabled residents.
-
Social Media's Automated Word-Flagging without Context Shifted Content Creators' Language Use AIID ↗
TikTok's, YouTube's, Instagram's, and Twitch's use of algorithms to flag certain words devoid of context changed content creators' use of everyday language or discussion about certain topics in fear of their content getting flagged or auto-demonetized by mistake.
-
Uber Locked Indian Drivers out of Accounts Allegedly Due to Facial Recognition Fails AIID ↗
Uber drivers in India reported being locked out of their accounts allegedly due to Real-Time ID Check's facial recognition failing to recognize appearance changes or faces in low lighting conditions.
-
High-Toxicity Assessed on Text Involving Women and Minority Groups AIID ↗
Google's Perspective API, which assigns a toxicity score to online text, seems to award higher toxicity scores to content involving non-white, male, Christian, heterosexual phrases.
-
AI incident: sexual content (Amazon, Dec 2016) AIID ↗
An AI Incident Database record involving sexual content, dated 30 December 2016. Risk classification, related incidents and the laws on record for this risk area.
-
Passport checker Detects Asian man's Eyes as Closed AIID ↗
New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.
-
NYPD's Deployment of Facial Recognition Cameras Reportedly Reinforced Biased Policing AIID ↗
New York Police Department’s use of facial recognition deployment of surveillance cameras were shown using crowdsourced volunteer data reinforcing discriminatory policing against minority communities.
-
LinkedIn Search Prefers Male Names AIID ↗
An investigation by The Seattle Times in 2016 found a gender bias in LinkedIn's search engine.
-
AI Beauty Judge Did Not Like Dark Skin AIID ↗
In 2016, after artificial inntelligence software Beauty.AI judged an international beauty contest and declared a majority of winners to be white, researchers found that Beauty.AI was racially biased in determining beauty.
-
Amazon's Experimental Hiring Tool Allegedly Displayed Gender Bias in Candidate Rankings AIID ↗
Between 2014 and 2017, Amazon reportedly developed an AI-powered recruiting tool to score job applicants, trained on a decade of resumes purportedly drawn largely from men. Media reports say the system learned to favor male candidates, penalizing terms like "women's" and graduates from certain all-women's colleges. Efforts to remove these biases reportedly did not guarantee fairness, and the project was ultimately abandoned. Amazon reportedly states recruiters never solely relied on the tool.
-
Common Biases of Vector Embeddings AIID ↗
Researchers from Boston University and Microsoft Research, New England demonstrated gender bias in the most common techniques used to embed words for natural language processing (NLP).
-
COMPAS Algorithm Reportedly Performs Poorly in Crime Recidivism Prediction AIID ↗
Correctional Offender Management Profiling for Alternative Sanctions (COMPAS), a recidivism risk-assessment algorithmic tool used in the judicial system to assess likelihood of defendants' recidivism, is found to be less accurate than random untrained human evaluators.
-
Northpointe Risk Models AIID ↗
An algorithm developed by Northpointe and used in the penal system is two times more likely to incorrectly label a black person as a high-risk re-offender and is two times more likely to incorrectly label a white person as low-risk for reoffense according to a ProPublica review.
-
Chinese Insurer Ping An Employed Facial Recognition to Determine Customers’ Untrustworthiness, Which Critics Alleged to Likely Make Errors and Discriminate AIID ↗
Customers’ untrustworthiness and unprofitability were reportedly determined by Ping An, a large insurance company in China, via facial-recognition measurements of micro-expressions and body-mass indices (BMI), which critics argue was likely to make mistakes, discriminate against certain ethnic groups, and undermine its own industry.
-
Google Images Showed Racially Biased Results for 'Professional' Hairstyles AIID ↗
Google Images reportedly showed disparate search results along racial lines, featuring almost exclusively white women for "professional hairstyles" and Black women for "unprofessional hairstyles" prompts.
-
Biased Google Image Results AIID ↗
On June 6, 2016, Google image searches of "three black teenagers" resulted in mostly mugshot images whereas Google image searchers of "three white teenagers" consisted of mostly stock images, suggesting a racial bias in Google's algorithm.
-
Microsoft's TayBot Allegedly Posts Racist, Sexist, and Anti-Semitic Content to Twitter AIID ↗
Microsoft's Tay, an artificially intelligent chatbot, was released on March 23, 2016 and removed within 24 hours due to multiple racist, sexist, and anti-semitic tweets generated by the bot.
-
Is Pokémon Go racist? How the app may be redlining communities of color AIID ↗
Through a crowdsourcing social media campaign in 2016, several journalists and researchers demonstrated that augmented reality locations in the popular smartphone game Pokemon Go were more likely to be in white neighborhoods.
-
Twitter Recommender System Amplified Right-Leaning Tweets AIID ↗
Twitter’s “Home” timeline algorithm was revealed by its internal researchers to have amplified tweets and news of rightwing politicians and organizations more than leftwing ones in six out of seven studied countries.
-
Uber's Surge Pricing Reportedly Offered Disproportionate Service Quality along Racial Lines AIID ↗
Uber's surge-pricing algorithm which adjusts prices to influence car availability inadvertently caused better service offering such as shorter wait times for majority white neighborhoods.
-
Predictive Policing Biases of PredPol AIID ↗
Predictive policing algorithms meant to aid law enforcement by predicting future crime show signs of biased output.
-
Images of Black People Labeled as Gorillas AIID ↗
Google Photos image processing software mistakenly labelled a black couple as "gorillas."
-
Google’s YouTube Kids App Presents Inappropriate Content AIID ↗
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.
-
Gender Biases of Google Image Search AIID ↗
Google Image returns results that under-represent women in leadership roles, notably with the first photo of a female "CEO" being a Barbie doll after 11 rows of male CEOs.
-
UK Home Office's Sham Marriage Detection Algorithm Reportedly Flagged Certain Nationalities Disproportionately AIID ↗
UK Home Office's opaque algorithm to detect sham marriages flagged some nationalities for investigation more than others, raising fears surrounding discrimination based on nationality and age.
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
What is recorded in each incident?
What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.
Does an incident mean wrongdoing was proven?
No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.
How current is the incident data?
It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.
Does this page include the full incident reports?
No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.