AI Incident Database
Browse AI incidents
Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.
-
Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash AIID ↗
A lawsuit cited Amazon as liable in a crash involving its delivery driver, alleging that Amazon’s AI-powered driver monitoring system pushed drivers to prioritize speed over safety.
-
Amazon Allegedly Forced Deployment of AI-Powered Cameras on Delivery Drivers AIID ↗
Amazon delivery drivers were allegedly forced to consent to algorithmic collection and processing of their location, movement, and biometric data through AI-powered cameras, or be dismissed.
-
Year-long AI Surveillance Pilot in Two South Australian Aged Care Facilities Reportedly Overwhelmed Staff with False Positives AIID ↗
Between March 2021 and March 2022, an AI-enabled video and audio monitoring system was trialed in two South Australian aged care facilities. According to an independent audit commissioned by South Australia Health, the system produced over 12,000 false alerts, overwhelming staff and contributing to at least one missed real incident. The report concluded the system did not reach accuracy levels acceptable to staff or management during the pilot.
-
Facebook's Automated Tools Failed to Adequately Remove Hate Speech, Violence, and Incitement AIID ↗
Facebook's automated moderation tools were shown by internal documents performing incomparably to human moderators, and accounting for only a small fraction of hate speech, violence, and incitement content removal.
-
TikTok’s "For You" Allegedly Pushed Fatal “Blackout” Challenge Videos to Two Young Girls AIID ↗
TikTok’s recommendation algorithm was alleged in a lawsuit to have intentionally and repeatedly pushed videos of the “blackout” challenge onto children’s feeds, incentivizing their participation which ultimately resulted in the death of two young girls.
-
Manufacturing Robot Failure Caused Factory Worker's Death in India AIID ↗
A sensor snag resulted in an automotive parts factory robot falling on a factory worker in India
-
Facebook’s and Twitter's Automated Content Moderation Reportedly Failed to Effectively Enforce Violation Rules for Small Language Groups AIID ↗
Facebook's and Twitter were not able to sufficiently moderate content of small language groups such as the Balkan languages using AI, allegedly due to the lack of investment in human moderation and difficulty in AI-solution design for the languages.
-
California's Algorithm Considered ZIP Codes in Vaccine Distribution, Allegedly Excluding Low-Income Neighborhoods and Communities of Color AIID ↗
California's vaccine-distribution algorithm used ZIP codes as opposed to census tracts in its decision-making, which critics said undermined equity and access for vulnerable communities who are largely low-income, underserved neighborhoods with low Healthy Places Index scores.
-
Facebook's Advertisement Moderation System Allegedly Routinely Misidentified Adaptive Fashion Products as Medical Equipment and Blocked Their Sellers AIID ↗
Facebook platforms' automated ad moderation system falsely classified adaptive fashion products as medical and health care products and services, resulting in regular bans and appeals faced by their retailers.
-
AI-Generated Deepfakes Reportedly Derailed Political Career of Florida Official AIID ↗
Sabrina Javellana, a Florida politician, was reportedly targeted with AI-generated deepfake pornography in February 2021, which was spread online, leading to severe emotional distress and her eventual withdrawal from public life.
-
California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed AIID ↗
A police officer in Beverly Hills played copyrighted music on his phone when realizing that his interactions were being recorded on a livestream, allegedly hoping the Instagram's automated copyright detection system to end or mute the stream.
-
Queensland Man Allegedly Distributed Purportedly AI-Generated Sexual Posters Falsely Advertising Women for Sex AIID ↗
Queensland police in Australia allege that a man used AI to place at least eight women's faces onto explicit images and displayed posters containing their names, social media accounts, employment details, and false claims that they offered sexual services. The alleged campaign ran from February 2021 through May 2026.
-
Remote Proctoring Facial-Detection Software Reportedly Failed to Detect Black Student During Lab Quiz AIID ↗
In February 2021, a Black college student, Amaya Ross, reportedly tried to take a remote biology lab quiz using proctoring software that could not detect her face. Ross said she spent 45 minutes changing lights, shades, position, and background before pointing an LED flashlight at her face so the app would work; the quiz itself was only 30 minutes.
-
Amazon’s Search and Recommendation Algorithms Found by Auditors to Have Boosted Products That Contained Vaccine Misinformation AIID ↗
Evidence of the "filter-bubble effect" were found by vaccine-misinformation researchers in Amazon's recommendations, where its algorithms presented users who performed actions on misinformative products with more misinfomative products.
-
Facebook's Automated Moderation Mistakenly Flagged Landmark's Name as Offensive AIID ↗
Facebook's automated system mistakenly labelled posts featuring the seafaring landmark Plymouth Hoe as misogynistic.
-
Facebook Recommended Military Gear Ads Despite Pause on Weapons Accessories Ads AIID ↗
Facebook’s algorithmic recommendations reportedly continued showing advertisements for gun accessories and military gear, despite Facebook’s halt on weapons accessories ads following the US Capitol attack.
-
Israeli Tax Authority Reportedly Used an Opaque Automated System to Issue a Fine, Declining to Explain or Disclose the Underlying Calculation AIID ↗
An Israeli farmer, Moshe Har Shemesh, reportedly received a fine generated by a Tax Authority software system whose calculation officials were allegedly unable to explain. When the farmer reportedly sought access to the program or its source code to understand the basis for the amount, the authority allegedly refused, citing security concerns and the difficulty of extracting the embedded guidelines. The dispute reportedly later moved into legal proceedings focused on whether code and automated d
-
Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment AIID ↗
Honolulu Police Department spent federal pandemic relief funds on a robot dog to take body temperatures and patrol a homeless quarantine encampment which local civil rights advocates criticized as dehumanizing.
-
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers AIID ↗
North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes
-
XPeng Motors Fined For Illegal Collection of Consumers’ Faces Using Facial Recognition Cameras AIID ↗
The Chinese electric vehicle (EV) firm XPeng Motors was fined by local market regulators for illegally collecting in-store customers’ facial images without their consent for six months.
-
TikTok’s Content Moderation Allegedly Failed to Adequately Take down Videos Promoting Eating Disorders AIID ↗
Videos promoting eating disorders evaded TikTok's automated violation detection system without difficulty via common misspellings of search terms, bypassing its ban of violating hashtags such as "proana" and "anorexia".
-
Robot in Chinese Shopping Mall Fell off the Escalator, Knocking down Passengers AIID ↗
A shopping guide robot deployed by the Fuzhou Zhongfang Marlboro Mall was shown on video allegedly walking to the escalator by itself, falling down, and knocking over passengers, which prompted its suspension.
-
FaceApp Predicted Different Genders for Similar User Photos with Slight Variations AIID ↗
FaceApp’s algorithm was reported by a user to have predicted different genders for two mostly identical facial photos with only a slight difference in eyebrow thickness.
-
Korean Chatbot Luda Reportedly Made Offensive Remarks Towards Minority Groups in South Korea AIID ↗
A Korean interactive chatbot was allegedly shown in screenshots to have used derogatory and bigoted language when asked about lesbians, Black people, and people with disabilities.
-
Frontline workers protest at Stanford after hospital distributed vaccine to administrators AIID ↗
In 2020, Stanford Medical Center's distribution algorithm only designated 7 of 5,000 vaccines to Medical Residents, who are frontline workers regularly exposed to COVID-19.
-
Japanese Porn Depixelated by Man using Deepfake AIID ↗
A man allegedly unblurred, using deepfake technology, pixelated pornographic images and videos of pornographic actors, which violated Japan’s obscenity law requiring images of genitalia to be obscured.
-
Online Trolls Allegedly Abused TikTok’s Automated Content Reporting System to Discriminate against Marginalized Creators AIID ↗
TikTok's automated content reporting system was allegedly abused by online trolls to intentionally misreport content created by users of marginalized groups.
-
Brand Safety Tech Firms Falsely Claimed Use of AI, Blocking Ads Using Simple Keyword Lists AIID ↗
Brand safety tech firms falsely claimed use of AI, blocking ads using simple keyword lists.
-
Proctoring Algorithm in Online California Bar Exam Flagged an Unusually High Number of Alleged Cheaters AIID ↗
The proctoring algorithm used in a California bar exam cited a third of thousands of applicants as cheaters, resulting in allegations where exam takers were instructed to prove otherwise without seeing their incriminating video evidence.
-
Court Rules Deliveroo Used 'Discriminatory' Algorithm AIID ↗
In December 2020, an Italian court ruled that Deliveroo’s employee ‘reliability’ algorithm illegally discriminated against workers with legitimate reasons for cancelling shifts.
-
Poachers Evaded AI Cameras and Killed Four Rhinos AIID ↗
AI cameras installed by Ezemvelo KZN Wildlife failed to detect poachers when four dehorned rhino carcasses were found.
-
Facebook Mistakenly Blocked Small Business Ads AIID ↗
Facebook’s AI mistakenly blocked advertisements by small and struggling businesses, after the company allegedly leaned more on algorithms to monitor ads on the platform with little review from human moderators.
-
YouTube Recommendation Reportedly Pushed Election Fraud Content to Skeptics Disproportionately AIID ↗
YouTube's recommendation algorithm allegedly pushed 2020's US Presidential Election fraud content to users most skeptical of the election's legitimacy disproportionately compared to least skeptical users.
-
Autonomous Roborace Car Drove Directly into a Wall AIID ↗
An autonomous Roborace car drove itself into a wall in round one of the Season Beta 1.1 race.
-
OpenAI’s GPT-3 Reported as Unviable in Medical Tasks by Healthcare Firm AIID ↗
The French digital care company, Nabla, in researching GPT-3’s capabilities for medical documentation, diagnosis support, and treatment recommendation, found its inconsistency and lack of scientific and medical expertise unviable and risky in healthcare applications. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
-
Meta Allegedly Used Books3, a Dataset of 191,000 Pirated Books, to Train LLaMA AI AIID ↗
Meta and Bloomberg allegedly used Books3, a dataset containing 191,000 pirated books, to train their AI models, including LLaMA and BloombergGPT, without author consent. Lawsuits from authors such as Sarah Silverman and Michael Chabon claim this constitutes copyright infringement. Books3 includes works from major publishers like Penguin Random House and HarperCollins. Meta argues its AI outputs are not "substantially similar" to the original books, but legal challenges continue.
-
AI mistakes referee’s bald head for football — hilarity ensued AIID ↗
In a Scottish soccer match the AI-enabled ball-tracking camera used to livestream the game repeatedly tracked an official’s bald head as though it were the soccer ball.
-
Tesla Autopilot Mistakes Red Letters on Flag for Red Traffic Lights AIID ↗
A Tesla Model 3 misidentified flags with "COOP" written vertically on them as traffic lights.
-
AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection AIID ↗
AlgorithmWatch tested spam filtering algorithms across Gmail, Yahoo, Outlook, GMX, and LaPoste. Their findings reportedly showed that Microsoft Outlook’s spam filter flagged emails based on specific keywords that led to racial and content-based biases blocking legitimate communications. Emails mentioning Nigeria or containing certain financial and sexual health terms were found to be disproportionately marked as spam.
-
#LekkiMassacre: Why Facebook labelled content from October 20 incident ‘false’ AIID ↗
Facebook incorrectly labels content relating to an incident between #EndSARS protestors and the Nigerian army as misinformation.
-
Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers AIID ↗
A study by the University of Toronto, the Vector Institute, and MIT showed the input databases that trained AI systems used to classify chest X-rays led the systems to show gender, socioeconomic, and racial biases.
-
Tesla Disabled “Rolling Stop” Functionality Associated with the “Aggressive” Driving Mode AIID ↗
The “rolling stop” functionality within the “Aggressive” Full Self Driving (FSD) profile that was released via a Tesla firmware update was recalled and disabled.
-
AI attempts to ease fear of robots, blurts out it can’t ‘avoid destroying humankind’ AIID ↗
On September 8, 2020, the Guardian published an op-ed generated by OpenAI’s GPT-3 text generating AI that included threats to destroy humankind. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
-
Tiny Changes Let False Claims About COVID-19, Voting Evade Facebook Fact Checks AIID ↗
Avaaz, an international advocacy group, released a review of Facebook's misinformation identifying software showing that the labeling process failed to label 42% of false information posts, most surrounding COVID-19 and the 2020 USA Presidential Election.
-
Ireland's 2020 Leaving Certificate Calculated-Grades Model Reportedly Issued Incorrect Scores to Thousands of Students AIID ↗
After Covid-19 disrupted the 2020 Leaving Certificate exams, Ireland's Department of Education and Skills used a calculated-grades model to issue student results on September 7. The Department later confirmed coding errors in how the model handled Junior Cycle data, resulting in incorrect grades. About 6,100 students received upgraded results, and college-offer eligibility had to be reassessed.
-
UK passport photo checker shows bias against dark-skinned women AIID ↗
UK passport photo checker shows bias against dark-skinned women.
-
Korean Internet Portal Giant Naver Manipulated Shopping and Video Search Algorithms to Favor In-House Services AIID ↗
The Korean Fair Trade Commission (FTC) imposed a 26.7B KRW on Naver for manipulating shopping and video search algorithms, favoring its own online shopping business to boost its market share.
-
Facebook’s Algorithm Mistook an Advertisement of Onions as Sexual Suggestive Content AIID ↗
Facebook’s content moderation algorithm misidentified and removed a Canadian business’s advertisement containing a photo of onions as products of overtly sexual content, which was later reinstated after review.
-
Amazon’s Robotic Fulfillment Centers Have Higher Serious Injury Rates AIID ↗
Amazon’s robotic fulfillment centers have higher serious injury rates.
-
Suicide Clips Evaded TikTok's Automated Moderation in Coordinated Attack AIID ↗
Many clips showing a suicide evaded TikTok's automated content moderation system allegedly in a coordinated attack, which resulted in exposure of violating content to its users.
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.