Browse AI incidents

6 incidents

1. 16 Jul 2021

   #126 · 3 reports

   Three Robots Collided, Sparking Fire in a Grocer's Warehouse in UK AIID ↗

   A collision involving three robots at an Ocado's warehouse in Erith, UK, resulting in a fire but no reports of injuries.

   Deployer: Ocado · Developer: Ocado · Harmed: Ocado

   AI system safety, failures, an... Lack of capability or robustness none GB
2. 24 Oct 2020

   #80 · 2 reports

   AI mistakes referee’s bald head for football — hilarity ensued AIID ↗

   In a Scottish soccer match the AI-enabled ball-tracking camera used to livestream the game repeatedly tracked an official’s bald head as though it were the soccer ball.

   Deployer: Inverness Caledonian Thistle Football Club · Developer: Unknown · Harmed: Livestream Viewers

   AI system safety, failures, an... Lack of capability or robustness none GB
3. 7 Oct 2020

   #87 · 1 report

   UK passport photo checker shows bias against dark-skinned women AIID ↗

   UK passport photo checker shows bias against dark-skinned women.

   Deployer: UK Home Office, Government of the United Kingdom · Developer: UK Home Office, Government of the United Kingdom · Harmed: Women and girls, Women, dark-skinned women, dark-skinned people

   Discrimination and Toxicity Unequal performance across groups none GB
4. 22 Jan 2018

   #64 · 1 report

   Customer Service Robot Scares Away Customers AIID ↗

   Heriot-Watt Univeristy in Scotland developed an artificially intelligent grocery store robot, Fabio, who provided unhelpful answers to customer's questions and "scared away" multiple customers, according to the grocery store Margiotta.

   Deployer: Heriot Watt University, Margiotta · Developer: Heriot Watt University · Harmed: Store Patrons

   AI system safety, failures, an... Lack of capability or robustness none GB
5. 1 Jan 2014

   #162 · 1 report

   ETS Used Allegedly Flawed Voice Recognition Evidence to Accuse and Assess Scale of Cheating, Causing Thousands to be Deported from the UK AIID ↗

   International testing organization ETS admits voice recognition as evidence of cheating for thousands of previous TOEIC test-takers that reportedly included wrongfully accused people, causing them to be deported without an appeal process or seeing their incriminating evidence.

   Deployer: ETS · Developer: ETS · Harmed: UK Home Office, UK ETS test takers, UK ETS past test takers

   AI system safety, failures, an... Lack of capability or robustness AI tangible harm event GB
6. 5 Mar 1998

   #43 · 4 reports

   St George's Hospital Medical School allegedly Automated Admissions with Discriminatory Results AIID ↗

   From 1982 to 1986, St George's Hospital Medical School used a program to automate a portion of their admissions process that allegedly discriminated against women and members of ethnic minorities.

   Deployer: St George's Hospital Medical School · Developer: Geoffrey Franglen · Harmed: Women and girls, Women, Minority groups

   Discrimination and Toxicity Unfair discrimination and misrepre... none GB

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.