Browse AI incidents

3 incidents

1. 3 Jun 2022

   #290 · 3 reports

   False Negatives for Water Quality-Associated Beach Closures AIID ↗

   Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.

   Deployer: Toronto City Government · Developer: Toronto Public Health · Harmed: Sunnyside Beachgoers, Marie Curtis Beachgoers, Toronto Citizens

   AI system safety, failures, an... Lack of capability or robustness AI tangible harm near-miss CA
2. 1 Jun 2020

   #140 · 1 report

   University of Toronto's ProctorU Deployment Reportedly Disadvantaged BIPOC Students During Exam Check-Ins AIID ↗

   University of Toronto students reported that ProctorU and other online exam-monitoring services created discriminatory and stressful check-in experiences for BIPOC students during remote exams. One U of T student said ProctorU's identity-verification process often failed to recognize her passport, forcing manual checks and consuming exam check-in time. ProctorU said human proctors made final identity and integrity decisions.

   Deployer: University Of Toronto · Developer: Proctoru · Harmed: University Students, University Of Toronto Students, Students, Educational Communities, Students Of Color

   Discrimination and Toxicity Unequal performance across groups none CA
3. 25 Jan 2018

   #63 · 1 report

   Google Photo Merge Decapitates Subject AIID ↗

   Google Photos' AI Assistant created a strange hybrid photograph when merging three different pictures from a ski trip.

   Deployer: Google · Developer: Google · Harmed: Alex Harker

   AI system safety, failures, an... Lack of capability or robustness none CA

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.