Artificial Intelligence Policy Tracker

AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Filter incidents (1 active)

Two-letter code, e.g. US

Reset

243 incidents · page 7 of 10

  1. #140 · 1 report

    University of Toronto's ProctorU Deployment Reportedly Disadvantaged BIPOC Students During Exam Check-Ins AIID ↗

    University of Toronto students reported that ProctorU and other online exam-monitoring services created discriminatory and stressful check-in experiences for BIPOC students during remote exams. One U of T student said ProctorU's identity-verification process often failed to recognize her passport, forcing manual checks and consuming exam check-in time. ProctorU said human proctors made final identity and integrity decisions.

    Deployer: University Of Toronto · Developer: Proctoru · Harmed: University Students, University Of Toronto Students, Students, Educational Communities, Students Of Color

  2. #138 · 6 reports

    University of Illinois' Proctorio Remote-Proctoring Deployment Reportedly Raised Student Rights Concerns AIID ↗

    Beginning in March 2020, the University of Illinois Urbana-Champaign deployed Proctorio for remote exam proctoring after the COVID-19 shift to online instruction. Students and faculty raised concerns that the software surveilled students' homes and devices, created accessibility barriers, increased testing anxiety, and could flag students when facial-detection tools failed to detect their faces, with particular concern for students of color. UIUC later declined to renew its emergency contract.

    Deployer: University Of Illinois Urbana Champaign · Developer: Proctorio · Harmed: Students, University Students, Educational Communities, University Of Illinois Urbana Champaign Students, Students Of Color, Students With Disabilities

  3. #102 · 2 reports

    Personal voice assistants struggle with black voices, new study shows AIID ↗

    A study found that voice recognition tools from Apple, Amazon, Google, IBM, and Microsoft disproportionately made errors when transcribing black speakers.

    Deployer: Microsoft, Ibm, Google, Apple, Amazon · Developer: Microsoft, Ibm, Google, Apple, Amazon · Harmed: Black People

  4. #424 · 4 reports

    Canadian Universities' AI Proctoring Tools Reportedly Collected Student Biometric Data Without Adequate Consent AIID ↗

    During the COVID-19 pandemic, Canadian universities reportedly used AI-enabled remote-proctoring tools for online exams. A University of Ottawa project supported by the Office of the Privacy Commissioner of Canada found that tools such as Respondus Monitor, ProctorU, ProctorTrack, Proctorio, ProctorExam, and Examity collected student personal or biometric data under conditions not conducive to meaningful consent.

    Deployer: Universities, Professors, Educators, Canadian Universities · Developer: Respondus Monitor, Proctoru, Proctortrack, Proctorio, Proctorexam, Examity · Harmed: University Students, Universities, Students, Educational Communities, Canadian Students, Privacy, Biometric Data Subjects

  5. #117 · 4 reports

    TikTok's "Suggested Accounts" Algorithm Allegedly Reinforced Racial Bias through Feedback Loops AIID ↗

    TikTok's "Suggested Accounts" recommendations allegedly reinforced racial bias despite not basing recommendations on race or creators' profile photo.

    Deployer: Tiktok · Developer: Tiktok · Harmed: Tiktok Users, Tiktok Content Creators

  6. #180 · 3 reports

    Algorithm Used by the Malaysian Judiciary Reportedly Recommended Unusually High Sentencing to a Drug Possession Case AIID ↗

    The AI system used by the Malaysian judiciary which explicitly considered age, employment, and socio-economic data provided sentencing to a drug possession case that was alleged by lawyer to be disproportionately high for the crime committed.

    Deployer: Malaysian Judiciary, Malaysian Courts · Developer: Sarawak Information Systems · Harmed: Malaysian Convicted People

  7. #166 · 2 reports

    Networking Platform Giggle Employs AI to Determine Users’ Gender, Allegedly Excluding Transgender Women AIID ↗

    A social networking platform, Giggle, allegedly collected, shared to third-parties, and used sensitive information and biometric data to verify whether a person is a woman via facial recognition, which critics claimed to be discriminatory against women of color and harmful towards trans women.

    Deployer: Giggle · Developer: Kairos · Harmed: Women of color, Women and girls, Women, Trans women, Privacy, Biometric data subjects

  8. #74 · 11 reports

    Detroit Police Allegedly Wrongfully Arrested Black Man Due to Purportedly Faulty Facial Recognition Technology AIID ↗

    A Black man was allegedly wrongfully detained by the Detroit Police Department as a result of a purportedly false facial recognition technology (FRT) result.

    Deployer: Detroit Police Department · Developer: DataWorks Plus · Harmed: Robert Julian-Borchak Williams, Black people in Detroit

  9. #214 · 1 report

    SN Technologies Reportedly Lied to a New York State School District about Its Facial and Weapon Detection Systems’ Performance AIID ↗

    SN Technologies allegedly misled Lockport City Schools about the performance of its AEGIS face and weapons detection systems, downplaying error rates for Black faces and weapon misidentification.

    Deployer: Lockport City School District · Developer: SN Technologies · Harmed: Students, Epistemic integrity, Educational communities, Black students

  10. #417 · 4 reports

    Facebook Feed Algorithms Exposed Low Digitally Skilled Users to More Disturbing Content AIID ↗

    Facebook feed algorithms were known by internal research to have harmed people having low digital literacy by exposing them to disturbing content they did not know how to avoid or monitor.

    Deployer: Facebook · Developer: Facebook · Harmed: Low Digitally Skilled Facebook Users

  11. #92 · 6 reports

    Apple Card's Credit Assessment Algorithm Allegedly Discriminated against Women AIID ↗

    Apple Card's credit assessment algorithm was reported by Goldman-Sachs customers to have shown gender bias, in which men received significantly higher credit limits than women with equal credit qualifications.

    Deployer: Goldman-Sachs · Developer: Apple · Harmed: Women and girls, Women, Apple card users, Apple card credit applicants

  12. #95 · 4 reports

    Job Screening Service Halts Facial Analysis of Applicants AIID ↗

    In January 2021, HireVue removed the controversial AI expression tracking tool from its virtual job interview software.

    Deployer: Hirevue · Developer: Hirevue · Harmed: Job Applicants Using Hirevue, Hirevue Customers

  13. #124 · 7 reports

    Optum Algorithmic Health Risk Scores Reportedly Underestimated Black Patients' Needs AIID ↗

    Researchers analyzing an Optum algorithm used by a large academic hospital reportedly found evidence that it tended to under-predict the health care needs of Black patients, which in turn appeared to result in lower prioritization for extra care programs compared with white patients exhibiting similar health profiles.

    Deployer: unnamed large academic hospital · Developer: Optum · Harmed: Black patients

  14. #189 · 6 reports

    Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities AIID ↗

    People with disabilities were allegedly disproportionately targeted by a benefit fraud detection algorithm which the UK’s Department of Work and Pensions was urged to disclose.

    Deployer: UK Department of Work and Pensions · Developer: UiPath · Harmed: People with disabilities

  15. #272 · 3 reports

    Grab Tweaked Matchmaking Algorithm, Providing Preferential Treatment to Drivers Registered with Affiliated Car Rental Service AIID ↗

    Grab Indonesia was fined by the Indonesian Competition Commission (KPPU) for unfairly favoring drivers who rented cars via the Grab-affiliated company Teknologi Pengangkutan Indonesia (TPI), including offering more rides via their matchmaking algorithm.

    Deployer: Grab · Developer: Grab · Harmed: non-TPI-registered Grab drivers, Grab drivers in Indonesia, Grab drivers

  16. #439 · 3 reports

    Detroit Police Wrongfully Arrested Black Man Due To Faulty Facial Recognition AIID ↗

    A Black man was wrongfully detained by the Detroit Police Department as a result of a false facial recognition (FRT) result.

    Deployer: Detroit Police Department · Developer: DataWorks Plus · Harmed: Michael Oliver, Black people in Detroit, Black people

  17. #386 · 3 reports

    Amazon’s "Time Off Task" System Made False Assumptions about Workers' Time Management AIID ↗

    Amazon’s warehouse worker “time off task" (TOT) tracking system was used to discipline and dismiss workers, falsely assuming workers to have wasted time and failing to account for breaks or equipment issues.

    Deployer: Amazon · Developer: Amazon · Harmed: Amazon warehouse workers

  18. #279 · 3 reports

    TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content AIID ↗

    TikTok’s young users were allegedly exposed to community-guideline-violating pro-eating disorder content on their algorithmically curated “For You” page that serves videos from any user on its platform.

    Deployer: Tiktok · Developer: Tiktok · Harmed: Tiktok Young Users, Tiktok Users

  19. #471 · 8 reports

    Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia AIID ↗

    Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.

    Deployer: Meta, Facebook · Developer: Meta, Facebook · Harmed: Tigrinya Speaking Facebook Users, Facebook Users In Ethiopia, Ethiopian Public, Afaan Oromo Speaking Facebook Users

  20. #489 · 1 report

    Workday's AI Tools Allegedly Enabled Employers to Discriminate against Applicants of Protected Groups AIID ↗

    Workday's algorithmic screening systems were alleged in a lawsuit allowing employers to discriminate against African-Americans, people over 40, and people with disabilities.

    Deployer: Workday · Developer: Workday · Harmed: Derek Mobley, Applicants With Disabilities, Applicants Over 40, African American Applicants

  21. #546 · 3 reports

    Algorithm to Distribute Social Welfare Reported for Oversimplifying Economic Vulnerability AIID ↗

    Takaful cash transfer program's algorithm which ranks families by their economic vulnerability level to determine financial assistance reportedly oversimplified people's economic situation, fueling social tension and perceptions of unfairness.

    Deployer: National Aid Fund · Developer: The World Bank, Unicef, World Food Programme · Harmed: Jordanians In Poverty

  22. #161 · 3 reports

    Facebook's Ad Delivery Reportedly Excluded Audience along Racial and Gender Lines AIID ↗

    Facebook's housing and employment ad delivery process allegedly resulted in skews in exposure for some users along demographic lines such as gender and racial identity.

    Deployer: Meta · Developer: Meta · Harmed: Women and girls, Women, Social media users, Facebook users, Black Facebook users

  23. #89 · 1 report

    The Christchurch shooter and YouTube’s radicalization trap AIID ↗

    A New Zealand government report released following a right-wing terrorist killing 51 worshippers at two New Zealand mosques which indicated that Youtube's recommendation algorithm played an important role in the terrorist's radicalization.

    Deployer: Youtube · Developer: Youtube · Harmed: Youtube Users

  24. #281 · 3 reports

    YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm AIID ↗

    Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.

    Deployer: Youtube · Developer: Youtube · Harmed: Youtube Young Users, Youtube Users

  25. #288 · 4 reports

    New Jersey Police Wrongful Arrested Innocent Black Man via FRT AIID ↗

    Woodbridge Police Department falsely arrested an innocent Black man following a misidentification by their facial recognition software, who was jailed for more than a week and paid thousands of dollar for his defense.

    Deployer: Woodbridge Police Department · Developer: Unknown · Harmed: Nijeer Parks

Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.

Frequently asked questions

What is recorded in each incident?

What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.

Does an incident mean wrongdoing was proven?

No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.

How current is the incident data?

It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.

Does this page include the full incident reports?

No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.