MIT AI Risk Repository · Risk Sub-Category · 58.06.03
Discrimination
Category: Human rights and civil liberties
Description
"Discrimination - Unfair or inadequate treatment or arbitrary distinction based on a person’s race, ethnicity, age, gender, sexual preference, religion, national origin, marital status, disability, language, or other protected groups."
From A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Other
- Intent
- Other
- Timing
- Post-deployment
Subdomain definition: Unequal treatment of individuals or groups by AI, often based on race, gender, or other sensitive characteristics, resulting in unfair outcomes and representation of those groups.
Real-world incidents in this subdomain
- DOGE Reportedly Relied on Unvetted ChatGPT Outputs in Canceling National Endowment for the Humanities Grants
- Sora Video Generator Has Reportedly Been Creating Biased Human Representations Across Race, Gender, and Disability
- Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
- Alleged AI-Generated Photo Alteration Leads to Inappropriate Modifications in Speaker's Conference Picture
- Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups
- Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers
How other frameworks describe this risk
Other entries from Abercrombie2024
- Autonomy
- Autonomy/agency loss
- Impersonation/identity theft
- IP/copyright loss
- Personality rights loss
- Physical
- Bodily Injury
- Loss of Life
- Personal Health Deterioration
- Property Damage
- "Psychological - Direct or indirect impairment of the emotional and psychological mental health of an individual, organisation, or society."
- Addiction