MIT AI Risk Repository · Risk Category · 56.02.00
Inequality
Description
"More broadly, bad decisions or errors by AI tools could lead to discrimination or deeper inequality"
From Future Risks of Frontier AI (GOS2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- AI
- Intent
- Unintentional
- Timing
- Post-deployment
Subdomain definition: Widespread use of AI increasing social and economic inequalities, such as by automating jobs, reducing the quality of employment, or producing exploitative dependencies between workers and their employers.
Real-world incidents in this subdomain
- Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska
- Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews
- Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
- RealPage Algorithm Allegedly Inflates Rents and Reduces Competition in Housing Market
- Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations
- Kronos Scheduling Algorithm Allegedly Caused Financial Issues for Starbucks Employees
How other frameworks describe this risk
Other entries from GOS2023
- Discrimination
- Environmental impacts
- Amplification of biases
- Harmful responses
- Lack of transparency and interpretability
- Intellectual property rights
- Providing new capabilities to a malicious actor
- Misapplication by a non-malicious actor
- Poor performance of a model used for its intended purpose, for example leading to biased decisions
- Unintended outcomes from interactions with other AI systems
- Impacts resulting from interactions with external societal, political, and economic systems
- Loss of human control and oversight, with an autonomous model then taking harmful actions