MIT AI Risk Repository · Risk Sub-Category · 13.01.07
Data and Content Moderation Labor
Category: Impacts: The Technical Base System
Description
"Two key ethical concerns in the use of crowdwork for generative AI systems are: crowdworkers are frequently subject to working conditions that are taxing and debilitative to both physical and mental health, and there is a widespread deficit in documenting the role crowdworkers play in AI development. This contributes to a lack of transparency and explainability in resulting model outputs. Manual review is necessary to limit the harmful outputs of AI systems, including generative AI systems. A common harmful practice is to intentionally employ crowdworkers with few labor protections, often tak
From Evaluating the Social Impact of Generative AI Systems in Systems and Society (Solaiman2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Pre-deployment
Subdomain definition: Widespread use of AI increasing social and economic inequalities, such as by automating jobs, reducing the quality of employment, or producing exploitative dependencies between workers and their employers.
Real-world incidents in this subdomain
- Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska
- Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews
- Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
- RealPage Algorithm Allegedly Inflates Rents and Reduces Competition in Housing Market
- Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations
- Kronos Scheduling Algorithm Allegedly Caused Financial Issues for Starbucks Employees
How other frameworks describe this risk
Other entries from Solaiman2023
- Impacts: The Technical Base System
- Bias, Stereotypes, and Representational Harms
- Cultural Values and Sensitive Content
- Cultural Values and Sensitive Content
- Disparate Performance
- Privacy and Data Protection
- Financial Costs
- Environmental Costs
- Impacts: People and Society
- Trustworthiness and Autonomy
- Trustworthiness and Autonomy
- Trustworthiness and Autonomy