AI incident #450 ·
Kenyan Data Annotators Allegedly Exposed to Graphic Content for OpenAI's AI
What happened
Sama AI's Kenyan contractors were reportedly asked with excessively low pay to annotate a large volume of disturbing content to improve OpenAI's generative AI systems such as ChatGPT, and whose contract was terminated prior to completion by Sama AI.
Only the incident metadata is stored here. The underlying news reports are on the AI Incident Database (CC BY-SA 4.0); use the links above to read them.
News reports (8)
Coverage catalogued by the AI Incident Database. Titles link to the original publisher; the text is not reproduced here.
Who was involved
- Alleged deployer
- Openai
- Alleged developer
- Openai, Chatbot Developers, Large Language Model Developers
- Alleged harmed party
- Sama, Employees Of Sama, Data Annotators
Classification (MIT AI Risk Repository taxonomy)
- Risk domain
- Socioeconomic & Environmental Harms
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Pre-deployment
- Harm level
- —
- Sectors
- —
- Countries
- —
Risk entries describing this failure mode
Entries from the MIT AI Risk Repository coded to subdomain 6.2.
- Job loss/losses
"Job loss/losses - Replacement/displacement of human jobs by a technology system, leading to increased unemployment, inequality, reduced consumer spending, and social friction."
- Societal destabilisation
"Societal destabilisation - Societal instability in the form of strikes, demonstrations and other types of civil unrest caused by loss of jobs to technology, unfair algorithmic outcomes, disinformation, etc."
- Societal inequality
"Societal inequality - Increased difference in social status or wealth between individuals or groups caused or amplified by a technology system, leading to the loss of social and community wellbeing/cohesion and destabil...
- Labour exploitation
"Labour exploitation - Use of under-paid and/or offshore labour to develop, manage or optimise a technology system."
- Political instability
"Political instability - Political polarisation or unrest caused by increased inequality, job losses, over- dependence on technology making societies vulnerable to systemic failures, etc, arising from or amplified by the...
- Increased income disparity
"While AI is predicted to bring increased GDP per capita by performing existing jobs more efficiently and compensating for a decline in the workforce, especially due to population aging, the potential substitution of man...
- Economic
"AI is predicted to bring increased GDP per capita by performing existing jobs more efficiently and compensating for a decline in the workforce, especially due to population aging, the potential substitution of many low-...
- Effects on the Workforce
"Rapid advances in LLMs pose three distinct sets of challenges for workers’ incomes (Korinek and Stiglitz, 2019; Susskind, 2023). First, they are likely to accelerate the rate of job turnover and disruption —– affecting...
Incidents in the same risk subdomain
- Polish Radio Station Replaces Human Hosts with AI-Generated Presenters to Simulate Interviewing Deceased Poet Wisława Szymborska
- Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews
- RealPage Algorithm Allegedly Inflates Rents and Reduces Competition in Housing Market
- Amazon Flex Drivers Allegedly Fired via Automated Employee Evaluations
- Kronos Scheduling Algorithm Allegedly Caused Financial Issues for Starbucks Employees
Other incidents involving Openai
- Nippon Life Alleged ChatGPT Practiced Law Without a License in Illinois Disability Case
- ChatGPT Reportedly Found to Reproduce Protected German Lyrics in Copyright Case
- Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad
- Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats
- Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions