MIT AI Risk Repository · Risk Category · 35.05.00
Value lock-in
Description
the most powerful AI systems may be designed by and available to fewer and fewer stakeholders. This may enable, for instance, regimes to enforce narrow values through pervasive surveillance and oppressive censorship
From X-Risk Analysis for AI Research (Hendrycks2022), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Post-deployment
Subdomain definition: AI-driven concentration of power and resources within certain entities or groups, especially those with access to or ownership of powerful AI systems, leading to inequitable distribution of benefits and increased societal inequality.
Real-world incidents in this subdomain
- LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
- Coupang Allegedly Tweaked Search Algorithms to Boost Own Products
- Amazon Allegedly Tweaked Search Algorithm to Boost Its Own Products
- Gmail’s Inbox Sorting System Reportedly Reduced Visibility of Political Emails and Campaign Calls-to-Action
- Google Fined for Changing Shopping Algorithms in EU to Favor Own Service
- Amazon India Allegedly Rigged Search Results to Promote Own Products