MIT AI Risk Repository · Risk Sub-Category · 52.03.02
Ideological Homogenization from Value Embedding
Category: Systemic Risks
Description
"The increasing integration of general purpose AI models into every-day life raises concerns around their embedded normative values. The reach of a small number of AI models to a large number of people around the world can make these value judgements unprecedently impactful, potentially leading to increased ideological homogenization."
From Governing General Purpose AI: A Comprehensive Map of Unreliability, Misuse and Systemic Risks (Maham2023 ), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Pre-deployment
Subdomain definition: Accuracy and effectiveness of AI decisions and actions is dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.
Real-world incidents in this subdomain
- Washington State DOL's AI Phone System Reportedly Failed to Provide Spanish-Language Service to Callers Requesting Spanish
- UK Facial Recognition System Reportedly Exhibits Higher False Positive Rates for Black and Asian Subjects
- Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools
- Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge
- Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud
- Facewatch Reported to Have Wrongfully Flagged Home Bargains Customer as Shoplifter
How other frameworks describe this risk
Other entries from Maham2023
- Risks from Unreliability
- Discrimination and Stereotype Reproduction
- Discrimination and Stereotype Reproduction
- Discrimination and Stereotype Reproduction
- Misinformation and Privacy Violations
- Misinformation and Privacy Violations
- Misinformation and Privacy Violations
- Accidents
- Accidents
- Accidents
- Accidents
- Accidents