MIT AI Risk Repository · Risk Sub-Category · 55.04.01
AI contributes to increased online polarisation
Category: Worsened epistemic processes for society
Description
"One of the most significant commercial uses of current AI systems is in the content recommendation algorithms of social media companies, and there are already concerns that this is contributing to worsened polarisation online"
From A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values (Clarke2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Domain
- 3. Misinformation
- Causal entity
- Human
- Intent
- Unintentional
- Timing
- Post-deployment
Subdomain definition: Highly personalized AI-generated misinformation creating “filter bubbles” where individuals only see what matches their existing beliefs, undermining shared reality, weakening social cohesion and political processes.
Real-world incidents in this subdomain
- Google Books Appears to Be Indexing Works Written by AI
- Uptick in Low-Quality AI-Produced Content Degraded Publishers' Submission Management
- Korean Politician Employed Deepfake as Campaign Representative
- Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach
How other frameworks describe this risk
Other entries from Clarke2023
- Risks from accelerating scientific progress
- Eased development of technologies that make a global catastrophe more likely
- Eased development of technologies that make a global catastrophe more likely
- Faster scientific progress makes it harder for governance to keep pace with development
- Faster scientific progress makes it harder for governance to keep pace with development
- Worsened conflict
- AI enables development of weapons of mass destruction
- AI enables automation of military decision-making
- AI-induced strategic instability
- Resource conflicts driven by AI development
- Increased power concentration and inequality
- Unequal distribution of harms and benefits