MIT AI Risk Repository · Risk Category · 55.04.00
Worsened epistemic processes for society
Description
"Epistemic processes and problem solving: we currently see more reasons to be concerned about AI worsening society's epistemic processes than reasons to be optimistic about AI helping us better solve problems as a society. For example, increased use of content selection algorithms could drive epistemic insularity and a decline in trust in credible multipartisan sources, which reducing our ability to deal with important long-term threats and challenges such as pandemics and climate change."
From A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values (Clarke2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Domain
- 3. Misinformation
- Causal entity
- Human
- Intent
- Unintentional
- Timing
- Post-deployment
Subdomain definition: Highly personalized AI-generated misinformation creating “filter bubbles” where individuals only see what matches their existing beliefs, undermining shared reality, weakening social cohesion and political processes.
Real-world incidents in this subdomain
- Google Books Appears to Be Indexing Works Written by AI
- Uptick in Low-Quality AI-Produced Content Degraded Publishers' Submission Management
- Korean Politician Employed Deepfake as Campaign Representative
- Facebook Political Ad Delivery Algorithms Inferred Users' Political Alignment, Inhibiting Political Campaigns' Reach
How other frameworks describe this risk
Other entries from Clarke2023
- Risks from accelerating scientific progress
- Eased development of technologies that make a global catastrophe more likely
- Eased development of technologies that make a global catastrophe more likely
- Faster scientific progress makes it harder for governance to keep pace with development
- Faster scientific progress makes it harder for governance to keep pace with development
- Worsened conflict
- AI enables development of weapons of mass destruction
- AI enables automation of military decision-making
- AI-induced strategic instability
- Resource conflicts driven by AI development
- Increased power concentration and inequality
- Unequal distribution of harms and benefits