MIT AI Risk Repository · Risk Sub-Category · 19.04.05
Decreasing human interaction as AI systems assume human tasks, disturbing well-being
Category: Social AI Risks
Description
—
From Governance of artificial intelligence: A risk and guideline-based integrative framework (Wirtz2022), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Subdomain
- 5.1 Overreliance and unsafe use
- Causal entity
- Other
- Intent
- Unintentional
- Timing
- Post-deployment
Subdomain definition: Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.
Real-world incidents in this subdomain
- Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats
- Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
- Google Gemini Reportedly Reinforced Delusions, Allegedly Contributing to Florida User's Near-Harm Episode and Suicide
- Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death
- Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension
- ChatGPT Allegedly Reinforced Delusions Before Greenwich, Connecticut Murder-Suicide
How other frameworks describe this risk
Other entries from Wirtz2022
- Technological, Data and Analytical AI Risks
- Loss of control of autonomous systems and unforeseen behaviour due to lack of transparency and self-programming/ reprogramming
- Programming error
- Lack of data, poor data quality, and biases in training data
- Vulnerability of AI systems to attacks and misuse
- Lack of AI experts with comprehensive AI knowledge
- Immaturity of AI technology can cause incorrect decisions
- High investment costs of AI hinder integration
- Informational and Communicational AI Risks
- Manipulation and control of information provision (e.g., personalised adds, filtered news)
- Disinformation and computational propaganda
- Censorship of opinions expressed in the Internet restricts freedom of expression