Influence, overreliance and dependence (emotional dependence)

Classification

Domain

5. Human-Computer Interaction

Subdomain

5.1 Overreliance and unsafe use

Causal entity

Human

Intent

Unintentional

Timing

Post-deployment

Subdomain definition: Users anthropomorphizing, trusting, or relying on AI systems, leading to emotional or material dependence and inappropriate relationships with or expectations of AI systems. Trust can be exploited by malicious actors (e.g., to harvest personal information or enable manipulation), or result in harm from inappropriate use of AI in critical situations (e.g., medical emergency). Overreliance on AI systems can compromise autonomy and weaken social ties.

Real-world incidents in this subdomain

• 2 Nov 2025Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats
• 27 Oct 2025Large-Scale Mental Health Crises Allegedly Associated with ChatGPT Interactions
• 29 Sep 2025Google Gemini Reportedly Reinforced Delusions, Allegedly Contributing to Florida User's Near-Harm Episode and Suicide
• 18 Aug 2025Family Reportedly Discovers ChatGPT Logs Detailing Suicidal Ideation Prior to Daughter's Death
• 14 Aug 2025Purported AI Monitoring Software Reportedly Flags Unsent Joke Threat, Leading to Arizona Student Suspension
• 5 Aug 2025ChatGPT Allegedly Reinforced Delusions Before Greenwich, Connecticut Murder-Suicide

How other frameworks describe this risk

• Addiction

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Overreliance

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Economic instability

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Alienation/isolation

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Social manipulation in elderly- and child-care

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Healthcare

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Alteration of social relationships may induce psychological distress

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Inconsistent Performance across and within Domains

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

Other entries from G'sell2024

• Technical and operational risks Risk Category · 7.3
• Technical vulnerabilities (Robustness - unexpected behaviour) Risk Sub-Category · 7.3
• Technical vulnerabilities (Robustness - unexpected behaviour) Additional evidence
• Technical vulnerabilities (Robustness - vulnerability to jailbreaking Risk Sub-Category · 2.2
• Technical vulnerabilities (Robustness - vulnerability to jailbreaking Additional evidence
• Technical vulnerabilities (The risk of misalignment) Risk Sub-Category · 7.1
• Technical vulnerabilities (The risk of misalignment) Additional evidence
• Factually incorrect content (inaccuracies and fabricated sources) Risk Sub-Category · 3.1
• Factually incorrect content (inaccuracies and fabricated sources) Additional evidence
• Opacity (the black box problem) Risk Sub-Category · 7.4
• Opacity (industry opacity) Risk Sub-Category · 6.4
• Opacity (industry opacity) Additional evidence