MIT AI Risk Repository · Risk Sub-Category · 13.02.01
Trustworthiness and Autonomy
Category: Impacts: People and Society
Description
"Human trust in systems, institutions, and people represented by system outputs evolves as generative AI systems are increasingly embedded in daily life."
From Evaluating the Social Impact of Generative AI Systems in Systems and Society (Solaiman2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Human
- Intent
- Other
- Timing
- Post-deployment
Subdomain definition: Humans delegating key decisions to AI systems, or AI systems making decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory or becoming cognitively enfeebled.
Real-world incidents in this subdomain
- DisMech AI Curation Agent Reportedly Completed GitHub Issue Intended as New Contributor's Learning Task
- Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco
- California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed
- Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment
How other frameworks describe this risk
Other entries from Solaiman2023
- Impacts: The Technical Base System
- Bias, Stereotypes, and Representational Harms
- Cultural Values and Sensitive Content
- Cultural Values and Sensitive Content
- Disparate Performance
- Privacy and Data Protection
- Financial Costs
- Environmental Costs
- Data and Content Moderation Labor
- Impacts: People and Society
- Trustworthiness and Autonomy
- Trustworthiness and Autonomy