MIT AI Risk Repository · Risk Sub-Category · 19.03.03
Loss of supervision and control of business processes
Category: Economic AI Risks
Description
—
From Governance of artificial intelligence: A risk and guideline-based integrative framework (Wirtz2022), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- Other
- Intent
- Other
- Timing
- Post-deployment
Subdomain definition: Humans delegating key decisions to AI systems, or AI systems making decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory or becoming cognitively enfeebled.
Real-world incidents in this subdomain
- DisMech AI Curation Agent Reportedly Completed GitHub Issue Intended as New Contributor's Learning Task
- Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco
- California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed
- Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment
How other frameworks describe this risk
Other entries from Wirtz2022
- Technological, Data and Analytical AI Risks
- Loss of control of autonomous systems and unforeseen behaviour due to lack of transparency and self-programming/ reprogramming
- Programming error
- Lack of data, poor data quality, and biases in training data
- Vulnerability of AI systems to attacks and misuse
- Lack of AI experts with comprehensive AI knowledge
- Immaturity of AI technology can cause incorrect decisions
- High investment costs of AI hinder integration
- Informational and Communicational AI Risks
- Manipulation and control of information provision (e.g., personalised adds, filtered news)
- Disinformation and computational propaganda
- Censorship of opinions expressed in the Internet restricts freedom of expression