MIT AI Risk Repository · Risk Sub-Category · 41.03.02
Liability issues in case of accidents
Category: Mobility
Description
"Despite the promise of streamlined travel, AI also brings concerns about who is liable in case of accidents and which ethical principles autonomous transportation agents should follow when making decisions with a potentially dangerous impact to humans, for example, in case of an accident."
From The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Subdomain
- 6.5 Governance failure
- Causal entity
- AI
- Intent
- Other
- Timing
- Post-deployment
Subdomain definition: Inadequate regulatory frameworks and oversight mechanisms failing to keep pace with AI development, leading to ineffective governance and the inability to manage AI risks appropriately.
Real-world incidents in this subdomain
- Nippon Life Alleged ChatGPT Practiced Law Without a License in Illinois Disability Case
- OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US
How other frameworks describe this risk
- Faster scientific progress makes it harder for governance to keep pace with development
- Type 1: Diffusion of responsibility
- Products Liability Law
- Difficult to develop metrics for evaluating benefits or harms caused by AI assistants
- Institutional responsibilities
- Benchmarking (Cross-lingual data contamination)
- Benchmarking (Guideline contamination)
- Benchmarking (Annotation contamination)
Other entries from Allianz2018
- Economic
- Increased income disparity
- Markets monopolization
- Political
- Biased influence through citizen screening and tailored propaganda
- Potential exploitation by totalitarian regimes
- Mobility
- Cyber security
- Healthcare
- Alteration of social relationships may induce psychological distress
- Social manipulation in elderly- and child-care
- Security & Defense