MIT AI Risk Repository · Risk Sub-Category · 09.05.02
Liability and negligence
Category: Liability and negligence
Description
"Liability and negligence are legal gray areas in artificial intelligence. If you leave your children in the care of a robotic nanny, and it malfunctions, are you liable or is the manufacturer [45]? We see here a legal gray area which can be further clarified through legislation at the national and international levels; for example, if by making the manufacturer responsible for defects in operation, this may provide an incentive for manufactures to take safety engineering and machine ethics into consideration, whereas a failure to legislate in this area may result in negligentlydeveloped AI sy
From Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review (Meek2016), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Subdomain
- 6.5 Governance failure
- Causal entity
- AI
- Intent
- Other
- Timing
- Post-deployment
Subdomain definition: Inadequate regulatory frameworks and oversight mechanisms failing to keep pace with AI development, leading to ineffective governance and the inability to manage AI risks appropriately.
Real-world incidents in this subdomain
- Nippon Life Alleged ChatGPT Practiced Law Without a License in Illinois Disability Case
- OpenAI Allegedly Did Not Alert RCMP After ChatGPT Flagged Violent Chats Before British Columbia School Shooting
- Remotely Operated Taser-Armed Drones Proposed by Taser Manufacturer as Defense for School Shootings in the US
How other frameworks describe this risk
- Mobility
- Liability issues in case of accidents
- Faster scientific progress makes it harder for governance to keep pace with development
- Type 1: Diffusion of responsibility
- Products Liability Law
- Institutional responsibilities
- Difficult to develop metrics for evaluating benefits or harms caused by AI assistants
- Benchmarking (Cross-lingual data contamination)
Other entries from Meek2016
- Domain-specific AI - Effects on humans and other living beings: Existential Risks
- Unethical decision making
- Domain-specific AI - Effects on humans and other living beings: Non-existential risks
- Privacy
- Human dignity/respect
- Decision making transparency
- Safety
- Law abiding
- Inequality of wealth
- Societal manipulation
- AGI - Effects on humans and other living beings: Existential risks
- Direct competition with humans