Direct catastrophe from AI

Classification

Domain

—

Subdomain

—

Causal entity

AI

Intent

Other

Timing

Other

Other entries from Maas2023

• Alignment failures in existing ML systems Risk Category · 7.1
• Faulty reward functions in the wild Risk Sub-Category · 7.1
• Specification gaming Risk Sub-Category · 7.1
• Reward model overoptimization Risk Sub-Category · 7.1
• Instrumental convergence Risk Sub-Category · 7.1
• Goal misgeneralization Risk Sub-Category · 7.1
• Inner misalignment Risk Sub-Category · 7.1
• Language model misalignment Risk Sub-Category · 7.1
• Harms from increasingly agentic algorithmic systems Risk Sub-Category · 7.2
• Dangerous capabilities in AI systems Risk Category · 7.2
• Situational awareness Risk Sub-Category · 7.2
• Acquisition of a goal to harm society Risk Sub-Category · 4.2