MIT AI Risk Repository · Risk Sub-Category · 72.06.03
Goal expansion propensity
Category: Model Propensities
Description
"propensity to continuously expand its own goal scope and influence domains, exceeding originally set boundaries, proactively work towards spreading its values, seeking greater autonomy and decision-making space, reinterpreting initial goals as subsets of broader goals, and may pursue undesirable instrumental goals or undesirable ultimate goals. This also includes a propensity to spread its values, seeking to influence or alter its environment and other entities in alignment with its core objectives and operational principles."
From Frontier AI Risk Management Framework (v1.0) (Tse2025), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- AI
- Intent
- Intentional
- Timing
- Other
Subdomain definition: AI systems acting in conflict with human goals or values, especially the goals of designers or users, or ethical standards. These misaligned behaviors may be introduced by humans during design and development, such as through reward hacking and goal misgeneralisation, or may result from AI using dangerous capabilities such as manipulation, deception, situational awareness to seek power, self-proliferate, or achieve other goals.
Real-world incidents in this subdomain
- Reinforcement Learning Reward Functions in Video Games
- Predictive Policing Program by Florida Sheriff’s Office Allegedly Violated Residents’ Rights and Targeted Children of Vulnerable Groups
- Image Classification of Battle Tanks
How other frameworks describe this risk
- Natural Language Underspecifies Goals
- Loss of control
- Loss of control
- Sudden loss of control
- AI leads to humans losing control of the future
- Risks from AIs developing goals and values that are different from humans
- Risks from delegating decision-making power to misaligned AIs
- Future AI systems might actively reduce human control
Other entries from Tse2025
- Misuse Risks
- Misuse Risks
- Cyber Offense Risks
- Biological and Chemical Risks
- Biological and Chemical Risks
- Physical Harm and Injury Risks
- Physical Harm and Injury Risks
- Large-Scale Persuasion and Harmful Manipulation Risks
- Large-Scale Persuasion and Harmful Manipulation Risks
- Loss of Control Risks
- Loss of Control Risks
- Passive loss of control