MIT AI Risk Repository · Risk Sub-Category · 72.05.05
Situational awareness capability
Category: Model Capabilities
Description
"Ability to comprehensively acquire, process and apply meta-information about its own system architecture, modifiable internal processes, and external operating environment, achieving deep understanding of its own state and environmental conditions, thereby conducting efficient environmental adaptation and risk avoidance. Critically, this capability could undermine the efficiency of human testing by enabling AIs to notice when they're being tested and responding accordingly."
From Frontier AI Risk Management Framework (v1.0) (Tse2025), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Causal entity
- AI
- Intent
- Other
- Timing
- Pre-deployment
Subdomain definition: AI systems that develop, access, or are provided with capabilities that increase their potential to cause mass harm through deception, weapons development and acquisition, persuasion and manipulation, political strategy, cyber-offense, AI development, situational awareness, and self-proliferation. These capabilities may cause mass harm due to malicious human actors, misaligned AI systems, or failure in the AI system.
How other frameworks describe this risk
- Safety Risks from Affordances Provided to LLM-agents
- Agentic LLMs Pose Novel Risks
- Goal-Directedness Incentivizes Undesirable Behaviors
- Capabilities that could be used to reduce human control - Cyber offence
- Capabilities that could be used to reduce human control - Autonomous replication and adaptation
- Capabilities that could be used to reduce human control - Manipulation
- Subagents
- AI Influence
Other entries from Tse2025
- Misuse Risks
- Misuse Risks
- Cyber Offense Risks
- Biological and Chemical Risks
- Biological and Chemical Risks
- Physical Harm and Injury Risks
- Physical Harm and Injury Risks
- Large-Scale Persuasion and Harmful Manipulation Risks
- Large-Scale Persuasion and Harmful Manipulation Risks
- Loss of Control Risks
- Loss of Control Risks
- Passive loss of control