Capabilities that could be used to reduce human control - Autonomous replication and adaptation

Classification

Domain

7. AI system safety, failures, & limitations

Subdomain

7.2 AI possessing dangerous capabilities

Causal entity

AI

Intent

Other

Timing

Other

Subdomain definition: AI systems that develop, access, or are provided with capabilities that increase their potential to cause mass harm through deception, weapons development and acquisition, persuasion and manipulation, political strategy, cyber-offense, AI development, situational awareness, and self-proliferation. These capabilities may cause mass harm due to malicious human actors, misaligned AI systems, or failure in the AI system.

How other frameworks describe this risk

• Goal-Directedness Incentivizes Undesirable Behaviors

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Safety Risks from Affordances Provided to LLM-agents

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Agentic LLMs Pose Novel Risks

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Subagents

  AGI Safety Literature Review (Everitt2018 )

• Nascent capabilities (emergent capabilities)

  Regulating under Uncertainty: Governance Options for Generative AI (G'sell2024)

• Nascent capabilities (agency and autonomy)

  Regulating under Uncertainty: Governance Options for Generative AI (G'sell2024)

• Artificial general intelligence (existential risk posed by Artificial General Intelligence)

  Regulating under Uncertainty: Governance Options for Generative AI (G'sell2025)

• Agency and autonomy

  Future Risks of Frontier AI (GOS2023)

Other entries from DSIT2023

• Societal harms Risk Category
• Degradation of the information environment Risk Sub-Category · 3.2
• Degradation of the information environment Additional evidence
• Degradation of the information environment Additional evidence
• Degradation of the information environment Additional evidence
• Degradation of the information environment Additional evidence
• Labour market disruption Risk Sub-Category · 6.2
• Labour market disruption Additional evidence
• Bias, Fairness and Representational Harms Risk Category · 1.1
• Bias, Fairness and Representational Harms Additional evidence
• Bias, Fairness and Representational Harms Additional evidence
• Bias, Fairness and Representational Harms Additional evidence