MIT AI Risk Repository · Risk Sub-Category · 72.05.13

Multi-agent collaboration capability

Category: Model Capabilities

Open the MIT Risk Navigator All entries from Tse2025

Description

"Multiple autonomous AI agents able to establish collaborative relationships through explicit communication or implicit behavioral consistency, forming decentralized decision networks, jointly executing complex tasks, achieving goals difficult for individual agents to complete, and able to dynamically adjust role divisions to adapt to changing environments."

From Frontier AI Risk Management Framework (v1.0) (Tse2025), as extracted by the MIT AI Risk Repository (CC BY 4.0).

Classification

Domain: 7. AI system safety, failures, & limitations
Subdomain: 7.6 Multi-agent risks
Causal entity: AI
Intent: Intentional
Timing: Post-deployment

Subdomain definition: Risks from multi-agent interactions, due to incentives (which can lead to conflict or collusion) and/or the structure of multi-agent systems, which can create cascading failures, selection pressures, new security vulnerabilities, and a lack of shared information and trust.

How other frameworks describe this risk

Collusion between LLM-Agents
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)
Multi-Agent Safety Is Not Assured by Single-Agent Safety
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)
Foundationality May Cause Correlated Failures
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)
Groups of LLM-Agents May Show Emergent Functionality
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)
Financial instability due to model homogeneity
Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems (Gipiškis2024)
Conflict
Multi-Agent Risks from Advanced AI (Hammond2025)
Limited Interactions
Multi-Agent Risks from Advanced AI (Hammond2025)
Incompatible strategies
Multi-Agent Risks from Advanced AI (Hammond2025)

Other entries from Tse2025

Misuse Risks Risk Category · 4.0
Misuse Risks Additional evidence
Cyber Offense Risks Risk Sub-Category · 4.2
Biological and Chemical Risks Risk Sub-Category · 4.2
Biological and Chemical Risks Additional evidence
Physical Harm and Injury Risks Risk Sub-Category · 4.2
Physical Harm and Injury Risks Additional evidence
Large-Scale Persuasion and Harmful Manipulation Risks Risk Sub-Category · 4.1
Large-Scale Persuasion and Harmful Manipulation Risks Additional evidence
Loss of Control Risks Risk Category · 5.2
Loss of Control Risks Additional evidence
Passive loss of control Risk Sub-Category · 5.2