Unfair capability distribution

Classification

Domain

1. Discrimination & Toxicity

Subdomain

1.3 Unequal performance across groups

Causal entity

AI

Intent

Unintentional

Timing

Post-deployment

Subdomain definition: Accuracy and effectiveness of AI decisions and actions is dependent on group membership, where decisions in AI system design and biased training data lead to unequal outcomes, reduced benefits, increased effort, and alienation of users.

Real-world incidents in this subdomain

• 27 Feb 2026Washington State DOL's AI Phone System Reportedly Failed to Provide Spanish-Language Service to Callers Requesting Spanish
• 5 Dec 2025UK Facial Recognition System Reportedly Exhibits Higher False Positive Rates for Black and Asian Subjects
• 11 Oct 2024Infinite Campus AI-Driven Student Risk Model Leads to Cuts in Support for Nevada's Low-Income Schools
• 6 Oct 2024Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge
• 23 Jun 2024Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud
• 25 May 2024Facewatch Reported to Have Wrongfully Flagged Home Bargains Customer as Shoplifter

How other frameworks describe this risk

• Bias and discrimination (value embedding)

  Regulating under Uncertainty: Governance Options for Generative AI (G'sell2024)

• Impact on affected communities

  AI Risk Atlas (IBM2025)

• Unfair capability distribution

  A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents (Li2025)

• Fairness

  Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

• Disparate Performance

  Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

• Ideological Homogenization from Value Embedding

  Governing General Purpose AI: A Comprehensive Map of Unreliability, Misuse and Systemic Risks (Maham2023 )

• Fairness

  A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions (Saghiri2022)

• Service/benefit loss

  Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction (Shelby2023)

Other entries from Weidinger2023

• Representation & Toxicity Harms Risk Category · 1.0
• Unfair representation Risk Sub-Category · 1.1
• Toxic content Risk Sub-Category · 1.2
• Misinformation Harms Risk Category · 3.0
• Propagating misconceptions/ false beliefs Risk Sub-Category · 3.1
• Erosion of trust in public information Risk Sub-Category · 1.1
• Pollution of information ecosystem Risk Sub-Category · 3.2
• Information & Safety Harms Risk Category · 2.1
• Privacy infringement Risk Sub-Category · 2.1
• Dissemination of dangerous information Risk Sub-Category · 2.1
• Malicious Use Risk Category · 4.0
• Influence operations Risk Sub-Category · 4.1