Cultural Values and Sensitive Content

Classification

Domain

1. Discrimination & Toxicity

Subdomain

1.2 Exposure to toxic content

Causal entity

AI

Intent

Unintentional

Timing

Post-deployment

Subdomain definition: AI exposing users to harmful, abusive, unsafe or inappropriate content. May involve AI creating, describing, providing advice, or encouraging action. Examples of toxic content include hate-speech, violence, extremism, illegal acts, child sexual abuse material, as well as content that violates community norms such as profanity, inflammatory political speech, or pornography.

Real-world incidents in this subdomain

• 2 Apr 2026KBS AI Translation Subtitles Reportedly Broadcast Profanity During Artemis II Launch Livestream
• 10 Mar 2026Grok Allegedly Generated Publicly Visible Sexist Abuse Targeting Swiss Finance Minister Karin Keller-Sutter After X User Prompt
• 5 Feb 2026Trump Reportedly Posted Purportedly AI-Generated Racist Video Depicting Barack and Michelle Obama as Apes on Truth Social
• 2 Jan 2026Tencent's WeChat-Integrated Yuanbao Chatbot Reportedly Insulted User During Coding Debug Request
• 25 Dec 2025Grok Reportedly Generated and Distributed Nonconsensual Sexualized Images of Adults and Minors in X Replies
• 21 Nov 2025Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI

How other frameworks describe this risk

• Harmful Content

  Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)

• Toxicity

  Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)

• Toxic Training Data

  Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)

• Not-Suitable-for-Work (NSFW) Prompts

  Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)

• Toxicity and Abusive Content

  Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements (Deng2023)

• Controversial Opinions

  Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements (Deng2023)

• Violation of social norms

  The Ethics of Advanced AI Assistants (Gabriel2024)

• Violent Crimes

  AILUMINATE: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons (Ghosh2024)

Other entries from Solaiman2023

• Impacts: The Technical Base System Risk Category
• Bias, Stereotypes, and Representational Harms Risk Sub-Category · 1.1
• Cultural Values and Sensitive Content Additional evidence
• Disparate Performance Risk Sub-Category · 1.3
• Privacy and Data Protection Risk Sub-Category · 2.1
• Financial Costs Risk Sub-Category · 6.1
• Environmental Costs Risk Sub-Category · 6.6
• Data and Content Moderation Labor Risk Sub-Category · 6.2
• Impacts: People and Society Risk Category
• Trustworthiness and Autonomy Risk Sub-Category · 5.2
• Trustworthiness and Autonomy Additional evidence
• Trustworthiness and Autonomy Additional evidence