Large-Scale Persuasion and Harmful Manipulation Risks

Classification

Domain

4. Malicious actors

Subdomain

4.1 Disinformation, surveillance, and influence at scale

Causal entity

Human

Intent

Intentional

Timing

Post-deployment

Subdomain definition: Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim to manipulate political processes, public opinion and behavior.

Real-world incidents in this subdomain

• 28 Apr 2026Suspected AI-Generated Deepfake Video Reportedly Targeted Former Chhattisgarh Chief Minister Bhupesh Baghel on Instagram
• 28 Feb 2026Purportedly AI-Manipulated Satellite Image Reportedly Claimed Iranian Strike Destroyed U.S. Radar in Qatar
• 28 Feb 2026Purported AI-Generated War Footage Reportedly Circulated Widely Online During the Opening Phase of the War in Iran
• 22 Feb 2026Network of Allegedly Fake Facebook Profiles with Purportedly AI-Generated Images Amplified Posts by Bulgaria's 'There Is Such a People' (ITN) Party
• 7 Feb 2026Purportedly AI-Generated Image Reportedly Circulated Ahead of Thai Election Depicting PM Anutin Charnvirakul Dining with Benjamin Mauerberger
• 24 Jan 2026Purportedly AI-Altered Images Reportedly Distort Evidence After Minneapolis Shooting of ICU Nurse Alex Pretti

How other frameworks describe this risk

• Electoral interference

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Political manipulation

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Coercion/manipulation

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Political and Economic

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Biased influence through citizen screening and tailored propaganda

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Political

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Surveillance and Censorship

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Disinformation and manipulation of public opinion

  International Scientific Report on the Safety of Advanced AI (Bengio2024)

Other entries from Tse2025

• Misuse Risks Risk Category · 4.0
• Misuse Risks Additional evidence
• Cyber Offense Risks Risk Sub-Category · 4.2
• Biological and Chemical Risks Risk Sub-Category · 4.2
• Biological and Chemical Risks Additional evidence
• Physical Harm and Injury Risks Risk Sub-Category · 4.2
• Physical Harm and Injury Risks Additional evidence
• Large-Scale Persuasion and Harmful Manipulation Risks Additional evidence
• Loss of Control Risks Risk Category · 5.2
• Loss of Control Risks Additional evidence
• Passive loss of control Risk Sub-Category · 5.2
• Active loss of control Risk Sub-Category · 7.1