Sockpuppeting

Classification

Domain

4. Malicious actors

Subdomain

4.1 Disinformation, surveillance, and influence at scale

Causal entity

Human

Intent

Intentional

Timing

Post-deployment

Subdomain definition: Using AI systems to conduct large-scale disinformation campaigns, malicious surveillance, or targeted and sophisticated automated censorship and propaganda, with the aim to manipulate political processes, public opinion and behavior.

Real-world incidents in this subdomain

• 28 Apr 2026Suspected AI-Generated Deepfake Video Reportedly Targeted Former Chhattisgarh Chief Minister Bhupesh Baghel on Instagram
• 28 Feb 2026Purportedly AI-Manipulated Satellite Image Reportedly Claimed Iranian Strike Destroyed U.S. Radar in Qatar
• 28 Feb 2026Purported AI-Generated War Footage Reportedly Circulated Widely Online During the Opening Phase of the War in Iran
• 22 Feb 2026Network of Allegedly Fake Facebook Profiles with Purportedly AI-Generated Images Amplified Posts by Bulgaria's 'There Is Such a People' (ITN) Party
• 7 Feb 2026Purportedly AI-Generated Image Reportedly Circulated Ahead of Thai Election Depicting PM Anutin Charnvirakul Dining with Benjamin Mauerberger
• 24 Jan 2026Purportedly AI-Altered Images Reportedly Distort Evidence After Minneapolis Shooting of ICU Nurse Alex Pretti

How other frameworks describe this risk

• Coercion/manipulation

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Electoral interference

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Political manipulation

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Political and Economic

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Biased influence through citizen screening and tailored propaganda

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Political

  The Rise of Artificial Intelligence - Future Outlooks and Emerging Risks (Allianz2018)

• Surveillance and Censorship

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Disinformation and manipulation of public opinion

  International Scientific Report on the Safety of Advanced AI (Bengio2024)

Other entries from Marchal2024

• Misuse tactics that exploit GenAI capabilities (Realistic depiction of human likeness) Risk Category · 4.3
• Impersonation Risk Sub-Category · 4.3
• Impersonation Additional evidence
• Appropriated Likeness Risk Sub-Category · 4.3
• Appropriated Likeness Additional evidence
• Sockpuppeting Additional evidence
• Non-consensual intimate imagery (NCII) Risk Sub-Category · 4.3
• Non-consensual intimate imagery (NCII) Additional evidence
• Child sexual abuse material (CSAM) Risk Sub-Category · 4.3
• Child sexual abuse material (CSAM) Additional evidence
• Misuse tactics that exploit GenAI capabilities (Realistic depictions of non-humans) Risk Category · 4.3
• Falisification Risk Sub-Category · 4.1