MIT AI Risk Repository · Risk Sub-Category · 46.01.02
Propaganda - Digital impersonations
Category: Personal Loss and Identity Theft
Description
"AI-generated impersonation for identity theft might be found at the intersection of “Harm to the Person” and “Deception.”"
From GenAI against humanity: nefarious applications of generative artificial intelligence and large language models (Ferrara2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Domain
- 4. Malicious actors
- Causal entity
- Other
- Intent
- Intentional
- Timing
- Post-deployment
Subdomain definition: Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Real-world incidents in this subdomain
- Italian Mediaset Journalist Safiria Leccese's Image Was Reportedly Used in a Purportedly AI-Generated Fake Loan Scam
- Scammers Reportedly Used AI-Cloned Daughter's Voice to Defraud Bay Area Mother in Fake Kidnapping Call
- Texas Man Arturo Hernandez Allegedly Published AI-Generated Deepfake Pornography Depicting Women in TAKE IT DOWN Act Case
- Guelph, Ontario, Woman Reportedly Lost $14,000 in Purported Deepfake MrBeast Cryptocurrency Scam
- Purportedly AI-Recreated Clips from Beastie Boys' 'Sabotage' Video Reportedly Appeared in FBI Promotional Video Posted by Kash Patel
- Ahmedabad Aadhaar Fraud Racket Reportedly Used Purportedly AI-Generated Deepfakes to Change Businessman's Linked Mobile Number
How other frameworks describe this risk
Other entries from Ferrara2023
- Personal Loss and Identity Theft
- Deception - Synthetic identities
- Dishonesty - Targeted harassment
- Financial and Economic Damage
- Deception - Bespoke ransom
- Propaganda - Extremist schemes
- Dishonesty - Market manipulation
- Information Manipulation
- Deception - Information control
- Propaganda - Influence campaigns
- Propaganda - Influence campaigns
- Dishonesty - Information disorder