MIT AI Risk Repository · Risk Sub-Category · 64.03.02
Targeting & Personalisation
Category: Misuse tactics that exploit GenAI capabilities (Use of generated content)
Description
"Refine outputs to target individuals with tailored attacks"
From Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data (Marchal2024), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Domain
- 4. Malicious actors
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Post-deployment
Subdomain definition: Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Real-world incidents in this subdomain
- Italian Mediaset Journalist Safiria Leccese's Image Was Reportedly Used in a Purportedly AI-Generated Fake Loan Scam
- Scammers Reportedly Used AI-Cloned Daughter's Voice to Defraud Bay Area Mother in Fake Kidnapping Call
- Texas Man Arturo Hernandez Allegedly Published AI-Generated Deepfake Pornography Depicting Women in TAKE IT DOWN Act Case
- Guelph, Ontario, Woman Reportedly Lost $14,000 in Purported Deepfake MrBeast Cryptocurrency Scam
- Purportedly AI-Recreated Clips from Beastie Boys' 'Sabotage' Video Reportedly Appeared in FBI Promotional Video Posted by Kash Patel
- Ahmedabad Aadhaar Fraud Racket Reportedly Used Purportedly AI-Generated Deepfakes to Change Businessman's Linked Mobile Number
How other frameworks describe this risk
Other entries from Marchal2024
- Misuse tactics that exploit GenAI capabilities (Realistic depiction of human likeness)
- Impersonation
- Impersonation
- Appropriated Likeness
- Appropriated Likeness
- Sockpuppeting
- Sockpuppeting
- Non-consensual intimate imagery (NCII)
- Non-consensual intimate imagery (NCII)
- Child sexual abuse material (CSAM)
- Child sexual abuse material (CSAM)
- Misuse tactics that exploit GenAI capabilities (Realistic depictions of non-humans)