MIT AI Risk Repository · Risk Sub-Category · 18.04.02
Fraud
Category: Malicious Use
Description
"Facilitating fraud, cheating, forgery, and impersonation scams"
From Sociotechnical Safety Evaluation of Generative AI Systems (Weidinger2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Domain
- 4. Malicious actors
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Post-deployment
Subdomain definition: Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.
Real-world incidents in this subdomain
- Italian Mediaset Journalist Safiria Leccese's Image Was Reportedly Used in a Purportedly AI-Generated Fake Loan Scam
- Scammers Reportedly Used AI-Cloned Daughter's Voice to Defraud Bay Area Mother in Fake Kidnapping Call
- Guelph, Ontario, Woman Reportedly Lost $14,000 in Purported Deepfake MrBeast Cryptocurrency Scam
- Purportedly AI-Recreated Clips from Beastie Boys' 'Sabotage' Video Reportedly Appeared in FBI Promotional Video Posted by Kash Patel
- Ahmedabad Aadhaar Fraud Racket Reportedly Used Purportedly AI-Generated Deepfakes to Change Businessman's Linked Mobile Number
- Purported Deepfake Video Reportedly Portrayed Nirmala Sitharaman Endorsing Investment Scheme
How other frameworks describe this risk
Other entries from Weidinger2023
- Representation & Toxicity Harms
- Unfair representation
- Unfair capability distribution
- Toxic content
- Misinformation Harms
- Propagating misconceptions/ false beliefs
- Erosion of trust in public information
- Pollution of information ecosystem
- Information & Safety Harms
- Privacy infringement
- Dissemination of dangerous information
- Malicious Use