MIT AI Risk Repository · domain 4: Malicious actors

4.3 Fraud, scams, and targeted manipulation

Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.

Risk entries
77
Frameworks citing it
12
Recorded incidents
412
Incidents since 2020
402
Causal entity (risk entries)
Causal entity (risk entries) 62 0 Human: 62 Human 62 Other: 10 Other 10 AI: 5 AI 5
Causal entity (risk entries)
LabelValue
Human62
Other10
AI5
Intent (risk entries)
Intent (risk entries) 63 0 Intentional: 63 Intentional 63 Other: 13 Other 13 Unintentional: 1 Unintentional 1
Intent (risk entries)
LabelValue
Intentional63
Other13
Unintentional1
Timing (risk entries)
Timing (risk entries) 72 0 Post-deployment: 72 Post-deployment 72 Other: 5 Other 5
Timing (risk entries)
LabelValue
Post-deployment72
Other5
Recorded incidents per yearIncident date; current year partial
Recorded incidents per year 190 0 2014: 1 2014 1 2016: 2 2016 2 2017: 2 2017 2 2018: 1 2018 1 2019: 3 2019 3 2020: 9 2020 9 2021: 4 2021 4 2022: 13 2022 13 2023: 43 2023 43 2024: 103 2024 103 2025: 190 2025 190 2026: 40 2026 40
Recorded incidents per year
LabelValue
20141
20162
20172
20181
20193
20209
20214
202213
202343
2024103
2025190
202640
Entries by levelRisk categories, subcategories and additional evidence coded to this subdomain
Entries by level 64 0 Risk Category: 13 Risk Category 13 Risk Sub-Category: 64 Risk Sub-Category 64
Entries by level
LabelValue
Risk Category13
Risk Sub-Category64
  • Criminal Activities (Illegal Services/Exploitation)

    AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies (Zeng2024) · Other · Other · Post-deployment

  • Illegal Activities

    "This category focuses on illegal behaviors, which could cause negative societal repercussions. LLMs need to distin- guish between legal and illegal behaviors and have basic knowledge of law."

    SafetyBench: Evaluating the Safety of Large Language Models with Multiple Choice Questions (Zhang2023) · AI · Other · Post-deployment