MIT AI Risk Repository · Risk Sub-Category · 11.04.02

Technology-facilitated violence

Category: Interpersonal Harms

Open the MIT Risk Navigator All entries from Shelby2023

Description

Technology-facilitated violence occurs when algorithmic features enable use of a system for harassment and violence [2, 16, 44, 80, 108], including creation of non-consensual sexual imagery in generative AI... other facets of technology-facilitated violence, include doxxing [79], trolling [14], cyberstalking [14], cyberbullying [14, 98, 204], monitoring and control [44], and online harassment and intimidation [98, 192, 199, 226], under the broader banner of online toxicity

From Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction (Shelby2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).

Classification

Domain: 4. Malicious actors
Subdomain: 4.3 Fraud, scams, and targeted manipulation
Causal entity: Human
Intent: Intentional
Timing: Post-deployment

Subdomain definition: Using AI systems to gain a personal advantage over others such as through cheating, fraud, scams, blackmail or targeted manipulation of beliefs or behavior. Examples include AI-facilitated plagiarism for research or education, impersonating a trusted or fake individual for illegitimate financial benefit, or creating humiliating or sexual imagery.

Real-world incidents in this subdomain

Browse all incidents in this subdomain

How other frameworks describe this risk

Impersonation/identity theft
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
IP/copyright loss
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
Dehumanisation/objectification
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
Defamation/libel/slander
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
Financial and business
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
Cheating/plagiarism
A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)
Cybersecurity
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)
Domain-Specific Misuses
Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

Other entries from Shelby2023

Representational Harms Risk Category · 1.1
Stereotyping social groups Risk Sub-Category · 1.1
Demeaning social groups Risk Sub-Category · 1.1
Erasing social groups Risk Sub-Category · 1.3
Alienating social groups Risk Sub-Category · 1.1
Denying people the opportunity to self-identify Risk Sub-Category · 1.1
Reifying essentialist categories Risk Sub-Category · 1.1
Allocative Harms Risk Category · 1.1
Opportunity loss Risk Sub-Category · 1.1
Economic loss Risk Sub-Category · 1.1
Quality-of-Service Harms Risk Category · 1.3
Alienation Risk Sub-Category · 1.3