AI incident: sexual content (Xai, Aug 2025)

Laws on record for this risk area

Policy angle: Classified under Malicious Actors & Misuse (Fraud, scams, and targeted manipulation) in the MIT AI Risk Repository taxonomy; 5 instruments on record cover this risk area.

• India DPDP Act India · Partially applicable · binding
• Law on Artificial Intelligence (2025) Kazakhstan · Adopted · binding
• Law No. 132/2025 on artificial intelligence Italy · In force · binding
• EU AI Act European Union · Partially applicable · binding
• Texas Responsible AI Governance Act (TRAIGA) Texas (United States) · In force · binding

Matched from the record's risk category and country to the instruments in effect recorded here: a law listed covers the area, which is not a finding that it applies to this incident. A reviewer can correct the match in the repository (data/external/incident_overrides.yaml).

News reports (3)

Titles link to the original publisher; report text is not reproduced here.

1. 5 Aug 2025
   Grok generates fake Taylor Swift nudes without being asked

   arstechnica.com · Ashley Belanger
2. 5 Aug 2025
   Grok’s ‘spicy’ video setting instantly made me Taylor Swift nude deepfakes

   theverge.com · Jess Weatherbed
3. 6 Aug 2025
   Grok Imagine generates unsolicited deepfake nudes of Taylor Swift, user reports

   mashable.com · Meera Navlakha

Who was involved

Alleged deployer

Xai

Alleged developer

Xai

Alleged harmed party

Taylor Swift, Jess Weatherbed, Grok Imagine Users

Classification (MIT AI Risk Repository taxonomy)

Risk domain

Malicious Actors & Misuse

Risk subdomain

4.3 Fraud, scams, and targeted manipulation

Causal entity

AI

Intent

Unintentional

Timing

Post-deployment

Harm level

—

Sectors

—

Countries

—

Risk entries describing this failure mode

Entries from the MIT AI Risk Repository coded to subdomain 4.3.

• Defamation/libel/slander

  "Defamation/libel/slander - Use of a technology system to create, facilitate or amplify false perception(s) about an individual, group, or organisation."

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• IP/copyright loss

  "IP/copyright loss - Misuse or abuse of an individual or organisation’s intellectual property, including copyright, trademarks, and patents."

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Cheating/plagiarism

  "Cheating/plagiarism - Use of another person’s or group’s words or ideas without consent and/or acknowledgement."

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Dehumanisation/objectification

  "Dehumanisation/objectification - Use or misuse of a technology system to depict and/or treat people as not human, less than human, or as objects."

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Impersonation/identity theft

  "Impersonation/identity theft - Theft of an individual, group or organisation’s identity by a third-party in order to defraud, mock or otherwise harm them."

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Financial and business

  "Financial and Business - Use or misuse of a technology system in a manner that damages the financial interests of an individual or group, or which causes strategic, operational, legal or financial harm to a business or...

  A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms (Abercrombie2024)

• Cybersecurity

  "LLMs may exacerbate cybersecurity risks in various ways (Newman, 2024). Firstly, LLMs may significantly amplify the effectiveness of deceptive operations aimed at tricking people into disclosing sensitive information or...

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

• Misinformation and Manipulation

  "Recent studies have demonstrated that LLMs can be exploited to craft deceptive narratives with levels of persuasiveness similar to human-generated content (Pan et al., 2023b; Spitale et al., 2023), to fabri- cate fake n...

  Foundational Challenges in Assuring Alignment and Safety of Large Language Models (Anwar2024)

Incidents in the same risk subdomain

• 31 May 2026Italian Mediaset Journalist Safiria Leccese's Image Was Reportedly Used in a Purportedly AI-Generated Fake Loan Scam
• 24 May 2026Scammers Reportedly Used AI-Cloned Daughter's Voice to Defraud Bay Area Mother in Fake Kidnapping Call
• 5 May 2026Guelph, Ontario, Woman Reportedly Lost $14,000 in Purported Deepfake MrBeast Cryptocurrency Scam
• 4 May 2026Purportedly AI-Recreated Clips from Beastie Boys' 'Sabotage' Video Reportedly Appeared in FBI Promotional Video Posted by Kash Patel
• 28 Apr 2026Ahmedabad Aadhaar Fraud Racket Reportedly Used Purportedly AI-Generated Deepfakes to Change Businessman's Linked Mobile Number
• 16 Apr 2026ChatGPT Was Reportedly Consulted on Body-Disposal and Concealment Questions Before and After University of South Florida Doctoral Students Were Killed

Other incidents involving Xai

• 15 Mar 2026Grok Reportedly Misclassified Netanyahu Proof-of-Life Video as AI-Generated Deepfake Amid Iran War Rumors
• 19 Feb 2026Grok Reportedly Disclosed Adult Performer Siri Dahl's Legal Name and Birthdate, Allegedly Contributing to Doxxing and Harassment
• 15 Dec 2025Grok AI Reportedly Generated Fabricated Civilian Hero Identity During Bondi Beach Shooting
• 8 Jul 2025Grok 3 Reportedly Generated Graphic Threats and Hate Speech Targeting Minnesota Attorney Will Stancil
• 14 Aug 2024Grok AI Reportedly Generates Offensive and Violent Images Without Proper Safeguards
• 13 Aug 2024Grok AI Chatbot Reportedly Spreads Unfounded Rumors About Trump’s Dentures