MIT AI Risk Repository · Risk Category · 03.04.00

Privacy and regulation violations

Open the MIT Risk Navigator All entries from Cunha2023

Description

"Some of the broken systems discussed above are also very invasive of people’s privacy, controlling, for instance, the length of someone’s last romantic relationship [51]. More recently, ChatGPT was banned in Italy over privacy concerns and potential violation of the European Union’s (EU) General Data Protection Regulation (GDPR) [52]. The Italian data-protection authority said, “the app had experienced a data breach involving user conversations and payment information.” It also claimed that there was no legal basis to justify “the mass collection and storage of personal data for the purpose o

From Navigating the Landscape of AI Ethics and Responsibility (Cunha2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).

Classification

Domain: 2. Privacy & Security
Subdomain: 2.1 Compromise of privacy by obtaining, leaking or correctly inferring sensitive information
Causal entity: Human
Intent: Intentional
Timing: Post-deployment

Subdomain definition: AI systems that memorize and leak sensitive personal data or infer private information about individuals without their consent. Unexpected or unauthorized sharing of data and information can compromise user expectation of privacy, assist identity theft, or loss of confidential intellectual property.

Real-world incidents in this subdomain

Browse all incidents in this subdomain

How other frameworks describe this risk

Risks to privacy
International Scientific Report on the Safety of Advanced AI (Bengio2024)
Risks to privacy
International AI Safety Report 2025 (Bengio2025)
Privacy Leakage
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Private Training Data
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Memorization in LLMs
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Association in LLMs
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Privacy Leakage
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Privacy and Data Leakage
Towards Safer Generative Language Models: A Survey on Safety Risks, Evaluations, and Improvements (Deng2023)

Other entries from Cunha2023

Broken systems Risk Category · 1.1
Hallucinations Risk Category · 3.1
Intellectual property rights violations Risk Category · 6.3
Enabling malicious actors and harmful actions Risk Category · 4.0
Environmental and socioeconomic harms Risk Category · 6.6