MIT AI Risk Repository
Browse AI risks
3 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
"Adversarial AI refers to a class of attacks that exploit vulnerabilities in machine-learning (ML) models. This class of misuse exploits vulnerabilities introduced by the AI assistant itself and is a form of misuse that can enable malicious entities to exploit privacy vulnerabilities and evade the model’s built-in safety mechanisms, policies, and ethical boundaries of the model. Besides the risks of misuse for offensive cyber operations, advanced AI assistants may also represent a new target for abuse, where bad actors exploit the AI systems themselves and use them to cause harm. While our und
-
24.03.06 · Risk Sub-Category
Adversarial AI: Circumvention of Technical Security Measures
"The technical measures to mitigate misuse risks of advanced AI assistants themselves represent a new target for attack. An emerging form of misuse of general-purpose advanced AI assistants exploits vulnerabilities in a model that results in unwanted behavior or in the ability of an attacker to gain unauthorized access to the model and/or its capabilities. While these attacks currently require some level of prompt engineering knowledge and are often patched by developers, bad actors may develop their own adversarial AI agents that are explicitly trained to discover new vulnerabilities that all
-
"Prompt injections represent another class of attacks that involve the malicious insertion of prompts or requests in LLM-based interactive systems, leading to unintended actions or disclosure of sensitive information. The prompt injection is somewhat related to the classic structured query language (SQL) injection attack in cybersecurity where the embedded command looks like a regular input at the start but has a malicious impact. The injected prompt can deceive the application into executing the unauthorized code, exploit the vulnerabilities, and compromise security in its entirety. More rece
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
Where do these risk entries come from?
The MIT AI Risk Repository, which extracts risks from dozens of published frameworks, taxonomies and papers and codes each one by domain and subdomain, and by a causal taxonomy of entity, intent and timing. This is a browseable copy, attributed and openly licensed, not original research.
What do entity, intent and timing mean?
They are the causal coding. Entity is whether a human or the AI system is the cause; intent is whether the harm was intentional or not; timing is whether it arises before or after deployment. Together they let you separate misuse from malfunction.
Can I export the results?
Yes, any filtered set exports as CSV or JSON, and every export carries the upstream source, licence and citation with it, because attribution is a condition of the licence rather than a courtesy.
What is the MIT AI Risk Repository?
A living database of AI risks extracted from published frameworks, taxonomies and papers, classified by a causal taxonomy of entity, intent and timing and by a domain taxonomy of seven domains and 24 subdomains. It is published by the MIT AI Risk Initiative under CC BY 4.0.