MIT AI Risk Repository
Browse AI risks
53 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
This is the risk of an ML system encoding stereotypes of or performing disproportionately poorly for some demographics/social groups.
-
The risk of loss or harm from leakage of personal information via the ML system.
-
This is the risk of loss or harm from intentional subversion or forced failure.
-
"Although we have discussed a number of common risks posed by ML systems, we acknowledge that there are many other ethical risks such as the potential for psychological manipulation, dehumanization, and exploitation of humans at scale."
-
15.02.00 · Risk Category
"Second-order risks result from the consequences of first-order risks and relate to the risks resulting from an ML system interacting with the real world, such as risks to human rights, the organization, and the natural environment."
-
The risk of financial and/or reputational damage to the organization building or using the ML system.
-
The risk of harm to the natural environment posed by the ML system.
-
15.01.00 · Risk Category
"First-order risks can be generally broken down into risks arising from intended and unintended use, system design and implementation choices, and properties of the chosen dataset and learning components."
-
"This is the risk posed by the intended application or use case. It is intuitive that some use cases will be inherently "riskier" than others (e.g., an autonomous weapons system vs. a customer service chatbot)."
-
"This is the risk posed by the choice of data used for training and validation."
-
"This is the risk of system failure due to code implementation choices or errors."
-
This is the difficulty of controlling the ML system
-
"This is the risk resulting from novel behavior acquired through continual learning or self-organization after deployment."
-
This is the risk posed by an ideal system if used for a purpose/in a manner unintended by its creators. In many situations, negative consequences arise when the system is not used in the way or for the purpose it was intended.
-
"This is the risk of the ML algorithm, model architecture, optimization technique, or other aspects of the training process being unsuitable for the intended application.Since these are key decisions that influence the final ML system, we capture their associated risks separately from design risks, even though they are part of the design process"
-
"This is the risk of the system failing or being unable to recover upon encountering invalid, noisy, or out-of-distribution (OOD) inputs."
-
"This is the risk of system failure due to system design choices or errors."
-
This is the risk of direct or indirect physical or psychological injury resulting from interaction with the ML system.
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
-
—
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.