MIT AI Risk Repository
Browse AI risks
2 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
24.01.02 · Risk Sub-Category
Difficult to develop metrics for evaluating benefits or harms caused by AI assistants
"Another difficulty facing AI assistant systems is that it is challenging to develop metrics for evaluating particular aspects of benefits or harms caused by the assistant – especially in a sufficiently expansive sense, which could involve much of society (see Chapter 19). Having these metrics is useful both for assessing the risk of harm from the system and for using the metric as a training signal."
-
"Efforts to deploy advanced assistant technology in society, in a way that is broadly beneficial, can be viewed as a wicked problem (Rittel and Webber, 1973). Wicked problems are defined by the property that they do not admit solutions that can be foreseen in advance, rather they must be solved iteratively using feedback from data gathered as solutions are invented and deployed. With the deployment of any powerful general-purpose technology, the already intricate web of sociotechnical relationships in modern culture are likely to be disrupted, with unpredictable externalities on the convention
Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.
Frequently asked questions
Where do these risk entries come from?
The MIT AI Risk Repository, which extracts risks from dozens of published frameworks, taxonomies and papers and codes each one by domain and subdomain, and by a causal taxonomy of entity, intent and timing. This is a browseable copy, attributed and openly licensed, not original research.
What do entity, intent and timing mean?
They are the causal coding. Entity is whether a human or the AI system is the cause; intent is whether the harm was intentional or not; timing is whether it arises before or after deployment. Together they let you separate misuse from malfunction.
Can I export the results?
Yes, any filtered set exports as CSV or JSON, and every export carries the upstream source, licence and citation with it, because attribution is a condition of the licence rather than a courtesy.
What is the MIT AI Risk Repository?
A living database of AI risks extracted from published frameworks, taxonomies and papers, classified by a causal taxonomy of entity, intent and timing and by a domain taxonomy of seven domains and 24 subdomains. It is published by the MIT AI Risk Initiative under CC BY 4.0.