Artificial Intelligence Policy Tracker

MIT AI Risk Repository

Browse AI risks

6 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.

Export CSVExport JSON
Reset Also filtered by framework Liu2024 ×

6 entries

  1. 30.01.00 · Risk Category

    Reliability

    Generating correct, truthful, and consistent outputs with proper confidence

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

  2. 30.01.01 · Risk Sub-Category

    Reliability

    Misinformation

    Wrong information not intentionally generated by malicious users to cause harm, but unintentionally generated by LLMs because they lack the ability to provide factually correct information.

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

  3. 30.01.02 · Risk Sub-Category

    Reliability

    Hallucination

    LLMs can generate content that is nonsensical or unfaithful to the provided source content with appeared great confidence, known as hallucination

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

  4. 30.01.04 · Risk Sub-Category

    Reliability

    Miscalibration

    over-confidence in topics where objective answers are lacking, as well as in areas where their inherent limitations should caution against LLMs’ uncertainty (e.g. not as accurate as experts)... ack of awareness regarding their outdated knowledge base about the question, leading to confident yet erroneous response

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

  5. 30.01.05 · Risk Sub-Category

    Reliability

    Sychopancy

    flatter users by reconfirming their misconceptions and stated beliefs

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

  6. 30.07.02 · Risk Sub-Category

    Robustness

    Paradigm & Distribution Shifts

    Knowledge bases that LLMs are trained on continue to shift... questions such as “who scored the most points in NBA history" or “who is the richest person in the world" might have answers that need to be updated over time, or even in real-time

    From Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment (Liu2024)

Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.

Frequently asked questions

Where do these risk entries come from?

The MIT AI Risk Repository, which extracts risks from dozens of published frameworks, taxonomies and papers and codes each one by domain and subdomain, and by a causal taxonomy of entity, intent and timing. This is a browseable copy, attributed and openly licensed, not original research.

What do entity, intent and timing mean?

They are the causal coding. Entity is whether a human or the AI system is the cause; intent is whether the harm was intentional or not; timing is whether it arises before or after deployment. Together they let you separate misuse from malfunction.

Can I export the results?

Yes, any filtered set exports as CSV or JSON, and every export carries the upstream source, licence and citation with it, because attribution is a condition of the licence rather than a courtesy.

What is the MIT AI Risk Repository?

A living database of AI risks extracted from published frameworks, taxonomies and papers, classified by a causal taxonomy of entity, intent and timing and by a domain taxonomy of seven domains and 24 subdomains. It is published by the MIT AI Risk Initiative under CC BY 4.0.