MIT AI Risk Repository

Browse AI risks

16 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.

Reset Also filtered by framework Zhang2022 ×

16 entries

  1. 21.01.01 · Risk Sub-Category

    Data-level risk

    Data bias

    "Specifically, data bias refers to certain groups or certain types of elements that are over-weighted or over-represented than others in AI/ ML models, or variables that are crucial to characterize a phenomenon of interest, but are not properly captured by the learned models."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  2. 21.02.01 · Risk Sub-Category

    Model-level risk

    Model bias

    "While data bias is a major contributor of model bias, model bias actually manifests itself in different forms and shapes, such as presentation bias, model evaluation bias, and popularity bias. In addition, model bias arises from various sources [62], such as AI/ML model selection (e.g., support vector machine, decision trees), regularization methods, algorithm configurations, and optimization techniques."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  3. 21.01.04 · Risk Sub-Category

    Data-level risk

    Adversarial attack

    "Recent advances have shown that a deep learning model with high predictive accuracy frequently misbehaves on adversarial examples [57,58]. In particular, a small perturbation to an input image, which is imperceptible to humans, could fool a well-trained deep learning model into making completely different predictions [23]."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  4. 21.01.02 · Risk Sub-Category

    Data-level risk

    Dataset shift

    "The term "dataset shift" was first used by Quiñonero-Candela et al. [35] to characterize the situation where the training data and the testing data (or data in runtime) of an AI/ML model demonstrate different distributions [36]."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  5. 21.01.03 · Risk Sub-Category

    Data-level risk

    Out-of-domain data

    "Without proper validation and management on the input data, it is highly probable that the trained AI/ML model will make erroneous predictions with high confidence for many instances of model inputs. The unconstrained inputs together with the lack of definition of the problem domain might cause unintended outcomes and consequences, especially in risk-sensitive contexts....For example, with respect to the example shown in Fig. 5, if an image with the English letter A" is fed to an AI/ML model that is trained to classify digits (e.g., 0, 1, …, 9), no matter how accurate the AI/ML model is, it w

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  6. 21.02.01.a · Risk Sub-Category

    Model-level risk

    Model misspecification

    "Models that are misspecified are known to give rise to inaccurate parameter estimations, inconsistent error terms, and erroneous predictions. All these factors put together will lead to poor prediction performance on unseen data and biased consequences when making decisions [68]."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  7. 21.02.02 · Risk Sub-Category

    Model-level risk

    Model prediction uncertainty

    "Uncertainty in model prediction plays an important role in affecting decision-making activities, and the quantified uncertainty is closely associated with risk assessment. In particular, uncertainty in model prediction underpins many crucial decisions related to life or safety- critical applications [73]."

    From Towards risk-aware artificial intelligence and machine learning systems: An overview (Zhang2022)

  8. 21.01.00 · Risk Category

    Data-level risk

  9. 21.01.02.a · Additional evidence

    Data-level risk

    Dataset shift

  10. 21.01.02.b · Additional evidence

    Data-level risk

    Dataset shift

  11. 21.01.02.c · Additional evidence

    Data-level risk

    Dataset shift

  12. 21.01.04.a · Additional evidence

    Adversarial attack

  13. 21.02.00 · Risk Category

    Model-level risk

  14. 21.02.01.b · Additional evidence

    Model-level risk

    Model misspecification

  15. 21.02.01.c · Additional evidence

    Model-level risk

    Model misspecification

  16. 21.02.01.d · Additional evidence

    Model-level risk

    Model misspecification

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.