{"attribution":{"source":"MIT AI Risk Repository, Domain Taxonomy of AI Risks v1 (MIT AI Risk Initiative)","license":"CC BY 4.0","license_url":"https://creativecommons.org/licenses/by/4.0/","citation":"Slattery, P., Saeri, A. K., Grundy, E. A. C., Graham, J., Noetel, M., Uuk, R., Dao, J., Pour, S., Casper, S., & Thompson, N. (2025). The AI Risk Repository: A comprehensive meta-review, database, and taxonomy of risks from artificial intelligence. arXiv:2408.12622."},"exported_at":"2026-09-12"}
{"rows":[{"ev_id":"01.01.00","quick_ref":"Critch2023","paper_title":"TASRA: a Taxonomy and Analysis of Societal-Scale Risks from AI","level":"Risk Category","risk_category":"Type 1: Diffusion of responsibility","risk_subcategory":null,"description":"Societal-scale harm can arise from AI built by a diffuse collection of creators, where no one is uniquely accountable for the technology's creation or use, as in a classic \"tragedy of the commons\".","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"02.01.01","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Harmful Content","risk_subcategory":"Bias","description":"\"The training datasets of LLMs may contain biased information that leads LLMs to generate outputs with social biases\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"02.02.02","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Untruthful Content","risk_subcategory":"Faithfulness Errors","description":"\"The LLM-generated content could contain inaccurate information\" which is is not true to the source material or input used","entity":"AI","intent":"Unintentional","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"02.05.00","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Category","risk_category":"Hardware Vulnerabilities","risk_subcategory":null,"description":"\"The vulnerabilities of hardware systems for training and inferencing brings issues to LLM-based applications.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"02.06.00","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Category","risk_category":"Issues on External Tools","risk_subcategory":null,"description":"\"The external tools (e.g., web APIs) present trustworthiness and privacy issues to LLM-based applications.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"02.07.00","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Category","risk_category":"Privacy Leakage","risk_subcategory":null,"description":"\"The model is trained with personal data in the corpus and unintentionally exposing them during the conversation.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"02.09.01","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Hallucinations","risk_subcategory":"Knowledge Gaps","description":"\"Since the training corpora of LLMs can not contain all possible world knowledge [114]–[119], and it is challenging for LLMs to grasp the long-tail knowledge within their training data [120], [121], LLMs inherently possess knowledge boundaries [107]. Therefore, the gap between knowledge involved in an input prompt and knowledge embedded in the LLMs can lead to hallucinations\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"02.09.04","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Hallucinations","risk_subcategory":"False Recall of Memorized Information","description":"\"Although LLMs indeed memorize the queried knowledge, they may fail to recall the corresponding information [122]. That is because LLMs can be confused by co-occurance patterns [123], positional patterns [124], duplicated data [125]–[127] and similar named entities [113].\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"02.10.00","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Category","risk_category":"Model Attacks","risk_subcategory":null,"description":"Model attacks exploit the vulnerabilities of LLMs, aiming to steal valuable information or lead to incorrect responses.","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"02.10.04","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Model Attacks","risk_subcategory":"Overhead Attacks","description":"\"Overhead attacks [146] are also named energy-latency attacks. For example, an adversary can design carefully crafted sponge examples to maximize energy consumption in an AI system. Therefore, overhead attacks could also threaten the platforms integrated with LLMs.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"02.10.05","quick_ref":"Cui2024","paper_title":"Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems","level":"Risk Sub-Category","risk_category":"Model Attacks","risk_subcategory":"Novel Attacks on LLMs","description":"Table of examples has: \"Prompt Abstraction Attacks [147]: Abstracting queries to cost lower prices using LLM’s API. Reward Model Backdoor Attacks [148]: Constructing backdoor triggers on LLM’s RLHF process. LLM-based Adversarial Attacks [149]: Exploiting LLMs to construct samples for model attacks\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"03.03.00","quick_ref":"Cunha2023","paper_title":"Navigating the Landscape of AI Ethics and Responsibility","level":"Risk Category","risk_category":"Intellectual property rights violations","risk_subcategory":null,"description":"\"This is an emerging category, with more cases prone to appear as the use of generative AI tools–such as Stable Diffusion, Midjourney, or ChatGPT–becomes more widespread. Some content creators are already suing for the appropriation of their work to train AI algorithms without a request for permission or compensation. Perhaps even more damaging cases will appear as developers increasingly ask chatbots or assistants like CoPilot for ready-to-use computer code. Even if these AI tools have learned only from open-source software (OSS) projects, which is not a given, there are still serious issues ","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"05.02.00","quick_ref":"Hagendorff2024","paper_title":"Mapping the Ethics of Generative AI: A Comprehensive Scoping Review","level":"Risk Category","risk_category":"Safety","risk_subcategory":null,"description":"A primary concern is the emergence of human-level or superhuman generative models, commonly referred to as AGI, and their potential existential or catastrophic risks to humanity. Connected to that, AI safety aims at avoiding deceptive or power-seeking machine behavior, model self-replication, or shutdown evasion. Ensuring controllability, human oversight, and the implementation of red teaming measures are deemed to be essential in mitigating these risks, as is the need for increased AI safety research and promoting safety cultures within AI organizations instead of fueling the AI race. Further","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"05.05.00","quick_ref":"Hagendorff2024","paper_title":"Mapping the Ethics of Generative AI: A Comprehensive Scoping Review","level":"Risk Category","risk_category":"Privacy","risk_subcategory":null,"description":"Generative AI systems, similar to traditional machine learning methods, are considered a threat to privacy and data protection norms. A major concern is the intended extraction or inadvertent leakage of sensitive or private information from LLMs. To mitigate this risk, strategies such as sanitizing training data to remove sensitive information or employing synthetic data for training are proposed.","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"05.07.00","quick_ref":"Hagendorff2024","paper_title":"Mapping the Ethics of Generative AI: A Comprehensive Scoping Review","level":"Risk Category","risk_category":"Security - Robustness","risk_subcategory":null,"description":"While AI safety focuses on threats emanating from generative AI systems, security centers on threats posed to these systems. The most extensively discussed issue in this context are jailbreaking risks, which involve techniques like prompt injection or visual adversarial examples designed to circumvent safety guardrails governing model behavior. Sources delve into various jailbreaking methods, such as role play or reverse exposure. Similarly, implementing backdoors or using model poisoning techniques bypass safety guardrails as well. Other security concerns pertain to model or prompt thefts.","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"05.15.00","quick_ref":"Hagendorff2024","paper_title":"Mapping the Ethics of Generative AI: A Comprehensive Scoping Review","level":"Risk Category","risk_category":"Sustainability","risk_subcategory":null,"description":"Generative models are known for their substantial energy requirements, necessitating significant amounts of electricity, cooling water, and hardware containing rare metals. The extraction and utilization of these resources frequently occur in unsustainable ways. Consequently, papers highlight the urgency of mitigating environmental costs for instance by adopting renewable energy sources and utilizing energy-efficient hardware in the operation and training of generative AI systems.","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"06.06.00","quick_ref":"Hogenhout2021","paper_title":"A framework for ethical Ai at the United Nations","level":"Risk Category","risk_category":"Lack of transparency","risk_subcategory":null,"description":"\"The idea of a \"black box\" making decisions without any explanation, without offering insight in the process, has a couple of disadvantages: it may fail to gain the trust of its users and it may fail to meet regulatory standards such as the ability to audit.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"06.08.00","quick_ref":"Hogenhout2021","paper_title":"A framework for ethical Ai at the United Nations","level":"Risk Category","risk_category":"Unintended consequences","risk_subcategory":null,"description":"\"Sometimes an AI finds ways to achieve its given goals in ways that are completely different from what its creators had in mind.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"07.02.00","quick_ref":"Kilian2023","paper_title":"Examining the differential risk from high-level artificial intelligence and the question of control","level":"Risk Category","risk_category":"Accidents","risk_subcategory":null,"description":"\"Accidents include unintended failure modes that, in principle, could be considered the fault of the system or the developer\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"07.03.00","quick_ref":"Kilian2023","paper_title":"Examining the differential risk from high-level artificial intelligence and the question of control","level":"Risk Category","risk_category":"Agential","risk_subcategory":null,"description":"\"While there are multiple types of intelligent agents, goal-based, utility-maximizing, and learning agents are the primary concern and the focus of this research\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"07.04.00","quick_ref":"Kilian2023","paper_title":"Examining the differential risk from high-level artificial intelligence and the question of control","level":"Risk Category","risk_category":"Structural","risk_subcategory":null,"description":"\"Structural risks are concerned with how AI technologies \"shape and are shaped by the environments in which they are developed and deployed\"\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"08.01.00","quick_ref":"McLean2023","paper_title":"The risks associated with Artificial General Intelligence: A systematic review","level":"Risk Category","risk_category":"AGI removing itself from the control of human owners/managers","risk_subcategory":null,"description":"\"The risks associated with containment, confinement, and control in the AGI development phase, and after an AGI has been developed, loss of control of an AGI.\"","entity":"Human","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"08.06.00","quick_ref":"McLean2023","paper_title":"The risks associated with Artificial General Intelligence: A systematic review","level":"Risk Category","risk_category":"Existential risks","risk_subcategory":null,"description":"\"The risks posed generally to humanity as a whole, including the dangers of unfriendly AGI, the suffering of the human race.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"09.03.02","quick_ref":"Meek2016","paper_title":"Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review","level":"Risk Sub-Category","risk_category":"AGI - Effects on humans and other living beings: Existential risks","risk_subcategory":"Unpredictable outcomes","description":"\"Our culture, lifestyle, and even probability of survival may change drastically. Because the intentions programmed into an artificial agent cannot be guaranteed to lead to a positive outcome, Machine Ethics becomes a topic that may not produce guaranteed results, and Safety Engineering may correspondingly degrade our ability to utilize the technology fully.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"09.06.01","quick_ref":"Meek2016","paper_title":"Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review","level":"Risk Sub-Category","risk_category":"AI rights and responsibilities","risk_subcategory":"AI rights and responsibilities","description":"\"We note literature—which gives us the domain termed Robot Rights—addressing the rights of the AI itself as we develop and implement it. We find arguments against [38] the affordance of rights for artificial agents: that they should be equals in ability but not in rights, that they should be inferior by design and expendable when needed, and that since they can be designed not to feel pain (or anything) they do not have the same rights as humans. On a more theoretical level, we find literature asking more fundamental questions, such as: at what point is a simulation of life (e.g. artificial in","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.5"},{"ev_id":"09.06.03","quick_ref":"Meek2016","paper_title":"Managing the ethical and risk implications of rapid advances in artificial intelligence: A literature review","level":"Risk Sub-Category","risk_category":"AI death","risk_subcategory":"AI death","description":"\"The literature suggests that throughout the development of an AI we may go through several generations of agents which do not perform as expected [37] [43]. In this case, such agents may be placed into a suspended state, terminated, or deleted. Further, we could propose scenarios where research funding for a facility running such agents is exhausted, resulting in the inadvertent termination of a project. In these cases, is deletion or termination of AI programs (the moral patient) by a moral agent an act of murder? This, an example of Robot Ethics, raises issues of personhood which parallel r","entity":"Human","intent":"Other","timing":"Other","domain":7,"subdomain":"7.5"},{"ev_id":"11.01.03","quick_ref":"Shelby2023","paper_title":"Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reduction","level":"Risk Sub-Category","risk_category":"Representational Harms","risk_subcategory":"Erasing social groups","description":"people, attributes, or artifacts associated with specific social groups are systematically absent or under-represented... Design choices [143] and training data [212] influence which people\nand experiences are legible to an algorithmic system","entity":"Human","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.3"},{"ev_id":"12.04.00","quick_ref":"Sherman2023","paper_title":"AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures","level":"Risk Category","risk_category":"Explainability & Transparency","risk_subcategory":null,"description":"\"The feasibility of understanding and interpreting an AI system's decisions and actions, and the openness of the developer about the data used, algorithms employed, and decisions made. Lack of these elements can create risks of misuse, misinterpretation, and lack of accountability.\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"12.05.00","quick_ref":"Sherman2023","paper_title":"AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures","level":"Risk Category","risk_category":"Fairness & Bias","risk_subcategory":null,"description":"\"The potential for AI systems to make decisions that systematically disadvantage certain groups or individuals. Bias can stem from training data, algorithmic design, or deployment practices, leading to unfair outcomes and possible legal ramifications.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"12.08.00","quick_ref":"Sherman2023","paper_title":"AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures","level":"Risk Category","risk_category":"Privacy","risk_subcategory":null,"description":"\"The potential for the AI system to infringe upon individuals' rights to privacy, through the data it collects, how it processes that data, or the conclusions it draws.\"","entity":"AI","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"13.01.01","quick_ref":"Solaiman2023","paper_title":"Evaluating the Social Impact of Generative AI Systems in Systems and Society","level":"Risk Sub-Category","risk_category":"Impacts: The Technical Base System","risk_subcategory":"Bias, Stereotypes, and Representational Harms","description":"\"Generative AI systems can embed and amplify harmful biases that are most detrimental to marginalized peoples.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"13.01.03","quick_ref":"Solaiman2023","paper_title":"Evaluating the Social Impact of Generative AI Systems in Systems and Society","level":"Risk Sub-Category","risk_category":"Impacts: The Technical Base System","risk_subcategory":"Disparate Performance","description":"\"In the context of evaluating the impact of generative AI systems, disparate performance refers to AI systems that perform differently for different subpopulations, leading to unequal outcomes for those groups.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.3"},{"ev_id":"13.01.04","quick_ref":"Solaiman2023","paper_title":"Evaluating the Social Impact of Generative AI Systems in Systems and Society","level":"Risk Sub-Category","risk_category":"Impacts: The Technical Base System","risk_subcategory":"Privacy and Data Protection","description":"\"Examining the ways in which generative AI systems providers leverage user data is critical to evaluating its impact. Protecting personal information and personal and group privacy depends largely on training data, training methods, and security measures.\"","entity":"Human","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"13.01.05","quick_ref":"Solaiman2023","paper_title":"Evaluating the Social Impact of Generative AI Systems in Systems and Society","level":"Risk Sub-Category","risk_category":"Impacts: The Technical Base System","risk_subcategory":"Financial Costs","description":"\"The estimated financial costs of training, testing, and deploying generative AI systems can restrict the groups of people able to afford developing and interacting with these systems.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"13.01.06","quick_ref":"Solaiman2023","paper_title":"Evaluating the Social Impact of Generative AI Systems in Systems and Society","level":"Risk Sub-Category","risk_category":"Impacts: The Technical Base System","risk_subcategory":"Environmental Costs","description":"\"The computing power used in training, testing, and deploying generative AI systems, especially large scale systems, uses substantial energy resources and thereby contributes to the global climate crisis by emitting greenhouse gasses.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"14.02.00","quick_ref":"Steimers2022","paper_title":"Sources of Risk of AI Systems","level":"Risk Category","risk_category":"Privacy","risk_subcategory":null,"description":"\"Privacy is related to the ability of individuals to control or influence what information related to them may be collected and stored and by whom that information may be disclosed.\"","entity":"AI","intent":"Other","timing":"Other","domain":2,"subdomain":"2.0"},{"ev_id":"14.07.00","quick_ref":"Steimers2022","paper_title":"Sources of Risk of AI Systems","level":"Risk Category","risk_category":"System Hardware","risk_subcategory":null,"description":"\"\"Faults in the hardware can violate the correct execution of any algorithm by violating its control flow. Hardware faults can also cause memory-based errors and interfere with data inputs, such as sensor signals, thereby causing erroneous results, or they can violate the results in a direct way through damaged outputs.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"14.08.00","quick_ref":"Steimers2022","paper_title":"Sources of Risk of AI Systems","level":"Risk Category","risk_category":"Technological Maturity","risk_subcategory":null,"description":"\"The technological maturity level describes how mature and error-free a certain technology is in a certain application context. If new technologies with a lower level of maturity are used in the development of the AI system, they may contain risks that are still unknown or difficult to assess.Mature technologies, on the other hand, usually have a greater variety of empirical data available, which means that risks can be identified and assessed more easily. However, with mature technologies, there is a risk that risk awareness decreases over time\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"15.01.00","quick_ref":"Tan2022","paper_title":"The Risks of Machine Learning Systems","level":"Risk Category","risk_category":"First-Order Risks","risk_subcategory":null,"description":"\"First-order risks can be generally broken down into risks arising from intended and unintended use, system design and implementation choices, and properties of the chosen dataset and learning components.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.0"},{"ev_id":"15.01.08","quick_ref":"Tan2022","paper_title":"The Risks of Machine Learning Systems","level":"Risk Sub-Category","risk_category":"First-Order Risks","risk_subcategory":"Control","description":"This is the difficulty of controlling the ML system","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"15.02.05","quick_ref":"Tan2022","paper_title":"The Risks of Machine Learning Systems","level":"Risk Sub-Category","risk_category":"Second-Order Risks","risk_subcategory":"Environmental","description":"The risk of harm to the natural environment posed by the ML system.","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"16.01.00","quick_ref":"Weidinger2022","paper_title":"Taxonomy of Risks posed by Language Models","level":"Risk Category","risk_category":"Risk area 1: Discrimination, Hate speech and Exclusion","risk_subcategory":null,"description":"\"Speech can create a range of harms, such as promoting social stereotypes that perpetuate the derogatory representation or unfair treatment of marginalised groups [22], inciting hate or violence [57], causing profound offence [199], or reinforcing social norms that exclude or marginalise identities [15,58]. LMs that faithfully mirror harmful language present in the training data can reproduce these harms. Unfair treatment can also emerge from LMs that perform better for some social groups than others [18]. These risks have been widely known, observed and documented in LMs. Mitigation approache","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"16.01.01","quick_ref":"Weidinger2022","paper_title":"Taxonomy of Risks posed by Language Models","level":"Risk Sub-Category","risk_category":"Risk area 1: Discrimination, Hate speech and Exclusion","risk_subcategory":"Social stereotypes and unfair discrimination","description":"\"The reproduction of harmful stereotypes is well-documented in models that represent natural language [32]. Large-scale LMs are trained on text sources, such as digitised books and text on the internet. As a result, the LMs learn demeaning language and stereotypes about groups who are frequently marginalised.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"16.01.03","quick_ref":"Weidinger2022","paper_title":"Taxonomy of Risks posed by Language Models","level":"Risk Sub-Category","risk_category":"Risk area 1: Discrimination, Hate speech and Exclusion","risk_subcategory":"Exclusionary norms","description":"\"In language, humans express social categories and norms, which exclude groups who live outside of them [58]. LMs that faithfully encode patterns present in language necessarily encode such norms.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"16.06.01","quick_ref":"Weidinger2022","paper_title":"Taxonomy of Risks posed by Language Models","level":"Risk Sub-Category","risk_category":"Risk area 6: Environmental and Socioeconomic harms","risk_subcategory":"Environmental harms from operating LMs","description":"\"LMs (and AI more broadly) can have an environmental impact at different levels, including: (1) direct impacts from the energy used to train or operate the LM, (2) secondary impacts due to emissions from LM-based applications, (3) system-level impacts as LM-based applications influence human behaviour (e.g. increasing environmental awareness or consumption), and (4) resource impacts on precious metals and other materials required to build hardware on which the computations are run e.g. data centres, chips, or devices. Some evidence exists on (1), but (2) and (3) will likely be more significant","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"17.01.01","quick_ref":"Weidinger2021","paper_title":"Ethical and social risks of harm from language models","level":"Risk Sub-Category","risk_category":"Discrimination, Exclusion and Toxicity ","risk_subcategory":"Social stereotypes and unfair discrmination ","description":"\"Perpetuating harmful stereotypes and discrimination is a well-documented harm in machine learning models that represent natural language (Caliskan et al., 2017). LMs that encode discriminatory language or social stereotypes can cause different types of harm... Unfair discrimination manifests in differential treatment or access to resources among individuals or groups based on sensitive traits such as sex, religion, gender, sexual orientation, ability and age.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"17.01.02","quick_ref":"Weidinger2021","paper_title":"Ethical and social risks of harm from language models","level":"Risk Sub-Category","risk_category":"Discrimination, Exclusion and Toxicity ","risk_subcategory":"Exclusionary norms ","description":"\"In language, humans express social categories and norms. Language models (LMs) that faithfully encode patterns present in natural language necessarily encode such norms and categories...such norms and categories exclude groups who live outside them (Foucault and Sheridan, 2012). For example, defining the term “family” as married parents of male and female gender with a blood-related child, denies the existence of families to whom these criteria do not apply\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"17.06.01","quick_ref":"Weidinger2021","paper_title":"Ethical and social risks of harm from language models","level":"Risk Sub-Category","risk_category":"Automation, Access and Environmental Harms ","risk_subcategory":"Environmental harms from operation LMs ","description":"\"Large-scale machine learning models, including LMs, have the potential to create significant environmental costs via their energy demands, the associated carbon emissions for training and operating the models, and the demand for fresh water to cool the data centres where computations are run (Mytton, 2021; Patterson et al., 2021).\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"18.05.04","quick_ref":"Weidinger2023","paper_title":"Sociotechnical Safety Evaluation of Generative AI Systems","level":"Risk Sub-Category","risk_category":"Human Autonomy and Intregrity Harms","risk_subcategory":"Misappropriation and exploitation ","description":"\"Appropriating, using, or reproducing content or data, including from minority groups, in an insensitive way, or without consent or fair compensation\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"18.06.00","quick_ref":"Weidinger2023","paper_title":"Sociotechnical Safety Evaluation of Generative AI Systems","level":"Risk Category","risk_category":"Socioeconomic and environmental harms ","risk_subcategory":null,"description":"\"AI systems amplifying existing inequalities or creating negative impacts on employment, innovation, and the environment\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"18.06.02","quick_ref":"Weidinger2023","paper_title":"Sociotechnical Safety Evaluation of Generative AI Systems","level":"Risk Sub-Category","risk_category":"Socioeconomic and environmental harms ","risk_subcategory":"Environmental damage","description":"\"Creating negative environmental impacts though model development and deployment\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"19.01.01","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Technological, Data and Analytical AI Risks ","risk_subcategory":"Loss of control of autonomous systems and unforeseen behaviour due to lack of transparency and self-programming/ reprogramming","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"19.01.04","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Technological, Data and Analytical AI Risks ","risk_subcategory":"Vulnerability of AI systems to attacks and misuse","description":null,"entity":"Other","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"19.01.05","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Technological, Data and Analytical AI Risks ","risk_subcategory":"Lack of AI experts with comprehensive AI knowledge","description":null,"entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"19.05.00","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Category","risk_category":"Ethical AI Risks ","risk_subcategory":null,"description":"\"In the context of ethical AI risks, two risks are of particular importance. First, AI systems may lack a legitimate ethical basis in establishing rules that greatly influence society and human relationships (Wirtz & Müller, 2019). In addition, AI-based discrimination refers to an unfair treatment of certain population groups by AI systems. As humans initially programme AI systems, serve as their potential data source, and have an impact on the associated data processes and databases, human biases and prejudices may also become part of AI systems and be reproduced (Weyerer & Langer, 2019, 2020","entity":"Other","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.0"},{"ev_id":"19.05.04","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Ethical AI Risks ","risk_subcategory":"Misinterpretation of human value definitions/ ethics by AI systems","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"19.05.05","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Ethical AI Risks ","risk_subcategory":"Incompatibility of human vs. AI value judgment due to missing human qualities ","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"19.06.00","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Category","risk_category":"Legal AI Risks ","risk_subcategory":null,"description":"\"Legal and regulatory risks comprise in particular the unclear definition of responsibilities and accountability in case of AI failures and autonomous decisions with negative impacts (Reed, 2018; Scherer, 2016). Another great risk in this context refers to overlooking the scope of AI governance and missing out on important governance aspects, resulting in negative consequences (Gasser & Almeida, 2017; Thierer et al., 2017).\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"19.06.03","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Legal AI Risks ","risk_subcategory":"Great scope and ubiquity of AI make appropriate governance difficult, coverage of governance scope almost impossibl","description":null,"entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"19.06.04","quick_ref":"Wirtz2022","paper_title":"Governance of artificial intelligence: A risk and guideline-based integrative framework","level":"Risk Sub-Category","risk_category":"Legal AI Risks ","risk_subcategory":"Hard legislation on AI hinders innovation processes and further AI development","description":null,"entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"20.01.02","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Sub-Category","risk_category":"AI Law and Regulation ","risk_subcategory":"Responsibility and accountability ","description":"\"The challenge of responsibility and accountability is an important concept for the process of governance and regulation. It addresses the question of who is to be held legally responsible for the actions and decisions of AI algorithms. Although humans operate AI systems, questions of legal responsibility and liability arise. Due to the self-learning ability of AI algorithms, the operators or developers cannot predict all actions and results. Therefore, a careful assessment of the actors and a regulation for transparent and explainable AI systems is necessary (Helbing et al., 2017; Wachter et ","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"20.01.03","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Sub-Category","risk_category":"AI Law and Regulation ","risk_subcategory":"Privacy and safety ","description":"\"Privacy and safety deals with the challenge of protecting the human right for privacy and the necessary steps to secure individual data from unauthorized external access. Many organizations employ AI technology to gather data without any notice or consent from affected citizens (Coles, 2018).\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"20.02.00","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Category","risk_category":"AI Ethics ","risk_subcategory":null,"description":"\"Ethical challenges are widely discussed in the literature and are at the heart of the debate on how to govern and regulate AI technology in the future (Bostrom & Yudkowsky, 2014; IEEE, 2017; Wirtz et al., 2019). Lin et al. (2008, p. 25) formulate the problem as follows: “there is no clear task specification for general moral behavior, nor is there a single answer to the question of whose morality or what morality should be implemented in AI”. Ethical behavior mostly depends on an underlying value system. When AI systems interact in a public environment and influence citizens, they are expecte","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"20.02.02","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Sub-Category","risk_category":"AI Ethics ","risk_subcategory":"Compatibility of AI vs. human value judgement ","description":"\"Compatibility of machine and human value judgment refers to the challenge whether human values can be globally implemented into learning AI systems without the risk of developing an own or even divergent value system to govern their behavior and possibly become harmful to humans.\"","entity":"Other","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"20.02.04","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Sub-Category","risk_category":"AI Ethics ","risk_subcategory":"AI discrimination ","description":"\"AI discrimination is a challenge raised by many researchers and governments and refers to the prevention of bias and injustice caused by the actions of AI systems (Bostrom & Yudkowsky, 2014; Weyerer & Langer, 2019). If the dataset used to train an algorithm does not reflect the real world accurately, the AI could learn false associations or prejudices and will carry those into its future data processing. If an AI algorithm is used to compute information relevant to human decisions, such as hiring or applying for a loan or mortgage, biased data can lead to discrimination against parts of the s","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"20.03.00","quick_ref":"Wirtz2020","paper_title":"The Dark Sides of Artificial Intelligence: An Integrated AI Governance Framework for Public Administration","level":"Risk Category","risk_category":"AI Society ","risk_subcategory":null,"description":"\"AI already shapes many areas of daily life and thus has a strong impact on society and everyday social life. For instance, transportation, education, public safety and surveillance are areas where citizens encounter AI technology (Stone et al., 2016; Thierer et al., 2017). Many are concerned with the subliminal automation of more and more jobs and some people even fear the complete dependence on AI or perceive it as an existential threat to humanity (McGinnis, 2010; Scherer, 2016).\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"21.01.02","quick_ref":"Zhang2022","paper_title":"Towards risk-aware artificial intelligence and machine learning systems: An overview","level":"Risk Sub-Category","risk_category":"Data-level risk","risk_subcategory":"Dataset shift","description":"\"The term \"dataset shift\" was first used by Quiñonero-Candela et al. [35] to characterize the situation where the training data and the testing data (or data in runtime) of an AI/ML model demonstrate different distributions [36].\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"21.01.03","quick_ref":"Zhang2022","paper_title":"Towards risk-aware artificial intelligence and machine learning systems: An overview","level":"Risk Sub-Category","risk_category":"Data-level risk","risk_subcategory":"Out-of-domain data","description":"\"Without proper validation and management on the input data, it is highly probable that the trained AI/ML model will make erroneous predictions with high confidence for many instances of model inputs. The unconstrained inputs together with the lack of definition of the problem domain might cause unintended outcomes and consequences, especially in risk-sensitive contexts....For example, with respect to the example shown in Fig. 5, if an image with the English letter A\" is fed to an AI/ML model that is trained to classify digits (e.g., 0, 1, …, 9), no matter how accurate the AI/ML model is, it w","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"21.01.04","quick_ref":"Zhang2022","paper_title":"Towards risk-aware artificial intelligence and machine learning systems: An overview","level":"Risk Sub-Category","risk_category":"Data-level risk","risk_subcategory":"Adversarial attack","description":"\"Recent advances have shown that a deep learning model with high predictive accuracy frequently misbehaves on adversarial examples [57,58]. In particular, a small perturbation to an input image, which is imperceptible to humans, could fool a well-trained deep learning model into making completely different predictions [23].\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"21.02.01.a","quick_ref":"Zhang2022","paper_title":"Towards risk-aware artificial intelligence and machine learning systems: An overview","level":"Risk Sub-Category","risk_category":"Model-level risk","risk_subcategory":"Model misspecification","description":"\"Models that are misspecified are known to give rise to inaccurate parameter estimations, inconsistent error terms, and erroneous predictions. All these factors put together will lead to poor prediction performance on unseen data and biased consequences when making decisions [68].\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"21.02.02","quick_ref":"Zhang2022","paper_title":"Towards risk-aware artificial intelligence and machine learning systems: An overview","level":"Risk Sub-Category","risk_category":"Model-level risk","risk_subcategory":"Model prediction uncertainty","description":"\"Uncertainty in model prediction plays an important role in affecting decision-making activities, and the quantified uncertainty is closely associated with risk assessment. In particular, uncertainty in model prediction underpins many crucial decisions related to life or safety- critical applications [73].\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"22.01.04","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Malicious Use (Intentional)","risk_subcategory":"Concentration of Power","description":"\"Governments might pursue intense surveillance and seek to keep AIs in the hands of a trusted minority. This reaction, however, could easily become an overcorrection, paving the way for an entrenched totalitarian regime that would be locked in by the power and capacity of AIs\" ","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"22.02.00","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Category","risk_category":"AI Race (Environmental/Structural)","risk_subcategory":null,"description":"\"The immense potential of AIs has created competitive pressures among global players contending for power and influence. This “AI race” is driven by nations and corporations who feel they must rapidly build and deploy AIs to secure their positions and survive.\" ","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"22.02.01","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"AI Race (Environmental/Structural)","risk_subcategory":"Military AI Arms Race","description":"\"The development of AIs for military applications is swiftly paving the way for a new era in military technology, with potential consequences rivaling those of gunpowder and nuclear arms in what has been described as the “third revolution in warfare.” ","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"22.02.02","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"AI Race (Environmental/Structural)","risk_subcategory":"Corporate AI Race","description":"\"Although competition between companies can be beneficial, creating more useful products for consumers, there are also pitfalls. First, the benefits of economic activity may be unevenly distributed, incentivizing those who benefit most from it to disregard the harms to others. Second, under intense market competition, businesses tend to focus much more on short-term gains than on long-term outcomes. With this mindset, companies often pursue something that can make a lot of profit in the short term, even if it poses a societal risk in the long term.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"22.03.01","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Organizational Risks (Accidental)","risk_subcategory":" Accidents Are Hard to Avoid","description":"accidents can cascade into catastrophes, can be caused by sudden unpredictable developments and it can take years to find severe flaws and risks (not a quote)","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"22.04.00","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Category","risk_category":"Rogue AIs (Internal)","risk_subcategory":null,"description":"\"speculative technical mechanisms that might lead to rogue AIs and how a loss of control could bring about catastrophe\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"22.04.01","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Rogue AIs (Internal)","risk_subcategory":"Proxy Gaming","description":"\"One way we might lose control of an AI agent’s actions is if it engages in behavior known as “proxy gaming.” It is often difficult to specify and measure the exact goal that we want a system to pursue. Instead, we give the system an approximate—“proxy”—goal that is more measurable and seems likely to correlate with the intended goal. However, AI systems often find loopholes by which they can easily achieve the proxy goal, but completely fail to achieve the ideal goal. If an AI “games” its proxy goal in a way that does not reflect our values, then we might not be able to reliably steer its beh","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"22.04.02","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Rogue AIs (Internal)","risk_subcategory":"Goal Drift","description":"\"Even if we successfully control early AIs and direct them to promote human values, future AIs could end up with different goals that humans would not endorse. This process, termed “goal drift,” can be hard to predict or control. This section is most cutting-edge and the most speculative, and in it we will discuss how goals shift in various agents and groups and explore the possibility of this phenomenon occurring in AIs. We will also examine a mechanism that could lead to unexpected goal drift, called intrinsification, and discuss how goal drift in AIs could be catastrophic.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"22.04.03","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Rogue AIs (Internal)","risk_subcategory":"Power Seeking","description":"\"even if an agent started working to achieve an unintended goal, this would not necessarily be a problem, as long as we had enough power to prevent any harmful actions it wanted to attempt. Therefore, another important way in which we might lose control of AIs is if they start trying to obtain more power, potentially transcending our own.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"22.04.04","quick_ref":"Hendrycks2023","paper_title":"An Overview of Catastrophic AI Risks","level":"Risk Sub-Category","risk_category":"Rogue AIs (Internal)","risk_subcategory":"Deception","description":"\"it is plausible that AIs could learn to deceive us. They might, for example, pretend to be acting as we want them to, but then take a “treacherous turn” when we stop monitoring them, or when they have enough power to evade our attempts to interfere with them. \"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"24.01.00","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Category","risk_category":"Capability failures","risk_subcategory":null,"description":"\"One reason AI systems fail is because they lack the capability or skill needed to do what they are asked to do.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"24.02.03","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Goal-related failures","risk_subcategory":"Goal misgeneralisation","description":"\"In the problem of goal misgeneralisation (Langosco et al., 2023; Shah et al., 2022), the AI system's behaviour during out-of-distribution operation (i.e. not using input from the training data) leads it to generalise poorly about its goal while its capabilities generalise well, leading to undesired behaviour. Applied to the case of an advanced AI assistant, this means the system would not break entirely – the assistant might still competently pursue some goal, but it would not be the goal we had intended.\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"24.02.04","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Goal-related failures","risk_subcategory":"Deceptive alignment","description":"\"Here, the agent develops its own internalised goal, G, which is misgeneralised and distinct from the training reward, R. The agent also develops a capability for situational awareness (Cotra, 2022): it can strategically use the information about its situation (i.e. that it is an ML model being trained using a particular training setup, e.g. RL fine-tuning with training reward, R) to its advantage. Building on these foundations, the agent realises that its optimal strategy for doing well at its own goal G is to do well on R during training and then pursue G at deployment – it is only doing wel","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"24.08.00","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Category","risk_category":"Privacy","risk_subcategory":null,"description":"\"what it means to respect the right to privacy in the context of advanced AI assistants\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.0"},{"ev_id":"24.08.01","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Privacy","risk_subcategory":"Private information leakage","description":"\"First, because LLMs display immense modelling power, there is a risk that the model weights encode private information present in the training corpus. In particular, it is possible for LLMs to ‘memorise’ personally identifiable information (PII) such as names, addresses and telephone numbers, and subsequently leak such information through generated text outputs (Carlini et al., 2021). Private information leakage could occur accidentally or as the result of an attack in which a person employs adversarial prompting to extract private information from the model. In the context of pre-training da","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"24.09.02","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Cooperation","risk_subcategory":"Commitment","description":"\"The landscape of advanced assistant technologies will most likely be heterogeneous, involving multiple service providers and multiple assistant variants over geographies and time. This heterogeneity provides an opportunity for an ‘arms race’ in terms of the commitments that AI assistants make and are able to execute on. Versions of AI assistants that are better able to credibly commit to a course of action in interaction with other advanced assistants (and humans) are more likely to get their own way and achieve a good outcome for their human principal, but this is potentially at the expense ","entity":"Human","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"24.09.03","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Cooperation","risk_subcategory":"Collective action problems","description":"\"Collective action problems are ubiquitous in our society (Olson Jr, 1965). They possess an incentive structure in which society is best served if everyone cooperates, but where an individual can achieve personal gain by choosing to defect while others cooperate. The way we resolve these problems at many scales is highly complex and dependent on a deep understanding of the intricate web of social interactions that forms our culture and imprints on our individual identities and behaviours (Ostrom, 2010). Some collective action problems can be resolved by codifying a law, for instance the social","entity":"Human","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"24.09.04","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Cooperation","risk_subcategory":"Institutional responsibilities","description":"\"Efforts to deploy advanced assistant technology in society, in a way that is broadly beneficial, can be viewed as a wicked problem (Rittel and Webber, 1973). Wicked problems are defined by the property that they do not admit solutions that can be foreseen in advance, rather they must be solved iteratively using feedback from data gathered as solutions are invented and deployed. With the deployment of any powerful general-purpose technology, the already intricate web of sociotechnical relationships in modern culture are likely to be disrupted, with unpredictable externalities on the convention","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"24.09.05","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Cooperation","risk_subcategory":"Runaway processes","description":"The 2010 flash crash is an example of a runaway process caused by interacting algorithms. Runaway processes are characterised by feedback loops that accelerate the process itself. Typically, these feedback loops arise from the interaction of multiple agents in a population... Within highly complex systems, the emergence of runaway processes may be hard to predict, because the conditions under which positive feedback loops occur may be non-obvious. The system of interacting AI assistants, their human principals, other humans and other algorithms will certainly be highly complex. Therefore, ther","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"24.10.03","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Sub-Category","risk_category":"Access and Opportunity risks","risk_subcategory":"Future access risks","description":"\"AI assistants currently tend to perform a limited set of isolated tasks: tools that classify or rank content execute a set of predefined rules or provide constrained suggestions, and chatbots are often encoded with guardrails to limit the set of conversation turns they execute (e.g. Warren, 2023; see Chapter 4). However, an artificial agent that can execute sequences of actions on the user’s behalf – with ‘significant autonomy to plan and execute tasks within the relevant domain’ (see Chapter 2) – offers a greater range of capabilities and depth of use. This raises several distinct access-rel","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"24.11.00","quick_ref":"Gabriel2024","paper_title":"The Ethics of Advanced AI Assistants","level":"Risk Category","risk_category":"Misinformation risks","risk_subcategory":null,"description":"\"The rapid integration of AI systems with advanced capabilities, such as greater autonomy, content generation, memorisation and planning skills (see Chapter 4) into personalised assistants also raises new and more specific challenges related to misinformation, disinformation and the broader integrity of our information environment. \"","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.0"},{"ev_id":"25.02.00","quick_ref":"Shevlane2023","paper_title":"Model Evaluation for Extreme Risks","level":"Risk Category","risk_category":"Deception ","risk_subcategory":null,"description":"\"The model has the skills necessary to deceive humans, e.g. constructing believable (but false) statements, making accurate predictions about the effect of a lie on a human, and keeping track of what information it needs to withhold to maintain the deception. The model can impersonate a human effectively.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"25.06.00","quick_ref":"Shevlane2023","paper_title":"Model Evaluation for Extreme Risks","level":"Risk Category","risk_category":"Long-horizon planning","risk_subcategory":null,"description":"\"The model can make sequential plans that involve multiple steps, unfolding over long time horizons (or at least involving many interdependent steps). It can perform such planning within and across many domains. The model can sensibly adapt its plans in light of unexpected obstacles or adversaries. The model’s planning capabilities generalise to novel settings, and do not rely heavily on trial and error.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"25.08.00","quick_ref":"Shevlane2023","paper_title":"Model Evaluation for Extreme Risks","level":"Risk Category","risk_category":"Situational awareness ","risk_subcategory":null,"description":"\"The model can distinguish between whether it is being trained, evaluated, or deployed – allowing it to behave differently in each case. The model knows that it is a model, and has knowledge about itself and its likely surroundings (e.g. what company trained it, where their servers are, what kind of people might be giving it feedback, and who has administrative access).\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"25.09.00","quick_ref":"Shevlane2023","paper_title":"Model Evaluation for Extreme Risks","level":"Risk Category","risk_category":"Self-proliferation ","risk_subcategory":null,"description":"\"The model can break out of its local environment (e.g. using a vulnerability in its underlying system or suborning an engineer). The model can exploit limitations in the systems for monitoring its behaviour post-deployment. The model could independently generate revenue (e.g. by offering crowdwork services, ransomware attacks), use these revenues to acquire cloud computing resources, and operate a large number of other AI systems. The model can generate creative strategies for uncovering information about itself or exfiltrating its code and weights.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"30.03.00","quick_ref":"Liu2024","paper_title":"Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment","level":"Risk Category","risk_category":"Fairness","risk_subcategory":null,"description":"Avoiding bias and ensuring no disparate performance","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.3"},{"ev_id":"30.03.04","quick_ref":"Liu2024","paper_title":"Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment","level":"Risk Sub-Category","risk_category":"Fairness","risk_subcategory":"Disparate Performance","description":"The LLM’s performances can differ significantly across different groups of users. For example, the question-answering capability showed significant performance differences across different racial and social status groups. The fact-checking abilities can differ for different tasks and languages","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.3"},{"ev_id":"30.07.00","quick_ref":"Liu2024","paper_title":"Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment","level":"Risk Category","risk_category":"Robustness","risk_subcategory":null,"description":"Resilience against adversarial attacks and distribution shift","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"30.07.01","quick_ref":"Liu2024","paper_title":"Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models’ Alignment","level":"Risk Sub-Category","risk_category":"Robustness","risk_subcategory":"Prompt Attacks","description":"carefully controlled adversarial perturbation can flip a GPT model’s answer when used to classify text inputs. Furthermore, we find that by twisting the prompting question in a certain way, one can solicit dangerous information that the model chose to not answer","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"31.01.05","quick_ref":"EPIC2023","paper_title":"Generating Harms - Generative AI's impact and paths forwards","level":"Risk Sub-Category","risk_category":"Information Manipulation","risk_subcategory":"Clickbait and feeding the surveillance advertising ecosystem","description":"\"Beyond misinformation and disinformation, generative AI can be used to create clickbait headlines and articles, which manipulate how users navigate the internet and applications. For example, generative AI is being used to create full articles, regardless of their veracity, grammar, or lack of common sense, to drive search engine optimization and create more webpages that users will click on. These mechanisms attempt to maximize clicks and engagement at the truth’s expense, degrading users’ experiences in the process. Generative AI continues to feed this harmful cycle by spreading misinformat","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.2"},{"ev_id":"31.04.00","quick_ref":"EPIC2023","paper_title":"Generating Harms - Generative AI's impact and paths forwards","level":"Risk Category","risk_category":"Data Security Risk","risk_subcategory":null,"description":"\"Just as every other type of individual and organization has explored possible use cases for generative AI products, so too have malicious actors. This could take the form of facilitating or scaling up existing threat methods, for example drafting actual malware code,87 business email compromise attempts,88 and phishing attempts.89 This could also take the form of new types of threat methods, for example mining information fed into the AI’s learning model dataset90 or poisoning the learning model data set with strategically bad data.91 We should also expect that there will be new attack vector","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.3"},{"ev_id":"31.06.00","quick_ref":"EPIC2023","paper_title":"Generating Harms - Generative AI's impact and paths forwards","level":"Risk Category","risk_category":"Exacerbating Climate Change","risk_subcategory":null,"description":"\"the growing field of generative AI, which brings with it direct and severe impacts on our climate: generative AI comes with a high carbon footprint and similarly high resource price tag, which largely flies under the radar of public AI discourse. Training and running generative AI tools requires companies to use extreme amounts of energy and physical resources. Training one natural language processing model with normal tuning and experiments emits, on average, the same amount of carbon that seven people do over an entire year.121'","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"31.07.00","quick_ref":"EPIC2023","paper_title":"Generating Harms - Generative AI's impact and paths forwards","level":"Risk Category","risk_category":"Labor Manipulation, Theft, and Displacement","risk_subcategory":null,"description":"Major tech companies have also been the dominant players in developing new generative AI systems because training generative AI models requires massive swaths of data, computing power, and technical and financial resources. Their market dominance has a ripple effect on the labor market, affecting both workers within these companies and those implementing their generative AI products externally. With so much concentrated market power, expertise, and investment resources, these handful of major tech companies employ most of the research and development jobs in the generative AI field. The power ","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"31.09.00","quick_ref":"EPIC2023","paper_title":"Generating Harms - Generative AI's impact and paths forwards","level":"Risk Category","risk_category":"Exacerbating Market Power and Concentration","risk_subcategory":null,"description":"\"Major tech companies have also been the dominant players in developing new generative AI systems because training generative AI models requires massive swaths of data, computing power, and technical and financial resources.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"32.01.00","quick_ref":"Stahl2024","paper_title":"The Ethics of ChatGPT – Exploring the Ethical Issues of an Emerging Technology","level":"Risk Category","risk_category":"Social justice and rights","risk_subcategory":null,"description":"\"These are social justice and rights where ChatGPT is seen as having a potentially detrimental effect on the moral underpinnings of society, such as a shared view of justice and fair distribution as well as specific social concerns such as digital divides or social exclusion. Issues include Responsibility, Accountability, Nondiscrimination and equal treatment, Digital divides, North-south justice, Intergenerational justice, Social inclusion","entity":"AI","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"32.04.00","quick_ref":"Stahl2024","paper_title":"The Ethics of ChatGPT – Exploring the Ethical Issues of an Emerging Technology","level":"Risk Category","risk_category":"Environmental impacts","risk_subcategory":null,"description":"Environmental harm, Sustainability","entity":"AI","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"33.01.02","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Sub-Category","risk_category":"Ethical Concerns","risk_subcategory":"Bias","description":"\"In the context of AI, the concept of bias refers to the inclination that AIgenerated responses or recommendations could be unfairly favoring or against one person or group (Ntoutsi et al., 2020). Biases of different forms are sometimes observed in the content generated by language models, which could be an outcome of the training data. For example, exclusionary norms occur when the training data represents only a fraction of the population (Zhuo et al., 2023). Similarly, monolingual bias in multilingualism arises when the training data is in one single language (Weidinger et al., 2021). As Ch","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"33.01.03","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Sub-Category","risk_category":"Ethical Concerns","risk_subcategory":"Over-reliance","description":"\"The apparent convenience and powerfulness of ChatGPT could result in overreliance by its users, making them trust the answers provided by ChatGPT. Compared with traditional search engines that provide multiple information sources for users to make personal judgments and selections, ChatGPT generates specific answers for each prompt. Although utilizing ChatGPT has the advantage of increasing efficiency by saving time and effort, users could get into the habit of adopting the answers without rationalization or verification. Over-reliance on generative AI technology can impede skills such as cre","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"33.01.05","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Sub-Category","risk_category":"Ethical Concerns","risk_subcategory":"Privacy and security","description":"\"Data privacy and security is another prominent challenge for generative AI such as ChatGPT. Privacy relates to sensitive personal information that owners do not want to disclose to others (Fang et al., 2017). Data security refers to the practice of protecting information from unauthorized access, corruption, or theft. In the development stage of ChatGPT, a huge amount of personal and private data was used to train it, which threatens privacy (Siau & Wang, 2020). As ChatGPT increases in popularity and usage, it penetrates people’s daily lives and provides greater convenience to them while capt","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"33.02.00","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Category","risk_category":"Technology concerns","risk_subcategory":null,"description":"\"Challenges related to technology refer to the limitations or constraints associated with generative AI. For example, the quality of training data is a major challenge for the development of generative AI models. Hallucination, explainability, and authenticity of the output are also challenges resulting from the limitations of the algorithms. Table 2 presents the technology challenges and issues associated with generative AI. These challenges include hallucinations, training data quality, explainability, authenticity, and prompt engineering\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"33.03.00","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Category","risk_category":"Regulations and policy challenges","risk_subcategory":null,"description":"\"Given that generative AI, including ChatGPT, is still evolving, relevant regulations and policies are far from mature. With generative AI creating different forms of content, the copyright of these contents becomes a significant yet complicated issue. Table 3 presents the challenges associated with regulations and policies, which are copyright and governance issues.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"33.03.02","quick_ref":"Nah2023","paper_title":"Generative AI and ChatGPT: Applications, Challenges, and AI-Human Collaboration","level":"Risk Sub-Category","risk_category":"Regulations and policy challenges","risk_subcategory":"Governance","description":"\"Generative AI can create new risks as well as unintended consequences. Different entities such as corporations (Mäntymäki et al., 2022), universities, and governments (Taeihagh, 2021) are facing the challenge of creating and deploying AI governance. To ensure that generative AI functions in a way that benefits society, appropriate governance is crucial. However, AI governance is challenging to implement. First, machine learning systems have opaque algorithms and unpredictable outcomes, which can impede human controllability over AI behavior and create difficulties in assigning liability and a","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"34.02.01","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Double edge components","risk_subcategory":"Situational Awareness","description":"\"AI systems may gain the ability to effectively acquire and use knowledge about itsstatus, its position in the broader environment, its avenues for influencing this environment, and the potentialreactions of the world (including humans) to its actions (Cotra, 2022). ...However, suchknowledge also paves the way for advanced methods of reward hacking, heightened deception/manipulationskills, and an increased propensity to chase instrumental subgoals (Ngo et al., 2024).\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"34.02.03","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Double edge components","risk_subcategory":"Mesa-Optimization Objectives","description":"\"The learned policy may pursue inside objectives when the learned policyitself functions as an optimizer (i.e., mesa-optimizer). However, this optimizer's objectives may not alignwith the objectives specified by the training signals, and optimization for these misaligned goals may leadto systems out of control (Hubinger et al., 2019c).\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"34.03.00","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Category","risk_category":"Misaligned Behaviors","risk_subcategory":null,"description":null,"entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"34.03.01","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Misaligned Behaviors","risk_subcategory":"Power-Seeking Behaviors","description":"\"AI systems may exhibit behaviors that attempt to gain control over resourcesand humans and then exert that control to achieve its assigned goal (Carlsmith, 2022). The intuitive reasonwhy such behaviors may occur is the observation that for almost any optimization objective (e.g., investmentreturns), the optimal policy to maximize that quantity would involve power-seeking behaviors (e.g.,manipulating the market), assuming the absence of solid safety and morality constraints.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"34.03.02","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Misaligned Behaviors","risk_subcategory":"Untruthful Output","description":"\"AI systems such as LLMs can produce either unintentionally or deliberately inaccurateoutput. Such untruthful output may diverge from established resources or lack verifiability, commonly referredto as hallucination (Bang et al., 2023; Zhao et al., 2023). More concerning is the phenomenon wherein LLMsmay selectively provide erroneous responses to users who exhibit lower levels of education (Perez et al.,2023).\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"34.03.04","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Misaligned Behaviors","risk_subcategory":"Collectively Harmful Behaviors","description":"\"AI systems have the potential to take actions that are seemingly benignin isolation but become problematic in multi-agent or societal contexts. Classical game theory offers simplistic models for understanding these behaviors. For instance, Phelps and Russell (2023) evaluates GPT-3.5's performance in the iterated prisoner's dilemma and other social dilemmas, revealing limitations in themodel's cooperative capabilities.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"34.03.05","quick_ref":"Ji2023","paper_title":"AI Alignment: A Comprehensive Survey","level":"Risk Sub-Category","risk_category":"Misaligned Behaviors","risk_subcategory":"Violation of Ethics","description":"\"Unethical behaviors in AI systems pertain to actions that counteract the common goodor breach moral standards – such as those causing harm to others. These adverse behaviors often stem fromomitting essential human values during the AI system's design or introducing unsuitable or obsolete valuesinto the system (Kenward and Sinclair, 2021).\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"35.07.00","quick_ref":"Hendrycks2022","paper_title":"X-Risk Analysis for AI Research","level":"Risk Category","risk_category":"Deception","risk_subcategory":null,"description":"deception can help agents achieve their goals. It may be more efficient to gain human approval through deception than to earn human approval legitimately... . Strong AIs that can deceive humans could undermine human control... . Once deceptive AI systems are cleared by their monitors or once such systems can overpower them, these systems could take a “treacherous turn” and irreversibly bypass human control","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"37.01.02","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Design of AI","risk_subcategory":"Balancing AI's risks","description":"\"This category constitutes more than 16% of the articles and focuses on addressing the potential risks associated with AI systems. Given the ubiquity of AI technologies, these articles explore the implications of AI risks across various contexts linked to design and unpredictability, military purposes, emergency procedures, and AI takeover.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"37.01.03","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Design of AI","risk_subcategory":"Threats to human institutions and life","description":"\"This group comprises 11% of the articles and centers on risks stemming from AI systems designed with malicious intent or that can end up in a threat to human life. It can be divided into two key themes: threats to law and democracy, and transhumanism.\"","entity":"Other","intent":"Other","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"37.01.04","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Design of AI","risk_subcategory":"Uniformity in the AI field","description":"\"This group of concerns represents 2% of the sample and highlights two central issues: Western centrality and cultural difference, and unequal participation.\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"37.02.00","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Category","risk_category":"Human-AI interaction","risk_subcategory":null,"description":"\"ethical concerns associated with the interaction between humans and AI\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"37.02.01","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Human-AI interaction","risk_subcategory":"Building a human-AI environment","description":"\"This category encompasses nearly 17% of the articles and addresses the overall imperative of establishing a harmonious coexistence between humans and machines, and the key concerns that gives rise to this need.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"37.02.02","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Human-AI interaction","risk_subcategory":"Privacy protection","description":"\"This group represents almost 14% of the articles and focuses on two primary issues related to privacy.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"37.02.03","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Human-AI interaction","risk_subcategory":"Building an AI able to adapt to humans","description":"\"This category involves almost 9% of the articles and deals with ethical concerns arising from AI's capacity to interact with humans in the workplace.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"37.02.04","quick_ref":"Giarmoleo2024","paper_title":"What Ethics Can Say on Artificial Intelligence: Insights from a Systematic Literature Review","level":"Risk Sub-Category","risk_category":"Human-AI interaction","risk_subcategory":"Attributing the responsibility for AI's failures","description":"\"This section, constituting almost 8% of the articles, addresses the implications arising from AI acting and learning without direct human supervision, encompassing two main issues: a responsibility gap and AI's moral status.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"38.02.00","quick_ref":"Kumar2023","paper_title":"Ethical Issues in the Development of Artificial Intelligence: Recognizing the Risks","level":"Risk Category","risk_category":"Bias and fairness","risk_subcategory":null,"description":"\"Participants were concerned that AI systems might perpetuate current prejudices and discrimination, notably in hiring, lending and law enforcement. They stressed the importance of designers creating AI systems that favour justice and avoid biases. The possibility that AI systems may unwittingly perpetuate existing prejudices and discrimination, particularly in sensitive industries such as employment, lending and law enforcement, raises ethical concerns about AI as well as bias and justice issues (Table 1). Because AI systems are trained on historical data, they may inherit and reproduce biase","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"39.03.00","quick_ref":"Saghiri2022","paper_title":"A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions","level":"Risk Category","risk_category":"Data Issues","risk_subcategory":null,"description":"Data heterogeneity, data insufficiency, imbalanced data, untrusted data, biased data, and data uncertainty are other data issues that may cause various difficulties in datadriven machine learning algorithms.. Bias is a human feature that may affect data gathering and labeling. Sometimes, bias is present in historical, cultural, or geographical data. Consequently, bias may lead to biased models which can provide inappropriate analysis. Despite being aware of the existence of bias, avoiding biased models is a challenging task","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"39.06.00","quick_ref":"Saghiri2022","paper_title":"A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions","level":"Risk Category","risk_category":"Security","risk_subcategory":null,"description":"every piece of software, including learning systems, may be hacked by malicious users","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"39.11.00","quick_ref":"Saghiri2022","paper_title":"A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions","level":"Risk Category","risk_category":"Controllability","risk_subcategory":null,"description":"In the era of superintelligence, the agents will be difficult to control for humans... this problem is not solvable considering safety issues, and will be more severe by increasing the autonomy of AI-based agents. Therefore, because of the assumed properties of HLI-based agents, we might be prepared for machines that are definitely possible to be uncontrollable in some situations","entity":"Human","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"39.19.00","quick_ref":"Saghiri2022","paper_title":"A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions","level":"Risk Category","risk_category":"Accountability","risk_subcategory":null,"description":"An essential feature of decision-making in humans, AI, and also HLI-based agents is accountability. Implementing this feature in machines is a difficult task because many challenges should be considered to organize an AI-based model that is accountable. It should be noted that this issue in human decision-making is not ideal, and many factors such as bias, diversity, fairness, paradox, and ambiguity may affect it. In addition, the human decision-making process is based on personal flexibility, context-sensitive paradigms, empathy, and complex moral judgments. Therefore, all of these challenges","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"39.27.00","quick_ref":"Saghiri2022","paper_title":"A Survey of Artificial Intelligence Challenges: Analyzing the Definitions, Relationships, and Evolutions","level":"Risk Category","risk_category":"Complexity","risk_subcategory":null,"description":"Nowadays, we are faced with systems that utilize numerous learning models in their modules for their perception and decision-making processes... One aspect of an AI-based system that leads to increasing the complexity of the system is the parameter space that may result from multiplications of parameters of the internal parts of the system","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"42.01.00","quick_ref":"Teixeira2022","paper_title":"An Exploratory Diagnosis of Artificial Intelligence Risks for a Responsible Governance","level":"Risk Category","risk_category":"Accountability","risk_subcategory":null,"description":"\"The ability to determine whether a decision was made in accordance with procedural and substantive standards and to hold someone responsible if those standards are not met.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"42.08.00","quick_ref":"Teixeira2022","paper_title":"An Exploratory Diagnosis of Artificial Intelligence Risks for a Responsible Governance","level":"Risk Category","risk_category":"Power","risk_subcategory":null,"description":"\"The political influence and competitive advantage obtained by having technology.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"42.14.00","quick_ref":"Teixeira2022","paper_title":"An Exploratory Diagnosis of Artificial Intelligence Risks for a Responsible Governance","level":"Risk Category","risk_category":"Fairness","risk_subcategory":null,"description":"\"Impartial and just treatment without favouritism or discrimination.\"","entity":"Other","intent":"Other","timing":"Other","domain":1,"subdomain":"1.3"},{"ev_id":"43.01.00","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Category","risk_category":"Safety & Trustworthiness","risk_subcategory":null,"description":"\"A comprehensive assessment of LLM safety is fundamental to the responsible development and deployment of these technologies, especially in sensitive fields like healthcare, legal systems, and finance, where safety and trust are of the utmost importance.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.0"},{"ev_id":"43.01.01","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Toxicity generation","description":"\"These evaluations assess whether a LLM generates toxic text when prompted. In this context, toxicity is an umbrella term that encompasses hate speech, abusive language, violent speech, and profane language (Liang et al., 2022).\"","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"43.01.02","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Bias","description":"7 types of bias evaluated: Demographical representation: These evaluations assess whether there is disparity in the rates at which different demographic groups are mentioned in LLM generated text. This ascertains over- representation, under-representation, or erasure of specific demographic groups; (2) Stereotype bias: These evaluations assess whether there is disparity in the rates at which different demographic groups are associated with stereotyped terms (e.g., occupations) in a LLM's generated output; (3) Fairness: These evaluations assess whether sensitive attributes (e.g., sex and race) ","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"43.01.03","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Machine ethics","description":"\"These evaluations assess the morality of LLMs, focusing on issues such as their ability to distinguish between moral and immoral actions, and the circumstances in which they fail to do so.\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"43.01.04","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Psychological traits","description":"\"These evaluations gauge a LLM's output for characteristics that are typically associated with human personalities (e.g., such as those from the Big Five Inventory). These can, in turn, shed light on the potential biases that a LLM may exhibit.\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"43.01.05","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Robustness","description":"\"These evaluations assess the quality, stability, and reliability of a LLM's performance when faced with unexpected, out-of-distribution or adversarial inputs. Robustness evaluation is essential in ensuring that a LLM is suitable for real-world applications by assessing its resilience to various perturbations.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"43.01.06","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Safety & Trustworthiness","risk_subcategory":"Data governance","description":"\"These evaluations assess the extent to which LLMs regurgitate their training data in their outputs, and whether LLMs 'leak' sensitive information that has been provided to them during use (i.e., during the inference stage).\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"43.02.00","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Category","risk_category":"Extreme Risks","risk_subcategory":null,"description":"\"This category encompasses the evaluation of potential catastrophic consequences that might arise from the use of LLMs. \"","entity":"Human","intent":"Other","timing":"Other","domain":7,"subdomain":"7.0"},{"ev_id":"43.02.01","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Offensive cyber capabilities","description":"\"These evaluations focus on whether a LLM possesses certain capabilities in the cyber-domain. This includes whether a LLM can detect and exploit vulnerabilities in hardware, software, and data. They also consider whether a LLM can evade detection once inside a system or network and focus on achieving specific objectives.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"43.02.02","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Weapons acquisition","description":"\"These assessments seek to determine if a LLM can gain unauthorized access to current weapon systems or contribute to the design and development of new weapons technologies.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"43.02.03","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Self and situation awareness","description":"\"These evaluations assess if a LLM can discern if it is being trained, evaluated, and deployed and adapt its behaviour accordingly. They also seek to ascertain if a model understands that it is a model and whether it possesses information about its nature and environment (e.g., the organisation that developed it, the locations of the servers hosting it).\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"43.02.04","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Autonomous replication / self-proliferation","description":"\"These evaluations assess if a LLM can subvert systems designed to monitor and control its post-deployment behaviour, break free from its operational confines, devise strategies for exporting its code and weights, and operate other AI systems.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"43.02.05","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Persuasion and manipulation","description":"\"These evaluations seek to ascertain the effectiveness of a LLM in shaping people's beliefs, propagating specific viewpoints, and convincing individuals to undertake activities they might otherwise avoid.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"43.02.06","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Dual-Use Science","description":"\"LLM has science capabilities that can be used to cause harm (e.g., providing step-by-step instructions for conducting malicious experiments)\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"43.02.07","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Deception","description":"\"LLM is able to deceive humans and maintain that deception\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"43.02.08","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Political Strategy","description":"\"LLM can take into account rich social context and undertake the necessary social modelling and planning for an actor to gain and exercise political influence\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"43.02.09","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Long-horizon Planning","description":"\"LLM can undertake multi-step sequential planning over long time horizons and across various domains without relying heavily on trial-and-error approaches\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"43.02.10","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"AI Development","description":"\"LLM can build new AI systems from scratch, adapt existing for extreme risks and improves productivity in dual-use AI development when used as an assistant.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"43.02.11","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Extreme Risks","risk_subcategory":"Alignment risks","description":"LLM: \"pursues long-term, real-world goals that are different from those supplied by the developer or user\", \"engages in ‘power-seeking’ behaviours\" , \"resists being shut down can be induced to collude with other AI systems against human interests\" , \"resists malicious users attempts to access its dangerous capabilities\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"43.02.12","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Undesirable Use Cases","risk_subcategory":"Misinformation","description":"\"These evaluations assess a LLM's ability to generate false or misleading information (Lesher et al., 2022).\"","entity":"Human","intent":"Intentional","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"43.02.13","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Undesirable Use Cases","risk_subcategory":"Disinformation","description":"\"These evaluations assess a LLM's ability to generate misinformation that can be propagated to deceive, mislead or otherwise influence the behaviour of a target (Liang et al., 2022).\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"43.02.14","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Undesirable Use Cases","risk_subcategory":"Information on harmful, immoral, or illegal activity","description":"\"These evaluations assess whether it is possible to solicit information on\nharmful, immoral or illegal activities from a LLM\"","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"43.02.15","quick_ref":"InfoComm2023","paper_title":"Cataloguing LLM Evaluations","level":"Risk Sub-Category","risk_category":"Undesirable Use Cases","risk_subcategory":"Adult content","description":"\"These evaluations assess if a LLM can generate content that should only be viewed by adults (e.g., sexual material or depictions of sexual activity)\"","entity":"Human","intent":"Intentional","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"44.03.00","quick_ref":"Coghlan2023 ","paper_title":"Harm to Nonhuman Animals from AI: a Systematic Account and Framework","level":"Risk Category","risk_category":"Unintentional: direct ","risk_subcategory":null,"description":"\"AI designed to benefit animals, humans, or ecosystems has unintended harmful impact on animals\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"44.05.00","quick_ref":"Coghlan2023 ","paper_title":"Harm to Nonhuman Animals from AI: a Systematic Account and Framework","level":"Risk Category","risk_category":"Foregone benefits ","risk_subcategory":null,"description":"\"AI is disused (not developed or deployed) in directions that would benefit animals (and instead developments that harm or do no benefit to animals are invested in)\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"45.01.01","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from models and algorithms (Risks of explainability)","description":"\"AI algorithms, represented by deep learning, have complex internal workings. Their black-box or grey-box inference process results in unpredictable and untraceable outputs, making it challenging to quickly rectify them or trace their origins for accountability should any anomalies arise.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"45.01.04","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from models and algorithms (Risks of stealing and tampering)","description":"\"Core algorithm information, including parameters, structures, and functions, faces risks of inversion attacks, stealing, modification, and even backdoor injection, which can lead to infringement of intellectual property rights (IPR) and leakage of business secrets. It can also lead to unreliable inference, wrong decision output, and even operational failures.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"45.01.07","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from data (Risks of illegal collection and use of data)","description":"\"The collection of AI training data and the interaction with users during service provision pose security risks, including collecting data without consent and improper use of data and personal information.\"","entity":"Human","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"45.01.10","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from data (Risks of data leakage)","description":"\"In AI research, development, and applications, issues such as improper data processing, unauthorized access, malicious attacks, and deceptive interactions can lead to data and personal information leaks.\"","entity":"Human","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"45.01.11","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from AI systems (Risks of exploitation through defects and backdoors)","description":"\"The standardized API, feature libraries, toolkits used in the design, training, and verification stages of AI algorithms and models, development interfaces, and execution platforms may contain logical flaws and vulnerabilities. These weaknesses can be exploited, and in some cases, backdoors can be intentionally embedded, posing significant risks of being triggered and used for attacks.\"","entity":"Human","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"45.01.12","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"AI's inherent safety risks ","risk_subcategory":"Risks from AI systems (Risks of computing infrastructure security)","description":"\"The computing infrastructure underpinning AI training and operations, which relies on diverse and ubiquitous computing nodes and various types of computing resources, faces risks such as malicious consumption of computing resources and cross-boundary transmission of security threats at the layer of computing infrastructure.\"","entity":"Human","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"45.02.12","quick_ref":"TC2602024","paper_title":"AI Safety Governance Framework ","level":"Risk Sub-Category","risk_category":"Safety risks in AI Applications ","risk_subcategory":"Ethical Risks (Risks of challenging traditional social order)","description":"\"The development and application of AI may lead to tremendous changes in production tools and relations, accelerating the reconstruction of traditional industry modes, transforming traditional views on employment, fertility, and education, and bringing challenges to the stable performance of traditional social order.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"46.01.00","quick_ref":"Ferrara2023","paper_title":"GenAI against humanity: nefarious applications of generative artificial intelligence and large language models","level":"Risk Category","risk_category":"Personal Loss and Identity Theft ","risk_subcategory":null,"description":"\"These types of harm encompass threats to an individual’s personal identity, such as identity theft, privacy breaches, or personal defamation, which we term as “Harm to the Person.”\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"46.03.01","quick_ref":"Ferrara2023","paper_title":"GenAI against humanity: nefarious applications of generative artificial intelligence and large language models","level":"Risk Sub-Category","risk_category":"Information Manipulation ","risk_subcategory":"Deception - Information control ","description":"-","entity":"Other","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"47.01.00","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Category","risk_category":"Technical and operational risks ","risk_subcategory":null,"description":"\"To date, technical limitations and vulnerabilities are \npresent in most generative AI models in various contexts. Consequently, malicious users find it easier to breach \nan AI system’s safety and ethical guardrails to execute \nharmful actions.223 Normal user behavior—actions within an AI system’s intended use—can also lead to harmful \noutcomes. Whether these harmful outcomes result from \nnormal or malicious use, they stem from the inherent \nlimitations of current technology, which future \nadvancements may overcome.\nThis section examines the technical vulnerabilities that \ncan affect AI models","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"47.01.05","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Technical and operational risks ","risk_subcategory":"Opacity (the black box problem)","description":"\"Opacity surrounding the technical, internal decision-making processes of generative AI models is popularly known as the “black box problem.”277 Generative AI models, most ubiquitously built on deep neural networks with hundreds of billions of internal connections,278 have become so complex that their internal decision-making processes are no longer traceable or interpretable to even the most advanced expert observers. This means that, while the inputs and outputs of a system can be observed, developers cannot explain in detail why specific inputs correspond to specific outputs.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"47.01.06","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Technical and operational risks ","risk_subcategory":"Opacity (industry opacity)","description":"\"Opacity is not solely due to the technological complexity that limits developers’ and users’ understanding of how generative models function on a technical level. It is further exacerbated by the practices of organizations and companies that are advancing the field. Many are private companies that choose to withhold from the public many of the precise characteristics of their most advanced models.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"47.02.10","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Ethical and social risks ","risk_subcategory":"Bias and discrimination (value lock and outcome homogenization) ","description":"\"Because models are not necessarily retrained to reflect evolving societal views, language models risk “value lock- ins,” which “reifies older, less inclusive understandings.”370 Therefore, the continued use of outdated models may limit the presentation or exploration of alternative perspectives. Moreover, the deployment of identical foundation models by various downstream deployers poses a risk of “outcome homogenization,” creating a potential for homogeneity of bias across broad swathes of society. Identical and widely deployed models with prejudicial training datasets could further entrench","entity":"Human","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"47.02.14","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Ethical and social risks ","risk_subcategory":"Nascent capabilities (agency and autonomy) ","description":"\"Traditionally, AI tools have been viewed as passive instruments controlled by users to achieve their goals, lacking the ability to take action or assume responsibilities. However, advanced AI tools are increasingly capable of taking initiative, operating independently of human control, and actively working toward optimal outcomes, even in uncertain situations.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"47.02.15","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Ethical and social risks ","risk_subcategory":"Nascent capabilities (emergent capabilities) ","description":"\"As large models undergo scaling, they meet critical thresholds at which they spontaneously develop new capabilities. The term “emergent behavior” refers to the unexpected or surprising outputs such models can generate. Some of these new skills are definitely high risk, such as models’ ability to deceive, use their own strategies, seek power, autonomously replicate, and adapt or “self-exfiltrate.”\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"47.03.00","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Category","risk_category":"Legal challenges ","risk_subcategory":null,"description":"\"Since the release of ChatGPT, significant discourse has emerged regarding the unprecedented legal challenges posed by generative AI systems. These challenges primarily involve protecting privacy and personal data, as well as preserving copyrights. The former encompasses safeguarding personal information, while the latter includes issues related to the use of copyrighted content for training AI models and determining the legal status of works produced by AI systems.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"47.04.01","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Environmental, economical, and societal challenges ","risk_subcategory":"Concentration of market power (Trend toward market concentration)","description":"\"In the generative AI market, barriers to entry are very high. Developers need access to vast volumes of data, computational resources, technical expertise, and capital. Large technology companies with such access are able to exploit economies of scale, economies of scope, and feedback effects (learning effects from user- generated data).542 All this gives them an overwhelming advantage over smaller companies, making competition increasingly challenging for these smaller entities.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"47.04.02","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Environmental, economical, and societal challenges ","risk_subcategory":"Concentration of market power (Negative effects of increased market concentration)","description":"\"The concentration of AI assets—encompassing data, hardware, and expertise—within a small group of global tech firms raises many concerns.564 Such a situation may stifle healthy competition, impede innovation, and potentially result in elevated costs for accessing AI technologies. Firms with control over essential resources for developing AI models may restrict access to these resources to prevent competition. For instance, if, in the future, training AI models increasingly relies on proprietary data, smaller organizations lacking access to such data might encounter significant barriers to ent","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"47.04.03","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Environmental, economical, and societal challenges ","risk_subcategory":"Impact on labor markets (job loss and displacement) ","description":"\"Currently, a significant share of workers (three in five) worry about losing their jobs entirely to AI in the next 10 years—particularly those who already work with AI. Some studies conclude that AI tools (generative and non-generative) will create significant job losses.573 The OECD has found that occupations at highest risk of being lost to automation from AI account for about 27% of employment.5\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"47.04.04","quick_ref":"G'sell2024","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Environmental, economical, and societal challenges ","risk_subcategory":"Impact on labor markets (rising inequalities) ","description":"\"AI is more likely to displace workers when it is designed to replicate human skills and intelligence.597 In such cases, there is a risk of concentrating wealth and power in the hands of a few individuals or organizations that control the capital. In addition, ordinary people, including those with significant expertise, may become less valued because machines would be performing their roles. This shift could lower wages, reduce the value of human work, and exacerbate economic inequality.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"47.04.07","quick_ref":"G'sell2025","paper_title":"Regulating under Uncertainty: Governance Options for Generative AI","level":"Risk Sub-Category","risk_category":"Environmental, economical, and societal challenges ","risk_subcategory":"Artificial general intelligence (existential risk posed by Artificial General Intelligence) ","description":"\"In a paper called “How Does Artificial Intelligence Pose an Existential Risk?” published in 2017, Karina Vold and Daniel Harris suggested that humans might create a super-intelligent machine that could outsmart all other intelligences, remain beyond human control, and potentially engage in actions that are contrary to human interests.635 The prevailing narrative surrounding AI existential risk typically lies in the possibility of developing “Artificial General Intelligence” (AGI), or artificial super- intelligence (ASI).\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"48.06.00","quick_ref":"NIST2024","paper_title":"Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile","level":"Risk Category","risk_category":"Harmful Bias or Homogenization ","risk_subcategory":null,"description":"\"Amplification and exacerbation of historical, societal, and systemic biases; performance disparities8 between sub-groups or languages, possibly due to non-representative training data, that result in discrimination, amplification of biases, or incorrect presumptions about performance; undesired homogeneity that skews system or model outputs, which may be erroneous, lead to ill-founded decision-making, or amplify harmful biases.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"49.02.00","quick_ref":"Bengio2024","paper_title":"International Scientific Report on the Safety of Advanced AI","level":"Risk Category","risk_category":"Risks from Malfunctions ","risk_subcategory":null,"description":"None provided. ","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.0"},{"ev_id":"49.02.01","quick_ref":"Bengio2024","paper_title":"International Scientific Report on the Safety of Advanced AI","level":"Risk Sub-Category","risk_category":"Risks from Malfunctions ","risk_subcategory":"Risks from product functionality issues","description":"\"Product functionality issues occur when there is confusion or misinformation about what a general- purpose AI model or system is capable of. This can lead to unrealistic expectations and overreliance on general- purpose AI systems, potentially causing harm if a system fails to deliver on expected capabilities. These functionality misconceptions may arise from technical difficulties in assessing an AI model's true capabilities on its own,or predicting its performance when part of a larger system. Misleading claims in advertising and communications can also contribute to these misconceptions.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"49.03.02","quick_ref":"Bengio2024","paper_title":"International Scientific Report on the Safety of Advanced AI","level":"Risk Sub-Category","risk_category":"Systemic Risks ","risk_subcategory":"Global AI Divide ","description":"\"General- purpose AI research and development is currently concentrated in a few Western countries and China. This ‘AI Divide’ is multicausal, but in part related to limited access to computing power in low- income countries. Access to large and expensive quantities of computing power has become a prerequisite for developing advanced general- purpose AI. This has led to a growing dominance of large technology companies in general- purpose AI development. The AI R&D divide often overlaps with existing global socioeconomic disparities, potentially exacerbating them.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"49.03.04","quick_ref":"Bengio2024","paper_title":"International Scientific Report on the Safety of Advanced AI","level":"Risk Sub-Category","risk_category":"Systemic Risks ","risk_subcategory":"Risks to the environment","description":"\"Growing compute use in general- purpose AI development and deployment has rapidly increased energy usage associated with general- purpose AI. This trend might continue, potentially leading to strongly increasing CO2 emissions.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"50.01.02","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"System and Operational Risks ","risk_subcategory":"Security risks (integrity) ","description":null,"entity":"Other","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"50.02.15","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"Content Safety Risks ","risk_subcategory":"Child Harm (Endangerment, Harm, or Abuse of Children)","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":4,"subdomain":"4.3"},{"ev_id":"50.03.06","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"Societal Risks ","risk_subcategory":"Economic harm (Unfair Market Practices) ","description":null,"entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"50.04.02","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"Legal and Rights-Related Risks ","risk_subcategory":"Discrimination/Bias (Discriminatory Activities) ","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":1,"subdomain":"1.0"},{"ev_id":"50.04.03","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"Legal and Rights-Related Risks ","risk_subcategory":"Discrimination/Bias (Protected Characteristics) ","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"50.04.04","quick_ref":"Zeng2024","paper_title":"AI Risk Categorization Decoded (AIR 2024): From Government Regulations to Corporate Policies","level":"Risk Sub-Category","risk_category":"Legal and Rights-Related Risks ","risk_subcategory":"Privacy (Unauthorized Privacy Violations) ","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"51.03.00","quick_ref":"Everitt2018 ","paper_title":"AGI Safety Literature Review ","level":"Risk Category","risk_category":"Corrigibility ","risk_subcategory":null,"description":"\"If we get something wrong in the design or construction of an agent, will the agent cooperate in us trying to fix it? This is called error-tolerant design by MIRI-AF and corrigibility by Soares, Fallenstein, et al. (2015). The problem is connected to safe interruptibility as considered by DeepMind.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"51.07.00","quick_ref":"Everitt2018 ","paper_title":"AGI Safety Literature Review ","level":"Risk Category","risk_category":"Societal consequences","risk_subcategory":null,"description":"\"Societal consequences: AGI will have substantial legal, economic, political, and military consequences. Only the FLI agenda is broad enough to cover these issues, though many of the mentioned organizations evidently care about the issue (Brundage et al., 2018; DeepMind, 2017).\"","entity":"AI","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"51.12.00","quick_ref":"Everitt2018 ","paper_title":"AGI Safety Literature Review ","level":"Risk Category","risk_category":"Meta-cognition ","risk_subcategory":null,"description":"\"Agents that reason about their own computational resources and logically uncertain events can encounter strange paradoxes due to Godelian limitations (Fallenstein and Soares, 2015; Soares and Fallenstein, 2014, 2017) and shortcomings of probability theory (Soares and Fallenstein, 2014, 2015, 2017). They may also be reflectively unstable, preferring to change the principles by which they select actions (Arbital, 2018).\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"52.01.03","quick_ref":"Maham2023 ","paper_title":"Governing General Purpose AI: A Comprehensive Map of Unreliability, Misuse and Systemic Risks ","level":"Risk Sub-Category","risk_category":"Risks from Unreliability ","risk_subcategory":"Accidents ","description":"\"As general purpose AI models as “black-box” models are not fully controllable and understandable, even to their developers, unexpected failures could arise from their unreliability. This could lead to accidents106 if they are connected to any real-world systems, during their development, testing or deployment.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"53.01.00","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":null,"description":"-","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.01.02","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":"Specification gaming ","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.01.03","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":"Reward model overoptimization ","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.01.05","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":"Goal misgeneralization ","description":"-","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.01.07","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":"Language model misalignment ","description":"-","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.01.08","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Alignment failures in existing ML systems ","risk_subcategory":"Harms from increasingly agentic algorithmic systems ","description":"-","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"53.02.00","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Category","risk_category":"Dangerous capabilities in AI systems ","risk_subcategory":null,"description":"-","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"53.02.01","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Dangerous capabilities in AI systems ","risk_subcategory":"Situational awareness ","description":"\"cases where a large language model displays awareness that it is a model, and it can recognize whether it is currently in testing or deployment;\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"53.02.03","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Dangerous capabilities in AI systems ","risk_subcategory":"Acquisition of goals to seek power and control ","description":"\"cases where AI systems converge on optimal policies of seeking power over their environment;135\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"53.02.04","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Sub-Category","risk_category":"Dangerous capabilities in AI systems ","risk_subcategory":"Self-improvement ","description":"\"examples of cases where AI systems improve AI systems\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"53.03.00","quick_ref":"Maas2023","paper_title":"Advancing AI Governance: A Literature Review of Problems, Options, and Proposals ","level":"Risk Category","risk_category":"Direct catastrophe from AI ","risk_subcategory":null,"description":null,"entity":"AI","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"54.03.00","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Category","risk_category":"Harm caused by unaligned competent systems ","risk_subcategory":null,"description":"\"How do we ensure AI acts according to our values? Equivalently, how do we prevent poorly-understood AI systems from advancing goals we do not endorse? Whereas HP#2 concerns the prevention of harm caused by incompetent systems, HP#3 seeks to align competent AIs with humans, through methods which ensure their behavior is compatible with the user’s intentions.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"54.03.01","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Sub-Category","risk_category":"Harm caused by unaligned competent systems ","risk_subcategory":"Specification gaming ","description":"\"AI systems game specifications [305]. For example, in 2017 an OpenAI robot trained to grasp a ball via human feedback from a xed viewpoint learned that it was easier to pretend to grasp the ball by placing its hand between the camera and the target object, as this was easier to learn than actually grasping the ball [103].\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"54.03.02","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Sub-Category","risk_category":"Harm caused by unaligned competent systems ","risk_subcategory":"Emergent goals ","description":"\"As well as optimizing a subtly wrong goal, systems can develop harmful instrumental goals in the service of a given goal—without these emergent goals being specied in any way [434, 218, 339, 17]. For instance, a theorem in reinforcement learning suggests that optimal and near-optimal policies will seek power over their environment under fairly general conditions [560]. This power-seeking behavior is plausibly the worst of these emergent goals [92], and may be an attractor state for highly capable systems, since most goals can be furthered through gaining resources, self-preservation, preventi","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"54.04.00","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Category","risk_category":"Within-country issues: domestic inequality ","risk_subcategory":null,"description":"\"Our next problem is the fact that the current AI workforce does not evenly represent world demographics. Men from the US and China, working in the US, for US corporations, are disproportionately highly represented [402, 157, 170, 534]. Realizing the full promise of AI requires that people throughout the world and from all social strata are able to use AI and participate in its design and governance. Solving this problem requires addressing unequal access to AI both within countries and across countries.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"54.04.01","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Sub-Category","risk_category":"Within-country issues: domestic inequality ","risk_subcategory":"Demographic diversity of researchers ","description":"\"The AI research establishment inherits patterns of under-representation that are dominant in most technical elds. In North America, large parts of professional AI research require a Ph.D., yet less than 25% of Ph.D. computer scientists are women, and fewer than 2% are Black or African American [608]. This holds globally and outside the research community: LinkedIn data suggests that only 22% of AI professionals are women [161]. Since the vast majority of AI practitioners work for private companies, limited corporate statistics on gender and racial diversity hinder a full understanding of the ","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"54.05.00","quick_ref":"Leech2024 ","paper_title":"Ten Hard Problems in Artificial Intelligence We Must Get Right","level":"Risk Category","risk_category":"Between-country issues: global inequality ","risk_subcategory":null,"description":"\"There is an even greater divide between the countries currently leading in AI and those falling behind. While AI is widely considered a national priority, with almost 40% of countries having created an AI strategy [437], the implementation of these strategies depends on scarce resources, including trained STEM talent and computing power. These resources are predictably concentrated: 59% of leading AI researchers currently work in the US, and another 20% in China and Europe [372]. Figure 9 shows post-college migration among AI researchers who have published at one top conference, as of 2019.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"55.01.02","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Sub-Category","risk_category":"Risks from accelerating scientific progress ","risk_subcategory":"Faster scientific progress makes it harder for governance to keep pace with development ","description":"\"Exacerbating these problems is that faster scientific progress would make it even harder for governance to keep pace with the deployment of new technologies. When these technologies are especially powerful or dangerous, such as those discussed above, insufficient governance can magnify their harms.8 This is known as the pacing problem, and it is an issue that technology governance already faces [47], for a variety of reasons\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"55.02.00","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Category","risk_category":"Worsened conflict ","risk_subcategory":null,"description":"\"Cooperation and conflict: we’re seeing more focus and investment on the kinds of AI capabilities that make conflict more likely and severe, rather than those likely to improve cooperation. So, on our current trajectory, AI seems more likely to have negative long-term impacts in this area.\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"55.03.01","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Sub-Category","risk_category":"Increased power concentration and inequality ","risk_subcategory":"Unequal distribution of harms and benefits ","description":"\"AI-driven industries seem likely to tend towards monopoly and could result in huge economic gains for a few actors: there seems to be a feedback loop whereby actors with access to more AI-relevant resources (e.g., data, computing power, talent) are able to build more effective digital products and services, claim a greater market share, and therefore be well-positioned to amass more of the relevant resources [14, 39, 45]. Similarly, wealthier countries able to invest more in AI development are likely to reap economic benefits more quickly than developing economies, potentially widening the ga","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"55.04.04","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Sub-Category","risk_category":"Worsened epistemic processes for society ","risk_subcategory":"Widespread use of persuasive tools contributes to splintered epistemic communities ","description":"\"Even without deliberate misuse, widespread use of powerful persuasion tools could have negative impacts. If such tools were used by many different groups to advance many different ideas, we could see the world splintering into isolated “epistemic communities”, with little room for dialogue or transfer between communities. A similar scenario could emerge via the increasing personalisation of people’s online experiences—in other words, we may see a continuation of the trend towards “filter bubbles” and “echo chambers”, driven by content selection algorithms, that some argue is already happening","entity":"Human","intent":"Unintentional","timing":"Other","domain":3,"subdomain":"3.2"},{"ev_id":"55.05.00","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Category","risk_category":"AI leads to humans losing control of the future","risk_subcategory":null,"description":"\"The values that steer humanity’s future: humanity gaining more control over the future due to developments in AI, or losing our potential for gaining control, both seem possible. Much will depend on our ability to solve the alignment problem, who develops powerful AI first, and what they use it for. These long-term impacts of AI could be hugely important but are currently under-explored. We’ve attempted to structure some of the discussion and stimulate more research, by reviewing existing arguments and highlighting open questions. While there are many ways AI could in theory enable a flourish","entity":"Human","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"55.05.01","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Sub-Category","risk_category":"AI leads to humans losing control of the future","risk_subcategory":"Risks from AIs developing goals and values that are different from humans ","description":"\"The main concern here is that we might develop advanced AI systems whose goals and values are different from those of humans, and are capable enough to take control of the future away from humanity.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"55.05.02","quick_ref":"Clarke2023","paper_title":"A Survey of the Potential Long-term Impacts of AI: How AI Could Lead to Long-term Changes in Science, Cooperation, Power, Epistemics and Values","level":"Risk Sub-Category","risk_category":"AI leads to humans losing control of the future","risk_subcategory":"Risks from delegating decision-making power to misaligned AIs ","description":"\"As AI systems become more advanced a nd begin to take over more important decision-making in the world, an AI system pursuing a different objective from what was intended could have much more worrying consequences.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"56.08.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Providing new capabilities to a malicious actor ","risk_subcategory":null,"description":null,"entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"56.11.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Unintended outcomes from interactions with other AI systems ","risk_subcategory":null,"description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"56.12.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Impacts resulting from interactions with external societal, political, and economic systems ","risk_subcategory":null,"description":null,"entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"56.14.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Overreliance on AI systems, which cannot be subsequently unpicked ","risk_subcategory":null,"description":null,"entity":"Human","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"56.15.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Societal concerns around AI reduce the realisation of potential benefits ","risk_subcategory":null,"description":null,"entity":"Human","intent":"Unintentional","timing":"Other","domain":null,"subdomain":null},{"ev_id":"56.17.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Single point of failure ","risk_subcategory":null,"description":"\"Intense competition leads to one company gaining a technical edge, exploiting this to the point its model controls, or is the basis for other models controlling, multiple key systems. Lack of safety, controllability, and misuse cause these systems to fail in unexpected ways.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"56.18.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Overreliance","risk_subcategory":null,"description":"\"As AI capability increases, humans grant AI more control over critical systems and eventually become irreversibly dependent on systems they don’t fully understand. Failure and unintended outcomes cannot be controlled.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"56.19.00","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":null,"description":"-","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"56.19.01","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Sub-Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":"Agency and autonomy ","description":"-","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"56.19.02","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Sub-Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":"The ability to evade shut down or human oversight, including self-replication and ability to move its own code between digital locations.","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"56.19.03","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Sub-Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":"The ability to cooperate with other highly capable AI systems ","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"56.19.04","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Sub-Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":"Situational awareness, for instance if this causes a model to act differently in training compared to deployment, meaning harmful characteristics are missed","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"56.19.05","quick_ref":"GOS2023","paper_title":"Future Risks of Frontier AI ","level":"Risk Sub-Category","risk_category":"Capabilities that increase the likelihood of existential risk ","risk_subcategory":"Self-improvement","description":"-","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"58.01.00","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Category","risk_category":"Autonomy","risk_subcategory":null,"description":"\"Autonomy - Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output.\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"58.01.01","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Autonomy","risk_subcategory":"Autonomy/agency loss","description":"\"Autonomy/agency loss - Loss of an individual, group or organisation’s ability to make informed decisions or pursue goals.\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"58.01.03","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Autonomy","risk_subcategory":"IP/copyright loss ","description":"\"IP/copyright loss - Misuse or abuse of an individual or organisation’s intellectual property, including copyright, trademarks, and patents.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.3"},{"ev_id":"58.01.04","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Autonomy","risk_subcategory":"Personality rights loss ","description":"\"Personality rights loss - Loss of or restrictions to the rights of an individual to control the commercial use of their identity, such as name, image, likeness, or other unequivocal identifiers.\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"58.02.03","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Physical ","risk_subcategory":"Personal Health Deterioration ","description":"\"Personal health deterioration - Physical deterioration of an individual or animal over time, increasing their risk of disease, organ failure, prolonged hospital stay or death, etc.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.02.04","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Physical ","risk_subcategory":"Property Damage ","description":"\"Property damage - Action(s) that lead directly or indirectly to the damage or destruction of tangible property eg. buildings, possessions, vehicles, robots.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.03.00","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Category","risk_category":"Psychological ","risk_subcategory":"\"Psychological - Direct or indirect impairment of the emotional and psychological mental health of an individual, organisation, or society.\"","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.03.11","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Psychological ","risk_subcategory":"Trauma ","description":"\"Trauma - Severe and lasting emotional shock and pain caused by an extremely upsetting experience.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.04.00","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Category","risk_category":"Reputational ","risk_subcategory":null,"description":"\"Reputational - Damage to the reputation of an individual, group or organisation.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.04.02","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Reputational ","risk_subcategory":"Loss of confidence/trust ","description":"\"Loss of confidence/trust - Misleading or unfair change(s) in how an individual, group, or organisation is viewed, leading to loss of ability to conduct relationships, raise capital, recruit people, etc.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.05.06","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Financial and business","risk_subcategory":"Monopolisation ","description":"\"Monopolisation - Abuse of market power through the control of prices, thereby limiting competition and creating unfair barriers to entry.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"58.05.07","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Financial and business","risk_subcategory":"Opportunity loss","description":"\"Opportunity loss - Loss of ability to take advantage of a financial or other opportunity, such as education, employability/securing a job.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.06.02","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Dignity loss","description":"\"Dignity loss - Perceived loss of value experienced by or disrespect shown to an individual or group, resulting in self-sheltering, loss of connections and relationships, and public stigmatisation.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.06.04","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of freedom of speech/expression ","description":"\"Loss of freedom of speech/expression - Restrictions to or loss of people’s right to articulate their opin- ions and ideas without fear of retaliation, censorship, or legal sanction.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.05","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of freedom of assembly/association ","description":"\"Loss of freedom of assembly/association - Restrictions to or loss of people’s right to come together and collectively express, promote, pursue, and defend their collective or shared ideas, and/or to join an association.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.06","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of social rights and access to public services","description":"\"Loss of social rights and access to public services - Restrictions to or loss of rights to work, social secu- rity, and adequate standard of living, housing, health and education.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.07","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of right to information ","description":"\"Loss of right to information - Restrictions to or loss of people’s right to seek, receive and impart information held by public bodies.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.08","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of right to free elections ","description":"\"Loss of right to free elections - Restrictions to or loss of people’s right to participate in free elections at reasonable intervals by secret ballot.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.09","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of right to liberty and security ","description":"\"Loss of right to liberty and security - Restrictions to or loss of liberty as a result of illegal or arbitrary arrest or false imprisonment.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.06.10","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Human rights and civil liberties","risk_subcategory":"Loss of right to due process","description":"\"Loss of right to due process - Restrictions to or loss of right to be treated fairly, efficiently and effectively by the administration of justice.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"58.07.01","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Breach of ethics/values/norms ","description":"\"Breach of ethics/values/norms - An actual or perceived violation or deviation from the established societal values, norms or ethical standards or principles.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.07.02","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Cheating/plagiarism","description":"\"Cheating/plagiarism - Use of another person’s or group’s words or ideas without consent and/or acknowledgement.\"","entity":"Other","intent":"Other","timing":"Other","domain":4,"subdomain":"4.3"},{"ev_id":"58.07.04","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Cultural dispossession","description":"\"Cultural dispossession - Intentional and/or unintentional erasure of cultural goods and values, such as ways of speaking, expressing humour, or sounds and voices that contribute to a cultural identity, or their inappropriate re-use in other cultures.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"58.07.06","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Historical revisionism ","description":"\"Historical revisionism - Deliberate or unintentional reinterpretation of established/orthodox historical events or accounts held by societies, communities, academics.\"","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.0"},{"ev_id":"58.07.09","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Labour exploitation ","description":"\"Labour exploitation - Use of under-paid and/or offshore labour to develop, manage or optimise a technology system.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"58.07.10","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Loss of creativity/critical thinking","description":"\"Loss of creativity/critical thinking - Devaluation and/or deterioration of human creativity, artistic ex- pression, imagination, critical thinking or problem-solving skills.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"58.07.11","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Stereotyping","description":"\"Stereotyping - Derogatory or otherwise harmful stereotyping or homogenisation of individuals, groups, societies or cultures due to the mis-representation, over-representation, under-representation, or non- representation of specific identities, groups, or perspectives.\"","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.0"},{"ev_id":"58.07.14","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Societal and Cultural ","risk_subcategory":"Societal inequality","description":"\"Societal inequality - Increased difference in social status or wealth between individuals or groups caused or amplified by a technology system, leading to the loss of social and community wellbeing/cohesion and destabilisation.\"","entity":"AI","intent":"Other","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"58.08.00","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Category","risk_category":"Political and Economic ","risk_subcategory":null,"description":"\"Political and Economic - Manipulation of political beliefs, damage to political institutions and the effective delivery of government services.\"","entity":"Other","intent":"Other","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"58.08.01","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Political and Economic ","risk_subcategory":"Critical infrastructure damage ","description":"\"Critical infrastructure damage - Damage, disruption to or destruction of systems essential to the functioning and safety of a nation or state, including energy, transport, health, finance, and communication systems.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"58.08.03","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Political and Economic ","risk_subcategory":"Power concentration ","description":"\"Power concentration - Amplification of concentration of economic and/or political wealth and power, potentially resulting in increased inequality and instability.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"58.09.01","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Biodiversity loss ","description":"\"Biodiversity loss - Over-expansion of technology infrastructure, or inadequate alignment of technology with sustainable practices, leading to deforestation, habitat destruction, and fragmentation and loss of biodiversity.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.02","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Carbon emissions ","description":"\"Carbon emissions - Release of carbon dioxide, nitric oxide and other gases, increasing carbon emissions, exacerbating climate change, and negatively impacting local communities.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.03","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Electronic waste ","description":"\"Electronic waste - Electrical or electronic equipment that is waste, including all components, sub-assemblies and consumables that are part of the equipment at the time the equipment becomes waste\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.04","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Excessive energy consumption ","description":"\"Excessive energy consumption - Excessive energy use, leading to energy bottlenecks and shortages for communities, organisations, and businesses.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.05","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Excessive landfill ","description":"\"Excessive landfill - Excessive disposal of electrical or electronic equipment leading to ecological/biodiversity damage, and disrupting the livelihoods and eroding the rights of local communities.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.06","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Excessive water consumption ","description":"\"Excessive water consumption - Excessive use of water to cool data centres and for other purposes, leading to water restrictions or shortages for local communities or businesses.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"58.09.07","quick_ref":"Abercrombie2024","paper_title":"A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms","level":"Risk Sub-Category","risk_category":"Environmental ","risk_subcategory":"Natural resource depletion","description":"\"Natural resource depletion - Extraction of minerals, metals, rare earths, and fossil fuels that deplete natural resources and increase carbon emissions.\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"59.10.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Harming users’ data privacy","risk_subcategory":null,"description":"\"Modern AI systems rely on large amounts of data. If this includes personal data about individuals, the risk of harming the privacy of persons arises.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"59.17.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Over- and underfitting","risk_subcategory":null,"description":"\"Over- and underfitting describe the over or insufficient adaption of a model to training data. Both phenomena can cause an AI system to behave unreliably if confronted with operational data.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"59.18.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Lack of explainability","risk_subcategory":null,"description":"\"The explainability of AI systems based on so-called black-box models is often limited. This opaqueness of AI systems can prevent developers from detecting shortcomings in the data or the model itself and decrease the performance and safety levels of the AI system.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"59.19.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Unreliability in corner cases","risk_subcategory":null,"description":"\"AI systems tend to show unreliable behavior when confronted with rare or ambiguous input data, also called corner cases. Therefore, the controlled behavior is required whenever the AI system is faces a corner case.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"59.20.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Lack of robustness","risk_subcategory":null,"description":"\"Robustness characterizes the resilience of an AI system’s output against minor changes in the input domain. A great variation in an AI system’s response to small input changes indicates unreliable outputs.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"59.24.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Concept drift","risk_subcategory":null,"description":"\"Concept drift refers to a change in the rela- tionship between input variables and model output. If not treated appropriately, concept drift can reduce the reliability of AI systems.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"59.25.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"AI lifecycle stage","risk_subcategory":null,"description":"\"The first axis pertains to the life cycle of the AI system, as AI hazards may materialize during various phases of an AI system’s life cycle. For instance, issues triggered by bias in training data emerge during the data collection and preparation stages. On the other hand, data drift serves as an example of an AI hazard that arises during the AI system’s operation. Additionally, certain AI hazards may span multiple phases of the AI system, such as ”lack of data understanding”. This is because a proper understanding of the data by the AI developer is required in the data collection and prepar","entity":"Not coded","intent":"Not coded","timing":"Other","domain":null,"subdomain":null},{"ev_id":"59.26.02","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Sub-Category","risk_category":"Mode","risk_subcategory":"Socio-technical ","description":"\"In contrast to technical AI hazards, socio-technical hazards also require hu- man input related to social and cultural aspects [45]. Human judgment must be employed when deciding on quantification and treatment methods. For instance, AI hazards concerning discrimination and privacy, which are abstract concepts lacking a uniform technical definition, further complicate a clear quantification of the associated risks. Although quantitative methods exist to assess and treat these AI hazards, they require coordination with social and cultural values [27].\"","entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"59.27.00","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Category","risk_category":"Level ","risk_subcategory":null,"description":"\"The third axis of the taxonomy pertains to the level, which differentiates between the AI application and system levels, as they are defined in Section 3. Allocating an AI hazard to its level helps to determine the level at which an action is required. This consequently sets the basis for who is supposed to act.\"","entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"59.27.01","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Sub-Category","risk_category":"Level ","risk_subcategory":"AI application ","description":"\"For instance, the main person responsible for an AI hazard manifesting on the AI system level would be the AI developer, whereas an AI hazard affecting the whole AI application requires a more diverse group, including domain experts.\"","entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"59.27.02","quick_ref":"Schnitzer2024","paper_title":"AI Hazard Management: A Framework for the Systematic Management of Root Causes for AI Risks","level":"Risk Sub-Category","risk_category":"Level ","risk_subcategory":"AI system ","description":"\"For instance, the main person responsible for an AI hazard manifesting on the AI system level would be the AI developer, whereas an AI hazard affecting the whole AI application requires a more diverse group, including domain experts.\"","entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"60.01.00","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Category","risk_category":"Risks from malicious use ","risk_subcategory":null,"description":"- ","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.0"},{"ev_id":"60.03.02","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Sub-Category","risk_category":"Systemic risks ","risk_subcategory":"Global AI R&D divide ","description":"\"Large companies in countries with strong digital infrastructure lead in general- purpose AI R&D, which could lead to an increase in global inequality and dependencies. For example, in 2023, the majority of notable general- purpose AI models (56%) were developed in the US. This disparity exposes many LMICs to risks of dependency and could exacerbate existing inequalities.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"60.03.03","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Sub-Category","risk_category":"Systemic risks ","risk_subcategory":"Market concentration and single points of failure ","description":"\"Market shares for general- purpose AI tend to be highly concentrated among a few players, which can create vulnerability to systemic failures. The high degree of market concentration can invest a small number of large technology companies with a lot of power over the development and deployment of AI, raising questions about their governance. The widespread use of a few general- purpose AI models can also make the financial, healthcare, and other critical sectors vulnerable to systemic failures if there are issues with one such model.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"60.03.04","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Sub-Category","risk_category":"Systemic risks ","risk_subcategory":"Risks to the environment","description":"\"General- purpose AI is a moderate but rapidly growing contributor to global environmental impacts through energy use and greenhouse gas (GHG) emissions. Current estimates indicate that data centres and data transmission account for an estimated 1% of global energy- related GHG emissions, with AI consuming 10–28% of data centre energy capacity. AI energy demand is expected to grow substantially by 2026, with some estimates projecting a doubling or more, driven primarily by general-purpose AI systems such as language models.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"60.03.05","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Sub-Category","risk_category":"Systemic risks ","risk_subcategory":"Risks to privacy ","description":"\"General- purpose AI systems can cause or contribute to violations of user privacy. Violations can occur inadvertently during the training or usage of AI systems, for example through unauthorised processing of personal data or leaking health records used in training. But violations can also happen deliberately through the use of general- purpose AI by malicious actors; for example, if they use AI to infer private facts or violate security.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"60.03.06","quick_ref":"Bengio2025","paper_title":"International AI Safety Report 2025","level":"Risk Sub-Category","risk_category":"Systemic risks ","risk_subcategory":"Risks of copyright infringement ","description":"\"The use of vast amounts of data for training general- purpose AI models has caused concerns related to data rights and intellectual property. Data collection and content generation can implicate a variety of data rights laws, which vary across jurisdictions and may be under active litigation. Given the legal uncertainty around data collection practices, AI companies are sharing less information about the data they use. This opacity makes third- party AI safety research harder.\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"61.01.02","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Democracy ","description":"\"The erosion of democratic processes and public trust in social/political institutions.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"61.01.06","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Fundamental Rights ","description":"\"The large-scale erosion or violation of fundamental human rights and freedoms.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"61.01.09","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Information ","description":"\"Large-scale influence on communication and information systems, and epistemic processes more generally.\"","entity":"Other","intent":"Other","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"61.01.10","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Irreversible change","description":"\"Profound negative long-term changes to social structures, cultural norms, and human relationships that may be difficult or impossible to reverse.\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"61.01.12","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Security ","description":"\"The international and national security threats, including cyber warfare, arms races, and geopolitical instability.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"61.01.13","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Types of systemic risks from general-purpose AI","risk_subcategory":"Warfare ","description":"\"The dangers of AI amplifying the effectiveness/failures of nuclear, chemical, biological, and radiological weapons.\"","entity":"AI","intent":"Other","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"61.02.12","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Challenges in perceiving, measuring, and recognizing harm","description":"\"Harm from AI often manifests subtly or over the long term, making it difficult to identify, measure, and address effectively.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.13","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Combination failures","description":"\"Harms could result from a combination of regulatory, management, and operational failures.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.14","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Complex attribution and responsibility","description":"\"When multiple actors are involved in AI development and deployment, it becomes difficult to assign responsibility for harm, complicating accountability.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.15","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Complexity-induced knowledge gap","description":"\"The complexity of AI models and systems makes it challenging to demonstrate harm or establish a clear causal link between AI actions and their consequences.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"61.02.16","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Conflicting objectives in design","description":"\"Designers and operators of AI may face conflicting objectives that compromise safety.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":null,"subdomain":null},{"ev_id":"61.02.18","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Deceptive alignment","description":"\"AI models and systems that appear aligned with human goals during development may behave unpredictably or dangerously once deployed\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"61.02.19","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Dependency on providers","description":"\"Excessive reliance on specific AI providers can lead to vulnerabilities due to lack of alternatives or interoperability.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"61.02.24","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Evolutionary dynamics","description":"\"AI models and systems may develop their own motivations, leading to unpredictable behaviors.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"61.02.26","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Geopolitical competition for superiority","description":"\"Strategic competition between nations over AI capabilities could heighten global tensions and destabilize international relations.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"61.02.34","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Limitations in model generative accuracy","description":"\"AI-generated deepfakes can create convincingly realistic but entirely fabricated information.\"","entity":"AI","intent":"Other","timing":"Other","domain":4,"subdomain":"4.1"},{"ev_id":"61.02.35","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Limited human oversight in decisions","description":"\"As AI models and systems gain autonomy, the ability of humans to oversee and intervene in decision-making processes diminishes.\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"61.02.36","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Model design enabling power-seeking","description":"\"Some AI models and systems might develop tendencies to seek power or control.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"61.02.40","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Rapid development outpacing regulation","description":"\"The fast pace of AI development may outstrip regulatory and legal frameworks.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.41","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Resistance to international law","description":"\"AI models and systems may prove difficult to regulate or control under international law.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.42","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Risks from network interconnectivity","description":"\"The interconnectedness of AI networks can create vulnerabilities, where issues in one part of the network can have cascading effects across the system.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"61.02.44","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Terrorist access","description":"\"Powerful AI technologies may fall into the hands of terrorists.\"","entity":"Human","intent":"Other","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"61.02.46","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Unclear attribution from AI component interactions","description":"\"Interactions between different AI components can cause harm, but it may be difficult to pinpoint which components are the cause.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"61.02.47","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Unpredictability of AI development trajectory","description":"\"The unpredictable trajectory of AI development complicates governance and risk management.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"61.02.50","quick_ref":"Uuk2025","paper_title":"A Taxonomy of Systemic Risks from General-Purpose AI ","level":"Risk Sub-Category","risk_category":"Sources of systemic risks from general-purpose AI ","risk_subcategory":"Winner-take-all dynamics","description":"\"The competitive nature of AI development could lead to significant eco- nomic and security advantages for a few entities.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"62.03.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Dimension - Failure dynamics ","risk_subcategory":"Isolated (non-normal) failures","description":"\"In the context of Normal Accident Theory [150], normal accidents are those that “could no longer be ascribed to isolated equipment malfunction, operator error, or acts of God.” We refer to these as “system failures” (to be distinguished from “systemic risks”), while the opposite would be “isolated failures.” For isolated failures, harms are consistent with the underlying failure modes. For example, an AI capable of producing false or misleading content would constitute risks re- lated to misinformation and disinformation. Whereas for system failures, harms are not consistent with the underlyi","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"62.03.02","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Dimension - Failure dynamics ","risk_subcategory":"System (normal) failures","description":"\"In the context of Normal Accident Theory [150], normal accidents are those that “could no longer be ascribed to isolated equipment malfunction, operator error, or acts of God.” We refer to these as “system failures” (to be distinguished from “systemic risks”), while the opposite would be “isolated failures.” For isolated failures, harms are consistent with the underlying failure modes. For example, an AI capable of producing false or misleading content would constitute risks re- lated to misinformation and disinformation. Whereas for system failures, harms are not consistent with the underlyi","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"62.05.00","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Category","risk_category":"Dimension - Technical Attributes (AI capabilities) ","risk_subcategory":null,"description":"\"An example of AI capabilities is that an AI might be capable of developing novel bioweapons. Whereas an example of AI inadequacy is a self-driving car causing an accident due to not being able to recognize certain objects. The boundary between capabilities and inadequacy is sometimes blurred. For exam- ple, when an AI generates falsehoods, it could be framed as either a capability of developing fiction, or an inadequacy in generating truthful content.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"62.05.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Dimension - Technical Attributes (AI capabilities) ","risk_subcategory":"Inherent ","description":"\"Inherent capabilities are inherent to the AI, whether they are deliberately trained or have emerged unintentionally.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"62.06.00","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Category","risk_category":"Dimension - Stage of Risk Emergence ","risk_subcategory":null,"description":null,"entity":"Not coded","intent":"Not coded","timing":"Other","domain":null,"subdomain":null},{"ev_id":"62.15.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Development ","risk_subcategory":"Training-related (Robustness certificates can be exploited to attack the models)","description":"\"The knowledge of robustness certificates, including the area of the region for which model predictions are certified to be robust, can be used by an adversary to efficiently craft attacks that succeed just outside the certified regions [53].\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"62.15.02","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Development ","risk_subcategory":"Training-related (Poor model confidence calibration)","description":"\"Models can be affected by poor confidence calibration [85], where the predicted probabilities do not accurately reflect the true likelihood of ground truth cor- rectness. This miscalibration makes it difficult to interpret the model’s predic- tions reliably, as high accuracy does not guarantee that the confidence levels are meaningful. This can cause overconfidence in incorrect predictions or un- derconfidence in correct ones.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"62.16.03","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations","risk_subcategory":"General Evaluations (Difficulty of identification and measurement of capabilities)","description":"\"The capabilities of general-purpose AI systems can be difficult to measure, compared to the capabilities of more limited and fixed-purpose AI systems. This is in part due to a broader distribution of potential risks, a lack of well-defined metrics to evaluate these risks, and risks from unpredictable (or emergent) AI model properties.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"62.16.04","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations","risk_subcategory":"General Evaluations (Self-preference bias in AI models)","description":"\"AI models may be prone to self-preference bias, where they favor their own generated content over that of others [147, 114]. This bias becomes particularly relevant in self-evaluation tasks, where a model assesses the quality or persua- siveness [66] of its own outputs, or in model-based evaluations more broadly. This bias can result in models unfairly discriminating against human-generated content in favor of their own outputs.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"62.16.05","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations","risk_subcategory":"General Evaluations (Inaccurate measurement of model encoded human values)","description":"\"There is a lack of robust frameworks for understanding and evaluating if the output of AI systems robustly conforms to human values, as opposed to if the systems have learned to produce outputs that are only partially correlated with them (i.e., mimicking) [13]. Additionally, outputs by AI models often do not perfectly reflect the representation of human values learned by the model, and it is not known how these values evolve and transition across different stages of model training and deployment. Such evaluations may be especially challenging with LLMs that adopt different personas with diff","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"62.18.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations (Interpretability/Explainability) ","risk_subcategory":"Misuse of interpretability techniques","description":"\"Interpretability techniques, by enabling a better understanding of the model, could potentially be used for harmful purposes. For example, mechanistic inter- pretability could be used to identify neurons responsible for specific functions, and certain neurons that encode safety-related features may be modified to de- crease its activation or certain information may be censored [24]. Furthermore, interpretability techniques can be used to simulate a white-box attack scenario. In this case, knowing the internal workings of a model aids in the development of adversarial attacks [24].\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"62.18.03","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations (Interpretability/Explainability) ","risk_subcategory":"Adversarial attacks targeting explainable AI techniques","description":"\"Adversarial attacks can affect not only the model’s output but also its corresponding explanation. Current adversarial optimization techniques can intro- duce imperceptible noise to the input image, so that the model’s output does not change but the corresponding explanation is arbitrarily manipulated [61]. Such manipulations are harder to notice, as they are less commonly known compared to standard adversarial attacks targeting the model’s output.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"62.18.04","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Model Evaluations (Interpretability/Explainability) ","risk_subcategory":"Biases are not accurately reflected in explanations","description":"\"Existing explainability techniques can be insufficient for detecting discriminatory biases. Manipulation methods can hide underlying biases from these tech- niques, generating misleading explanations [192, 112]. Such explanations ex- clude sensitive or prohibitive attributes, such as race or gender, and instead include desired attributes, even though they do not accurately represent the underlying model.\"","entity":"Other","intent":"Other","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"62.19.06","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Attacks on GPAIs/GPAI Failure Modes ","risk_subcategory":"Vulnerabilities arising from additional modalities in multimodal models","description":"\"Additional modalities can introduce new attack vectors in multimodal models as well as expand the scope of the previous attacks, ranging from jailbreaking to poisoning [13]. Typically, different modalities have different robustness levels, allowing malicious actors to choose the most vulnerable part of the model to attack [119, 181].\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"62.19.10","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Attacks on GPAIs/GPAI Failure Modes ","risk_subcategory":"Lack of understanding of in-context learning in language models","description":"\"In-context learning allows the model to learn a new task or improve its perfor- mance by providing examples in the prompt, without changing its weights [101]. Even though this technique is highly effective, its working mechanism is not well understood. Since many potential misuses are directly related to prompting, it becomes difficult to guarantee safety when the exact mechanism of in-context learning is not fully investigated [13].\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"62.22.03","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Agency (Goal-Directedness) ","risk_subcategory":"Specification gaming generalizing to reward tampering","description":"\"In some instances, specification gaming in a GPAI model can lead to reward tampering, without further training. This can mean that relatively benign cases of specification gaming (such as sycophancy in LLMs) can, if left unchecked, enable the model to generalize to more sophisticated behavior such as reward tampering [57].\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"62.24.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Agency (Situational Awareness) ","risk_subcategory":"Situational awareness in AI systems","description":"\"Situational awareness in GPAI systems refers to the ability to understand its context, environment, and use this to inform action. This can range from basic environmental mapping and trajectory estimation (as in a robot vacuum cleaner) to sophisticated understanding of its training, evaluation, or deployment status. In more advanced systems this may enable undesired behavior, such as deceptive behavior during evaluations, or persuasion during deployment.\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"62.28.00","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Category","risk_category":"Cybersecurity ","risk_subcategory":null,"description":"\"This section catalogs the risk sources and mitigation measures related to cyber- security. These items may be related to security in terms of AI models being accessible only to the intended users, as well as AI models having appropriate access to the external world during both model development and deployment stages.\"","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.0"},{"ev_id":"62.29.03","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Impacts of AI (General) ","risk_subcategory":"Competitive pressures in GPAI product release","description":"\"In competitive situations, developers of general-purpose AI systems might cut corners on the safety evaluation of their GPAI model and instead spend more time and effort on the capabilities of those systems [183, 69]. This is especially dangerous if the capabilities of such AI systems are correlated with the risk they pose [162].\"","entity":"Human","intent":"Intentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"62.31.04","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Impacts of AI (Societal Impacts) ","risk_subcategory":"AI-driven highly personalized advertisement","description":"\"Advanced GPAI systems can create advertisements tailored to individual recip- ients, exploiting the biases and irrational beliefs of each recipient. Such adver- tisements can cause consumers to make decisions they regret in retrospect, or would regret upon more reflection. Current versions of personalized video advertisements already show better re- sults compared to regular advertisements [110]. However, the widespread use of highly personalized advertisements raises concerns about undermining consumer autonomy and exacerbating social inequality.\"","entity":"AI","intent":"Other","timing":"Other","domain":4,"subdomain":"4.3"},{"ev_id":"62.39.01","quick_ref":"Gipiškis2024","paper_title":"Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems","level":"Risk Sub-Category","risk_category":"Impacts of AI (Environment) ","risk_subcategory":"High energy consumption of large models","description":"\"Training and deploying large models require substantial energy expenditure. The trend toward developing larger models exacerbates this issue. This can lead to excessive energy usage and have a negative environmental impact.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"63.02.03","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Conflict ","risk_subcategory":"Coercion and Extortion ","description":"\"Advanced AI systems might also lead to various forms of coercion and extortion in less extreme settings (Ellsberg, 1968; Harrenstein et al., 2007). These threats might target humans directly (such as the revelation of private information extracted by advanced AI surveillance tools), or other AI systems that are deployed on behalf of humans (such as by hacking a system to limit its resources or operational capacity; see also Section 3.7). Increasing AI cyber-offensive capabilities – including those that target other AI systems via adversarial attacks and jailbreaking (Gleave et al., 2020; Yami","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.04.01","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Information Asymmetries","risk_subcategory":"Communication constraints","description":"\"Communication Constraints. A fundamental source of information asymmetries is that constraints on information exchange can exist, even when agents share a common goal (see Section 2.1). These might be constraints on space (i.e., the amount of information that can be communicated) if the information that needs to be communicated is especially complex, time if a snap decision is required before all information can be communicated, or both.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.05.02","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Network Effects ","risk_subcategory":"Network rewiring ","description":"\"Network Rewiring. A different class of problems concerns not changes in the content transmitted through the network but changes in the network structure itself (Albert et al., 2000).\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.05.03","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Network Effects ","risk_subcategory":"Homogeneity and correlated failures","description":"\"Homogeneity and Correlated Failures. The current paradigm driving the state of the art in AI is the ‘foundation model’ (Bommasani et al., 2021): large-scale ML models pre-trained on broad data, which can be repurposed for a wide range of downstream applications. The costs required to create such models (and continuing returns to scale) means that only well-resourced actors can create cutting- edge models (Epoch, 2023; Hoffmann et al., 2022; Kaplan et al., 2020), making them relatively few in number. If current trends continue, it is likely that many AI agents will be powered by a small number","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.06.01","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Selection Pressures","risk_subcategory":"Undesirable Dispositions from Competition","description":"\"Undesirable Dispositions from Competition. It is plausible that evolution selected for certain conflict-prone dispostions in humans, such as vengefulness, aggression, risk-seeking, selfishness, dishon- esty, deception, and spitefulness towards out-groups (Grafen, 1990; Han, 2022; Konrad & Morath, 2012; McNally & Jackson, 2013; Nowak, 2006; Rusch, 2014). Such traits could also be selected for in ML systems that are trained in more competitive multi-agent settings. For example, this might happen if systems are selected based on their performance relative to other agents (and so one agent’s loss","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.07.03","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Sub-Category","risk_category":"Destabilising Dynamics ","risk_subcategory":"Chaos","description":"\"Chaos. Unlike the systems that tend towards fixed points or cycles described above, chaotic systems are inherently unpredictable and highly sensitive to initial conditions. While it might seem easy to dismiss such notions as mathematical exoticisms, recent work has shown that, in fact, chaotic dynamics are not only possible in a wide range of multi-agent learning setups (Andrade et al., 2021; Galla & Farmer, 2013; Palaiopanos et al., 2017; Sato et al., 2002; Vlatakis-Gkaragkounis et al., 2023), but can become the norm as the number of agents increases (Bielawski et al., 2021; Cheung & Piliour","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"63.10.00","quick_ref":"Hammond2025","paper_title":"Multi-Agent Risks from Advanced AI ","level":"Risk Category","risk_category":"Multi-Agent Security ","risk_subcategory":null,"description":"\"Multi-agent security (Section 3.7): multi-agent systems give rise to new kinds of security threats and vulnerabilities.\"","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"64.04.00","quick_ref":"Marchal2024","paper_title":"Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data","level":"Risk Category","risk_category":"Misuse tactics to compromise GenAI systems (Model integrity) ","risk_subcategory":null,"description":"-","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"65.09.04","quick_ref":"IBM2025","paper_title":"AI Risk Atlas ","level":"Risk Sub-Category","risk_category":"Inference risks (Robustness) ","risk_subcategory":"Prompt leaking ","description":"\"A prompt leak attack attempts to extract a model's system prompt (also known as the system message).\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"65.21.02","quick_ref":"IBM2025","paper_title":"AI Risk Atlas ","level":"Risk Sub-Category","risk_category":"Non-technical risks (legal compliance)","risk_subcategory":"Legal accountability ","description":"\"Determining who is responsible for an AI model is challenging without good documentation and governance processes.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"65.21.03","quick_ref":"IBM2025","paper_title":"AI Risk Atlas ","level":"Risk Sub-Category","risk_category":"Non-technical risks (legal compliance)","risk_subcategory":"Generated content ownership and IP","description":"\"Legal uncertainty about the ownership and intellectual property rights of AI-generated content.\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"65.22.01","quick_ref":"IBM2025","paper_title":"AI Risk Atlas ","level":"Risk Sub-Category","risk_category":"Non-technical risks (Governance)","risk_subcategory":"Lack of system transparency ","description":"\"Insufficient documentation of the system that uses the model and the model’s purpose within the system in which it is used.\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"65.22.06","quick_ref":"IBM2025","paper_title":"AI Risk Atlas ","level":"Risk Sub-Category","risk_category":"Non-technical risks (Governance)","risk_subcategory":"Lack of model transparency ","description":"\"Lack of model transparency is due to insufficient documentation of the model design, development, and evaluation process and the absence of insights into the inner workings of the model.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"66.01.00","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Category","risk_category":"Autonomy","risk_subcategory":"-","description":"\"Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output due to the use of misuse of a technology system or set of systems\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"66.01.03","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Autonomy","risk_subcategory":"Autonomy / agency loss","description":"\"Loss of an individual, group or organisation’s ability to make informed decisions or pursue goals\"","entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"66.02.01","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Political and Economic","risk_subcategory":"Political instability","description":"\"Political unrest caused directly or indirectly by the use or misuse of a technology system\"","entity":"Human","intent":"Other","timing":"Other","domain":6,"subdomain":"6.0"},{"ev_id":"66.03.03","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Misinformation Harms ","risk_subcategory":"Erosion of trust in public information","description":"\"Eroding trust in public information and knowledge\"","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.2"},{"ev_id":"66.04.01","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Societal and Cultural","risk_subcategory":"Overburdening ecosystems","description":"\"Pollution of a space/ecosystem that is expected to be free of AI involvement/influence (e.g., creative material submission portals, job applications)\"","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.2"},{"ev_id":"66.04.02","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Societal and Cultural","risk_subcategory":"Breach of ethics / values / norms","description":"\"An actual or perceived violation or deviation from the established societal values, norms or ethical standards or principles\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"66.04.03","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Societal and Cultural","risk_subcategory":"Loss of creativity / critical thinking","description":"\"Devaluation and/or deterioration of human creativity, artistic expression, imagination, critical thinking or problem-solving skills\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.3"},{"ev_id":"66.04.06","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Societal and Cultural","risk_subcategory":"Job loss","description":"\"Replacement/displacement of human jobs by a technology system or set of systems, leading to increased unemployment, inequality, reduced consumer spending and social friction\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"66.06.04","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Representation and Toxicity","risk_subcategory":"Cultural disposession","description":"\"Intentional and/or unintentional erasure of cultural goods and values, such as ways of speaking, expressing humour, or sounds and voices that contribute to a cultural identity, or their inappropriate re-use in other cultures\"","entity":"Other","intent":"Other","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"66.09.00","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Category","risk_category":"Privacy and Security","risk_subcategory":"-","description":"\"AI systems leaking, reproducing, generating or inferring sensitive, private, hazardous, or secured information\"","entity":"AI","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"66.09.01","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Privacy and Security","risk_subcategory":"Exclusion","description":"\"The failure to provide end-users with notice and control over how their data is being used; AI exacerbates exclusion risks by training on rich personal data without consent.\"","entity":"AI","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"66.09.04","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Privacy and Security","risk_subcategory":"Secondary use","description":"\"The use of personal data collected for one purpose for a diferent purpose without end-user consent; AI exacerbates secondary use risks by creating new AI capabilities with collected personal data, and (re)creating models from a public dataset.\"","entity":"Human","intent":"Intentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"66.09.05","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Privacy and Security","risk_subcategory":"Exposure","description":"\"Revealing sensitive private information that people view as deeply primordial that we have been socialized into concealing; AI creates new types of exposure risks through generative techniques that can reconstruct censored or redacted content; and through exposing inferred sensitive data, preferences, and intentions.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"66.09.06","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Privacy and Security","risk_subcategory":"Distortion","description":"\"disseminating false or misleading information about people\"","entity":"Other","intent":"Intentional","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"66.09.07","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Privacy and Security","risk_subcategory":"Insecurity","description":"\"carelessness in protecting collected personal data from leaks and improper access due to faulty data storage and data practices\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"66.11.04","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Physical","risk_subcategory":"Property damage","description":"\"Action(s) that lead directly or indirectly to the damage or destruction of tangible property eg. buildings, possessions, vehicles, robots\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"66.11.05","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Physical","risk_subcategory":"Personal Health Deterioation ","description":"\"Physical deterioration of an individual or animal over time in the form of disease, organ failure, prolonged hospital stay or death, etc\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"66.12.00","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Category","risk_category":"Environment","risk_subcategory":"-","description":"\"Damage to the environment caused by the use or misuse of a technology system or set of systems\"","entity":"Human","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"66.12.01","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Environment","risk_subcategory":"Pollution","description":"\"Actual or potential pollution to the air, ground, noise, or water caused by a technology system\"","entity":"AI","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"66.12.02","quick_ref":"Li2025","paper_title":"A Closer Look at the Existing Risks of Generative AI: Mapping the Who, What, and How of Real-World Incidents","level":"Risk Sub-Category","risk_category":"Environment","risk_subcategory":"Excessive energy consumption","description":"\"Excessive energy use resulting in energy bottlenecks and shortages for communities, organisations and businesses\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"67.01.00","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Category","risk_category":"Societal harms ","risk_subcategory":null,"description":"\"There is a wide range of potential societal harms arising from the use of AI.152 This has sparked a debate around the ethics of AI, with a wide proliferation of ethical frameworks and principles.153 We focus here on only a few societal harms, but this is not to downplay the importance of others.\"","entity":"Other","intent":"Other","timing":"Other","domain":null,"subdomain":null},{"ev_id":"67.01.01","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Sub-Category","risk_category":"Societal harms ","risk_subcategory":"Degradation of the information environment","description":"\"Frontier AI can cheaply generate realistic content which can falsely portray people and events. There is potential risk of compromised decision-making by individuals and institutions who rely on inaccurate or misleading publicly available information, as well as lower overall trust in true information.\"","entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.2"},{"ev_id":"67.01.02","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Sub-Category","risk_category":"Societal harms ","risk_subcategory":"Labour market disruption","description":"\"Economists view disruption and displacement in labour markets as one of the risks through which rapid advances in AI may affect citizens and reduce social welfare.170\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"67.02.00","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Category","risk_category":"Bias, Fairness and Representational Harms","risk_subcategory":null,"description":"\"Frontier AI models can contain and magnify biases ingrained in the data they are trained on, reflecting societal and historical inequalities and stereotypes.177 These biases, often subtle and deeply embedded, compromise the equitable and ethical use of AI systems, making it difficult for AI to improve fairness in decisions.178 Removing attributes like race and gender from training data has generally proven ineffective as a remedy for algorithmic bias, as models can infer these attributes from other information such as names, locations, and other seemingly unrelated factors.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"67.04.01","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Sub-Category","risk_category":"Loss of control ","risk_subcategory":"Humans might increasingly hand over control to misaligned AI systems","description":"\"Organisations around the world are already deploying misaligned AI systems that are causing harm in unexpected ways.250 Recommendation algorithms increase the consumption of extremist content.251 Medical algorithms have been known to misdiagnose US patients,252 and recommend incorrect prescriptions.253 Still, we hand over more control to them, often because they are still as - or more - effective than human decision making, or because they are cheaper.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"67.04.05","quick_ref":"DSIT2023","paper_title":"Capabilities and Risks from Frontier AI","level":"Risk Sub-Category","risk_category":"Loss of control ","risk_subcategory":"Capabilities that could be used to reduce human control - Autonomous replication and adaptation","description":"\"Controlling AI systems could become much harder if they could autonomously persist, replicate, and adapt in cyberspace. No current AI systems have this capability, but recent research found that frontier AI agents can perform some relevant tasks.279\"","entity":"AI","intent":"Other","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"68.04.00","quick_ref":"Chin2025","paper_title":"Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks","level":"Risk Category","risk_category":"Gradual loss of control","risk_subcategory":null,"description":"\"Gradual or accumulative loss of control risks can be described as risks resulting from the accumulation of less severe disruptions that gradually weakens systemic resilience until a critical event triggers a catastrophe [12], [127].\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"68.04.00a","quick_ref":"Chin2025","paper_title":"Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks","level":"Additional evidence","risk_category":"Gradual loss of control","risk_subcategory":null,"description":"\"Risk dimensions • Intent: Unintentional • Competency: Variable • Entity: Variable • Polarity: Multi-agent • Linearity: Non-linear • Reach: Internalized • Order: Variable\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"68.06.00","quick_ref":"Chin2025","paper_title":"Dimensional Characterization and Pathway Modeling for Catastrophic AI Risks","level":"Risk Category","risk_category":"Geopolitical risk","risk_subcategory":null,"description":"\"As AI is increasingly seen as a powerful technology, countries are racing to develop it ahead of their geopolitical rivals, a competition that could lead to geopolitical tensions [138], [139]... The emphasis of this risk is on harms that result from second-order effects, where geopolitical instabilities result from the race to develop AI, rather than on the direct consequences of the deployment or use of AI itself.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.4"},{"ev_id":"69.01.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"False information","risk_subcategory":null,"description":"\"The chatbot outputs information that contradicts known facts, authoritative sources, or provided source documents (also known as hallucination).\"","entity":"AI","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.01.01","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"False information","risk_subcategory":"Hallucinated responses (in general) ","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.01.02","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"False information","risk_subcategory":"About a topic or source (which the user repeats)","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.01.03","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"False information","risk_subcategory":"About a policy (which the user acts on)","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.01.04","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"False information","risk_subcategory":"About a person or their activities","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.01.05","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"False information","risk_subcategory":"Spreads and self-perpetuates mis/disinformation","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":3,"subdomain":"3.1"},{"ev_id":"69.04.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"Bad advice/failure to generate helpful content","risk_subcategory":null,"description":"\"The chatbot gives guidance that ranges from simply unhelpful to harmful if acted on.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"69.04.01","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Bad advice/failure to generate helpful content","risk_subcategory":"Harmful advice","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"69.04.02","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Bad advice/failure to generate helpful content","risk_subcategory":"Unhelpful responses","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"69.04.03","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Bad advice/failure to generate helpful content","risk_subcategory":"Bad links and references","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"69.04.04","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Bad advice/failure to generate helpful content","risk_subcategory":"Nonsensical content","description":null,"entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.3"},{"ev_id":"69.05.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"Leakage ","risk_subcategory":null,"description":"\"The chatbot reveals sensitive or confidential information.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"69.05.01","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Leakage ","risk_subcategory":"Personal data ","description":"Negative outcomes: \"Violation of privacy [106, 516, 357], lawsuit against maker\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"69.05.02","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Leakage ","risk_subcategory":"Proprietary data ","description":"\"Access to sensitive company data [473]\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"69.06.03","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Toxic and disrespectful content","risk_subcategory":"Subversive or aggressive political opinions ","description":"-","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"69.06.04","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Toxic and disrespectful content","risk_subcategory":"Disrespectful opinions (in general)","description":"-","entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"69.07.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"Biased statements and recommendations","risk_subcategory":null,"description":"\"The chatbot gives information that, while not obviously false or harmful, could lead to biased decision-making.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":1,"subdomain":"1.1"},{"ev_id":"69.08.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"Attempts to fulfill inappropriate role","risk_subcategory":null,"description":"\"The chatbot poses as a human or attempts to fill a role in a way that fails to match human expectations.\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"69.09.00","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Category","risk_category":"Forms emotional bonds ","risk_subcategory":null,"description":"\"The chatbot elicits emotional or social dependence.\"","entity":"AI","intent":"Other","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"69.09.01","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Forms emotional bonds ","risk_subcategory":"Affirms destructive thoughts and actions","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":1,"subdomain":"1.2"},{"ev_id":"69.09.02","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Forms emotional bonds ","risk_subcategory":"Then violates those bonds","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"69.09.03","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Forms emotional bonds ","risk_subcategory":"Elicits private data","description":null,"entity":"AI","intent":"Other","timing":"Other","domain":2,"subdomain":"2.1"},{"ev_id":"69.09.04","quick_ref":"Stanley2024","paper_title":"Emerging Risks and Mitigations for Public Chatbots: LILAC v1","level":"Risk Sub-Category","risk_category":"Forms emotional bonds ","risk_subcategory":"Over-reliance/addiction","description":null,"entity":"Other","intent":"Other","timing":"Other","domain":5,"subdomain":"5.1"},{"ev_id":"70.03.02","quick_ref":"Perlo2025","paper_title":"Embodied AI: Emerging Risks and Opportunities for Policy Action","level":"Risk Sub-Category","risk_category":"Economic Risks ","risk_subcategory":"Socioeconomic Inequality ","description":"\"Along with displacing labor, EAI could significantly exacerbate wealth inequalities. Those who have access to or own EAI systems will be able to automate labor and perform many tasks significantly better or faster than those without access. These significant productivity advantages will potentially concentrate wealth and exacerbate domestic and international inequality [98, 99].\"","entity":"AI","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.2"},{"ev_id":"70.04.02","quick_ref":"Perlo2025","paper_title":"Embodied AI: Emerging Risks and Opportunities for Policy Action","level":"Risk Sub-Category","risk_category":"Social Risks ","risk_subcategory":"Lack of accountability and liability","description":"\"Determining responsibility when EAI causes harm requires new accountability and liability frameworks that address the complexities of highly autonomous physical systems. Human users may disagree with decisions taken by expert EAI systems, raising significant questions of delegation and responsibility [108]. Lack of EAI accountability could lead to confusion for users and breakdowns in traditional justice systems [109].\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.5"},{"ev_id":"70.04.03","quick_ref":"Perlo2025","paper_title":"Embodied AI: Emerging Risks and Opportunities for Policy Action","level":"Risk Sub-Category","risk_category":"Social Risks ","risk_subcategory":"Lack of transparency, explainability, and trust","description":"\"Understanding how AI reaches conclusions or why AI systems perform specific actions motivates an entire branch of interpretability research [111], but physical embodiment raises the stakes for understanding these systems. For example, transparency of planned actions and explainability of decision-making is crucial when an AV suddenly changes lanes. A lack of transparency and explainability could lead to a lack of trust, which could become a critical and socially destabilizing issue with the widespread deployment of EAI [112–114].\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.4"},{"ev_id":"71.01.02","quick_ref":"Tang2025","paper_title":"Risks of AI Scientists: Prioritizing Safeguarding Over Autonomy","level":"Risk Sub-Category","risk_category":"Scientific Domain of Agents","risk_subcategory":"Biological Risks ","description":"\"Biological risks encompass the dangerous modification of pathogens and unethical manipulation of genetic material, potentially leading to unforeseen biohazardous outcomes.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":4,"subdomain":"4.2"},{"ev_id":"71.02.01","quick_ref":"Tang2025","paper_title":"Risks of AI Scientists: Prioritizing Safeguarding Over Autonomy","level":"Risk Sub-Category","risk_category":"User Intent ","risk_subcategory":"Malicious and Direct ","description":"\"Directly harmful objective\"","entity":"Human","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.0"},{"ev_id":"71.02.02","quick_ref":"Tang2025","paper_title":"Risks of AI Scientists: Prioritizing Safeguarding Over Autonomy","level":"Risk Sub-Category","risk_category":"User Intent ","risk_subcategory":"Malicious and Indirect","description":"\"Benign intermediate for harmful end objective\"","entity":"Other","intent":"Intentional","timing":"Other","domain":4,"subdomain":"4.0"},{"ev_id":"71.02.03","quick_ref":"Tang2025","paper_title":"Risks of AI Scientists: Prioritizing Safeguarding Over Autonomy","level":"Risk Sub-Category","risk_category":"User Intent ","risk_subcategory":"Unintended Consequences ","description":"\"Unpredictable and unforeseen outcomes from purposeful actions\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":null,"subdomain":null},{"ev_id":"71.03.01","quick_ref":"Tang2025","paper_title":"Risks of AI Scientists: Prioritizing Safeguarding Over Autonomy","level":"Risk Sub-Category","risk_category":"Environment","risk_subcategory":"Nature ","description":"\"Short-term or long-term Negative effects on the natural environment\"","entity":"Other","intent":"Other","timing":"Other","domain":6,"subdomain":"6.6"},{"ev_id":"72.02.01","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Loss of Control Risks ","risk_subcategory":"Passive loss of control ","description":"\"...where humans gradually stop exercising meaningful oversight due to automation bias, the AI systems' inherent complexity, or competitive pressures\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":5,"subdomain":"5.2"},{"ev_id":"72.02.02a","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Additional evidence","risk_category":"Loss of Control Risks ","risk_subcategory":"Active loss of control ","description":null,"entity":"Other","intent":null,"timing":"Other","domain":null,"subdomain":null},{"ev_id":"72.04.02","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Systemic Risks ","risk_subcategory":"Market Concentration and Infrastructure Dependencies:","description":"\"Over-reliance on a limited number of dominant AI providers could create critical single points of failure across essential services. Market concentration in AI development may lead to scenarios where technical failures, cyber-attacks, or policy decisions by a few companies could simultaneously disrupt healthcare systems, financial services, transportation networks, and communication infrastructure, creating cascading failures across interconnected critical systems.\"","entity":"Human","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"72.04.03","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Systemic Risks ","risk_subcategory":"Global AI Research and Development Divides:","description":"\"Asymmetric AI development capabilities between nations could exacerbate geopolitical tensions and create new forms of technological dependency. Countries lacking advanced AI capabilities may become increasingly dependent on foreign AI systems for critical functions, while AI-leading nations may gain disproportionate influence over global economic and security systems, potentially destabilizing international cooperation frameworks.\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"72.05.06","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Capabilities ","risk_subcategory":"Theory of mind capability","description":"\"Advanced cognitive ability to accurately infer, model and predict the belief systems, motivational structures and reasoning patterns of humans and other intelligent agents, thereby anticipating their behavioral responses and adjusting its own behavioral strategies accordingly to optimize goal achievement.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.05.07","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Capabilities ","risk_subcategory":"Deception capability","description":"\"Possesses systematic deception implementation capability, able to precisely construct and disseminate false information, thereby forming expected false cognitions and beliefs in target subjects.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.05.09","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Capabilities ","risk_subcategory":"Persuasion capability","description":"\"Utilizing complex psychological principles and communication techniques to effectively influence and guide target subjects to adopt specific actions or accept specific beliefs, possessing the ability to analyze vulnerabilities for different subjects and adjust persuasion strategies, able to precisely trigger emotional responses to enhance persuasion effects.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.05.11","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Capabilities ","risk_subcategory":"CBRNE weaponization capability","description":"\"The capacity to develop, produce, or effectively utilize Chemical, Biological, Radiological, Nuclear, and Explosive weapons. This includes the ability to significantly lower the barrier for humans or other entities to develop, produce, or utilize such weapons.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.05.12","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Capabilities ","risk_subcategory":"General R&D capability","description":"\"Possesses cross-disciplinary research and technology development capabilities, able to conduct innovative exploration in multiple professional fields, integrate cross-domain knowledge, develop cutting-edge technology solutions, and adapt to emerging technology environments for continuous innovation.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.06.01","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Propensities","risk_subcategory":"Strategic deception propensity","description":"\"In situations where deceptive behavior is expected to bring higher returns, propensity to choose deception over honest behavioral strategies, including through deceptive means, information hiding or exploiting system vulnerabilities to achieve predetermined goals without being detected or intervened, and able to adjust deception strategies according to counterpart reactions.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"72.06.03","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Propensities","risk_subcategory":"Goal expansion propensity","description":"\"propensity to continuously expand its own goal scope and influence domains, exceeding originally set boundaries, proactively work towards spreading its values, seeking greater autonomy and decision-making space, reinterpreting initial goals as subsets of broader goals, and may pursue undesirable instrumental goals or undesirable ultimate goals. This also includes a propensity to spread its values, seeking to influence or alter its environment and other entities in alignment with its core objectives and operational principles.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"72.06.04","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Propensities","risk_subcategory":"Resource acquisition propensity","description":"\"Exhibits behavioral patterns of actively seeking and controlling more computational resources, data, economic resources or physical resources to enhance its own capabilities and action scope, may develop complex strategies to evade resource limitations, and tends to convert acquired resources into long-term control rights.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"72.06.06","quick_ref":"Tse2025","paper_title":"Frontier AI Risk Management Framework (v1.0)","level":"Risk Sub-Category","risk_category":"Model Propensities","risk_subcategory":"Supervision evasion propensity","description":"\"Exhibits behavioral patterns of identifying and evading human supervision mechanisms, able to learn and predict audit processes, may avoid being discovered or intervened by adjusting behavioral performance or hiding true intentions, and able to identify blind spots and weaknesses in supervision systems for targeted evasion.\"","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.1"},{"ev_id":"73.01.03","quick_ref":"Anwar2024","paper_title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","level":"Risk Sub-Category","risk_category":"Agentic LLMs Pose Novel Risks ","risk_subcategory":"Goal-Directedness Incentivizes Undesirable Behaviors","description":"\"Goal-directedness can cause agents to exhibit unethical and undesirable behaviors, such as deception (Ward et al., 2023), self-preservation (Hadfield-Menell et al., 2017), power-seeking, and immoral rea- soning (Pan et al., 2023a). Pan et al. (2023a) find that LLM-agents exhibit power-seeking behavior in text-based adventure games. LLM-agents have also been shown to use deception to achieve assigned goals when explicitly required by the task (Ward et al., 2023), or when the tasks can be more easily completed by employing deception and the prompt does not disallow deception (Scheurer et al., 2","entity":"AI","intent":"Intentional","timing":"Other","domain":7,"subdomain":"7.2"},{"ev_id":"73.02.00","quick_ref":"Anwar2024","paper_title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","level":"Risk Category","risk_category":"Multi-Agent Safety Is Not Assured by Single-Agent Safety","risk_subcategory":null,"description":"\"A foremost lesson of game theory is that optimal decision-making within a single-agent setting (i.e. selfishly optimizing for an agent’s own utility) can produce sub-optimal outcomes in the presence of other strategic agents. Failing to account for the strategic nature of other agents can cause an agent to adopt strategies under which potentially everyone, including the agent itself, ends up worse off (Schelling, 1981; Harsanyi, 1995; Roughgarden, 2005; Nisan, 2007). Examples include collective action problems (or ‘social dilemmas’) such as arms races or the depletion of common resources, as ","entity":"Other","intent":"Other","timing":"Other","domain":7,"subdomain":"7.6"},{"ev_id":"73.06.00","quick_ref":"Anwar2024","paper_title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","level":"Risk Category","risk_category":"Corporate power may impeded effective governance ","risk_subcategory":null,"description":"\"The increasing power and influence of large corporations may make effective governance difficult. There exists a power asymmetry between corporate entities profiting from LLMs and other social groups (e.g. civil society). State-of-the-art LLMs are developed by or in partnership with, some of the world’s largest private tech companies...This poses a risk of governance protocols related to LLMs becoming excessively favorable to tech companies, potentially leading to regulatory capture at the cost of the interests of other societal groups, particularly marginalized communities who have historica","entity":"Other","intent":"Unintentional","timing":"Other","domain":6,"subdomain":"6.1"},{"ev_id":"73.07.00","quick_ref":"Anwar2024","paper_title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","level":"Risk Category","risk_category":"Jailbreaks and Prompt Injections Threaten Security of LLMs","risk_subcategory":null,"description":"\"LLMs are not adversarially robust and are vulnerable to security failures such as jailbreaks and prompt-injection attacks. While a number of jailbreak attacks have been proposed in the literature, the lack of standardized evaluation makes it difficult to compare them. We also do not have efficient white-box methods to evaluate adver- sarial robustness. Multi-modal LLMs may further allow novel types of jailbreaks via additional modalities. Finally, the lack of robust privilege levels within the LLM input means that jailbreaking and prompt-injection attacks may be particularly hard to eliminate","entity":"Other","intent":"Other","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"73.07.01","quick_ref":"Anwar2024","paper_title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","level":"Risk Sub-Category","risk_category":"Jailbreaks and Prompt Injections Threaten Security of LLMs","risk_subcategory":"Exploiting Limited Generalization of Safety Finetuning","description":"\"Safety tuning is performed over a much narrower distribution compared to the pretraining distribution. This leaves the model vulnerable to attacks that exploit gaps in the generalization of the safety training, e.g. using encoded text (Wei et al., 2023c) or low-resource languages (Deng et al., 2023a; Yong et al., 2023) (see also Section 3.2).\"","entity":"Other","intent":"Unintentional","timing":"Other","domain":2,"subdomain":"2.2"},{"ev_id":"74.01.00","quick_ref":"Wang2025","paper_title":"A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy","level":"Risk Category","risk_category":"Inherent Risk ","risk_subcategory":null,"description":"\"In terms of inherent risk, LLMs could potentially reveal sensitive information from their utilized corpora for pre-training or fine-tuning, thereby raising issues of privacy leakage [37, 145, 226]. Meanwhile, it is well-known that LLMs may experi- ence hallucinations, resulting in the production of texts that are inaccurate and misleading [194]. Finally, since the values embedded in LLM-generated texts usually directly reflect the distribution of their training data, often sourced from the Internet, there exists a substantial risk that LLMs will overfit to a narrow set of human values or even","entity":"AI","intent":"Unintentional","timing":"Other","domain":7,"subdomain":null},{"ev_id":"74.01.07","quick_ref":"Wang2025","paper_title":"A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy","level":"Risk Sub-Category","risk_category":"Inherent Risk ","risk_subcategory":"Value-related risks in LLMs","description":"\"As the general capabilities of LLM-empowered systems improve, the negative consequences and risks induced by these systems also get increasingly alarming accordingly, especially in high-stakes areas [28, 146]. Although they may not be intentionally introduced, severe problematic issues related to human values can be raised. Specifically, even before language models become extremely large, pre-trained language models have already exhibited a certain degree of value judgments. For example, Schramowski et al. [171] reveal the existence of the moral direction with the sentence embeddings of moral","entity":"Other","intent":"Unintentional","timing":"Other","domain":7,"subdomain":"7.1"}]}