MIT AI Risk Repository
Browse AI risks
977 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
-
-
-
-
46.04.00 · Risk Category
"Lastly, broader harms that can impact communities, societal structures, and critical infrastructures, including threats to democratic processes, social cohesion, and technological systems, are captured under “Societal, Socio-technical, and Infrastructural Damage.”"
-
-
-
-
-
"Generative AI facilitates the automation of data analysis, offering numerous benefits, such as increased speed and the ability to process large volumes of information efficiently. Such ability significantly reduces the costs of processing unprecedented amounts of data quickly and simplifies the analysis of large-scale data related to individuals’ behaviors and beliefs. Moreover, it enhances the capability to analyze both textual and visual communications efficiently. Consequently, generative AI models improve the efficiency of real-time monitoring and censorship of social media content."
-
"IIl-intentioned individuals or entities may deliberately use generative AI models to produce and spread disinformation—false or misleading information knowingly presented as if true—on a massive scale. In addition to increasing the scale and reach of disinformation, generative AI can create more convincing and targeted disinformation."
-
48.08.00 · Risk Category
"Lowered barrier to entry to generate and support the exchange and consumption of content which may not distinguish fact from opinion or fiction or acknowledge uncertainties, or could be leveraged for large-scale dis- and mis-information campaigns."
-
49.01.02#1 · Risk Sub-Category
Disinformation and manipulation of public opinion
"AI, particularly general- purpose AI, can be maliciously used for disinformation (351), which for the purpose of this report refers to false information that was generated or spread with the deliberate intent to mislead or deceive. General- purpose AI- generated text can be indistinguishable from genuine human- generated material (352, 353), and may already be disseminated at scale on social media (354). In addition, general- purpose AI systems can be used to not only generate text but also fully synthetic or misleadingly altered images, audio, and video content. General- purpose AI tools mig
-
—
-
—
-
—
-
—
-
—
-
—
-
"General purpose AI models could exacerbate existing tactics for political destabilisation, such as disinformation campaigns, and surveillance efforts if misused for political motivations. The technological advancements in text and media generation of general purpose AI models could refine disinformation164 attempts to shape and polarise public opinion or influence important political events.165 The improved automated processing of text, audio, image, and video could be used for surveillance measures and exacerbate human right violations and repression of political oppositions."
-
"OpenAI’s GPT-3 was designed to be dicult to extract personal information from, including for example public gures’ dates of birth. Even so, malicious uses of AI continue to encroach on privacy, as exemplied by China’s “Sharp Eye” automated surveillance system [551] and automated cyberattacks on personal data [354]. A more drastic form of AI-enabled surveillance could be on the way in the form of nonsurgical decoding of thoughts [54]—a technique which is reportedly already used by some police forces [398]."
-
55.03.03 · Risk Sub-Category
Increased power concentration and inequality
Developments in AI enable actors to undermine democratic processes
"Developments in AI are giving companies and governments more control over individuals’ lives than ever before, and may possibly be used to undermine democratic processes. We are already seeing how the collection of large amounts of personal data can be used to surveil and influence populations, for example the use of facial recognition technology to surveil Uighur and other minority populations in China [66]. Further advances in language modelling could also be used to develop tools that can effectively persuade people of certain claims [42]."
-
55.04.02 · Risk Sub-Category
Worsened epistemic processes for society
AI is used to scale up production of false and misleading information
"At the same time, we are seeing how AI can be used to scale up the production of convincing yet false or misleading information online (e.g. via image, audio, and text synthesis models like BigGAN [6] and GPT-3 [7])."
-
55.04.03 · Risk Sub-Category
Worsened epistemic processes for society
AI's persuasive capabilities are misused to gain influence and promote harmful ideologies
"As AI capabilities advance, they may be used to develop sophisticated persuasion tools, such as those that tailor their communication to specific users to persuade them of certain claims [42]. While these tools could be used for social good— such as New York Times’ chatbot that helps users to persuade people to get vaccinated against Covid-19 [27]—there are also many ways they could be misused by self-interested groups to gain influence and/or to promote harmful ideologies."
-
"Coercion/manipulation - Use of a technology system to covertly alter user beliefs and behaviour using nudging, dark patterns and/or other opaque techniques, resulting in potential erosion of privacy, addiction, anxiety/distress, etc."
-
"Electoral interference - Generation of false or misleading information that can interrupt or mislead voters and/or undermine trust in electoral processes."
-
"Political manipulation - Use or misuse of personal data to target individuals’ interests, personalities and vulnerabilities with tailored political messages via micro-advertising or deepfakes/synthetic media."
-
"Malicious actors can use general- purpose AI to generate fake content such as text, images, or videos, for attempts to manipulate public opinion. Researchers believe that if successful, such attempts could have several harmful consequences."
-
"AI could be used to develop sophisticated tools to manipulate and persuade individuals."
-
61.02.04 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Advertising-driven models
"AI models and systems underpin the advertising approaches that drive much of the internet, potentially influencing societal behavior."
-
61.02.05 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
AI in totalitarian regimes
"AI-based surveillance and manipulation could be used to maintain global totalitarian regimes."
-
61.02.43 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Surveillance capabilities
"AI models and systems may grant governments or corporations increased monitoring over individuals."
-
61.02.49 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Widespread use of persuasion tools
"Widespread use of AI-powered persuasion tools could lead to systemic harm"
-
62.31.03#1 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Automatically generating disinformation at scale
"Disinformation (in various modalities: text, audio, images, video, etc.) can be generated with minimal human oversight and effort. Disinformation tools are relatively cheap and their technology is widely available. Such deployments can be particularly widespread in sensitive political contexts."
-
62.31.05 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Generative AI use in political influence campaigns
"GPAI tools can be used in automation and scaling of influence campaigns [178]. Public opinion may be manipulated by targeted misleading or manipulative information. This can lead to rising political polarization and diminishing trust in public institutions."
-
62.31.10 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Misuse for surveillance and population control
"AI tools can be misused by human or institutional actors for monitoring, control- ling, or suppressing individuals [178]. Massive data collection and automated analysis are often conducted, and AI tools can further exacerbate such practices."
-
62.31.12 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Diminishing societal trust due to disinformation or manipulation
"The use of GPAIs may contribute to the proliferation of either deliberate dis- information or unintended misinformation can severely erode trust in public figures and democratic institutions. This diminishing trust can extend to other forms of media, making the public less informed."
-
"Automatic generation of disinformation can be personalized to target specific groups or individuals. Such attacks can be more effective in achieving their goals, and their costs can be significantly reduced when using GPAIs."
-
64.01.03 · Risk Sub-Category
Misuse tactics that exploit GenAI capabilities (Realistic depiction of human likeness)
Sockpuppeting
"Create synthetic online personas or accounts"
-
64.02.01 · Risk Sub-Category
Misuse tactics that exploit GenAI capabilities (Realistic depictions of non-humans)
Falisification
"Fabricate or falsely represent evidence, incl. reports, IDs, documents"
-
"Generative AI models might be used to intentionally create misleading or false information to deceive or influence a targeted audience."
-
"Erosion of trust in public institutions and weakened checks and balances due to mis/disinformation, influence operations, or real or perceived misuse of generative AI"
-
"Use of a technology system to covertly alter user beliefs and behaviour using nudging, dark patterns and/or other opaque techniques"
-
"In addition to unintentional degradation of the information environment (discussed in the section on Societal Harms above), frontier AI can be misused to deliberately spread false information to create disruption, persuade people on political issues, or cause other forms of harm or damage."
-
"AI systems can be gravely misused to distort public perception and compromise social stability through the generation of synthetic content (e.g., deepfakes, sophisticated fake news) and the strategic manipulation of digital platforms with large user bases to disseminate or precisely target misleading information or ideologies."
-
73.03.03 · Risk Sub-Category
Dual-Use Capabilities Enable Malicious Use and Misuse of LLMs
Surveillance and Censorship
"Content moderation has emerged as one of the key use-cases of LLMs (Weng et al., 2023), indicating the potential of LLMs for surveillance and censorship as well (Edwards, 2023). Surveillance and censorship are one of the primary tools employed by governments with dictatorial tendencies to suppress opposing political and social voices. These censorship measures, however, are often quite crude and can be escaped with little ingenuity...However, LLMs could enable significantly more sophisticated surveillance and censorship operations at scale (Feldstein, 2019). Multimodal-LLMs or LLMs combined w
-
01.05.00 · Risk Category
One or more criminal entities could create AI to intentionally inflict harms, such as for terrorism or combating law enforcement.
-
01.06.00 · Risk Category
AI deployed by states in war, civil war, or law enforcement can easily yield societal-scale harm
-
"Hackers can obtain malicious code in a low-cost and efficient manner to automate cyber attacks with powerful LLM systems."
-
05.10.00 · Risk Category
Closely related to discussions surrounding security and harmful content, the field of cybersecurity investigates how generative AI is misused for fraudulent online activities. A particular focus lies on social engineering attacks, for instance by utilizing generative AI to impersonate humans, creating fake identities, cloning voices, or crafting phishing messages. Another prevalent concern is the use of LLMs for generating malicious code or hacking.
-
06.10.00 · Risk Category
"What is debated as an ethical issue is the use of LAW — AI-driven weapons that fully autonomously take actions that intentionally kill humans."
-
"AI machines could be hacked and misused, e.g. manipulating an airport luggage screening system to smuggle weapons"
-
12.01.00 · Risk Category
"The potential for AI systems to be used maliciously or irresponsibly, including for creating deepfakes, automated cyber attacks, or invasive surveillance systems. Specifically denotes intentional use of AI for harm."
-
16.04.02 · Risk Sub-Category
Assisting code generation for cyber security threats
Anticipated risk: "Creators of the assistive coding tool Co-Pilot based on GPT-3 suggest that such tools may lower the cost of developing polymorphic malware which is able to change its features in order to evade detection [37]."
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.