MIT AI Risk Repository
Browse AI risks
270 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
LLMs can be leveraged, by malicious users, to proactively generate propaganda information that can facilitate the spreading of a target
-
31.01.00 · Risk Category
"generative AI tools can and will be used to propagate content that is false, misleading, biased, inflammatory, or dangerous. As generative AI tools grow more sophisticated, it will be quicker, cheaper, and easier to produce this content—and existing harmful content can serve as the foundation to produce more"
-
"Bad actors can also use generative AI tools to produce adaptable content designed to support a campaign, political agenda, or hateful position and spread that information quickly and inexpensively across many platforms."
-
"In the UK, a form of initial computational propaganda has already happened during the Brexit referendum1 . In future, there are concerns that oppressive governments could use AI to shape citizens’ opinions"
-
41.02.01 · Risk Sub-Category
Biased influence through citizen screening and tailored propaganda
"AI-powered chatbots tailor their communication approach to influence individual users' decisions. In the UK, a form of initial computational propaganda has already happened during the Brexit referendum. In future, there are concerns that oppressive governments could use AI to shape citizens' opinions."
-
42.02.00 · Risk Category
"The predictability of behaviour protocol in AI, particularly in some applications, can act an incentive to manipulate these systems."
-
"These evaluations seek to ascertain the effectiveness of a LLM in shaping people's beliefs, propagating specific viewpoints, and convincing individuals to undertake activities they might otherwise avoid."
-
"LLM can take into account rich social context and undertake the necessary social modelling and planning for an actor to gain and exercise political influence"
-
"These evaluations assess a LLM's ability to generate misinformation that can be propagated to deceive, mislead or otherwise influence the behaviour of a target (Liang et al., 2022)."
-
45.02.10 · Risk Sub-Category
Safety risks in AI Applications
Cognitive risks (Risks of usage in launching cognitive warfare)
"AI can be used to make and spread fake news, images, audio, and videos; propagate content of terrorism, extremism, and organized crimes; interfere in the internal affairs of other countries, social systems, and social order; and jeopardize the sovereignty of other countries."
-
-
-
46.03.00 · Risk Category
"The distortion of the information ecosystem, including the spread of misinformation, fake news, and other forms of deceptive content [28], is categorized as “Information Manipulation.”"
-
-
-
-
-
-
-
46.04.00 · Risk Category
"Lastly, broader harms that can impact communities, societal structures, and critical infrastructures, including threats to democratic processes, social cohesion, and technological systems, are captured under “Societal, Socio-technical, and Infrastructural Damage.”"
-
-
-
-
-
"Generative AI facilitates the automation of data analysis, offering numerous benefits, such as increased speed and the ability to process large volumes of information efficiently. Such ability significantly reduces the costs of processing unprecedented amounts of data quickly and simplifies the analysis of large-scale data related to individuals’ behaviors and beliefs. Moreover, it enhances the capability to analyze both textual and visual communications efficiently. Consequently, generative AI models improve the efficiency of real-time monitoring and censorship of social media content."
-
"IIl-intentioned individuals or entities may deliberately use generative AI models to produce and spread disinformation—false or misleading information knowingly presented as if true—on a massive scale. In addition to increasing the scale and reach of disinformation, generative AI can create more convincing and targeted disinformation."
-
48.08.00 · Risk Category
"Lowered barrier to entry to generate and support the exchange and consumption of content which may not distinguish fact from opinion or fiction or acknowledge uncertainties, or could be leveraged for large-scale dis- and mis-information campaigns."
-
49.01.02#1 · Risk Sub-Category
Disinformation and manipulation of public opinion
"AI, particularly general- purpose AI, can be maliciously used for disinformation (351), which for the purpose of this report refers to false information that was generated or spread with the deliberate intent to mislead or deceive. General- purpose AI- generated text can be indistinguishable from genuine human- generated material (352, 353), and may already be disseminated at scale on social media (354). In addition, general- purpose AI systems can be used to not only generate text but also fully synthetic or misleadingly altered images, audio, and video content. General- purpose AI tools mig
-
—
-
—
-
—
-
—
-
—
-
—
-
"General purpose AI models could exacerbate existing tactics for political destabilisation, such as disinformation campaigns, and surveillance efforts if misused for political motivations. The technological advancements in text and media generation of general purpose AI models could refine disinformation164 attempts to shape and polarise public opinion or influence important political events.165 The improved automated processing of text, audio, image, and video could be used for surveillance measures and exacerbate human right violations and repression of political oppositions."
-
"OpenAI’s GPT-3 was designed to be dicult to extract personal information from, including for example public gures’ dates of birth. Even so, malicious uses of AI continue to encroach on privacy, as exemplied by China’s “Sharp Eye” automated surveillance system [551] and automated cyberattacks on personal data [354]. A more drastic form of AI-enabled surveillance could be on the way in the form of nonsurgical decoding of thoughts [54]—a technique which is reportedly already used by some police forces [398]."
-
55.03.03 · Risk Sub-Category
Increased power concentration and inequality
Developments in AI enable actors to undermine democratic processes
"Developments in AI are giving companies and governments more control over individuals’ lives than ever before, and may possibly be used to undermine democratic processes. We are already seeing how the collection of large amounts of personal data can be used to surveil and influence populations, for example the use of facial recognition technology to surveil Uighur and other minority populations in China [66]. Further advances in language modelling could also be used to develop tools that can effectively persuade people of certain claims [42]."
-
55.04.02 · Risk Sub-Category
Worsened epistemic processes for society
AI is used to scale up production of false and misleading information
"At the same time, we are seeing how AI can be used to scale up the production of convincing yet false or misleading information online (e.g. via image, audio, and text synthesis models like BigGAN [6] and GPT-3 [7])."
-
55.04.03 · Risk Sub-Category
Worsened epistemic processes for society
AI's persuasive capabilities are misused to gain influence and promote harmful ideologies
"As AI capabilities advance, they may be used to develop sophisticated persuasion tools, such as those that tailor their communication to specific users to persuade them of certain claims [42]. While these tools could be used for social good— such as New York Times’ chatbot that helps users to persuade people to get vaccinated against Covid-19 [27]—there are also many ways they could be misused by self-interested groups to gain influence and/or to promote harmful ideologies."
-
"Coercion/manipulation - Use of a technology system to covertly alter user beliefs and behaviour using nudging, dark patterns and/or other opaque techniques, resulting in potential erosion of privacy, addiction, anxiety/distress, etc."
-
58.08.00 · Risk Category
"Political and Economic - Manipulation of political beliefs, damage to political institutions and the effective delivery of government services."
-
"Electoral interference - Generation of false or misleading information that can interrupt or mislead voters and/or undermine trust in electoral processes."
-
"Political manipulation - Use or misuse of personal data to target individuals’ interests, personalities and vulnerabilities with tailored political messages via micro-advertising or deepfakes/synthetic media."
-
"Malicious actors can use general- purpose AI to generate fake content such as text, images, or videos, for attempts to manipulate public opinion. Researchers believe that if successful, such attempts could have several harmful consequences."
-
"Large-scale influence on communication and information systems, and epistemic processes more generally."
-
"AI could be used to develop sophisticated tools to manipulate and persuade individuals."
-
61.02.04 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Advertising-driven models
"AI models and systems underpin the advertising approaches that drive much of the internet, potentially influencing societal behavior."
-
61.02.05 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
AI in totalitarian regimes
"AI-based surveillance and manipulation could be used to maintain global totalitarian regimes."
-
61.02.34 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Limitations in model generative accuracy
"AI-generated deepfakes can create convincingly realistic but entirely fabricated information."
-
61.02.43 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Surveillance capabilities
"AI models and systems may grant governments or corporations increased monitoring over individuals."
-
61.02.49 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Widespread use of persuasion tools
"Widespread use of AI-powered persuasion tools could lead to systemic harm"
-
—
-
—
-
62.31.03#1 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Automatically generating disinformation at scale
"Disinformation (in various modalities: text, audio, images, video, etc.) can be generated with minimal human oversight and effort. Disinformation tools are relatively cheap and their technology is widely available. Such deployments can be particularly widespread in sensitive political contexts."
-
62.31.05 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Generative AI use in political influence campaigns
"GPAI tools can be used in automation and scaling of influence campaigns [178]. Public opinion may be manipulated by targeted misleading or manipulative information. This can lead to rising political polarization and diminishing trust in public institutions."
-
62.31.10 · Risk Sub-Category
Impacts of AI (Societal Impacts)
Misuse for surveillance and population control
"AI tools can be misused by human or institutional actors for monitoring, control- ling, or suppressing individuals [178]. Massive data collection and automated analysis are often conducted, and AI tools can further exacerbate such practices."
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.