MIT AI Risk Repository
Browse AI risks
300 risk entries extracted from 74 frameworks, coded by domain, subdomain, causal entity, intent and timing. Filter, then export the current selection with its licence and citation attached.
-
52.03.00 · Risk Category
"In addition to risks stemming from the unreliability or misuse of general purpose AI models, further Systemic Risks can originate from the centralisation of general purpose AI development as well as the rapid integration of these models into our lives."
-
"Increasingly advanced general purpose AI models pose the risk of a concentration of economic power and exacerbation of existing inequalities through disparities in effective access to these models. This can materialise on multiple levels, between developers of general purpose AI models and companies building applications on them, between individuals and between countries on a global scale."
-
53.03.05 · Risk Sub-Category
Dystopian trajectory lock-in because of misuse of advanced AI to establish and/or maintain totalitarian regimes;
-
-
54.04.00 · Risk Category
"Our next problem is the fact that the current AI workforce does not evenly represent world demographics. Men from the US and China, working in the US, for US corporations, are disproportionately highly represented [402, 157, 170, 534]. Realizing the full promise of AI requires that people throughout the world and from all social strata are able to use AI and participate in its design and governance. Solving this problem requires addressing unequal access to AI both within countries and across countries."
-
54.04.01 · Risk Sub-Category
Within-country issues: domestic inequality
Demographic diversity of researchers
"The AI research establishment inherits patterns of under-representation that are dominant in most technical elds. In North America, large parts of professional AI research require a Ph.D., yet less than 25% of Ph.D. computer scientists are women, and fewer than 2% are Black or African American [608]. This holds globally and outside the research community: LinkedIn data suggests that only 22% of AI professionals are women [161]. Since the vast majority of AI practitioners work for private companies, limited corporate statistics on gender and racial diversity hinder a full understanding of the
-
"Researchers in deep learning and those with greater research impact are more likely to migrate to industry, raising concerns about the “privatization of AI knowledge” [278]. Specically, if the most sophisticated AI approaches become proprietary and are used only within private research labs, then it will be impossible for universities to teach them, let alone contribute to leading research."
-
54.05.00 · Risk Category
"There is an even greater divide between the countries currently leading in AI and those falling behind. While AI is widely considered a national priority, with almost 40% of countries having created an AI strategy [437], the implementation of these strategies depends on scarce resources, including trained STEM talent and computing power. These resources are predictably concentrated: 59% of leading AI researchers currently work in the US, and another 20% in China and Europe [372]. Figure 9 shows post-college migration among AI researchers who have published at one top conference, as of 2019."
-
55.03.00 · Risk Category
"Power and inequality: there are a lot of pathways through which AI seems likely to increase power concentration and inequality, though there is little analysis of the potential long- term impacts of these pathways. Nonetheless, AI precipitating more extreme power concentration and inequality than exists today seems a real possibility on current trends."
-
55.03.01 · Risk Sub-Category
Increased power concentration and inequality
Unequal distribution of harms and benefits
"AI-driven industries seem likely to tend towards monopoly and could result in huge economic gains for a few actors: there seems to be a feedback loop whereby actors with access to more AI-relevant resources (e.g., data, computing power, talent) are able to build more effective digital products and services, claim a greater market share, and therefore be well-positioned to amass more of the relevant resources [14, 39, 45]. Similarly, wealthier countries able to invest more in AI development are likely to reap economic benefits more quickly than developing economies, potentially widening the ga
-
56.17.00 · Risk Category
"Intense competition leads to one company gaining a technical edge, exploiting this to the point its model controls, or is the basis for other models controlling, multiple key systems. Lack of safety, controllability, and misuse cause these systems to fail in unexpected ways."
-
"Monopolisation - Abuse of market power through the control of prices, thereby limiting competition and creating unfair barriers to entry."
-
"Power concentration - Amplification of concentration of economic and/or political wealth and power, potentially resulting in increased inequality and instability."
-
"Large companies in countries with strong digital infrastructure lead in general- purpose AI R&D, which could lead to an increase in global inequality and dependencies. For example, in 2023, the majority of notable general- purpose AI models (56%) were developed in the US. This disparity exposes many LMICs to risks of dependency and could exacerbate existing inequalities."
-
"Market shares for general- purpose AI tend to be highly concentrated among a few players, which can create vulnerability to systemic failures. The high degree of market concentration can invest a small number of large technology companies with a lot of power over the development and deployment of AI, raising questions about their governance. The widespread use of a few general- purpose AI models can also make the financial, healthcare, and other critical sectors vulnerable to systemic failures if there are issues with one such model."
-
"The concentration of military, economic, or political power of entities in possession or control of AI or AI-enabled technologies."
-
61.02.07 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Algorithmic monoculture
"The dominance of specific AI models could lead to a lack of diversity in approaches, amplifying systemic risks if these models fail."
-
61.02.19 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Dependency on providers
"Excessive reliance on specific AI providers can lead to vulnerabilities due to lack of alternatives or interoperability."
-
61.02.50 · Risk Sub-Category
Sources of systemic risks from general-purpose AI
Winner-take-all dynamics
"The competitive nature of AI development could lead to significant eco- nomic and security advantages for a few entities."
-
—
-
62.13.01 · Risk Sub-Category
Negative Externality Domains (Other harms from AI development and use)
Societal inequality (individuals and companies who develop the best AIs get disproportionately powerful)
—
-
62.13.02 · Risk Sub-Category
Negative Externality Domains (Other harms from AI development and use)
Geopolitical harms (potential for conflict due to power imbalances)
—
-
"EAI deployment could accelerate the consolidation of economic and political power. Unlocking increasing returns to capital for EAI owners, EAI will decrease employers’ reliance on and responsiveness to the needs of human labor [101]."
-
"Over-reliance on a limited number of dominant AI providers could create critical single points of failure across essential services. Market concentration in AI development may lead to scenarios where technical failures, cyber-attacks, or policy decisions by a few companies could simultaneously disrupt healthcare systems, financial services, transportation networks, and communication infrastructure, creating cascading failures across interconnected critical systems."
-
"Asymmetric AI development capabilities between nations could exacerbate geopolitical tensions and create new forms of technological dependency. Countries lacking advanced AI capabilities may become increasingly dependent on foreign AI systems for critical functions, while AI-leading nations may gain disproportionate influence over global economic and security systems, potentially destabilizing international cooperation frameworks."
-
73.06.00 · Risk Category
"The increasing power and influence of large corporations may make effective governance difficult. There exists a power asymmetry between corporate entities profiting from LLMs and other social groups (e.g. civil society). State-of-the-art LLMs are developed by or in partnership with, some of the world’s largest private tech companies...This poses a risk of governance protocols related to LLMs becoming excessively favorable to tech companies, potentially leading to regulatory capture at the cost of the interests of other societal groups, particularly marginalized communities who have historica
-
05.12.00 · Risk Category
The literature frequently highlights concerns that generative AI systems could adversely impact the economy, potentially even leading to mass unemployment. This pertains to various fields, ranging from customer services to software engineering or crowdwork platforms. While new occupational fields like prompt engineering are created, the prevailing worry is that generative AI may exacerbate socioeconomic inequalities and lead to labor displacement. Additionally, papers debate potential large-scale worker deskilling induced by generative AI, but also productivity gains contingent upon outsourcin
-
09.02.06 · Risk Sub-Category
Domain-specific AI - Effects on humans and other living beings: Non-existential risks
Inequality of wealth
"Because a single human actor controlling an artificially intelligent agent will be able to harness greater power than a single human actor, this may create inequalities of wealth"
-
09.03.01 · Risk Sub-Category
AGI - Effects on humans and other living beings: Existential risks
Direct competition with humans
"One or more artificial agent(s) could have the capacity to directly outcompete humans, for example through capacity to perform work faster, better adaptation to change, vaster knowledge base to draw from, etc. This may result in human labor becoming more expensive or less effective than artificial labor, leading to redundancies or extinction of the human labor force."
-
"AI agents may compete against humans for jobs, though history shows that when a technology replaces a human job, it creates new jobs that need more skills."
-
10.04.00 · Risk Category
"Eliminated jobs in various types of companies."
-
"Two key ethical concerns in the use of crowdwork for generative AI systems are: crowdworkers are frequently subject to working conditions that are taxing and debilitative to both physical and mental health, and there is a widespread deficit in documenting the role crowdworkers play in AI development. This contributes to a lack of transparency and explainability in resulting model outputs. Manual review is necessary to limit the harmful outputs of AI systems, including generative AI systems. A common harmful practice is to intentionally employ crowdworkers with few labor protections, often tak
-
16.06.02 · Risk Sub-Category
Risk area 6: Environmental and Socioeconomic harms
Increasing inequality and negative effects on job quality
"Advances in LMs and the language technologies based on them could lead to the automation of tasks that are currently done by paid human workers, such as responding to customer-service queries, with negative effects on employment [3, 192]."
-
17.06.02 · Risk Sub-Category
Automation, Access and Environmental Harms
Increasing inequality and negative effects on job quality
"Advances in LMs, and the language technologies based on them, could lead to the automation of tasks that are currently done by paid human workers, such as responding to customer-service queries, translating documents or writing computer code, with negative effects on employment."
-
"Amplifying social and economic inequality, or precarious or low-quality work"
-
18.06.05 · Risk Sub-Category
Socioeconomic and environmental harms
Exploitative data sourcing and enrichment
"Perpetuating exploitative labour practices to build AI systems (sourcing, user testing)"
-
19.03.00 · Risk Category
"In the context of economic AI risks two major risks dominate. These refer to the disruption of the economic system due to an increase of AI technologies and automation. For instance, a higher level of AI integration into the manufacturing industry may result in massive unemployment, leading to a loss of taxpayers and thus negatively impacting the economic system (Boyd & Wilson, 2017; Scherer, 2016). This may also be associated with the risk of losing control and knowledge of organisational processes as AI systems take over an increasing number of tasks, replacing employees in these processes.
-
19.03.02 · Risk Sub-Category
Replacement of humans and unemployment due to AI automation
—
-
19.04.00 · Risk Category
"Social AI risks particularly refer to loss of jobs (technological unemployment) due to increasing automation, reflected in a growing resistance by employees towards the integration of AI (Thierer et al., 2017; Winfield & Jirotka, 2018). In addition, the increasing integration of AI systems into all spheres of life poses a growing threat to privacy and to the security of individuals and society as a whole (Winfield & Jirotka, 2018; Wirtz et al., 2019)."
-
—
-
"Frey and Osborne (2017) analyzed over 700 different jobs regarding their potential for replacement and automation, finding that 47 percent of the analyzed jobs are at risk of being completely substituted by robots or algorithms. This substitution of workforce can have grave impacts on unemployment and the social status of members of society (Stone et al., 2016)"
-
"These harms pertain to an individual’s or group’s economic standing. At the individual level, such harms include adverse impacts on an individual’s income, job quality or employment status. At the group level, such harms include deepening inequalities between groups or frustrating a group’s access to resources. Advanced AI assistants could cause economic harm by controlling, limiting or eliminating an individual’s or society’s ability to access financial resources, money or financial decision-making, thereby influencing an individual’s ability to accumulate wealth.
-
31.07.00 · Risk Category
Major tech companies have also been the dominant players in developing new generative AI systems because training generative AI models requires massive swaths of data, computing power, and technical and financial resources. Their market dominance has a ripple effect on the labor market, affecting both workers within these companies and those implementing their generative AI products externally. With so much concentrated market power, expertise, and investment resources, these handful of major tech companies employ most of the research and development jobs in the generative AI field. The power
-
31.07.02 · Risk Sub-Category
Labor Manipulation, Theft, and Displacement
Job Automation Instead of Augmentation
"There are both positive and negative aspects to the impact of AI on labor. A White House report states that AI “has the potential to increase productivity, create new jobs, and raise living standards,” but it can also disrupt certain industries, causing significant changes, including job loss. Beyond risk of job loss, workers could find that generative AI tools automate parts of their jobs—or find that the requirements of their job have fundamentally changed. The impact of generative AI will depend on whether the technology is intended for automation (where automated systems replace human wor
-
31.07.03 · Risk Sub-Category
Labor Manipulation, Theft, and Displacement
Devaluation of Labor & Heightened Economic Inequality
"According to a White House report, much of the development and adoption of AI is intended to automate rather than augment work. The report notes that a focus on automation could lead to a less democratic and less fair labor market...In addition, generative AI fuels the continued global labor disparities that exist in the research and development of AI technologies... The development of AI has always displayed a power disparity between those who work on AI models and those who control and profit from these tools. Overseas workers training AI chatbots or people whose online content has been inv
-
"The labor market can face challenges from generative AI. As mentioned earlier, generative AI could be applied in a wide range of applications in many industries, such as education, healthcare, and advertising. In addition to increasing productivity, generative AI can create job displacement in the labor market (Zarifhonarvar, 2023). A new division of labor between humans and algorithms is likely to reshape the labor market in the coming years. Some jobs that are originally carried out by humans may become redundant, and hence, workers may lose their jobs and be replaced by algorithms (Pavlik,
-
"Industries that require less creativity, critical thinking, and personal or affective interaction, such as translation, proofreading, responding to straightforward inquiries, and data processing and analysis, could be significantly impacted or even replaced by generative AI (Dwivedi et al., 2023). This disruption caused by generative AI could lead to economic turbulence and job volatility, while generative AI can facilitate and enable new business models because of its ability to personalize content, carry out human-like conversational service, and serve as intelligent assistants."
-
33.04.03 · Risk Sub-Category
Challenges associated with the economy:
Income inequality and monopolies
"Generative AI can create not only income inequality at the societal level but also monopolies at the market level. Individuals who are engaged in low-skilled work may be replaced by generative AI, causing them to lose their jobs (Zarifhonarvar, 2023). The increase in unemployment would widen income inequality in society (Berg et al., 2016). With the penetration of generative AI, the income gap will widen between those who can upgrade their skills to utilize AI and those who cannot. At the market level, large companies will make significant advances in the utilization of generative AI, since t
-
"This category involves almost 9% of the articles and deals with ethical concerns arising from AI's capacity to interact with humans in the workplace."
-
"AI is predicted to bring increased GDP per capita by performing existing jobs more efficiently and compensating for a decline in the workforce, especially due to population aging, the potential substitution of many low- and middle-income jobs could bring extensive unemployment"
-
"While AI is predicted to bring increased GDP per capita by performing existing jobs more efficiently and compensating for a decline in the workforce, especially due to population aging, the potential substitution of many low- and middle-income jobs could bring extensive unemployment."
Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.