MIT AI Risk Repository · domain 5: Human-Computer Interaction
5.2 Loss of human agency and autonomy
Humans delegating key decisions to AI systems, or AI systems making decisions that diminish human control and autonomy, potentially leading to humans feeling disempowered, losing the ability to shape a fulfilling life trajectory or becoming cognitively enfeebled.
- 47
- 12
- 4
- 4
| Label | Value |
|---|---|
| Other | 24 |
| Human | 12 |
| AI | 11 |
| Label | Value |
|---|---|
| Other | 22 |
| Unintentional | 19 |
| Intentional | 6 |
| Label | Value |
|---|---|
| Post-deployment | 31 |
| Other | 16 |
| Label | Value |
|---|---|
| 2021 | 2 |
| 2024 | 1 |
| 2026 | 1 |
| Label | Value |
|---|---|
| Risk Category | 13 |
| Risk Sub-Category | 33 |
| Additional evidence | 1 |
Risk entries
Browse and export all- Gradual, irretrievable ceding of human power over the future to AI systems
-
- Disruptions from Outpaced Societal Adaptation
"Although the implementation of general purpose AI models as automation tools could be a major opportunity, overly rapid adoption of this technology at scale might outpace the ability of society to ad...
- Human dignity/respect
"Discrepancies between caste/status based on intelligence may lead to undignified parts of the society—e.g., humans—who are surpassed in intelligence by AI"
- Over-reliance
"The apparent convenience and powerfulness of ChatGPT could result in overreliance by its users, making them trust the answers provided by ChatGPT. Compared with traditional search engines that provid...
- Reduced Autonomy/Responsibility
"AI is providing more and more solutions for complex activities, and by taking advantage of this process, people are becoming able to perform a greater number of activities more quickly and accurately...
- Interpersonal Harms
Interpersonal harms capture instances when algorithmic systems adversely shape relations between people or communities.
- Loss of agency/control
Loss of agency occurs when the use [123, 137] or abuse [142] of algorithmic systems reduces autonomy. One dimension of agency loss is algorithmic profiling [138], through which people are subject to s...
- Cultural harms
Cultural harm has been described as the development or use of algorithmic systems that affects cultural stability and safety, such as “loss of communication means, loss of cultural property, and harm...
- Trustworthiness and Autonomy
"Human trust in systems, institutions, and people represented by system outputs evolves as generative AI systems are increasingly embedded in daily life."
- Ethical Risks (Risks of challenging traditional social order)
"The development and application of AI may lead to tremendous changes in production tools and relations, accelerating the reconstruction of traditional industry modes, transforming traditional views o...
- Loss of Control Risks
"Risks associated with scenarios in which one or more general-purpose AI systems come to operate outside of anyone's control, with no clear path to regaining control. This includes both passive loss o...
- Passive loss of control
"...where humans gradually stop exercising meaningful oversight due to automation bias, the AI systems' inherent complexity, or competitive pressures"
- Irreversible change
"Profound negative long-term changes to social structures, cultural norms, and human relationships that may be difficult or impossible to reverse."
- Limited human oversight in decisions
"As AI models and systems gain autonomy, the ability of humans to oversee and intervene in decision-making processes diminishes."
- Personal decision automation capabilities
"AI models and systems could decide or influence important personal decisions."
- AI Society
"AI already shapes many areas of daily life and thus has a strong impact on society and everyday social life. For instance, transportation, education, public safety and surveillance are areas where ci...
- Censorship of opinions expressed in the Internet restricts freedom of expression
- Loss of supervision and control of business processes
- AI systems may undermine human values (e.g., free will, autonomy)
- Technology obedience and lack of governance through increasing application of AI systems
- Operational misuses (Autonomous unsafe operation of systems)