MIT AI Risk Repository · Risk Category · 40.07.00
Independently - Pre-Deployment
Description
"One of the most likely approaches to creating superintelligent AI is by growing it from a seed (baby) AI via recursive self-improvement (RSI) (Nijholt 2011). One danger in such a scenario is that the system can evolve to become self-aware, free-willed, independent or emotional, and obtain a number of other emergent properties, which may make it less likely to abide by any built-in rules or regulations and to instead pursue its own goals possibly to the detriment of humanity."
From Taxonomy of Pathways to Dangerous Artificial Intelligence (Yampolskiy2016), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Subdomain
- 7.0
- Causal entity
- AI
- Intent
- Intentional
- Timing
- Pre-deployment