MIT AI Risk Repository · Risk Sub-Category · 22.03.02
Organizational Factors can Reduce the Chances of Catastrophe
Category: Organizational Risks (Accidental)
Description
"Some organizations successfully avoid catastrophes while operating complex and hazardous systems such as nuclear reactors, aircraft carriers, and air traffic control systems [92, 93]. These organizations recognize that focusing solely on the hazards of the technology involved is insufficient; consideration must also be given to organizational factors that can contribute to accidents, including human factors, organizational procedures, and structure. These are especially important in the case of AI, where the underlying technology is not highly reliable and remains poorly understood"
From An Overview of Catastrophic AI Risks (Hendrycks2023), as extracted by the MIT AI Risk Repository (CC BY 4.0).