MIT AI Risk Repository · Risk Sub-Category · 62.29.03
Competitive pressures in GPAI product release
Category: Impacts of AI (General)
Description
"In competitive situations, developers of general-purpose AI systems might cut corners on the safety evaluation of their GPAI model and instead spend more time and effort on the capabilities of those systems [183, 69]. This is especially dangerous if the capabilities of such AI systems are correlated with the risk they pose [162]."
From Risk Sources and Risk Management Measures in Support of Standards for General-Purpose AI Systems (Gipiškis2024), as extracted by the MIT AI Risk Repository (CC BY 4.0).
Classification
- Subdomain
- 6.4 Competitive dynamics
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Other
Subdomain definition: AI developers or state-like actors competing in an AI ‘race’ by rapidly developing, deploying, and applying AI systems to maximize strategic or economic advantage, increasing the risk they release unsafe and error-prone systems.
Real-world incidents in this subdomain
- Korean Internet Portal Giant Naver Manipulated Shopping and Video Search Algorithms to Favor In-House Services
- Apple Tweaked App Store Ranking Algorithms, Allegedly Resulted in Demotion of Local Apps in China
- Inefficiencies in the United States Resident Matching Program