AI incident ·
California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed
In brief
An AI system built and deployed by Instagram allegedly harmed Sennett Devermont and Beverly Hills Citizens.
- Risk domain
- Human-Computer Interaction
- Occurred
- Coverage
- 0 reports
What happened
A police officer in Beverly Hills played copyrighted music on his phone when realizing that his interactions were being recorded on a livestream, allegedly hoping the Instagram's automated copyright detection system to end or mute the stream.
Laws that address this harm
Policy angle: Classified under Human-Computer Interaction (Loss of human agency and autonomy) in the MIT AI Risk Repository taxonomy; 5 recorded instruments address this use case.
- India DPDP Act
- Law on Artificial Intelligence (2025)
- Law No. 132/2025 on artificial intelligence
- EU AI Act
- Texas Responsible AI Governance Act (TRAIGA)
Matched from the record's risk domain and country to the instruments recorded here. A reviewer can correct the match in the repository (data/external/incident_overrides.yaml).
Who was involved
Classification (MIT AI Risk Repository taxonomy)
- Risk domain
- Human-Computer Interaction
- Risk subdomain
- 5.2 Loss of human agency and autonomy
- Causal entity
- Human
- Intent
- Intentional
- Timing
- Post-deployment
- Harm level
- —
- Sectors
- —
- Countries
- —
Risk entries describing this failure mode
Entries from the MIT AI Risk Repository coded to subdomain 5.2.
- Autonomy/agency loss
"Autonomy/agency loss - Loss of an individual, group or organisation’s ability to make informed decisions or pursue goals."
- Autonomy
"Autonomy - Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output."
- Personality rights loss
"Personality rights loss - Loss of or restrictions to the rights of an individual to control the commercial use of their identity, such as name, image, likeness, or other unequivocal identifiers."
- Gradual loss of control
"Gradual or accumulative loss of control risks can be described as risks resulting from the accumulation of less severe disruptions that gradually weakens systemic resilience until a critical event triggers a catastrophe...
- AI enables automation of military decision-making
"One concern here is humans not remaining in the loop for some military decisions, creating the possibility of unintentional escalation because of: • Automated tactical decision-making, by ‘in-theatre’ AI systems (e.g. b...
- AI-induced strategic instability
"For example, AI could undermine nuclear strategic stability by making it easier to discover and destroy previously secure nuclear launch facilities [30, 46, 49]. AI may also offer more extreme first-strike advantages or...
- -
"Humans may increasingly hand over control of important decisions to AI systems, due to economic and geopolitical incentives. Some experts are concerned that future advanced AI systems will seek to increase their own inf...
- Humans might increasingly hand over control to misaligned AI systems
"Organisations around the world are already deploying misaligned AI systems that are causing harm in unexpected ways.250 Recommendation algorithms increase the consumption of extremist content.251 Medical algorithms have...
Incidents in the same risk subdomain
- DisMech AI Curation Agent Reportedly Completed GitHub Issue Intended as New Contributor's Learning Task
- Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco
- Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment
Other incidents involving Instagram
Source record: incident #141 on the AI Incident Database