AI incident #854 ·
Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco
What happened
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
Only the incident metadata is stored here. The underlying news reports are on the AI Incident Database (CC BY-SA 4.0); use the links above to read them.
News reports (8)
Coverage catalogued by the AI Incident Database. Titles link to the original publisher; the text is not reproduced here.
Who was involved
Classification (MIT AI Risk Repository taxonomy)
- Risk domain
- Human-Computer Interaction
- Risk subdomain
- 5.2 Loss of human agency and autonomy
- Causal entity
- AI
- Intent
- Unintentional
- Timing
- Post-deployment
- Harm level
- —
- Sectors
- —
- Countries
- —
Risk entries describing this failure mode
Entries from the MIT AI Risk Repository coded to subdomain 5.2.
- Autonomy
"Autonomy - Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output."
- Personality rights loss
"Personality rights loss - Loss of or restrictions to the rights of an individual to control the commercial use of their identity, such as name, image, likeness, or other unequivocal identifiers."
- Autonomy/agency loss
"Autonomy/agency loss - Loss of an individual, group or organisation’s ability to make informed decisions or pursue goals."
- Gradual loss of control
"Gradual or accumulative loss of control risks can be described as risks resulting from the accumulation of less severe disruptions that gradually weakens systemic resilience until a critical event triggers a catastrophe...
- AI enables automation of military decision-making
"One concern here is humans not remaining in the loop for some military decisions, creating the possibility of unintentional escalation because of: • Automated tactical decision-making, by ‘in-theatre’ AI systems (e.g. b...
- AI-induced strategic instability
"For example, AI could undermine nuclear strategic stability by making it easier to discover and destroy previously secure nuclear launch facilities [30, 46, 49]. AI may also offer more extreme first-strike advantages or...
- Humans might increasingly hand over control to misaligned AI systems
"Organisations around the world are already deploying misaligned AI systems that are causing harm in unexpected ways.250 Recommendation algorithms increase the consumption of extremist content.251 Medical algorithms have...
- -
"Humans may increasingly hand over control of important decisions to AI systems, due to economic and geopolitical incentives. Some experts are concerned that future advanced AI systems will seek to increase their own inf...
Incidents in the same risk subdomain
- DisMech AI Curation Agent Reportedly Completed GitHub Issue Intended as New Contributor's Learning Task
- California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed
- Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment
Other incidents involving Waymo
- Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
- Waymo Robotaxis Allegedly Contributed to Traffic Gridlock During San Francisco PG&E Power Outage
- Waymo Robotaxi Reportedly Transported Undetected Person Trapped in Trunk in Los Angeles
- Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
- Waymo Autonomous Vehicle Reportedly Ran Over and Killed a Cat in San Francisco
- Reported Glitch in Waymo Self-Driving Cars Purportedly Triggers Regular All-Night Honking in San Francisco