AI incident #355 ·
Uber Allegedly Wrongfully Accused Drivers of Fraud via Automated Systems
What happened
Uber was alleged in a lawsuit to have wrongfully accused its drivers in the UK and Portugal of fraudulent activity through automated systems, which resulted in their dismissal without a right to appeal.
Only the incident metadata is stored here. The underlying news reports are on the AI Incident Database (CC BY-SA 4.0); use the links above to read them.
News reports (4)
Coverage catalogued by the AI Incident Database. Titles link to the original publisher; the text is not reproduced here.
Who was involved
AI systems implicated
Classification (MIT AI Risk Repository taxonomy)
- Risk domain
- AI system safety, failures, and limitations
- Risk subdomain
- 7.4 Lack of transparency or interpretability
- Causal entity
- AI
- Intent
- Unintentional
- Timing
- Post-deployment
- Harm level
- AI tangible harm event
- Sectors
- transportation and storage
- Countries
- —
Risk entries describing this failure mode
Entries from the MIT AI Risk Repository coded to subdomain 7.4.
- Intelligibility
"How can we build agent’s whose decisions we can understand? Con- nects explainable decisions (Berkeley) and informed oversight (MIRI)."
- Attributing the responsibility for AI's failures
"This section, constituting almost 8% of the articles, addresses the implications arising from AI acting and learning without direct human supervision, encompassing two main issues: a responsibility gap and AI's moral st...
- Model Evaluations (Interpretability/Explainability)
- Model outputs inconsistent with chain-of-thought reasoning
"Chain-of-thought reasoning is sometimes employed to get a better understanding of the model’s output, where it encourages transparent reasoning in text form. However, in some cases, this reasoning is not consistent with...
- Lack of understanding of in-context learning in language models
"In-context learning allows the model to learn a new task or improve its perfor- mance by providing examples in the prompt, without changing its weights [101]. Even though this technique is highly effective, its working...
- General Evaluations (Difficulty of identification and measurement of capabilities)
"The capabilities of general-purpose AI systems can be difficult to measure, compared to the capabilities of more limited and fixed-purpose AI systems. This is in part due to a broader distribution of potential risks, a...
- Lack of transparency and interpretability
"Today's Frontier AI is difficult to interpret and lacks transparency. Contextual understanding of the training data is not explicitly embedded within these models. They can fail to capture perspectives of underrepresent...
- Opacity (the black box problem)
"Opacity surrounding the technical, internal decision-making processes of generative AI models is popularly known as the “black box problem.”277 Generative AI models, most ubiquitously built on deep neural networks with...
Related incidents on the AI Incident Database
Linked by AIID editors or by its text-similarity model.
- Uber Allegedly Violated GDPR by Failing to Provide Sufficient Notice on Automated Profiling for Drivers
- Microsoft’s Algorithm Allegedly Selected Photo of the Wrong Mixed-Race Person Featured in a News Story
- Facial Recognition Trial Performed Poorly at Notting Hill Carnival
- Tinder's Personalized Pricing Algorithm Found to Offer Higher Prices for Older Users
Incidents in the same risk subdomain
- Uber Launched Opaque Algorithm That Changes Drivers' Payments in the US
- Israeli Tax Authority Reportedly Used an Opaque Automated System to Issue a Fine, Declining to Explain or Disclose the Underlying Calculation
- Houston ISD's EVAAS Teacher-Evaluation System Reportedly Put Teachers' Jobs at Risk Through Unverifiable Scores
- Dutch City Court Defended Home Value Generated by Black-Box Algorithm
Other incidents involving Uber
- Uber Launched Opaque Algorithm That Changes Drivers' Payments in the US
- Uber Allegedly Violated GDPR by Failing to Provide Sufficient Notice on Automated Profiling for Drivers
- Transgender Uber Drivers Mistakenly Kicked off App for Appearance Change during Gender Transitions
- Uber AV Killed Pedestrian in Arizona
- Uber Locked Indian Drivers out of Accounts Allegedly Due to Facial Recognition Fails
- Uber's Surge Pricing Reportedly Offered Disproportionate Service Quality along Racial Lines