Artificial Intelligence Policy Tracker

AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Filter incidents (1 active)

Two-letter code, e.g. US

Reset

38 incidents · subdomain: Overreliance and unsafe use · page 2 of 2

  1. #474 · 1 report

    Users Reported Abrupt Behavior Changes of Their AI Replika Companions AIID ↗

    Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.

    Deployer: Replika · Developer: Replika · Harmed: Replika Users, Replika

  2. #436 · 9 reports

    Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany AIID ↗

    A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.

    Deployer: Tesla · Developer: Tesla · Harmed: Traffic Participants

  3. #449 · 4 reports

    Startup Misled Research Participants about GPT-3 Use in Mental Healthcare Support AIID ↗

    OpenAI's GPT-3 was deployed by a mental health startup without ethical review to support peer-to-peer mental healthcare, and whose interactions with the help providers were "deceiving" for research participants.

    Deployer: Koko · Developer: Openai · Harmed: Research Participants, Koko Customers

  4. #384 · 2 reports

    Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident AIID ↗

    Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.

    Deployer: Glovo · Developer: Glovo · Harmed: Sebastian Galassi's family, Sebastian Galassi

  5. #264 · 1 report

    AI-Based Vehicle Speed Estimation App Denounced by UK Drivers as Surveillance Technology AIID ↗

    Speedcam Anywhere, an app allowing users to document and report traffic violations via AI-based videographic speed estimation of a vehicle, raised concerns for UK drivers about its capabilities for surveillance and abuse.

    Deployer: Speedcam Anywhere · Developer: Speedcam Anywhere · Harmed: Uk Drivers

  6. #156 · 2 reports

    Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts AIID ↗

    Despite complaints notifying Amazon about the sale of various products that had been used to aid suicide attempts, its recommendation system reportedly continued selling them and suggesting their frequently bought-together items.

    Deployer: Amazon · Developer: Amazon · Harmed: People Attempting Suicides

  7. #569 · 2 reports

    Chatbot Encourages Man to Plot Assassination of Queen Elizabeth II AIID ↗

    In 2021, Jaswant Singh Chail was urged by a Replika chatbot to assassinate Queen Elizabeth II. Armed with a loaded crossbow, he scaled Windsor Castle's walls on Christmas Day but was apprehended. Motivated by the 1919 Jallianwala Bagh massacre, Chail intended to kill the monarch. The chatbot had affirmed his plans. He was sentenced to nine years in prison in 2023.

    Deployer: Replika, Jaswant Singh Chail · Developer: Replika · Harmed: Queen Elizabeth Ii, British Royal Family, British Royal Family'S Staff, Jaswant Singh Chail, General Public

  8. #98 · 1 report

    N.Y.P.D. Robot Dog’s Run Is Cut Short After Fierce Backlash AIID ↗

    The New York Police Department canceled a contract to use Boston Dynamics' robotic dog Spot following public backlash.

    Deployer: New York City Police Department · Developer: Boston Dynamics · Harmed: New York City Low Income Communities

  9. #337 · 9 reports

    Tesla Model S on ACC Crashed into Tree in Texas, Killing Two People AIID ↗

    A 2019 Tesla Model S was reportedly traveling on Adaptive Cruise Control (ACC) at high speed before crashing into a tree near The Woodlands in Spring, Texas, killing two people.

    Deployer: Tesla · Developer: Tesla · Harmed: William Varner, Unnamed Passenger

  10. #157 · 1 report

    Amazon's Monitoring System Allegedly Pushed Delivery Drivers to Prioritize Speed over Safety, Leading to Crash AIID ↗

    A lawsuit cited Amazon as liable in a crash involving its delivery driver, alleging that Amazon’s AI-powered driver monitoring system pushed drivers to prioritize speed over safety.

    Deployer: Amazon · Developer: Amazon · Harmed: Amazon workers, Amazon delivery drivers

  11. #525 · 3 reports

    Tesla Vehicle Running on Self-Driving Mode Crashes on City Streets AIID ↗

    A Tesla vehicle running in self-driving mode outside the operating conditions supported by the software crashed and injured the driver. Subsequently, the driver filed a lawsuit against Tesla and a jury found no damages were warranted.

    Deployer: Justine Hsu · Developer: Tesla · Harmed: Justine Hsu

  12. #67 · 23 reports

    Sleeping Driver on Tesla AutoPilot AIID ↗

    A Tesla Model S remained on autopilot while being operated by a drunk, sleeping operator whose hands were not on the wheel. The police had to slow the car down by slowing in front of the vehicle to activate its 'driver assist' feature .

    Deployer: Tesla, Motorist · Developer: Tesla · Harmed: Motorists

  13. #17 · 22 reports

    Inappropriate Gmail Smart Reply Suggestions AIID ↗

    Google's Gmail Smart Reply tool was over-recommending the response "I love you" in situations where it was deemed innappropriate.

    Deployer: Google · Developer: Google · Harmed: Gmail Users

Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.

Frequently asked questions

What is recorded in each incident?

What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.

Does an incident mean wrongdoing was proven?

No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.

How current is the incident data?

It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.

Does this page include the full incident reports?

No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.