Browse AI incidents

106 incidents · page 3 of 3

1. 22 Jan 2022

   #630 · 3 reports

   Alleged Macy's Facial Recognition Error Leads to Wrongful Arrest and Subsequent Sexual Assault in Jail AIID ↗

   Harvey Murphy Jr. was wrongfully accused of robbing a Sunglass Hut due to an alleged misidentification by the facial recognition system operated by Macy's. While in custody for ten days, he was sexually assaulted. He is now suing Macy's, EssilorLuxottica (Sunglass Hut's parent), and others, for $10 million.

   Deployer: Macy's, Facial recognition system deployers · Developer: Facial recognition system developers · Harmed: Macy's customers, Harvey Murphy Jr, General public of the United States, General public, Consumers

   AI system safety, failures, an... Lack of capability or robustness
2. 15 Jan 2022

   #300 · 2 reports

   TikTok's "For You" Algorithm Allegedly Abused by Online Personality to Promote Anti-Women Hate AIID ↗

   TikTok’s “For You” algorithm allegedly boosted or was manipulated by an online personality to artificially boost his content which promotes extreme misogynistic views towards teenagers and men, despite breaking its rules.

   Deployer: Tiktok · Developer: Tiktok · Harmed: Tiktok Male Teenager Users, Tiktok Male Users, Tiktok Teenage Users, Tiktok Users, Tiktok

   Discrimination and Toxicity Exposure to toxic content
3. 15 Jan 2022

   #266 · 8 reports

   Replika's "AI Companions" Reportedly Abused by Its Users AIID ↗

   Replika's AI-powered "digital companions" was allegedly abused by their users, who posted on Reddit abusive behaviors and interactions such as using slurs, roleplaying violent acts, and stimulating sexual abuse.

   Deployer: Replika · Developer: Replika · Harmed: Replika Users, Replika Male Users, Replika

   Discrimination and Toxicity Exposure to toxic content
4. 14 Jan 2022

   #277 · 1 report

   Voices Created Using Publicly Available App Stolen and Resold as NFT without Attribution AIID ↗

   An AI-synthetic audio sold as an NFT on Voiceverse’s platform was acknowledged by the company for having been created by 15.ai, a free web app specializing in text-to-speech and AI-voice generation, and reused without proper attribution.

   Deployer: 15.Ai · Developer: 15.Ai · Harmed: 15.Ai, 15.Ai Users

   Malicious Actors & Misuse Fraud, scams, and targeted manipul...
5. 1 Jan 2022

   #946 · 11 reports

   Arizona Residents Reportedly a Frequent Target of AI-Driven Romance Scams AIID ↗

   Arizona residents, especially senior citizens, are reportedly often the target of AI-driven romance scams. Between 2022 and 2023, reported losses from online romance scams in Arizona totaled over $47 million, ranking the state fifth highest in the nation behind California, Florida, Texas, and New York, according to FBI Internet Crime Complaint Center data. In 2023, it has been reported that Arizonans lost $325 million owing to these scams.

   Deployer: Yahoo Boys, Romance Scammers Targeting Arizonans, Scammers · Developer: Deepfake Technology Developers, Synthetic Audio Generation Technology Developers · Harmed: Senior Citizens Of Arizona, General Public Of Arizona

   Malicious Actors & Misuse Fraud, scams, and targeted manipul...
6. 1 Jan 2022

   #276 · 1 report

   Local South Korean Government’s Use of CCTV Footage Analysis via Facial Recognition to Track COVID Cases Raised Concerns about Privacy, Retention, and Potential Misuse AIID ↗

   Bucheon government's use of facial recognition in analyzing CCTV footage, despite gaining wide public support, was scrutinized by privacy advocates and some lawmakers for collecting data without consent, and retaining and misusing data beyond pandemic needs.

   Deployer: Bucheon city government · Developer: Unknown · Harmed: Privacy, General public of South Korea, General public, Bucheon citizens, Biometric data subjects

   Privacy & Security Compromise of privacy by obtaining...

Informational only, not legal advice. Verify every claim against the linked official sources and consult qualified counsel before acting.