Artificial Intelligence Policy Tracker

AI Incident Database

Browse AI incidents

Every incident record (metadata only) from the weekly snapshot of 2026-09-07. Filter, then export the selection with its licence attached; each row links to the full record and its reports.

Filter incidents (1 active)

Two-letter code, e.g. US

Reset

91 incidents · subdomain: Exposure to toxic content · page 4 of 4

  1. #279 · 3 reports

    TikTok’s “For You” Algorithm Exposed Young Users to Pro-Eating Disorder Content AIID ↗

    TikTok’s young users were allegedly exposed to community-guideline-violating pro-eating disorder content on their algorithmically curated “For You” page that serves videos from any user on its platform.

    Deployer: Tiktok · Developer: Tiktok · Harmed: Tiktok Young Users, Tiktok Users

  2. #471 · 8 reports

    Facebook Allegedly Failed to Police Hate Speech Content That Contributed to Ethnic Violence in Ethiopia AIID ↗

    Facebook allegedly did not adequately remove hate speech, some of which was extremely violent and dehumanizing, on its platform including through automated means, contributing to the violence faced by ethnic communities in Ethiopia.

    Deployer: Meta, Facebook · Developer: Meta, Facebook · Harmed: Tigrinya Speaking Facebook Users, Facebook Users In Ethiopia, Ethiopian Public, Afaan Oromo Speaking Facebook Users

  3. #89 · 1 report

    The Christchurch shooter and YouTube’s radicalization trap AIID ↗

    A New Zealand government report released following a right-wing terrorist killing 51 worshippers at two New Zealand mosques which indicated that Youtube's recommendation algorithm played an important role in the terrorist's radicalization.

    Deployer: Youtube · Developer: Youtube · Harmed: Youtube Users

  4. #281 · 3 reports

    YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm AIID ↗

    Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube’s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.

    Deployer: Youtube · Developer: Youtube · Harmed: Youtube Young Users, Youtube Users

  5. #164 · 1 report

    Facebook "News Feed" Allegedly Boosted Misinformation and Violating Content Following Use of MSI Metric AIID ↗

    After the “News Feed” algorithm had been overhauled to boost engagement between friends and family in early 2018, its heavy weighting of re-shared content was alleged found by company researchers to have pushed content creators to reorient their posts towards outrage and sensationalism, causing a proliferation of misinformation, toxicity, and violent content.

    Deployer: Facebook · Developer: Facebook · Harmed: Facebook Users, Facebook Content Creators

  6. #169 · 5 reports

    Facebook Allegedly Failed to Police Anti-Rohingya Hate Speech Content That Contributed to Violence in Myanmar AIID ↗

    Facebook allegedly did not adequately remove anti-Rohingya hate speech, some of which was extremely violent and dehumanizing, on its platform, contributing to the violence faced by Rohingya communities in Myanmar.

    Deployer: Facebook, Meta · Developer: Facebook, Meta · Harmed: Rohingya People, Rohingya Facebook Users, Myanmar Public, Facebook Users In Myanmar, Burmese Speaking Facebook Users

  7. #229 · 2 reports

    Content Using Bestiality Thumbnails Allegedly Evaded YouTube’s Thumbnail Monitoring System AIID ↗

    YouTube’s thumbnail monitoring system was allegedly evaded by content farms such as ones in Cambodia who spike viewership and generate ad revenue using bestiality-themed thumbnails.

    Deployer: Youtube · Developer: Youtube · Harmed: Youtube Users, Youtube Content Creators

  8. #382 · 1 report

    Instagram's Exposure of Harmful Content Allegedly Contributed to Teenage Girl's Suicide AIID ↗

    Instagram was ruled by a judge to have contributed to the death of a teenage girl in the UK allegedly through its exposure and recommendation of suicide, self-harm, and depressive content.

    Deployer: Meta · Developer: Meta · Harmed: Women and girls, Molly Rose Russell, Girls, Family of Molly Rose Russell, Adolescent girls

  9. #58 · 5 reports

    Russian Chatbot Supports Stalin and Violence AIID ↗

    Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses

    Deployer: Yandex · Developer: Yandex · Harmed: Yandex Users

  10. #216 · 5 reports

    WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner” AIID ↗

    The Chinese platform WeChat provided an inappropriate and racist English translation for the Chinese term for “black foreigner” in its messaging app.

    Deployer: Wechat · Developer: Wechat · Harmed: Black Wechat Users

  11. #325 · 2 reports

    Offensive Instagram User Content Displayed as Facebook Ad AIID ↗

    An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.

    Deployer: Facebook · Developer: Facebook · Harmed: Olivia Solon, Olivia Solon'S Facebook Connections

  12. #56 · 7 reports

    AI-Designed Phone Cases Are Unexpected AIID ↗

    A third-party Amazon merchant named “my_handy_design” was suspected of using a bot to generate cell phone case designs based on the bizarre and unattractive designs being offered.

    Deployer: My_Handy_Design · Developer: My_Handy_Design · Harmed: My_Handy_Design

  13. #55 · 16 reports

    AI incident: sexual content (Amazon, Dec 2016) AIID ↗

    An AI Incident Database record involving sexual content, dated 30 December 2016. Risk classification, related incidents and the laws on record for this risk area.

    Deployer: Amazon · Developer: Amazon · Harmed: Minors

  14. #6 · 28 reports

    Microsoft's TayBot Allegedly Posts Racist, Sexist, and Anti-Semitic Content to Twitter AIID ↗

    Microsoft's Tay, an artificially intelligent chatbot, was released on March 23, 2016 and removed within 24 hours due to multiple racist, sexist, and anti-semitic tweets generated by the bot.

    Deployer: Microsoft · Developer: Microsoft · Harmed: X (Twitter) Users

  15. #1 · 14 reports

    Google’s YouTube Kids App Presents Inappropriate Content AIID ↗

    YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.

    Deployer: Youtube · Developer: Youtube · Harmed: Minors

  16. #380 · 5 reports

    Facebook's Auto-Generated Targeting Ad Categories Contained Anti-Semitic Options AIID ↗

    Facebook's automated advertising categories generated using users' declared interests contained anti-Semitic categories such as "Jew hater" and "How to burn Jews" which were listed as fields of study.

    Deployer: Facebook · Developer: Facebook · Harmed: Jewish People

Disclaimer: informational only, not legal advice. Verify every claim against the linked official sources and consult a qualified lawyer before acting.

Frequently asked questions

What is recorded in each incident?

What happened, when, who was involved as developer or deployer, who was harmed, the sectors and countries affected, and the domain and subdomain the harm falls under. Incidents are mirrored from the AI Incident Database and each links back to its source record.

Does an incident mean wrongdoing was proven?

No. These are reported incidents, not findings of liability. Entities named in a report are named as reported, allegations are marked as alleged, and nothing here is a legal determination.

How current is the incident data?

It syncs directly from the AI Incident Database several times a day, so a new incident usually appears within hours. Each record carries the date it was last synced, and the snapshot date is shown on the page.

Does this page include the full incident reports?

No. The report texts are outside the licence this data is shared under, so only the metadata and the classifications appear here. Every row links to the original incident record, which carries the reports themselves.