AI incident #1493 · 17 March 2026

Gemini and Grok Reportedly Misidentified Authentic Minab School-Strike Graveyard Photo as Unrelated Disaster Imagery

Open on the AI Incident Database 1 news report Snapshot 7 Sep 2026

What happened

Gemini and Grok reportedly gave false provenance claims about an authentic photo of graves prepared for victims of the Minab school strike, identifying it as disaster imagery from Turkey or Indonesia. Researchers verified the photo's location through satellite imagery and related visual evidence.

Only the incident metadata is stored here. The underlying news reports are on the AI Incident Database (CC BY-SA 4.0); use the links above to read them.

News reports (1)

Coverage catalogued by the AI Incident Database. Titles link to the original publisher; the text is not reproduced here.

17 Mar 2026
A photo of Iran’s bombed schoolgirl graveyard went viral. Why did AI say it wasn’t real?
theguardian.com · Tess McClure · AIID #7303

Who was involved

Alleged deployer: Google, Xai
Alleged developer: Google, Xai
Alleged harmed party: Epistemic Integrity, Shajareh Tayyebeh Primary School, Shajareh Tayyebeh Primary School Community, Iranian Schoolchildren, Educational Communities, Minab School Strike Victims And Families, Minab Hermud Cemetery, Human Rights Investigators, Fact Checkers, Open Source Investigators

Classification (MIT AI Risk Repository taxonomy)

Risk domain: Misinformation
Risk subdomain: 3.1 False or misleading information
Causal entity: AI
Intent: Unintentional
Timing: Post-deployment
Harm level: —
Sectors: —
Countries: —

Risk entries describing this failure mode

Entries from the MIT AI Risk Repository coded to subdomain 3.1.

Pursuing Consistent Context
"LLMs have been demonstrated to pursue consistent context [129]–[132], which may lead to erroneous generation when the prefixes contain false information. Typical examples include sycophancy [129], [130], false demonstra...
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Knowledge Gaps
"Since the training corpora of LLMs can not contain all possible world knowledge [114]–[119], and it is challenging for LLMs to grasp the long-tail knowledge within their training data [120], [121], LLMs inherently posse...
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Hallucinations
"LLMs generate nonsensical, untruthful, and factual incorrect content"
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Faithfulness Errors
"The LLM-generated content could contain inaccurate information" which is is not true to the source material or input used
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Defective Decoding Process
In general, LLMs employ the Transformer architecture [32] and generate content in an autoregressive manner, where the prediction of the next token is conditioned on the previously generated token sequence. Such a scheme...
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Untruthful Content
"The LLM-generated content could contain inaccurate information"
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Factuality Errors
"The LLM-generated content could contain inaccurate information" which is factually incorrect
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)
Noisy Training Data
"Another important source of hallucinations is the noise in training data, which introduces errors in the knowledge stored in model parameters [111]–[113]. Generally, the training data inherently harbors misinformation....
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems (Cui2024)

Incidents in the same risk subdomain

All incidents in this subdomain