Skip to content

Only 4.0% of prompts produce perfect consensus

Only 4.0 percent of identical prompts produced perfect agreement across all eight analyzed artificial intelligence models.

An analysis of eight major artificial intelligence models including OpenAI, Anthropic, Gemini, Grok, Deepseek, Meta, Perplexity, and Google AI Overviews reveals significant variance in output generation. When presented with identical prompts, the models generated unanimous responses in only a marginal fraction of cases.

The numbers behind it.

Perfect agreement
Only a small share of prompts produce unanimous outcomes.
4.0%
Models analyzed
OpenAI, Anthropic, Gemini, Grok, Deepseek, Meta, Perplexity, and Google AI Overviews.
8
MeasureResult
Perfect agreement

Only a small share of prompts produce unanimous outcomes.

4.0%
Models analyzed

OpenAI, Anthropic, Gemini, Grok, Deepseek, Meta, Perplexity, and Google AI Overviews.

8

What this study measured.

An observational snapshot.
Tested 11 March 2026.

Read the full methodology

Population and method

Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.

Where the evidence stops

Agreement is measured across recommendation outputs, not across hidden reasoning or retrieval context.

Average agreement can hide large differences between query classes and model pairs.

The study measures overlap, not which answer was objectively “right”.

What to do with this

Strategists and operators must diversify their artificial intelligence testing environments. Relying on a single model to validate search visibility or output accuracy is insufficient, as a single model win does not indicate broad market leadership or consistent cross platform performance.

“Only 4.0% of prompts produced perfect agreement across all 8 models.”

Same Question, Different AI, Different Answers - Trakkr Research · Only 4.0% of prompts produce perfect consensus
Same Question, Different AI, Different Answers · Trakkr Research · Updated 11 March 2026

https://trakkr.ai/trakkr-research/model-divergence/facts/only-four-percent-of-prompts-produce-perfect-consensus
Page JSON ↗Includes the finding, limits, attribution and canonical URL.