Not sure where to start? Take a guided tour.
AI Site Grader
AI Query Scanner
llms.txt GeneratorWhich query types produce the most consensus?
Mostly comparison queries. Comparison queries produce the most consensus in the study, averaging 50.4% agreement. More open-ended general prompts average 42.2% agreement, while best-of prompts frequently split models with a high divergence of 14.8%.
The key numbers.
- Comparison-query agreement
- Comparison prompts produce the highest average agreement.
- 50.4%
- General-query agreement
- General prompts are less stable across models.
- 42.2%
- Best-of high divergence
- Best-of prompts frequently split models.
- 14.8%
The tighter the question, the more likely models are to converge on overlapping answer sets, meaning operators should expect higher volatility in broad or subjective search categories.
The evidence.
| Measure | Result |
|---|---|
| Comparison-query agreement Comparison prompts produce the highest average agreement. | 50.4% |
| General-query agreement General prompts are less stable across models. | 42.2% |
| Best-of high divergence Best-of prompts frequently split models. | 14.8% |
Population and method
Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.
Where the evidence stops
Agreement is measured across recommendation outputs, not across hidden reasoning or retrieval context.
Average agreement can hide large differences between query classes and model pairs.
The study measures overlap, not which answer was objectively “right”.
What to do with this
- Track visibility across multiple models instead of using one platform as a proxy for the whole market.
- Prioritize query classes where disagreement is highest because that is where share can move fastest.
- Treat consensus as a benchmark, but treat divergence as the operating reality.
Understanding query consensus allows teams to allocate resources effectively, prioritizing content optimization for high-divergence queries where market share is fluid, rather than competing in locked-in consensus categories.
Questions about this answer.
Cite this answer.
Source study: Model Divergence“Mostly comparison queries. Comparison queries produce the most consensus in the study, averaging 50.4% agreement. More open-ended general prompts average 42.2% agreement, while best-of prompts frequently split models with a high divergence of 14.8%.”
Mack Grenfell · Which query types produce the most consensus?
Same Question, Different AI, Different Answers · Trakkr Research · Updated 11 March 2026