Which query types produce the most consensus? | Trakkr Research
Comparison queries produce the most consensus in the study, averaging 50.4% agreement. More open-ended general and best-of prompts are less stable.
Methodology: Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.
Direct Answer
Mostly comparison queries. Comparison queries produce the most consensus in the study, averaging 50.4% agreement. More open-ended general prompts average 42.2% agreement, while best-of prompts frequently split models with a high divergence of 14.8%.
What this means
Understanding query consensus allows teams to allocate resources effectively, prioritizing content optimization for high-divergence queries where market share is fluid, rather than competing in locked-in consensus categories.
Evidence table
| Metric | Value | Why it matters |
|---|---|---|
| Comparison-query agreement | 50.4% | Comparison prompts produce the highest average agreement. |
| General-query agreement | 42.2% | General prompts are less stable across models. |
| Best-of high divergence | 14.8% | Best-of prompts frequently split models. |
Frequently Asked Questions
What is the average agreement rate for comparison queries?
Comparison prompts produce the highest average agreement at 50.4%.
How do general queries perform compared to comparison queries?
General prompts are less stable across models, showing a 42.2% agreement rate.
Which query type causes the most split between models?
Best-of prompts frequently split models, showing a high divergence of 14.8%.
What to do next
Related pages
Continue through the same study cluster.
- are general and best of prompts more volatile than comparisons - Related answer page
- what does an average top three overlap of two point eight mean - Related answer page
- high divergence prompts make up fourteen point six percent of the study - Related fact page
- cross model consensus tracker - Related tracker page
Data & Sources
- Same Question, Different AI, Different Answers - Flagship study behind this page
- Page JSON - Machine-readable companion file