Skip to content

Why are comparison queries the most stable query class?

Mostly, because they constrain the answer space more than open-ended best-of or general prompts. Comparison queries reached 50.4% average agreement, the highest of the tracked query families.

The key numbers.

Comparison-query agreement
Comparison prompts produce the highest average agreement.
50.4%
General-query agreement
General prompts are less stable across models.
42.2%

Narrower prompts reduce the number of plausible answer sets and force models closer together, meaning operators can expect more consistent visibility for comparison-based content.

MeasureResult
Comparison-query agreement

Comparison prompts produce the highest average agreement.

50.4%
General-query agreement

General prompts are less stable across models.

42.2%

What this study measured.

An observational snapshot.
Tested 11 March 2026.

Read the full methodology

Population and method

Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.

Where the evidence stops

Agreement is measured across recommendation outputs, not across hidden reasoning or retrieval context.

Average agreement can hide large differences between query classes and model pairs.

The study measures overlap, not which answer was objectively “right”.

What to do with this

  • Track visibility across multiple models instead of using one platform as a proxy for the whole market.
  • Prioritize query classes where disagreement is highest because that is where share can move fastest.
  • Treat consensus as a benchmark, but treat divergence as the operating reality.

Understanding query stability allows teams to allocate resources effectively, prioritizing content formats that either lock in consensus or exploit high-variance opportunities in the market.

Questions about this answer.

“Mostly, because they constrain the answer space more than open-ended best-of or general prompts. Comparison queries reached 50.4% average agreement, the highest of the tracked query families.”

Mack Grenfell · Why are comparison queries the most stable query class?
Same Question, Different AI, Different Answers · Trakkr Research · Updated 11 March 2026

https://trakkr.ai/trakkr-research/model-divergence/answers/why-are-comparison-queries-the-most-stable-query-class
Page JSON ↗Includes the finding, limits, attribution and canonical URL.