Skip to content

General prompts are less stable than comparisons

General prompts average 42.2 percent agreement across models in the divergence study, indicating lower stability than comparative queries.

The study Same Question, Different AI, Different Answers evaluated the stability of general prompts compared to comparative prompts across multiple artificial intelligence models.

The numbers behind it.

General-query agreement
General prompts are less stable across models.
42.2%
MeasureResult
General-query agreement

General prompts are less stable across models.

42.2%

What this study measured.

An observational snapshot.
Tested 11 March 2026.

Read the full methodology

Population and method

Built from 797,644 valid comparisons across 44,088 reports and 8 models, covering 6,439,133 model responses in the observed window.

Where the evidence stops

Agreement is measured across recommendation outputs, not across hidden reasoning or retrieval context.

Average agreement can hide large differences between query classes and model pairs.

The study measures overlap, not which answer was objectively “right”.

What to do with this

Strategists and operators must recognize that generic market pages require wider coverage and stronger corroboration to maintain consistent visibility and accuracy across different AI models.

“General prompts average 42.2% agreement in the model divergence study.”

Same Question, Different AI, Different Answers - Trakkr Research · General prompts are less stable than comparisons
Same Question, Different AI, Different Answers · Trakkr Research · Updated 11 March 2026

https://trakkr.ai/trakkr-research/model-divergence/facts/general-prompts-are-less-stable-than-comparisons
Page JSON ↗Includes the finding, limits, attribution and canonical URL.