How aggressive are AI query rewrites? | Trakkr Research

They are aggressive. Average similarity between prompt and search query is only 25.24%, and 31.85% of pairs count as complete rewrites.

Methodology: Built from 11,521 captured prompt-to-query pairs observed in OpenAI web search calls, with 100% search-query coverage in the sampled dataset.

Direct Answer

Mostly, they are aggressive. Average Jaccard similarity between prompt and search query is only 25.24%, and 31.85% of the 11,521 captured pairs count as complete rewrites.

What this means

Relying on raw user prompts for keyword research is insufficient. Teams must measure and optimize for the post-rewrite queries that models actually use to fetch context.

Evidence table

Metric Value Why it matters
Average similarity 25.24% Average Jaccard similarity between prompt and search query.
Complete rewrites 31.85% 3,670 pairs fell into the complete rewrite bucket.
Prompt-query pairs 11,521 Captured prompt-to-query transformations.

Frequently Asked Questions

How many prompt-query pairs were analyzed?

The study captured 11,521 prompt-to-query transformations.

What is the average similarity between a prompt and a query?

The average Jaccard similarity between the prompt and the search query is 25.24%.

How often do complete rewrites occur?

Out of the analyzed pairs, 3,670 pairs, or 31.85%, fell into the complete rewrite bucket.

What to do next

Related pages

Continue through the same study cluster.

Data & Sources