The study tracks more than 300,000 unique URLs | Trakkr Research
The dataset is wide enough to capture real site-architecture differences.
Methodology: Built from 575,788 AI crawler visits across 84 brands and 314,501 unique URLs observed between June 11, 2025 and February 1, 2026.
Claim
The crawler behavior study covers 314,501 unique URLs.
Why it matters
These patterns are not being inferred from a tiny slice of crawler behavior.
Supporting metrics
| Metric | Value | Context |
|---|---|---|
| Unique URLs | 314,501 | Distinct pages visited by AI crawlers. |
| Brands analyzed | 84 | Study-wide brand count after exclusions. |
Related pages
Continue through the same study cluster.
- should you optimize for gptbot and oai searchbot separately - Related answer page
- what does the crawler data say about site architecture - Related answer page
- crawler depth and entry tracker - Related tracker page
Data & Sources
- When AI Comes to Your Website - Flagship study behind this page
- Page JSON - Machine-readable companion file