Crawler depth and homepage entry benchmark | Trakkr Research

Research tracker page for the study When AI Comes to Your Website, detailing the crawler depth and homepage entry benchmark.

Methodology: Built from 575,788 AI crawler visits across 84 brands and 314,501 unique URLs observed between June 11, 2025 and February 1, 2026.

Summary

The benchmark data demonstrates a clear pattern of shallow crawling behavior across AI bots, where the vast majority of interactions are single-page visits rather than deep site explorations. Additionally, the point of entry varies significantly by bot family, suggesting distinct data gathering strategies between different AI models.

Benchmark rows

Metric Value Context
One-visit sessions 88.5% Most AI crawler visits are one-and-done sessions.
10+ visit sessions 0.3% Deep repeat sessions are extremely rare.
GPTBot homepage rate 2.75% GPTBot rarely starts on the homepage.
ClaudeBot homepage rate 19.18% ClaudeBot is much more likely to touch the homepage.

Ranked view

Item Value Detail
One-visit sessions 88.5% Single-shot crawling dominates the study.
ClaudeBot homepage rate 19.18% ClaudeBot is much more likely to use the homepage.
GPTBot homepage rate 2.75% GPTBot almost never uses the homepage as a launchpad.
10+ visit sessions 0.3% Deep sessions are vanishingly rare.

Related pages

Continue through the same study cluster.

Data & Sources