Not sure where to start? Take a guided tour.
AI Site Grader
AI Query Scanner
llms.txt GeneratorDo AI crawlers read sites deeply?
Rarely. The study is dominated by shallow sessions, with 88.5% ending after one visit and only 0.3% reaching 10 or more requests.
The key numbers.
- One-visit sessions
- Most AI crawler visits are one-and-done sessions.
- 88.5%
- 10+ visit sessions
- Deep repeat sessions are extremely rare.
- 0.3%
- Unique URLs
- Distinct pages visited by AI crawlers.
- 314,501
Shallow crawler behavior raises the value of answer density, prominent internal links, and pages that resolve questions quickly without requiring deep site navigation.
The evidence.
| Measure | Result |
|---|---|
| One-visit sessions Most AI crawler visits are one-and-done sessions. | 88.5% |
| 10+ visit sessions Deep repeat sessions are extremely rare. | 0.3% |
| Unique URLs Distinct pages visited by AI crawlers. | 314,501 |
Population and method
Built from 575,788 AI crawler visits across 84 brands and 314,501 unique URLs observed between June 11, 2025 and February 1, 2026.
Where the evidence stops
This study measures observable crawler traffic rather than hidden fetches or internal cache reads.
One dominant e-commerce brand was excluded to keep the page-type patterns more generalizable.
Visit share and homepage preference vary sharply by bot family, so averages can hide crawler-specific behavior.
What to do with this
- Optimize entry pages and internal links for the crawlers that actually show up in your logs.
- Treat crawler families differently because they do not read the same site architecture the same way.
- Use low-depth answer pages to improve the odds that a one-visit crawler still finds something citeable.
Operators must adjust content architecture for single-hit indexing, prioritizing immediate information retrieval over multi-page journeys to ensure AI models capture core data.
Questions about this answer.
Cite this answer.
Source study: Crawler Behavior“Rarely. The study is dominated by shallow sessions, with 88.5% ending after one visit and only 0.3% reaching 10 or more requests.”
Mack Grenfell · Do AI crawlers read sites deeply?
When AI Comes to Your Website · Trakkr Research · Updated 1 February 2026