AI crawler traffic share by bot | Trakkr Research
Observed crawler traffic share across major AI bot families.
Methodology: Built from 575,788 AI crawler visits across 84 brands and 314,501 unique URLs observed between June 11, 2025 and February 1, 2026.
Summary
GPTBot dominates the crawler landscape, but the behavior of smaller bots still matters because they enter and read sites differently.
Benchmark rows
| Metric | Value | Context |
|---|---|---|
| GPTBot share | 57.2% | GPTBot is the dominant crawler by observed visits. |
| OAI-SearchBot share | 15.1% | SearchBot is the second-largest crawler in the study. |
| ClaudeBot share | 3.8% | ClaudeBot is smaller in raw volume but more diverse in behavior. |
Ranked view
| Item | Value | Detail |
|---|---|---|
| GPTBot | 57.2% | The largest crawler family in the study by visit share. |
| OAI-SearchBot | 15.1% | The second-largest crawler family and a distinct search-oriented pattern. |
| Bytespider | 9.2% | A meaningful third crawler with a very different profile. |
| Meta-ExternalFetcher | 7.9% | Still material in raw traffic, but behavior is narrower. |
| ClaudeBot | 3.8% | Smaller by volume, more diverse in where it lands. |
Related pages
Continue through the same study cluster.
- which ai crawler shows up most often - Related answer page
- do ai crawlers start on the homepage - Related answer page
- gptbot controls more than half of observed ai crawler traffic - Related fact page
Data & Sources
- When AI Comes to Your Website - Flagship study behind this page
- Page JSON - Machine-readable companion file