ClaudeBot
Anthropic's web crawler. It gathers public pages that may be used to train the Claude family of models.
What ClaudeBot is for
Collects pages to train future models. No direct traffic back to you.
Blocking ClaudeBot keeps your content out of Claude training data. It does not stop Claude from citing you when it searches the web live.
Crawler guide
Evergreen identity, source, and robots.txt handling guidance.
How ClaudeBot reads a site
Its real crawl signature, from the pages Trakkr observes it fetch.
When ClaudeBot crawls
Activity over a day in UTC - it peaks around 23:00 and is quietest near 13:00.
Allow or block ClaudeBot
Honours robots.txt. Add one of these to your robots.txt.
User-agent: ClaudeBot Disallow: /
User-agent: ClaudeBot Allow: /
Other AI crawlers
Every bot Trakkr tracks is a doorway.
AmazonbotOther · AmazonCommon questions
What is ClaudeBot?
ClaudeBot is an AI web crawler operated by Anthropic. Anthropic's web crawler. It gathers public pages that may be used to train the Claude family of models.
How do I block ClaudeBot?
Add a directive to your robots.txt: "User-agent: ClaudeBot" followed by "Disallow: /". Honours robots.txt.
Does blocking ClaudeBot hide me from AI?
Blocking ClaudeBot keeps your content out of training data but does not remove you from AI search answers - those are served by the search crawlers. Blocking ClaudeBot keeps your content out of Claude training data. It does not stop Claude from citing you when it searches the web live.
Identity and robots.txt facts come from Anthropic's published bot documentation. Behaviour is measured from identified ClaudeBot requests in the server logs of the brands Trakkr tracks - 576K crawler visits across 84 sites, recounted as new data arrives.
Telemetry updated Feb 1, 2026.