Claude-SearchBot
Indexes pages so Claude can surface and cite them when it searches the web to answer a question.
What Claude-SearchBot is for
Indexes content for AI search - how users find you inside an answer.
This is how your site becomes a citable source inside Claude. Blocking it removes you from Claude’s web-search citations.
Crawler guide
Evergreen identity, source, and robots.txt handling guidance.
Allow or block Claude-SearchBot
Honours robots.txt. Add one of these to your robots.txt.
User-agent: Claude-SearchBot Disallow: /
User-agent: Claude-SearchBot Allow: /
Other AI crawlers
Every bot Trakkr tracks is a doorway.
AmazonbotOther · AmazonCommon questions
What is Claude-SearchBot?
Claude-SearchBot is an AI web crawler operated by Anthropic. Indexes pages so Claude can surface and cite them when it searches the web to answer a question.
How do I block Claude-SearchBot?
Add a directive to your robots.txt: "User-agent: Claude-SearchBot" followed by "Disallow: /". Honours robots.txt.
Does blocking Claude-SearchBot hide me from AI?
Yes - Claude-SearchBot is a search crawler, so blocking it removes your site as a citable source in that assistant's answers. This is how your site becomes a citable source inside Claude. Blocking it removes you from Claude’s web-search citations.
Identity and robots.txt facts come from Anthropic's published bot documentation. This crawler carries no live telemetry of its own, so only the reference facts are shown.
Telemetry updated Feb 1, 2026.