Crawler access
Can each crawler read your pages, or is it turned away?
- GPTBot
- OAI-SearchBot
- ChatGPT-User
- ClaudeBot
- anthropic-ai
- PerplexityBot
- Perplexity-User
- Bytespider
- Browser baseline
No check has run yet. Your grade uses returned evidence.
How your site responds to AI crawlers.
Text and metadata on pages checked.
Your robots.txt, llms.txt and sitemap.
What a model knows about you, cold.
Mentions, archives and sources elsewhere.
Can each crawler read your pages, or is it turned away?
Text and metadata on the pages the Agent reads.
The public files that help crawlers find and read your site.
What a model recalls about you without using search.
Mentions, archives and public sources around your brand.
Google-Extended is a robots.txt policy token. Model knowledge and off-site signals are qualitative observations. Missing responses and outages are unavailable evidence. The report names every scored check and its source.
Every report gets its own page you can share. Open one to see the findings and the evidence behind them.
Loading the public report and its evidence.
Loading the public report and its evidence.
Loading the public report and its evidence.
Public reports, not customer case studies. A letter appears only when the saved evidence meets the grade method’s minimum coverage.
The Agent reads your public pages, tests requests using AI crawler user agents, checks site files and asks a model what it recalls without search. Findings link to the underlying evidence. The technical grade covers only evaluable crawler access, readable content and site-file checks.
The Agent answers from our docs, methods and pricing, and links to the source.
Type your domain. Get a report with the evidence and the fixes that matter.