Site & crawler setup
How to connect a site, verify crawler access, and diagnose differences between Trakkr checks and server logs.
Site & crawler setup questions
- Why does Trakkr say my site is blocking AI crawlers when I can see GPTBot traffic getting through in my own logs?
- Connecting my Vercel-hosted site to crawler tracking keeps failing. What's going on?
- Can I install crawler tracking on a site that isn't Cloudflare, Vercel, Netlify, or WordPress (like Wix, Framer, or a custom PHP site)?
- Crawler tracking shows visits from some AI bots (like Meta or Mistral) but not others (like ChatGPT or Perplexity), even though I know those engines have visited. Is tracking broken?
- I got a robots.txt or crawler-blocking alert from Trakkr that I think is wrong. How do I check it myself?
- Cloudflare says it denied analytics access when I try to connect my site to Trakkr. What permissions does the token need?
- I'm getting "We could not reach the WordPress crawler plugin endpoints" when connecting WordPress. How do I fix it?
- AI Pages says "Waiting for First Request" and the scan just keeps spinning. Is that normal?
- My tracked crawler count dropped off a cliff overnight. Is this a Trakkr bug?
- Which AI bot user agents should I allow in my firewall or WAF so Trakkr can track them?