What is Amzn-SearchBot? AI crawler guide
Amzn-SearchBot by Amazon: Amazon search crawler that indexes pages so they can be retrieved and cited in Amazon search and assistant answers. Check its reported user-agent, robots.txt behavior, source, and verification guidance.
Amazon search crawler that indexes pages so they can be retrieved and cited in Amazon search and assistant answers.
What is Amzn-SearchBot?
Amzn-SearchBot is Amazon's search crawler. It visits web pages to index them so they can be retrieved and cited in Amazon search results and assistant answers. The crawler identifies itself with the user-agent token Amzn-SearchBot and honors robots.txt directives. If you do not explicitly name Amzn-SearchBot in your robots.txt, Amazon applies the rules you set for other search crawlers. Amazon states that this crawler is not used for training purposes.
What it's for
For site owners, Amzn-SearchBot determines whether your pages appear in Amazon search and assistant answers. Allowing it can increase your visibility on Amazon's platforms, while blocking it may remove your content from those surfaces.
How to handle Amzn-SearchBot
To prevent Amzn-SearchBot from crawling your site, add a disallow rule for the user-agent token Amzn-SearchBot in your robots.txt file. If you do not specify rules for this bot, Amazon will apply the directives you have set for other search crawlers.
robots.txt rule
User-agent: Amzn-SearchBot Disallow: /
Blocking cost
Blocking Amzn-SearchBot can remove your pages from Amazon search and assistant answers, potentially reducing your visibility on Amazon's platforms.
Examples
- Amzn-SearchBot crawls a product page and the page later appears in Amazon search results.
- Amzn-SearchBot indexes an article, and Amazon's assistant cites it in an answer.
- A site owner blocks Amzn-SearchBot in robots.txt, and the site's pages stop appearing in Amazon search.
Related bots
- Kimi-SearchBot: Also tracked as a search crawler.
- OAI-SearchBot: Also tracked as a search crawler.
- MistralAI-Index: Also tracked as a search crawler.
- PerplexityBot: Also tracked as a search crawler.
- Kagibot: Also tracked as a search crawler.
- xAI-SearchBot: Also tracked as a search crawler.
- Claude-SearchBot: Also tracked as a search crawler.
- Applebot: Also tracked as a search crawler.
- YouBot: Also tracked as a search crawler.
- Robots.txt: Robots.txt is the control file used to allow or block Amzn-SearchBot.
- AI Crawlers: Amzn-SearchBot is a concrete crawler example for this concept.
- Timpibot: Also tracked as a search crawler.
Frequently Asked Questions
What does Amzn-SearchBot do?
Amzn-SearchBot crawls and indexes web pages so they can be retrieved and cited in Amazon search and assistant answers.
Does Amzn-SearchBot use my content for training?
Amazon states that Amzn-SearchBot is not used for training purposes.
What happens if I do not mention Amzn-SearchBot in robots.txt?
If Amzn-SearchBot is not named in your robots.txt, Amazon applies the rules you set for other search crawlers.
How can I block Amzn-SearchBot?
You can block Amzn-SearchBot by adding a disallow rule for the user-agent token Amzn-SearchBot in your robots.txt file.
Will blocking Amzn-SearchBot affect my visibility on Amazon?
Yes, blocking Amzn-SearchBot can remove your pages from Amazon search and assistant answers.
Data & Sources
- Amazon documentation - Primary source for Amzn-SearchBot crawler details.
- Amzn-SearchBot verification: Published IP ranges - Verification information published for Amzn-SearchBot.