What is YandexAdditional? AI crawler guide
YandexAdditional by Yandex: Yandex crawler token for data used in YandexGPT quick answers and additional analysis. Check its reported user-agent, robots.txt behavior, source, and verification guidance.
Yandex crawler token for data used in YandexGPT quick answers and additional analysis.
What is YandexAdditional?
YandexAdditional is a crawler operated by Yandex that collects web content to support YandexGPT quick answers and additional analysis. It is identified by the user-agent token YandexAdditional and honors robots.txt directives. The crawler is part of Yandex's search infrastructure, focusing on gathering data that can be used to generate concise, AI-driven responses in search results. Its activity is separate from the main YandexBot, and it follows standard exclusion rules, allowing site owners to control its access through their robots.txt file.
What it's for
For site owners, YandexAdditional can influence whether their content appears in YandexGPT-powered quick answers. Allowing the crawler may increase the chance that your pages are used to generate these AI-driven responses, potentially driving traffic from Yandex search. Blocking it can reduce the likelihood of your content being featured in such answer features, which may affect visibility in Yandex's search ecosystem.
Whether to allow YandexAdditional is a policy call. Either way, check which AI platforms actually send you human visitors before assuming crawl volume equals value.
How to handle YandexAdditional
To prevent YandexAdditional from accessing your site, add a disallow rule for the user-agent token YandexAdditional in your robots.txt file. Since the crawler honors robots.txt, this will stop it from crawling your pages. If you want to allow it, simply omit any disallow directive for this token. The page will render the appropriate robots.txt snippet separately.
robots.txt rule
User-agent: YandexAdditional Disallow: /
Blocking cost
Blocking YandexAdditional may reduce the chance that your content is used in YandexGPT quick answers, potentially lowering visibility in Yandex search results.
Examples
- YandexAdditional crawls a news article, and its content may later appear in a YandexGPT quick answer box when a user searches for related information.
- A recipe website allows YandexAdditional, and its structured data could be used to generate an AI-driven summary in Yandex search results.
- An e-commerce product page is crawled by YandexAdditional, and its details might be included in a YandexGPT-generated comparison snippet.
Related bots
- YandexAdditionalBot: Another Yandex search crawler to compare.
- xAI-SearchBot: Also tracked as a search crawler.
- Bravebot: Also tracked as a search crawler.
- PetalBot: Also tracked as a search crawler.
- iaskspider/2.0: Also tracked as a search crawler.
- Amzn-SearchBot: Also tracked as a search crawler.
- Googlebot: Also tracked as a search crawler.
- MistralAI-Index: Also tracked as a search crawler.
- Bingbot: Also tracked as a search crawler.
- Robots.txt: Robots.txt is the control file used to allow or block YandexAdditional.
- AI Crawlers: YandexAdditional is a concrete crawler example for this concept.
Frequently Asked Questions
What does YandexAdditional do?
YandexAdditional is a Yandex crawler that collects web content to support YandexGPT quick answers and additional analysis.
Does YandexAdditional obey robots.txt?
Yes, YandexAdditional honors robots.txt directives, so you can control its access to your site.
How can I block YandexAdditional?
You can block YandexAdditional by adding a disallow rule for the user-agent token YandexAdditional in your robots.txt file.
What happens if I block YandexAdditional?
Blocking YandexAdditional may reduce the chance that your content is used in YandexGPT quick answers, potentially affecting your visibility in Yandex search.
Data & Sources
- Yandex documentation - Primary source for YandexAdditional crawler details.