What is Gemini-Deep-Research? AI crawler guide

Gemini-Deep-Research by Google: Gemini Deep Research agent token reported for collecting and scanning resources used in research answers. Check its reported user-agent, robots.txt behavior, source, and verification guidance.

Gemini Deep Research agent token reported for collecting and scanning resources used in research answers.

What is Gemini-Deep-Research?

Gemini-Deep-Research is a web crawler operated by Google that collects and scans online resources to support research answers generated by Gemini Deep Research. It identifies itself with the user-agent token Gemini-Deep-Research. The bot is categorized as an interaction agent, meaning it retrieves content in response to user-directed research tasks rather than for general indexing. Its activity is documented in community-maintained repositories, and its official documentation is not available. The bot's posture toward robots.txt is unverified, so its compliance with standard exclusion rules is not confirmed.

What it's for

For site owners, Gemini-Deep-Research may visit your pages when a user asks Gemini Deep Research to investigate a topic that involves your content. If the bot can access your site, your information could appear in research answers, potentially driving traffic or citations. Blocking it may prevent your content from being used in those research responses, which could reduce visibility in AI-assisted research contexts.

Allowing Gemini-Deep-Research only creates the possibility of retrieval. To find out whether your pages are selected, measure which answer engines actually cite your pages using a stable query set.

How to handle Gemini-Deep-Research

To block Gemini-Deep-Research from accessing your site, add a robots.txt rule targeting its user-agent token. The page will render the appropriate snippet separately. Because its robots.txt posture is unverified, there is no guarantee the bot will honor the rule, but it is the standard method to request exclusion.

robots.txt rule

User-agent: Gemini-Deep-Research Disallow: /

Blocking cost

Blocking Gemini-Deep-Research may prevent your content from being included in Gemini Deep Research answers, which could reduce visibility in AI-driven research outputs.

Examples

• A user asks Gemini Deep Research to summarize recent advancements in renewable energy, and the bot fetches relevant articles from various websites to compile the answer.
• During a research task on historical architecture, the bot retrieves content from museum and academic sites to provide detailed context.
• When a user requests a comparative analysis of programming languages, the bot scans technical blogs and documentation pages to gather information.

Related bots

• Google-NotebookLM: Another Google live fetcher to compare.
• ChatGPT Agent: Also tracked as a live fetcher.
• DuckAssistBot: Also tracked as a live fetcher.
• Claude-User: Also tracked as a live fetcher.
• Google-Gemini-CLI: Another Google live fetcher to compare.
• GoogleAgent-Mariner: Another Google live fetcher to compare.
• Google-Agent: Another Google live fetcher to compare.
• Google-GeminiNotebook: Another Google live fetcher to compare.
• AmazonBuyForMe: Also tracked as a live fetcher.
• Gemini 2.0: Gemini-Deep-Research gives crawler context for Gemini 2.0.
• Google Assistant: Gemini-Deep-Research connects this operator term to its crawler behavior.