Trakkr Data

Google-Extended

Training crawlerby Google

A robots.txt control token - not a separate crawler. It governs whether content Google already crawled may be used to train Gemini and Vertex AI.

What Google-Extended is for

Collects pages to train future models. No direct traffic back to you.

Disallowing Google-Extended opts you out of Gemini/Vertex training without affecting Google Search ranking or AI Overviews indexing.

Crawler guide

Evergreen identity, source, and robots.txt handling guidance.

Read the full bot guide

Allow or block Google-Extended

Honours robots.txt. Add one of these to your robots.txt.

Block it
User-agent: Google-Extended
Disallow: /
Allow it explicitly
User-agent: Google-Extended
Allow: /
User-agent
- (control token only; does not appear as a fetching user-agent)

Google-Extended is a robots.txt directive, not a bot that fetches pages, so it carries no crawl telemetry of its own.

Google's official bot docs

Other AI crawlers

Every bot Trakkr tracks is a doorway.

Common questions

What is Google-Extended?

Google-Extended is an AI web crawler operated by Google. A robots.txt control token - not a separate crawler. It governs whether content Google already crawled may be used to train Gemini and Vertex AI.

How do I block Google-Extended?

Add a directive to your robots.txt: "User-agent: Google-Extended" followed by "Disallow: /". Honours robots.txt. Google-Extended is a robots.txt directive, not a bot that fetches pages, so it carries no crawl telemetry of its own.

Does blocking Google-Extended hide me from AI?

Blocking Google-Extended keeps your content out of training data but does not remove you from AI search answers - those are served by the search crawlers. Disallowing Google-Extended opts you out of Gemini/Vertex training without affecting Google Search ranking or AI Overviews indexing.

Methodology

Identity and robots.txt facts come from Google's published bot documentation. This crawler carries no live telemetry of its own, so only the reference facts are shown.

Trakkr DataAll crawlersCitations·Data as of 132d agoCC BY 4.0

Telemetry updated Feb 1, 2026.