Skip to content

Glossary entry google-extended

Google-Extended

Google's TRAINING-data crawler for Gemini and Vertex AI, distinct from Googlebot (search).

Filed under
Engines & bots

Definition

Google-Extended is Google's user-agent for training-data crawling of Gemini and Vertex AI models. Like GPTBot, it's separate from the retrieval/indexing crawler (Googlebot). Blocking Google-Extended only opts your content out of Gemini training; it does NOT affect Google AI Overview retrieval (which uses Googlebot's existing index).

Example

User-agent: Google-Extended Disallow: / (Opts out of Gemini training; AI Overview retrieval continues normally.)

How to optimize

Always Allow Googlebot (blocking kills SEO + AI Overview). Choose separately on Google-Extended based on training-data policy.

Check a page against a real AI answer

Claude’s live answer to your buyer’s question, its sources, your readiness score and the fixes. Free, no signup, about half a minute.

Run a free audit