Skip to content

Rubric signal ai-bot-access

AI bot access (robots.txt)

Whether robots.txt explicitly addresses GPTBot/ClaudeBot/PerplexityBot.

Class
Trust
Source
OpenAI / Anthropic / Perplexity bot docs

Why it matters for AI citation

Default-allow gets you crawled, but explicit allow signals intent + unlocks niche AI bots.

How to fix it

Add User-agent: GPTBot/ClaudeBot/OAI-SearchBot/PerplexityBot rules to robots.txt.

About the Trust class

Crawl-time + share-time trust signals: HTTPS, canonical, viewport, AI-bot access via robots/llms.txt, Twitter card, meta description.

See your score on this signal

The free audit scores your page on all 47 signals, including this one.

Run a free audit