100% free
No signup
Instant result

AI Crawler Checker

Checks whether the assistants people now ask for recommendations are allowed to read your site. Blocking them is almost always an accident - and nothing in your own dashboard will ever tell you it happened.

We check these crawlers:

GPTBot
OAI-SearchBot
ClaudeBot
PerplexityBot
Google-Extended

What this checks

We fetch your robots.txt and read the rules for each AI crawler by name, respecting the precedence robots.txt actually uses - a rule naming GPTBot beats a wildcard rule blocking everything. No robots.txt at all means nothing is blocked, which is both correct and the common case.

Why this happens by accident

Security plugins and copied configs add blocks for these agents by default, and a lot of sites picked one up during the wave of "block AI scrapers" advice. The result is that a business cannot be cited by ChatGPT at all - while their website, their rankings and their analytics all look completely normal.

More free tools

All tools

llms.txt GeneratorBuild a valid llms.txt from your live site.LLM HTML Visibility CheckerHow much of your text can AI actually read?SEO Score CheckerOne 0-100 score from a real crawl.Robots.txt CheckerVerdicts for search and AI bots together.Sitemap Checker & FinderFind and validate XML sitemaps.Meta Tag CheckerEvery tag Google and social sites read.

Being readable is the start. Being cited is the goal.

SeoVision tracks whether AI assistants actually recommend you, then writes the content that gets you named.

Get your free audit