Chạm·AI Phygital Agency
EN / VI Start a project
Start a project →
Free tool · GEO

Is your website accidentally blocking ChatGPT, Claude or Perplexity?

Paste a domain and the tool reads robots.txt to report on 15 key AI bots - GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended, Bingbot... - allowed or blocked. One wrong line and your brand vanishes from AI answers.

Quick Q&A - Frequently asked questions

How does the AI crawler checker work?

TL;DR: The tool fetches the website's robots.txt and matches it against the 15 most important AI and search bots - the answer-and-cite group (OAI-SearchBot, ChatGPT-User, PerplexityBot), the model-training group (GPTBot, ClaudeBot, CCBot, Bytespider) and traditional search (Googlebot, Bingbot). It reports which bots are fully blocked, partially blocked or allowed, and checks whether the site has llms.txt and sitemap.xml. Free, runs in 2-3 seconds, no sign-up.

What do you gain and lose by blocking AI crawlers?

Gain: your content is not used for model training. Lose: your website disappears from the answers of ChatGPT, Perplexity and Meta AI - the fastest-growing customer channel. For businesses pursuing GEO, the usual advice is to allow the answer-and-cite bots (OAI-SearchBot, PerplexityBot) and decide separately about training-only bots (GPTBot, CCBot, Bytespider).

What is Google-Extended, and does blocking it hurt SEO?

Google-Extended is a control token for whether Google may use your content for Gemini - not a separate crawler. Blocking it does not affect search rankings or AI Overviews, which both use Googlebot. Blocking Googlebot is what destroys SEO.

If a website has no robots.txt, can AI bots get in?

Yes. No robots.txt means every bot is allowed by default. To take control, create robots.txt at the root and declare each User-agent; to be cited better by AI, add an llms.txt summarizing your key content.