Enter your website address: the tool reads your robots.txt and llms.txt, then tells you whether ChatGPT, Bing, Google, Claude and Perplexity are allowed to read your website. It’s free, with no sign-up.
Pasted text is analyzed in your browser: it isn’t sent anywhere.
The tool applies your robots.txt rules to each crawler, following the protocol standard (RFC 9309), and sorts them into three families:
If the tool says other paths are blocked, that’s normal: most websites disallow their admin area, for example. To check a specific page, change the path tested. For a step-by-step example and the fixes to make, read how to tell whether ChatGPT can read your website.
A well-configured robots.txt doesn’t guarantee crawlers get in. Some hosts, firewalls and content delivery networks (CDNs) block AI crawlers by IP address, which no external tool can reliably check. If the checker can’t read your website, that’s a clue in itself: a firewall may also be blocking automated visitors. Ask your host. I explain this trap in the article on robots.txt and ChatGPT’s crawlers.
For llms.txt, the tool checks the structure defined by the llmstxt.org proposal: a title, a summary, sections and link lists. Remember that no major search engine has committed to using it: see what the llms.txt file really does.
Not necessarily. An open robots.txt makes your website readable, which is a starting condition. Being cited then depends on your pages, your presence in Bing and the other sources ChatGPT consults.
They’re two different settings. Googlebot powers Google Search. Google-Extended tells Google whether it may use your content to train Gemini and ground its answers; according to Google, it has no effect on your presence in Search.
The website may be offline, or a firewall may block automated visitors like our checker. If your robots.txt opens fine in your browser, use the “Paste a file” tab and talk to your host about the firewall.
No. It only reads the public /robots.txt and /llms.txt files and keeps the result in memory for ten minutes to avoid reloading the same website. Pasted text is analyzed in your browser.