AI crawler checker
Checks whether ChatGPT, Claude, and other AIs can read your site.
Pass when robots.txt exists and no registered AI crawler is blocked on /.
Reads: robots.txt
Check our other tools while you're here
- llms.txt
Checks whether the file that explains your site to AIs exists and is open.
- ai.txt and llms-full
Checks whether the extra files for AIs exist and are open.
- llms.txt links
Tests whether the links you point AIs to actually open.
- Citation signals
Checks whether the page states the date, the author, and who published it.
FAQ
Straight answers on what the tools check and how a corporate email unlocks your site.
A Disallow rule in robots.txt stops that bot from fetching the homepage. AI search and training may never see the page.
Without a file, crawlers are allowed by default. The result is a warning because the policy is not explicit.
The email domain is the site that gets checked. The address is added to the MencionAI newsletter. Webmail such as Gmail and Outlook does not unlock the check.
Pass means the expected signal is present and readable. A warning is a partial or missing signal that does not fully block the page. Fail means the file or signal this check looks for is missing.
No. It reads the HTML, headers, and files a crawler receives on the first response. It does not open a browser and it does not call an AI model.