Robots.txt and Sitemap Checker
Read a site’s robots.txt, see which paths are blocked for Googlebot and AI bots, test a specific URL and find sitemap URLs that robots.txt blocks.
Fill in the form and run the tool; results appear here.
This tool runs through our server; what you enter is not stored. Only public websites are inspected.
In short
A robots.txt check interprets crawl rules per bot: which paths are closed to Googlebot, GPTBot or ClaudeBot. URLs listed in the sitemap but blocked by robots.txt cause Search Console errors; Disallow does not de-index a page.
What does Robots.txt and Sitemap Checker do?
Read a site’s robots.txt, see which paths are blocked for Googlebot and AI bots, test a specific URL and find sitemap URLs that robots.txt blocks. It is free and needs no sign-up.
Who uses it and when?
- SEO specialists investigating dropped pages
- Developers testing new robots.txt rules
- People checking AI bot access
Frequently asked questions
Is Robots.txt and Sitemap Checker free?
Yes. The tool is free, needs no account and the data you enter is not stored.