Robots Block Checker

Test URL paths against pasted robots.txt rules and find rules that may block important crawlers or pages.

Paste robots.txt and URL paths. This local tester supports common Allow and Disallow matching rules.
Optional. Files are processed locally in your browser.
Paste input or load the sample to begin.

Free Online Robots Block Checker

Test URL paths against pasted robots.txt rules and find rules that may block important crawlers or pages. This tool runs in your browser, so pasted page source, crawl exports, sitemaps, and robots.txt data stay local unless you copy or download the report.

Related Tools

Robots.txt CheckerRobots.txt TesterRobots Sitemap CheckerMeta Robots Generator