Robots.txt Checker

Analyze robots.txt rules, test URL paths against crawler directives, review sitemap references, and flag common robots.txt SEO issues.

Test URL path

Primary option

Priority

Last modified date

Include lastmod / strict checks Include priority / issue notes Sort output

Input

Upload a local text, HTML, XML, CSV, or log file, or paste manually below. Files are processed in your browser.

Output

Free Online Robots.txt Checker

Analyze robots.txt rules, test URL paths against crawler directives, review sitemap references, and flag common robots.txt SEO issues. This tool runs in your browser so pasted URLs, page source, and keyword lists stay on your device.

Robots.txt Checker

Free Online Robots.txt Checker

Related Tools