Robots.txt Generator & Tester
Build a robots.txt file rule by rule, or paste one and test whether a URL is allowed. Supports wildcards, crawl delays, sitemaps, and multi-agent groups. Free, private, runs in your browser.
Group 1
disallow rules
allow rules
Generated robots.txt