Robots.txt Generator
Build a robots.txt file visually. Add user-agent blocks with allow/disallow rules, set crawl delays, and declare your sitemap URL.
Blank
Block 1
All crawlers (*)
Disallow paths
Allow paths
Like this tool? Meet the full platform
SECrawl is the SEO platform behind these free tools — crawl thousands of pages, run 40+ SEO, AI-readiness, performance and security reports, and chat with the results to find what to fix first. Start free, no credit card.