Generate a valid robots.txt file for your website. Configure crawl directives, set crawl delays, and add sitemap URLs.
Validation Warnings
Quick Presets
User-Agent Blocks
Sitemap URLs
Host Directive (optional)
Live Preview
robots.txt
User-agent: *
Allow: /
Want a Full Technical SEO Audit?
A robots.txt file is just one piece of the technical SEO puzzle. Let our experts audit your entire site for crawlability, indexing, and performance issues.