Robots.txt Generator

🤖 Agent Ready

Generate a robots.txt file with user agents, allow/disallow rules, crawl delay, and sitemap

Rule Group 1

User Agent

Disallow Paths

Allow Paths

No rules — click Add

Crawl Delay (seconds)

Sitemap URL

Generated robots.txt

User-agent: *
Disallow: /admin/
Disallow: /private/

Sitemap: https://example.com/sitemap.xml

Related Tools