Robots.txt Generator

Generate a robots.txt file with allow/disallow rules, sitemaps, and crawl-delay. Live preview, copy, deep-link, and ready-made presets (allow all, block all, block AI bots, WordPress, Shopify). 100% client-side.

Quick presets

User-agent groups

Each group applies to its listed user-agents. Use * to match all bots. Rules are applied in order; the first matching group wins for a given bot.

Sitemaps

Absolute URLs, one per line. Search engines will fetch these to discover your pages.

robots.txt preview

Copied!