Robots.txt Generator

Build a valid robots.txt with crawl rules for search engine bots.

Why use this tool?

Create a robots.txt file that tells search engine crawlers which parts of your site they may visit, with a link to your sitemap.

How to use it

1. Choose the rules and paths to allow or block.
2. Add your sitemap URL.
3. Copy the result into a robots.txt file at your site's root.