Robots.txt Generator

Choose a preset or build custom rules per crawler, then generate a ready-to-use robots.txt file.

Sitemap (optional)

Applied to all groups. Leave blank to omit — most major search engines ignore this directive today.

      

Upload the generated file to your site’s root directory as /robots.txt.

Scroll to Top