ROBOTS IT?✉

GEN

TEST

ZIP

Generator

Create rules for different bots, then generate your robots.txt below.

Select Bot(s)

Choose which search engines or AI crawlers these rules apply to.

Advanced Rules

Optional sitemap links, crawl settings, and custom directives.

Sitemap URL (optional)

Crawl Delay (seconds, optional)

Output — robots.txt

Click ROBOTS IT to build your robots.txt

Tester

User Agent to Test

URL Path to Test

Use a path like /private/ or paste a full URL.

Paste Existing robots.txt

— Awaiting input

Generate your robots.txt first, then enter a URL path above.

READY · Select a bot, add rules, then click ROBOTS IT.

Robots.txt Generator and Tester