Build robots.txt files visually. Add user-agents, rules, sitemaps. Use presets to block AI bots, set WordPress defaults, or validate existing files.
Click a preset to load it into the builder.
Allow all bots to crawl everything
Block all bots from crawling
Block GPTBot, CCBot, Google-Extended, Anthropic, Perplexity, etc.
Standard WordPress robots.txt with wp-admin blocked
Block cart, checkout, account pages
Allow all with API routes blocked
Paste an existing robots.txt to check for issues.