Robots.txt Generator
Control which bots can crawl your website. Generate a valid robots.txt file in seconds.
Bot Access Control
Toggle ON to allow a bot, OFF to block it.
Global Settings
Disallow Paths
Specify paths that bots should not crawl.
Allow Paths (Override Disallow)
Specify paths that should be explicitly allowed even within disallowed directories.
Preview
Click "Generate" to see your robots.txt
Get All 40+ Tools
Lifetime Pass ($99.99) gets every tool we build. Or resell them all under your brand from $99.
Visit the Store