Configuration
Disallow Paths
No paths restricted
Quick Presets
robots.txt
Usage Guide
- • Place robots.txt in your site root directory
- • Test at: yoursite.com/robots.txt
- • Use Allow: / to allow all crawlers
- • Disallow specific paths to protect private content
- • Include sitemap URL for better indexing
Enjoying this tool?
Support us to keep building free tools!
Secure payment via Stripe • No account required