Robots.txt Generator
Website URL:
User-Agent (e.g., Googlebot):
Allow (e.g., /blog/):
Disallow (e.g., /admin/):
Crawl Delay (in seconds):
Generate Robots.txt