↗
SerpUp
Robots.txt
Generator
Control how search engines crawl your website
Your Website URL
Sitemap URL (optional)
Allow/Disallow Paths
Allow All Pages
Block /admin/
Block /wp-admin/
Block /private/
Block /api/
Block /tmp/
Crawl Delay
No Delay
1 Second
5 Seconds
10 Seconds
Generate Robots.txt →
Your robots.txt
Copy
How to Use
Copy the code above
Create a file named
robots.txt
Upload to your website root (e.g., example.com/robots.txt)
Test at
Google Robots Testing Tool
Need Technical SEO Help?
Get a complete audit of your website.
Free SEO Audit →