Robots.txt Generator
Generate robots.txt files to control how search engines crawl your website.
Create robots.txt files for search engine crawlers
User-agent: * Allow: / Disallow: /admin Disallow: /private Disallow: /api
Generate robots.txt files to control how search engines crawl your website.