SEO Utilities
Robots.txt Generator
Writes a robots.txt with a user-agent, Allow and Disallow lines, and an optional sitemap URL.
How to use Robots.txt Generator
- Set user-agent and path rules.
- Add a sitemap URL.
- Generate, validate, and publish robots.txt at the site root.
A practical example
Disallow: /admin/ requests that cooperating crawlers avoid that path.
What to check before using the result
robots.txt is public, not authentication. Blocking crawling does not guarantee removal from search. A crawler must fetch a page to see its noindex directive.
Local processing
Inputs are processed in this tab. The site and some engines still load network assets.
Inspect before sharing
Review the output and keep the original file. Large files may take longer to process.
No account needed
No account, API keys, or watermarks required.