Robots.txt Generator
Create a robots.txt with crawl rules, sitemap and AI-bot controls. Free, private and runs in your browser.
AI crawlers (ChatGPT, Claude, Gemini, Perplexity…)
Block specific search engines & SEO crawlers
robots.txt
About the Robots.txt Generator
robots.txt tells search engine crawlers which parts of your site they may access. A correct file saves crawl budget and keeps admin or duplicate pages out of search — a wrong one can hide your whole site. Build yours safely with presets and live validation.
How to use the Robots.txt Generator
- Choose default access and a preset (e.g. WordPress).
- Add disallowed paths, your sitemap URL and any bot-specific rules.
- Download robots.txt and upload it to the root of your domain.
Frequently asked questions
Where does robots.txt go?
At the root: https://yourdomain.com/robots.txt. It will not work in a subfolder.
Does Disallow remove a page from Google?
Not necessarily. It blocks crawling, but a URL can still be indexed from links. Use a noindex meta tag to remove pages from search.
Is the Robots.txt Generator free?
Yes. Robots.txt Generator on Tooliphy is 100% free with no signup, no watermark and no usage limits.
Is it safe to use? Are my files uploaded?
Your data is processed directly in your browser and is never uploaded to our servers, so it stays completely private.
Does it work on mobile?
Yes, the tool works on Android phones, iPhones, tablets and desktops in any modern browser.