Submit
New launch

robots.txt generator

Build a robots.txt that lets search engines in, decides which AI crawlers may read your site, and points to your sitemap.

Last updated

AI crawlers allowed
Result
User-agent: *
Disallow: /admin
Disallow: /api/

Search engines are always allowed here. Choose which AI crawlers may read your site, add paths to keep out, and save the result as /robots.txt.

Tools done? Launch next.

Pick a launch week for free, or go Premium for a dofollow link and top placement.

Launch your product

More free tools

AI readiness checkerScore how ready your site is to be read and cited by ChatGPT, Claude, Perplexity and other AI assistants.Meta tags checkerSee the title, description, canonical, Open Graph and X tags of any page, with a search and link preview.UTM link builderTag your launch links with UTM parameters, so analytics shows exactly which post, newsletter or community sent each visitor.Launch week calculatorFind the ISO week of any date, when a launch week starts and ends in UTC, and how long until it opens.llms.txt generatorWrite an llms.txt file that tells AI assistants what your product is and which pages matter.