All free tools
Free tool
robots.txt Generator
Your robots.txt decides which AI crawlers can read your site. Allow the answer engines you want to be recommended by, block the ones you don't, add your sitemap, and copy the result to your site root.
AI crawler access
Allowing the answer engines is what lets them read and recommend you. All allowed.
Save this as robots.txt at the root of your site (yoursite.com/robots.txt).
robots.txt
# robots.txt
# Generated with RankNext — ranknext.io/tools/robots-txt-generator
User-agent: *
Allow: /
# AI answer engines
User-agent: GPTBot
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: Google-Extended
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: Applebot-Extended
Allow: /
User-agent: Bytespider
Allow: /
Want this handled for you — every month?
We build your site and get you named by Google AI and ChatGPT, proven with evidence. Start with a free check.