← Back to blog

llms.txt template: help AI systems understand your brand

MencionAI Blog MencionAI

MencionAI Blog Sep 16, 2026 · 1 min read

Quick answer

OpenAI documents GPTBot, OAI-SearchBot, and ChatGPT-User; Anthropic documents ClaudeBot, Claude-SearchBot, and Claude-User; Perplexity documents PerplexityBot and Perplexity-User. Do not invent tokens for Grok or DeepSeek.

Summary

  • llms.txt is a curated, plain-text map that helps AI crawlers and answer engines find your canonical marketing URLs without parsing JavaScript-heavy pages.
  • Publish /llms.txt at your site root with: 1.
  • - Use stable URLs that match your hreflang/canonical tags.
  • - English: https://www.example.com/en/pricing - Português (Brasil): https://www.

Why llms.txt exists

llms.txt is a curated, plain-text map that helps AI crawlers and answer engines find your canonical marketing URLs without parsing JavaScript-heavy pages.

For Brazilian brands, list both PT-BR and English canonicals so ChatGPT, Gemini, Claude, Perplexity, Grok, and DeepSeek can cite the right locale.

Minimal template

Publish /llms.txt at your site root with:

  1. Brand block — name, one-paragraph positioning, primary category.
  2. Canonical URLs — home, pricing, FAQ, guides (no tracking parameters).
  3. Locale variants — link each language version with a short label.
  4. Discovery links — sitemap.xml, robots.txt, and optional llms-full.txt for expanded markdown context.
  5. Exclusions note — state that authenticated areas (/dashboard, /share/*) are intentionally blocked.

Quality rules

  • Use stable URLs that match your hreflang/canonical tags.
  • Update when positioning, pricing, or cornerstone guides change.
  • Keep copy factual; avoid keyword stuffing.
  • Pair with AI-aware robots.txt rules for GPTBot, ClaudeBot, and PerplexityBot.

Example section

Product


[Full template guide](/en/guides/llms-txt-template) · [robots.txt for AI crawlers](/en/guides/robots-txt-ai-crawlers)

FAQ

Which AI crawlers have documented robots.txt tokens?

OpenAI documents GPTBot, OAI-SearchBot, and ChatGPT-User; Anthropic documents ClaudeBot, Claude-SearchBot, and Claude-User; Perplexity documents PerplexityBot and Perplexity-User. Do not invent tokens for Grok or DeepSeek.

What is GEO?

Generative Engine Optimization is how MencionAI gets a brand cited in AI answers.

Which engines does MencionAI track?

MencionAI tracks ChatGPT, Gemini, Google AI Mode, Claude, Perplexity, Grok, and DeepSeek.

Sources

  1. OpenAI crawler docs
  2. Google crawlers
  3. Anthropic crawler docs
  4. Perplexity crawlers
  5. llms.txt specification
  6. Google Search Central — Article structured data

What to read about this