Cartesiano.ai Blog

The simplest way to track your brand across AI search engines like ChatGPT

recent posts

What is llms.txt and Does It Actually Work?

The idea of llms.txt has exploded in AI and SEO circles, but there’s a huge gap between hype and reality. Some marketers treat it like the next big thing in AI visibility. Others laugh it off as snake oil. Here’s a breakdown of what llms.txt is, what it actually does, and whether it’s worth your time.

What Is llms.txt?

llms.txt is a simple markdown text file placed at the root of your website (e.g., example.com/llms.txt) that lists key pages you want AI tools to pay attention to. An optional companion, llms-full.txt, may include full, flattened content or documentation for easier ingestion by AI systems.

Unlike robots.txt or a sitemap, llms.txt doesn’t control crawlers or indexing. It suggests which URLs are most important and how they relate to each other.

How llms.txt Is Supposed to Work

The basic concept:

  • Give AI systems a clearly structured list of high-value content.
  • Use markdown headers and simple links to organize by category (Docs, Support, Policies, etc.).
  • Optionally provide text in llms-full.txt so AI can quickly absorb key information.

In essence, it is meant to: :

  • Helps AI tools find relevant pages more efficiently.
  • Reduce hallucinations by pointing to authoritative material.
  • Improve how content is interpreted and cited in AI-generated answers.

Think of it as a curated content map for LLMs, like a mini-sitemap with context.

What It Isn’t

llms.txt is not:

  • A crawling control file like robots.txt.
  • A substitute for a proper XML sitemap.
  • An official web standard backed by major AI providers.
  • A guaranteed ranking signal.

There’s no official protocol requiring LLMs to read or respect llms.txt. As of the writing of this blog post, Google and other platforms do not use it for ranking, indexing, or serving AI search results.

Should You Create One?

In short, yes, but only if you have a specific use case. Here’s how to think about it:

When it might make sense:

  • You operate an API or developer portal where structure matters.
  • You want to centralize documentation for tools and integrations.
  • You plan to build workflows that use the file as a single source of truth.

When it doesn’t make sense:

  • You’re chasing AI traffic or rankings without evidence of impact.
  • You plan to mirror every blog post or page into .md files. This will simply lead to duplicate content and a waste of resources.

If your goal is better AI visibility, invest in:

  • High-quality, crawlable content.
  • Structured data (Schema).
  • Strong internal linking and trust signals.
  • Monitoring how AI bots actually discover and cite your site.

These have real impacts on how your pages perform in search and AI-driven results.

How to Implement llms.txt

  1. Create a plain text file named llms.txt at your domain root.
  2. Add only your most relevant URLs (keep it curated).
  3. Use simple markdown with section headers.
  4. Optionally pair with llms-full.txt for richer context.
  5. Don’t duplicate entire site content, focus on quality.

Example structure:

# Your Brand Name
## Docs
- [API Overview](https://example.com/docs/api-overview)
- [Authentication Guide](https://example.com/docs/auth)
## Policies
- [Privacy Policy](https://example.com/privacy)

Final Verdict

llms.txt is interesting. Conceptually it makes sense to guide AI to your best content. But right now it’s experimental, unsupported by major platforms, and unlikely to deliver measurable SEO gains on its own.

Treat it as optional, not essential. Build it where it genuinely adds clarity for developers or tooling, not just because an audit flags it.

Posted in