llms.txt Best Practices: Format, Curation, and Maintenance

How to write an llms.txt that's actually useful: curate ruthlessly, write descriptive link notes, keep it current, mirror it in clean HTML, and don't mistake it for access control or a ranking lever.

By Andrej Ruckij · · 3 min read

llms.txt Best Practices: Format, Curation, and Maintenance

By Andrej Ruckij · June 16, 2026

TL;DR: A good llms.txt is curated (your best 10–30 pages, not all of them), descriptive (a real one-line note per link), current (updated when your key pages change), and honest about its role (comprehension aid, not access control or ranking lever). The format is trivial; the discipline is curation.

A cluster under our complete guide to llms.txt. You already know how to create the file — this is how to make it actually good.

1. Curate ruthlessly

The single most important rule. llms.txt is valuable because it’s selective. List your 10–30 most representative, highest-value pages — the ones you’d want an AI to read if it could only read a handful. If you list everything, you’ve built a sitemap, not an llms.txt, and given the AI no signal about what matters.

2. Write real descriptions

Each link should carry a genuine one-line note: [Pricing](url): plans, tiers, and what's included. Not [Pricing](url): pricing page. The description is where you tell the AI what the page is for — it’s the highest-signal part of the file. Vague notes waste the format.

3. Group with meaningful H2 sections

Organize links under clear headings (## Guides, ## Product, ## About) so the structure itself communicates how your site is organized. A flat list of 30 links is harder for an AI to reason about than three labeled groups of ten.

4. Lead with a sharp summary

The opening blockquote is your one-sentence pitch to the AI. Make it concrete and specific — what you do, for whom. This is the line most likely to be lifted verbatim into an AI’s description of you.

5. Keep it current

A stale llms.txt pointing at moved or deleted pages is worse than none — it feeds AI outdated information. Treat it like any other key asset: review it when you restructure your site or ship major pages. Stamp it with a date if your platform allows.

6. Mirror the truth in clean HTML

llms.txt doesn’t replace good on-page structure — and since the major engines mostly read your actual pages (see does-llms-txt-work), the real work is still clean, crawlable, well-structured HTML. Treat llms.txt as a supplement to that, never a substitute.

7. Don’t overclaim what it does

The discipline that separates a credible operator from a hype-merchant: llms.txt is not access control (that’s robots.txt + a firewall) and not a proven ranking lever. Add it, keep it good, and set expectations honestly with anyone who asks.

Key takeaways

  • Curate to your best 10–30 pages — selectivity is the whole value.
  • Write descriptive per-link notes and group with meaningful H2s.
  • Keep it current; a stale file misinforms AI.
  • It supplements clean HTML; it doesn’t replace it, and it isn’t access control.

Sources