llms.txt
llms.txt is a proposed convention of placing a structured text file at a site's root to guide large language model crawlers toward key resources.
Also known as: llms-full-txt · ai-crawler-manifest
Why it matters
AI assistants increasingly cite the web. Without a clear map, they may miss your best docs or misrepresent your product, llms.txt is a lightweight discovery layer complementing sitemaps and structured data.
How it works
Publish `/llms.txt` at your site root with a short summary and links to your most important pages, pricing, docs, features, and definitive guides. Optionally add `llms-full.txt` with longer descriptions. Update the file when you ship major product or pricing changes.
Common mistakes
- Pointing llms.txt at staging or broken URLs.
- Listing every blog post instead of canonical hubs and docs.
- Blocking all AI crawlers while expecting citations.
- Never updating llms-full.txt after major product repositioning.
Best practices
- Highlight docs, pricing, features, and definitive guides.
- Mirror llms content to actual public routes only.
- Pair with strong entity and Article schema on cited pages.
- Review crawler policy quarterly as bots evolve.
Learn Domains perspective
Say you sell invoicing software and a prospect asks ChatGPT about your pricing, and gets last year's plan, llms.txt is a simple file on your site that points AI assistants to your docs, pricing, and feature pages first. In Learn Domains, your Knowledge Base keeps product facts straight inside briefs and drafts, so what you publish publicly is what you want the world to repeat.
FAQ
- Is llms.txt required for AI visibility?
- Emerging convention, not mandatory, but low-cost discovery insurance alongside good content.
- llms.txt vs sitemap?
- Sitemaps list URLs for search; llms.txt curates what matters most for language model context.
- Does Learn Domains generate llms.txt for customer sites?
- No, you publish llms.txt on your own marketing domain. Learn Domains helps you keep the product facts on those pages accurate through your vault.
Next steps
- 1List your three most important public pages, pricing, docs, flagship feature.
- 2Publish llms.txt on your marketing domain pointing to those URLs.
- 3Update the file after your next pricing or positioning change.
Knowledge graph
Parent terms
Related concepts
schema-markup · knowledge-base · brand-entity