AI Discovery

llms.txt Guide

llms.txt is a plain-text or Markdown file that can summarize your website’s important pages, services, and preferred resources for AI systems and agents.

Quick summary
  • llms.txt presents your site’s core resources to AI systems in a more organized way.
  • The file should be simple, current, consistent with canonical URLs, and free of exaggerated claims.
  • llms.txt does not guarantee visibility on its own; it is meaningful together with crawlability and content quality.

What is llms.txt?

llms.txt is a text-based file used to provide AI systems with concise, organized context about a website’s main purpose, important pages, products or services, and preferred primary sources.

Why use it?

AI systems can struggle to determine which pages matter most on large websites. llms.txt can present resources such as the homepage, guides, API documentation, product pages, and policy pages in a clear list.

What should it include?

It can include a concise site description, primary URL, language options, important pages, API or OpenAPI links, guides, and policy pages. All URLs should be accessible and consistent with the canonical structure.

What should it not include?

Do not include keyword stuffing, misleading claims, content hidden from users, conflicting URLs, or outdated pages. The clearer and more trustworthy the file is, the more useful it becomes.

Its relationship with GEO

llms.txt is only one GEO signal. It becomes more useful when combined with robots.txt, sitemap.xml, structured data, strong content, consistent metadata, and crawlable HTML.

Checklist

  • Publish the file at /llms.txt in the site root.
  • Add a short, clear site description.
  • List important canonical URLs.
  • Represent language versions correctly.
  • Include API, guide, and policy pages when relevant.
  • Update the content after URL changes.

Implementation order

  1. Publish the file at /llms.txt in the site root.
  2. Add important URLs such as the homepage, guides, tools, pricing, and contact under organized headings.
  3. Keep the brand and service description concise and clear.
  4. Keep the file current as content changes.

Frequently asked questions

Is llms.txt required?

No. llms.txt is not a standard search engine requirement, but it can be a useful discovery file for summarizing a site’s important resources for AI systems and agents.

What should be written in llms.txt?

Include a brand description, important pages, documentation, guides, tools, API information, and concise, organized links explaining what the site does.

Does llms.txt improve SEO rankings?

It does not improve rankings on its own. When used correctly, it can support machine understanding of the site; content quality and technical SEO still matter.