llms.txt: The Complete Guide to the AI Search Engine File
llms.txt is to AI search engines what robots.txt is to Google. We explain what it does, how to write it, and where to place it.
What Is llms.txt
llms.txt is a plain-text file placed at the root of your website (e.g. example.com/llms.txt) that gives large language models and AI search engines a clear, human-readable summary of what your site is about and where to find the most important content.
While robots.txt tells crawlers what they're allowed to access, llms.txt offers AI a structured 'map' and context — so it can understand your site faster and more accurately, without having to wade through navigation menus and ads.
What llms.txt Looks Like
It's simple Markdown. It starts with the site name and a short description, followed by links to the most important pages, each with a one-sentence annotation.
- # Site Name — one sentence describing what the site is about
- > A short paragraph about what visitors (and AI) will find on the site
- ## Main Sections — links to key pages with brief descriptions
- ## Optional — contact, terms, additional resources
Where to Place the File
Place it at the domain root as llms.txt (and optionally llms-full.txt for an extended version). Simply upload it to your server — no registration or verification required.
Does llms.txt Actually Help?
The standard is new and not every AI system actively uses it yet, but the effort required is minimal and there's no downside. It signals that your site is AI-ready, and for models that do read it, it improves their understanding of your content. Our GEO tool can check for the presence and quality of your llms.txt file.
Frequently asked questions
Is llms.txt required?
No. It's a voluntary standard. Creating one is low-effort, however, and can help AI search engines understand your site more accurately.
What's the difference between llms.txt and robots.txt?
robots.txt controls what crawlers are permitted to access. llms.txt provides AI with a readable summary and content map of your site.