What is llms.txt?
llms.txt is a Markdown text file published at the root of a site (yourdomain.com/llms.txt) that gives language models a summary of what the site is and a list of links to its most useful pages. It is an open proposal from 2024, not an official standard or a search engine rule.
Jeremy Howard proposed it in September 2024 and the specification lives at llmstxt.org. The idea is simple: a site's HTML carries menus, scripts and ads; an assistant with limited context benefits from a clean, short version.
How is it different from robots.txt and the sitemap?
- 01
robots.txt
Says what bots may and may not crawl. It is a standard (RFC 9309) that well-behaved crawlers follow.
- 02
sitemap.xml
Lists every URL you want search engines to know, with its last change date. Google uses it to discover pages.
- 03
llms.txt
Summarizes the site in Markdown and links what matters most to an assistant. It grants no permissions and does not replace the sitemap.
All three work together. robots.txt decides who gets in (see can ChatGPT read your site?), the sitemap says what exists and llms.txt explains what matters.
What format does the proposal ask for?
Markdown in this order: an H1 with the site name (the only required part), a blockquote with the summary, optional paragraphs, and H2 sections with link lists formatted as «name» followed by a note after a colon. A section named «Optional» holds what an assistant can skip.
# Your company name > What you do, for whom and where, in two sentences. ## Services - [Main service](https://yourdomain.com/service/): what it includes and who it is for - [Plans](https://yourdomain.com/plans/): how pricing works ## Guides - [Most visited guide](https://yourdomain.com/guides/example/): what it answers ## Optional - [Privacy policy](https://yourdomain.com/privacy/)
The proposal also suggests offering a Markdown version of each key page at the same URL with «.md». The Market OS guides do this: each has a «Markdown» link at the bottom.
How do you create yours step by step?
From zero to live
- 01
Pick the pages
The ones that answer what customers ask: services, pricing, FAQs, guides. Ten to thirty links are enough.
- 02
Write the summary
Two sentences: what you do, for whom and where. It is the first thing an assistant reads.
- 03
Group into sections
Services, guides, company. One line per link with a concrete note on what it contains.
- 04
Publish it at the root
Upload it as plain text at /llms.txt and check that it returns status 200.
- 05
Keep it current
Every important new page goes into llms.txt and the sitemap the same day. A stale llms.txt misleads.
Does it help you show up in ChatGPT or Google?
There is no public evidence that any search engine uses it for ranking. Google says you need no special files or AI text for its AI features. Treat it as a low-cost aid for agents and assistants that do read it, not as a substitute for a solid SEO audit or for what we cover in what is GEO.
The Market OS robots.txt, sitemap and llms.txt tool validates all three files and tells you whether they contradict each other.
Tell me when it is ready →Frequently asked questions
Is llms.txt required?
No. It is an open proposal. No search engine requires it to index or show your site.
Does Google use llms.txt?
Google says you need no special files to appear in its AI features. There is no Google documentation using it as a signal.
Where does the file go?
At the domain root, such as yourdomain.com/llms.txt. The proposal also allows a subpath for one section.
What is the difference between llms.txt and llms-full.txt?
llms.txt is the index of links. Some sites also publish a file with the full content; it is not a required part of the proposal.
Does llms.txt block AI bots?
No. Allowing or blocking crawlers is done in robots.txt. llms.txt only summarizes and links.
Sources
- llmstxt.org: The /llms.txt file proposal
- Google Search Central: AI features and your website
- RFC 9309: Robots Exclusion Protocol
- sitemaps.org: Sitemaps protocol
- Google Search Central: Build and submit a sitemap
Written by Samuel Hinojosa, WITS · Updated November 1, 2026 · Markdown




