What Is llms.txt, and Do You Need One?
Updated July 8, 2026
llms.txt is a proposed website file designed to give
language-model tools a concise map of important content.
It is usually placed at:
https://example.com/llms.txt
The idea is straightforward: instead of making an AI tool navigate an entire website, the file provides a short Markdown-formatted summary and links to useful pages.
llms.txt file. It may be a harmless optional addition, but it is
not a substitute for crawlable pages, useful content, internal links, an XML
sitemap or legitimate authority.
What does llms.txt contain?
The proposal describes a Markdown file containing a title, a concise website description and organized links to important resources.
A simplified example could look like this:
# Summit Roofing Summit Roofing is a licensed residential roofing contractor serving Portland, Beaverton and nearby communities. ## Key Pages - [Homepage](https://example.com/): Business overview - [Roof Repair](https://example.com/roof-repair): Emergency and scheduled repairs - [Roof Replacement](https://example.com/roof-replacement): Replacement services - [Service Areas](https://example.com/service-areas): Communities served - [Contact](https://example.com/contact): Phone, hours and contact information
The file is intended to act as a curated guide, not as a complete copy of the entire website.
Is llms.txt an official web standard?
No. It remains a proposed convention rather than a universal standard comparable
to HTML, HTTP, robots.txt or XML sitemaps.
Some documentation platforms and website owners publish it, but adoption does not mean every AI search system reads or uses it.
llms.txt file does not prove that ChatGPT,
Gemini, Claude, Perplexity or Google will use it when generating an answer.
Does Google use llms.txt?
Google states that website owners do not need to create special AI text files or Markdown files to appear in Google Search or its generative AI features.
Google also states that it does not use llms.txt as a special
visibility or ranking signal.
Therefore, adding the file should not be presented as a Google SEO improvement.
Does ChatGPT require llms.txt?
OpenAI does not identify llms.txt as a requirement for appearing
in ChatGPT search.
OpenAI instead documents OAI-SearchBot as the crawler used to
surface websites in ChatGPT search results.
For ChatGPT search visibility, more direct technical priorities include:
- Allowing appropriate access to
OAI-SearchBot - Publishing crawlable HTML pages
- Using correct canonical URLs
- Keeping important content accessible without login barriers
- Providing clear internal links
- Publishing accurate and useful business information
How is llms.txt different from robots.txt?
| File | Primary purpose |
|---|---|
robots.txt |
Gives supported crawlers access instructions for particular areas of a website. |
sitemap.xml |
Lists important URLs so search engines can discover and revisit them. |
llms.txt |
Proposes a concise, human-curated Markdown guide to useful website content. |
These files are not interchangeable.
An llms.txt file cannot repair blocked crawling, broken pages,
missing internal links or incorrect indexing directives.
How is llms.txt different from an XML sitemap?
An XML sitemap is primarily a machine-readable list of URLs.
An llms.txt file is intended to provide more narrative context
around selected resources.
A sitemap may contain hundreds or thousands of URLs.
An llms.txt file should generally remain selective and concise.
For search visibility, a correct sitemap is a substantially higher priority.
Will llms.txt improve AI visibility?
There is no reliable public evidence that merely adding the file improves recommendations or citations across major AI platforms.
It may help tools that have explicitly chosen to use the proposed format. However, that is different from proving a measurable ranking or recommendation benefit.
Business owners should not treat the following sequence as guaranteed:
Add llms.txt → get crawled → get cited → get recommended
Each step depends on separate systems and factors.
Should a small business create one?
It is optional.
Consider creating one only after higher-priority work is complete.
It may be reasonable when:
- Your important pages are already crawlable and indexed
- Your sitemap and internal links are correct
- Your business information is clear and consistent
- You have a documentation-heavy or technically complex website
- The file can be maintained with little effort
- A tool you specifically care about documents support for it
It should not be a priority when:
- Your website has indexing problems
- Your services or locations are unclear
- Your important pages are thin or missing
- Your contact information is inconsistent
- You lack meaningful third-party evidence
- Your sitemap or canonical tags are incorrect
What should you fix before llms.txt?
- Confirm that important pages are crawlable and indexable.
- Clearly explain the business, services and locations in visible HTML.
- Create substantive service and location pages.
- Use accurate titles, descriptions and canonical tags.
- Add internal links between important resources.
- Maintain an accurate XML sitemap.
- Correct inconsistent business information across external profiles.
- Build legitimate third-party authority and citations.
Those changes have clearer value for search discovery and general website quality.
How to create an llms.txt file
If you still want one, keep it simple.
- Create a plain-text UTF-8 file named exactly
llms.txt. - Use Markdown formatting.
- Add the business or website name as the main heading.
- Write a concise factual description.
- Link only to important, canonical pages.
- Publish it at the root of the website.
- Update it when important URLs or facts change.
What should not go in the file?
- Unverifiable promotional claims
- Keyword-stuffed descriptions
- Hundreds of low-value links
- Confidential or private information
- URLs that redirect or return errors
- Claims that contradict the visible website
Can llms.txt hurt a website?
A normal public file is unlikely to cause direct harm by itself.
Problems can arise if it:
- Exposes information that should not be public
- Contains outdated URLs
- Contradicts the actual website
- Creates additional maintenance burden
- Distracts from more important technical and content work
Should an AI visibility audit penalize a missing llms.txt file?
A missing llms.txt file should not be treated as a major defect
or as evidence that a business is invisible to AI systems.
At most, it can be noted as an optional emerging convention.
More meaningful audit signals include:
- Observed recommendation inclusion
- Observed citations and sources
- Crawlability
- Indexability
- Business identity clarity
- Service and location relevance
- Third-party corroboration
- Credentials and authority
- Internal-link structure
The bottom line
llms.txt is an interesting proposed format, but it is not a
universal AI visibility standard.
It may be worth adding after the website's fundamentals are strong, especially if a specific tool supports it. For most small businesses, however, it belongs near the bottom of the priority list.
Focus on the signals that matter most
VisibilityIndex.ai evaluates website readiness, recommendation visibility, competitor inclusion and supporting evidence without treating optional files as guaranteed ranking factors.
Run the free AI visibility readiness audit or view audit examples.