AEO

What Is llms.txt, and Does Your Website Need One?

Agencies are selling llms.txt as the key to AI search. The truth is less exciting and more useful. Here is what the file does, who reads it today, and a 30-minute way to add one if it makes sense for you.

If you've talked to an SEO agency about AI search this year, there's a good chance someone mentioned llms.txt. Some present it as the robots.txt of the AI era, a file that gets you into ChatGPT. Others call it a waste of time.

Both camps overstate it. We publish an llms.txt file on this site, generated automatically every time we update our pages, so we've seen the work involved and what it does and doesn't change. This guide gives you the plain facts, separates what's on the record from what's guesswork, and helps you decide in five minutes whether your business needs one.

llms.txt is a helpful summary for AI tools that choose to read it. It isn't a ranking factor, and it isn't a switch that turns on AI visibility.

What is llms.txt?

llms.txt is a plain-text file, written in Markdown, that sits at the root of a website, for example yourdomain.com/llms.txt. It tells large language models (LLMs) what the site is about and links to the pages that matter most, with a short note on each one.

It was proposed by Jeremy Howard of Answer.AI in September 2024. The problem it tries to solve is real: web pages are full of menus, scripts, cookie banners and ads, and an AI tool reading a site has limited room for text. A short, clean file in Markdown is much easier for a model to use than a dozen HTML pages.

Some sites, mostly software documentation, also publish llms-full.txt, a single file that contains the full text of their docs. That's a convention that grew up around the proposal, not part of the original specification.

llms.txt vs robots.txt vs sitemap.xml

The three files sit side by side at the root of your site, so they're easy to confuse. They do very different jobs.

robots.txtsitemap.xmlllms.txt
PurposeSays which bots may crawl which pagesLists every page you want indexedSummarizes the site and points to the best pages
Written forCrawlersSearch enginesAI tools and language models
FormatSimple rulesXMLMarkdown
StatusInternet standard (RFC 9309)Supported by all major search enginesA proposal with limited support
Can it block a bot?Yes, for bots that follow itNoNo

The last row is the one people get wrong most often. Listing pages in llms.txt doesn't grant access, and leaving pages out doesn't hide them. If your robots.txt or your hosting firewall blocks AI crawlers, a perfect llms.txt file changes nothing. Our guide on whether to block AI crawlers covers that side.


What goes in an llms.txt file

The format is short and strict. Here's a complete example for a fictional plumbing company, with each part explained.

Anatomy of the file

A complete llms.txt for a local business

# Northside Plumbing

> Licensed plumbers serving Columbus, Ohio and
> nearby suburbs since 2009. Emergency service
> 24/7, upfront flat-rate pricing.

We do not service commercial buildings or
septic systems.

## Services
- [Water heater repair](https://northsideplumbing.com/water-heaters): tank and tankless, same-day
- [Drain cleaning](https://northsideplumbing.com/drains): prices from $149
- [Service area](https://northsideplumbing.com/areas): every suburb we cover

## Optional
- [About us](https://northsideplumbing.com/about): licenses and team
  1. A title. An H1 with the business or site name. It's the only required part.
  2. A one-paragraph summary in a blockquote: who you are, where you work, and what sets you apart.
  3. Extra details in plain paragraphs or lists, without headings. Limits and exclusions are useful here.
  4. Sections of links under H2 headings. Each line is a Markdown link, then a colon and a short note.
  5. An "Optional" section for pages an AI tool can skip when it needs to keep things short.
The business and URLs are invented for illustration. The structure follows the proposal at llmstxt.org.

Notice what the example leaves out. It doesn't list every page, and it doesn't repeat marketing copy. It reads like a well-briefed assistant describing the business in thirty seconds: what it does, where, for whom, at what price, and where to find the details.

Does anyone actually read llms.txt?

This is the question that matters, so here's what's on the record.

  • Google: its guidance on AI features says there are no additional requirements, and no special optimizations needed, to appear in AI Overviews or AI Mode. In June 2025, Google's John Mueller wrote that no AI system was using llms.txt at that point, and he has compared it to the old keywords meta tag.
  • AI assistants: OpenAI, Anthropic and Perplexity document their crawlers and how to control them with robots.txt, but none of them has said that ChatGPT, Claude or Perplexity uses llms.txt to decide which sources to cite.
  • Developer tools: this is where llms.txt is actually used. Many software companies, including Anthropic and Cloudflare, publish one for their documentation, and developers point coding assistants at those files so the assistant reads the docs directly.

You can check your own site, too. Your server or CDN logs show every request for /llms.txt and the bot that made it. That tells you more about your situation than any agency's pitch.

Our take

There's no evidence today that an llms.txt file gets a business recommended more often by AI assistants. It's cheap insurance in case more tools adopt it, and it forces a useful exercise: summarizing your business clearly. Treat it as that, not as a strategy.


Should your business have an llms.txt file?

Quick decision

Where llms.txt fits for your kind of website

Not yet

Fix the basics first

Your site is slow, missing service pages, blocking crawlers, or your business details differ from one directory to the next.

Spend the time on those first

Most businesses

Add a simple one

Your basics are in place. A short, accurate file takes about 30 minutes and gives AI tools a clean summary if they ask for it.

Local services, clinics, firms, agencies

Priority

Invest properly

Developers use AI assistants to work with your product, so a complete llms.txt and a full-text version of your docs pay off directly.

Software, APIs, documentation sites

How to create an llms.txt file in five steps

  1. Write the summary. Two or three sentences: what you do, where, for whom, and one fact that sets you apart, such as years in business, licensing or pricing approach.
  2. Choose 5 to 20 pages. Your main services or products, pricing, service area, contact, and the guides you're proudest of. It's a curated shortlist, not a sitemap.
  3. Write one useful note per link. Facts beat adjectives: "prices from $149" helps an AI answer more than "affordable, high-quality service."
  4. Upload it to your root folder so it opens at yourdomain.com/llms.txt as plain text. Most hosts and website builders let you upload a file there, and some SEO plugins can generate one.
  5. Keep it current. Put it on the same checklist as your prices and opening hours. On our own site, a script rebuilds the file whenever pages change, so it can't fall out of date.

Mistakes to avoid

  • Paying an agency or tool a premium for an llms.txt file. It's a short text file you can write yourself
  • Publishing llms.txt while your robots.txt or firewall blocks the AI crawlers you want to reach
  • Pasting in your whole sitemap. A list of 400 URLs defeats the purpose of a curated summary
  • Letting prices, services or locations go stale. An outdated file can feed wrong facts to the tools that read it
  • Keyword stuffing. The file is read by language models, which handle plain, specific language best
  • Linking to pages that are set to noindex, redirect, or no longer exist

What matters more than llms.txt

If you have an hour to spend on AI visibility, these steps will do more than any text file:

  1. Make sure AI crawlers and search bots can reach your site, at the robots.txt level and at your host or CDN
  2. Give every important question a page with a direct answer near the top. Our guide on how to structure content for AI search shows the format
  3. Keep your business name, address, services and prices identical everywhere they appear, as explained in our post on entity-based SEO
  4. Earn mentions on other trusted sites, since AI assistants lean heavily on what others say about you
  5. Measure what AI sends you. Our guide on tracking AI traffic in GA4 sets that up in ten minutes

Not sure where your site stands with AI search?

Digital Relevance helps U.S. and Canadian businesses get cited and recommended by ChatGPT, Perplexity, Gemini and Google's AI features. Start with a free AI Search Snapshot, a report on whether those assistants mention your business, or see what our AI Search plan covers.

Get My Free AI Search Snapshot

Frequently Asked Questions

What is llms.txt?

llms.txt is a proposed plain-text file, written in Markdown, placed at the root of a website. It gives AI tools and language models a short summary of the site and a curated list of its most useful pages, each with a brief note. It was proposed by Jeremy Howard of Answer.AI in September 2024.

Does Google use llms.txt?

No. Google says there are no additional requirements or special optimizations needed to appear in AI Overviews or AI Mode, and its staff have said Google doesn't use llms.txt. Ranking in Google's AI features depends on the same fundamentals as regular Search.

Does ChatGPT read llms.txt?

OpenAI hasn't said that ChatGPT uses llms.txt to choose sources. ChatGPT search finds pages through OpenAI's own crawler, OAI-SearchBot, and other search providers. llms.txt is mainly used today by developer tools reading software documentation.

What is the difference between llms.txt and robots.txt?

robots.txt is an internet standard that tells crawlers which pages they may visit, and it can block bots that follow it. llms.txt is a proposal that summarizes a site for AI tools. It cannot block or allow anything.

Is llms.txt worth it for a small business?

It's a low-cost nice-to-have, not a priority. Once your site is crawlable, your key pages answer customer questions clearly and your business details are consistent, a short llms.txt file takes about 30 minutes to write. There's no evidence it improves AI recommendations on its own.

llms.txt GEO AEO AI Search Technical SEO ChatGPT robots.txt