llms.txt: what it is, does your site need one, and how to add it

A short file that tells AI assistants what your site is about and where the key pages are. What goes in it, whether ChatGPT and Google actually read it, and how to add one in 15 minutes.

More and more people ask ChatGPT, Claude or Perplexity about businesses instead of Google: "who builds online stores in Kyiv", "how much does website support cost". To answer, the AI assistant opens websites — and sees what a browser sees: menus, banners, scripts, cookie pop-ups. The useful text gets lost in the noise.

The llms.txt file is an attempt to give models a short, clean guide to a site. Here is what it is, what is actually known about its benefits, and how to add one.

What llms.txt is

It is a plain text file in Markdown that sits at the root of your site: https://your-site/llms.txt. The idea was proposed by Jeremy Howard (Answer.AI) in September 2024; the format is described at llmstxt.org.

If robots.txt tells crawlers where they may not go, llms.txt tells a model what matters here: who you are, what you offer and which pages describe it.

What goes inside

The format is very simple. Only the heading is required; the rest is optional, but it is what makes the file useful:

  • Heading (#) — the name of the company or site.
  • Quote (>) — one or two sentences: what you do and for whom.
  • A few paragraphs — contacts, opening hours, key facts.
  • Sections (##) with lists of links: a page and a short note on what is there.
  • An "Optional" section — secondary pages a model can skip when it is short on space.

A minimal example for a small business:

# Oak Furniture Studio

> Custom kitchens and wardrobes made to order. Free measuring and design.

- Phone: +1 (000) 000-0000
- Hours: Mon–Sat 9:00–18:00

## Services

- [Custom kitchens](https://example.com/kitchens): materials, lead times, prices from $1,500
- [Wardrobes](https://example.com/wardrobes): sizes, fittings, examples
- [Prices](https://example.com/prices): what the price is made of

## Optional

- [Privacy policy](https://example.com/privacy)

Sites often add llms-full.txt as well — the same file, but with the full text of the pages, so a model does not have to fetch each one. This variant is not part of the proposal itself; it is a convention that grew up in practice.

Does it actually work?

The honest answer: partly, for now. llms.txt is still a proposal, not a standard, and the big companies have not confirmed they use it:

  • Google has said publicly that its search does not read the file and it does not affect rankings;
  • OpenAI and Anthropic, in their guidance for site owners, talk about robots.txt, not llms.txt;
  • server log studies show AI bots request llms.txt far less often than robots.txt, and most of these files are never opened at all.

Where it already helps is when an AI tool reads a site on someone's behalf: a browser agent, an assistant given a link, developer tools that pull in documentation. For them, a short file with a description and links is the easiest way to understand a site.

So llms.txt will not bring you traffic tomorrow. But it costs next to nothing, breaks nothing, and will be ready if AI search starts relying on it.

Why I added it to my own site

My llms.txt and llms-full.txt are not written by hand — the site builds them from the same texts as its pages: services, prices, projects, tools and blog posts. When I change a text in the admin, the file updates. That way it never drifts away from the site, which is the most common problem with hand-made files.

How to add llms.txt to your site

  1. Write a description. Your name, one or two sentences about what you do and for whom, and contacts. Write it as if explaining to a new colleague — no slogans.
  2. Pick 5–15 key pages. Services, prices, contacts, a few of your best projects or articles. Add one line to each: what a visitor will find there.
  3. Put the file at the root of your site as /llms.txt, in UTF-8. On most hosting plans it is enough to upload it next to robots.txt.
  4. Check that it opens at https://your-site/llms.txt as text, not as an error page or HTML.
  5. Keep it up to date along with the site. If your site runs on a CMS, it is better to have the file generated automatically.

Common mistakes: old prices, links to pages that no longer exist, a copy of the whole site instead of a short description, and marketing copy instead of facts.

Check your site

My free AI agent check looks for llms.txt and llms-full.txt on your site, checks whether AI bots are blocked in robots.txt, and shows what else to add so an AI agent can find and use your site. If the file is missing, it gives you a ready-made template.

Want llms.txt on your site to be built automatically from your page content? Get in touch — I will suggest how to do it on your CMS.

Need help with your website?

Have a task like the one I wrote about? Tell me about it and I will estimate it and suggest a solution.

Assistant
Online now