llms.txt generator
Build an llms.txt from your sitemap. We fetch your pages' real titles and descriptions, you curate the list, and the file regenerates live — ready to download.
Fetching pages…
File header
Pages
Untick to exclude · “Optional” moves a page to the Optional section
Your llms.txt
What is llms.txt?
llms.txt is a proposed standard (llmstxt.org) for a Markdown file served at the root of your site —
https://yoursite.com/llms.txt — that gives AI assistants a
concise, curated map of your most important pages. Where
robots.txt tells crawlers what they may not read,
llms.txt tells language models what they should read: an H1 with your site name, a
one-line summary, and short sections of links with one-sentence descriptions.
Who actually reads it?
AI tools that browse or ingest the web — Claude, ChatGPT, Perplexity, and a growing list of coding assistants and answer engines — use context windows, not index budgets. When one of them lands on your site, a good llms.txt is the difference between the model reasoning from your best pages and it wandering through your tag archives. Adoption is still early and no vendor guarantees they'll fetch it, but the file costs nothing to serve, and documentation sites (Anthropic, Cloudflare, Stripe among them) already publish one.
Why curate it short?
Because the reader is a model with a finite context window, not a crawler with a database. Dumping all 2,000 URLs of your sitemap into llms.txt defeats the point — the format works best as a curated 20–50 links covering what someone (or something) new to your site should read first. That's why this generator pre-selects the shallowest pages of your sitemap, unticks pages that are noindexed or broken, and gives you an Optional section for secondary material that models can skip when context is tight.
How this generator works
It expands your sitemap, keeps up to 60 of the shallowest URLs, fetches each page's real
<title> and meta description, and groups them by path
section. You untick, mark pages Optional, tweak the name and summary — and the file
regenerates live in the exact llmstxt.org format.
Where do I put the file?
Serve it at /llms.txt on your root domain, as plain text
(Markdown). Re-generate it when your key pages change — or let
siteOS watch your site so you know exactly
when they do.
Your llms.txt goes stale with every page you ship.
siteOS crawls your site on a schedule and knows exactly which pages exist, which are noindexed, and which broke — the same data this generator runs on.