Free toolsNext post
Field Guide

llms.txt Generator: A Clean File, Not a Site Scan

llms.txt is an emerging standard — a short, plain-text file at your site root that hands AI assistants a curated map of your site: a sentence about who you are, and a shortlist of the pages worth reading. This tool builds that file. It's a simple tool, and I'm going to be straight about that, because the honest version is more useful than dressing it up.

What this tool actually does

It's a formatter, and it runs entirely in your browser. You fill in a handful of plain fields — your site name, a one-line summary, an optional "about" paragraph, your key pages as Title :: URL :: note, and an optional contact line. As you type, it assembles a clean, correctly structured Markdown file: an H1 for your name, a blockquote summary, an "About" section, a "Key pages" list with each page linked and annotated, and a "Contact" section. Then it gives you a copy button and a one-click llms.txt download.

That's the whole job. It turns the right inputs into a valid, well-formed file you can upload to yoursite.com/llms.txt.

The thing that makes it different: it does not scan your site

Most tools in this space try to crawl your site and auto-generate the file. That sounds smarter. In practice it produces a bloated, generic file — every page dumped in, no curation, no judgement about what actually matters. The entire value of llms.txt is that it's a hand-picked shortlist, not an exhaustive dump. An auto-crawler defeats the point.

So this tool deliberately doesn't crawl. It asks you which pages you'd want an AI to quote when describing your business, because you're the one who knows. The result is the file an AI actually benefits from: short, specific, curated. That's a design choice, not a missing feature.

It also means there's no rate limit, no server round-trip, and nothing about your site is sent anywhere — the file is built locally as you type.

Where llms.txt sits next to robots.txt and your sitemap

These three files do different jobs, and llms.txt is the newest:

  • robots.txt tells crawlers which paths they may visit.
  • Your sitemap lists every page so search engines can find them all — exhaustive by design.
  • llms.txt is the opposite of exhaustive. It's a curated brief written in plain language for AI assistants: "here's who we are, and here are the few pages that matter most."

It sits alongside the other two. It doesn't replace either.

The honesty: will AI even read it?

I won't oversell this. llms.txt is an emerging standard, and no AI assistant is required to read it yet. Adoption is growing, and it costs nothing to add — think of it as leaving a clear, accurate note at your front door. The visitors who read it get a far better picture of you; the ones who don't lose nothing. That's the honest framing, and it's the one on the tool page too.

What the file genuinely buys you, today, is control over your own summary. When an AI does consult it, you've handed it your wording and your shortlist instead of letting it guess from whatever scattered pages it happens to find.

What it does not do

  • It does not check whether AI can reach or read your site. A perfect llms.txt is useless if your robots.txt blocks the crawlers or your content only loads with JavaScript. Those are separate checks (the AI Crawler Checker and How AI Reads Your Page cover them).
  • It does not validate your pages or your URLs. It formats what you type. If you list a broken link, it'll format the broken link.
  • It does not guarantee adoption. See above — the standard is young.

What you'll see when you run it

A live preview that updates as you type. Fill in "Acme Co", a one-line summary, and three key pages, and the output box immediately shows a tidy Markdown file with your name as the heading, your summary as a quote, and your pages as an annotated list. Copy it, or download llms.txt. The whole thing takes a couple of minutes, and the only mildly technical step is uploading the file to your site root — if you can open yoursite.com/llms.txt in a browser afterwards, it's in the right place.

A good file is short and specific: a summary you'd be happy to see quoted word-for-word, and five to ten strong pages. A weak file is vague ("we provide quality solutions") or bloated with fifty pages that bury the few that count.

Who should run this

Any business that wants a quiet edge while most sites haven't bothered yet — it costs nothing and takes minutes. Especially worth doing if you've got a clear sense of your handful of best pages and want AI assistants pointing people there, not at an outdated or off-topic page.

Build your llms.txt — fill the fields, copy the file, upload it. The file is step one; if you want to confirm AI can actually reach and read those pages in the first place, run the full AUDXY audit.

Run the llms txt generator on your own page —Open the tool →