llms.txt in 2026: Does It Actually Do Anything?
By David Sessford · 7 Jul 2026 · 9 min read
- llms.txt is a curated markdown menu of your best content for AI models. It lives at yoursite.com/llms.txt.
- It is not a ranking hack. In one study of 500M+ AI bot visits, only 408 hit llms.txt, and analysis of 94,000+ cited URLs found no citation uplift.
- Google has said it does not use llms.txt. Most big AI crawlers read your HTML instead.
- Where it earns its keep is the agent web: IDE tools, MCP servers and doc bots fetch it, and adoption is up roughly 5.4x year on year.
- Ship one in 30 minutes for near zero cost, then put your real effort into schema, technical SEO and authority that actually get you cited.
Every SEO "expert" on your feed is telling you to add an llms.txt file right now or get left behind. Most of them cannot tell you what it does. They read one thread, copied the take, and passed it off as strategy. That is exactly the lazy behaviour we call out around here. So let me give you the version nobody selling a course will: the truth, backed by real numbers.
What llms.txt actually is
llms.txt is a plain markdown file you drop at the root of your site, at yoursite.com/llms.txt. It was proposed in September 2024 by Australian technologist Jeremy Howard. The idea is simple. Big language models have small context windows and hate wading through your bloated HTML, your cookie banners, your nav, your ad slots and your JavaScript. So you hand them a clean, flattened map of your best content instead.
Think of it as a menu for machines. robots.txt tells crawlers where they are not allowed to go. A sitemap lists every URL. llms.txt is different: it curates. You point the model at the pages that matter, often with a one-line summary next to each, sometimes with the full text flattened into a single file (that variant is usually called llms-full.txt).
That is it. No magic. A text file. And yes, we practise what we preach. The KillerEdge has one live at thekilleredge.com/llms.txt right now. Go read it.
Why everyone suddenly cares
AI search is eating the click. People ask ChatGPT, Gemini, Perplexity and Google AI Mode a question and get an answer without visiting ten blue links. If the machine never quotes you, you do not exist. That fear is real and it is justified. We wrote the full survival plan in our AEO playbook and broke down the mindset shift in AEO vs SEO.
So along comes a 30-minute text file that promises to make you AI-friendly. Of course the internet lost its mind. It is cheap, it feels proactive, and it is easy to sell. The problem is that "easy to sell" and "actually works" are not the same thing. Let us look at what the data says.
The uncomfortable truth: does llms.txt move rankings?
Here is where most guides go quiet, because the honest answer hurts the sales pitch. As of 2026, the major AI crawlers are barely touching these files.
One study monitored over 500 million AI bot visits across a 90-day window. Out of all of that traffic, only 408 requests targeted llms.txt directly. That is a rounding error. GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot and Google-Extended overwhelmingly skip the file and crawl your HTML like they always have.
ALLMO analysed more than 94,000 cited URLs across AI answers and found no measurable citation uplift tied to having an llms.txt. Search Engine Land reported that 8 out of 9 sites saw no measurable traffic change after adding one. Google has publicly said it does not use llms.txt. Read that again. The biggest player in AI search does not use it.
So if a guru is telling you llms.txt is a ranking hack that gets you into ChatGPT answers, they are lying to you or they never checked. Bin that advice.
| Claim you have been sold | What the 2026 data actually shows |
|---|---|
| AI crawlers prioritise your llms.txt | Out of 500M+ AI bot visits in one 90-day study, only 408 hit llms.txt. Crawlers read your HTML instead. |
| It boosts your citations in AI answers | Analysis of 94,000+ cited URLs found no measurable citation uplift. |
| Adding it lifts traffic | 8 of 9 tested sites saw no measurable traffic change. |
| Google reads it | Google has said it does not use llms.txt. |
| Everyone has one, so you are behind | Roughly 5.6% of the top 10,000 sites had a valid file by June 2026. Most of the web has not bothered. |
Then why does the smart money still ship one?
Because the ranking pitch is the wrong pitch. llms.txt is not an SEO play. It is a Business-to-Agent play. And that is a different, quieter, faster-growing game.
Here is who fetches these files constantly right now: IDE coding agents, MCP servers, documentation bots and the wider agentic stack. When a developer points an AI agent at your docs, or when someone builds an assistant that routes on your product info, a clean llms.txt is the machine-readable front door. That layer is small today but growing fast, and the cost to serve it is basically zero.
Adoption backs this up. Casey Burridge tracked valid llms.txt files rising from 1.04% of the top 10,000 sites in July 2025 to 5.61% by June 2026. That is roughly 5.4x growth in a year. SE Ranking's survey of 300,000 domains put adoption higher, around 10%. Rankability clocked 8.7% of the top 1,000 in June 2026. The direction is up and to the right, even while the ranking benefit stays at zero.
Translation: nobody is getting rich off llms.txt today, but the people building for the agent web are planting a flag early for almost no cost. That is a smart, cheap hedge. It is not a growth lever. Know the difference so you spend your real effort where the leads are.
How to build an llms.txt in 30 minutes
You do not need a developer or a tool subscription. Here is the whole job.
Step 1: List your money pages
Pick the 15 to 40 URLs that actually matter. Your core service pages, your best guides, your about and contact. Not every tag archive and thin blog post. Curate like you mean it.
Step 2: Write the file in markdown
Start with an H1 of your brand name, then a blockquote summary of what you do, then grouped lists of links with a short description after each. Format looks like this:
# Your Brand
> One line on who you are and what you sell.
## Core pages
- [Service name](https://yoursite.com/service/): what it is and who it helps.
- [Guide title](https://yoursite.com/guide/): the promise of the page.
Step 3: Save it as llms.txt at your root
Upload it to yoursite.com/llms.txt. On WordPress a plugin can generate and host it for you. On any other stack it is a static file in your web root.
Step 4: Decide if you want llms-full.txt too
The "full" version flattens your entire site content into one file. It is genuinely handy, though often more for your own analysis (entity research, content gaps, competitor teardowns) than for ranking. Optional.
Step 5: Do not stop there
This is the bit the gurus skip. llms.txt is table stakes, not a strategy. The stuff that actually gets you quoted by AI is clean HTML, real schema markup, genuine authority and content that answers the question better than anyone. Get your schema markup right and fix your technical SEO first. Those move the needle. The text file is the easy 5%.
llms.txt vs robots.txt vs sitemap vs schema
People mix these up constantly. They do different jobs. Here is the clean version.
| File | What it does | Do the big AI engines act on it? |
|---|---|---|
| robots.txt | Tells crawlers where they may not go. Access control. | Mostly yes, when they choose to obey it. |
| XML sitemap | Lists every URL you want indexed. Discovery. | Yes, established standard. |
| Schema markup | Labels your content so machines understand entities and facts. | Yes, and it genuinely helps AI understanding. |
| llms.txt | Curates a clean menu of your best content for language models. | Not really, not in 2026. Agents and dev tools use it, big search AI mostly ignores it. |
Notice which row has the weakest "yes". That tells you where to put your energy.
Cost and time in plain numbers
DIY: about 30 to 60 minutes of your time and $0. A text file costs nothing to host.
Tool-assisted: many generators do small sites free. Custom or larger builds through paid generators tend to run in the $0 to $200 (USD) range as a one-off, and often you are paying for convenience you do not need.
Ongoing: near zero, but you should refresh it when your key pages change so you are not pointing agents at dead URLs.
Who should bother and who should not
Bother if you run documentation, a developer tool, an API, a SaaS product, or anything an AI agent might reasonably need to route on. For you this is a genuine, if early, front door. Bother also if you simply want the "full" flattened file for your own content analysis. It is a nice free byproduct.
Do not lose sleep over it if you run a local service business or a standard content site and you are hoping it lifts you in ChatGPT answers. It will not, not today. Your time is better spent on the fundamentals that do work. If you want that done properly without guesswork, that is exactly what our SEO service and Done For You partnership handle.
Mistakes people make
Treating it as a ranking hack. It is not. Believing it replaces robots.txt. It does not, and stuffing robots-style Disallow directives in there does nothing. Dumping your entire link graph in with no summaries, so it reads like a spam sitemap. Stuffing it with keywords like it is 2009, which fools nobody. And the biggest one: shipping the file, ticking the box, and then never doing the real AEO work that actually gets you cited. The file is the warm-up. The real playbook is the fight.
The 2026 view, straight
llms.txt is a cheap, sensible thing to have. It is not a growth lever and anyone selling it as one is either behind or bluffing. Adoption is climbing, the agent web that actually consumes it is growing, and the downside of shipping one is close to nothing. So do it, in 30 minutes, then forget about it and go win at the things that move leads: authority, schema, clean tech, and content that beats the competition on the actual question.
Strike first on the fundamentals. The text file is a jab. It is not the knockout.
What a good llms.txt actually looks like
Since we run one, let me show you the thinking instead of hand-waving. Our file opens with the brand name, a one-line blockquote on what The KillerEdge is, then it groups links into clear buckets: the platform, the blog, resources and about. Every link gets a short human sentence after it so a model knows exactly what the page delivers before it fetches anything.
That is the whole trick. Clarity over volume. A machine reading our file learns in seconds that we run training, a backlink vault, a done-for-you partnership and a tool arsenal, all on one $67/mo membership, based in the UK. No guessing, no scraping through a bloated homepage. If you strip your file down to that level of signal, you have done it right. If you dump 400 URLs with no context, you have built a worse sitemap.
Will the big AI engines ever actually use it?
Maybe. Probably in a limited way. Here is the honest forecast, not the hype.
The strongest argument against llms.txt ever mattering for search is that the line between a search engine and an AI model has basically dissolved. Google is a search engine with an AI bolted on. ChatGPT is an AI with a search engine bolted on. Both already crawl the open web brilliantly. They do not need you to hand them a menu, because they are perfectly capable of reading the full restaurant. Sitemaps, robots.txt and schema already tell them what they need. That is why plenty of respected voices think llms.txt is redundant for search, and on the search side they have a point.
The strongest argument for it is the agent web, and that argument is getting louder every month. As more work gets handed to autonomous agents that fetch a specific, trusted, machine-readable surface rather than crawling and guessing, a curated llms.txt becomes a genuinely useful contract between your brand and those agents. That is not a search-ranking story. It is an infrastructure story. And infrastructure bets that cost 30 minutes are the kind you take.
So the realistic 2026-into-2027 view: do not expect the big consumer AI search engines to suddenly reward your llms.txt with rankings. Do expect the agentic layer to keep leaning on it. Ship one on that basis and you are covered either way.
How llms.txt fits your wider AI search plan
Let me put it in its place so you spend your effort in the right order. llms.txt is step zero. It is the cheap, do-it-once box you tick. Above it sits the work that actually gets you found and quoted.
First, get your technical SEO clean so machines can read you at all. Second, add proper schema markup so they understand your entities and facts. Third, build real authority and links so you are a source worth quoting, which is the whole game we cover in the link building track. Fourth, write content that answers the question better and more completely than whatever currently ranks. Do those four and you will get cited by AI whether or not you ever touch an llms.txt. Skip them and no text file on earth will save you.
That is the difference between people who play SEO like a checklist and people who play to win. Be the second kind.
Stop guessing at AI search. The Dojo gives you the exact AEO, SEO and link-building playbooks we use to get sites ranked and quoted, plus the tools in The Armory to do it. Join The Dojo. $67/mo.
Frequently asked questions
Does llms.txt help my SEO or AI rankings?
Not in any measurable way as of 2026. Studies of AI bot traffic and cited URLs found no ranking or citation uplift from having one. Treat it as a cheap hedge for the agent web, not a growth lever.
Does Google use llms.txt?
No. Google has publicly said it does not use llms.txt. It relies on your normal HTML, sitemaps and its existing systems.
What is the difference between llms.txt and llms-full.txt?
llms.txt is a curated list of key pages with short summaries. llms-full.txt flattens your entire site content into one file. The full version is often more useful for your own content analysis than for AI ranking.
Is llms.txt the same as robots.txt?
No. robots.txt controls where crawlers may go. llms.txt curates a menu of content for language models. robots-style Disallow directives do not belong in llms.txt and do nothing there.
How long does it take to create an llms.txt file?
About 30 to 60 minutes by hand, at no cost. You list your key URLs, write short summaries in markdown, and save the file at your site root.
Should a local business bother with llms.txt?
If you are hoping it lifts you in AI answers, no, it will not. Your time is better spent on schema, reviews, citations and content. If an AI agent might need to route on your info, it is a cheap thing to have.
Do AI crawlers actually read llms.txt?
The big search AI crawlers mostly do not. Coding agents, MCP servers and documentation tools do fetch it, and that layer is growing, which is the real reason to ship one.
David Sessford. Founder of The KillerEdge, 14+ years in SEO & online marketing More about the founders →
Sources
- Search Engine Land: Meet llms.txt, a proposed standard
- Casey Burridge: State of llms.txt adoption
- ALLMO: llms.txt for AI Search Report 2026
- Rankability: llms.txt adoption data (June 2026)
- SE Ranking: Why brands rely on llms.txt and why it does not work
Grab the free AI-Search Cheat Sheet
The exact moves to make ChatGPT, Gemini and Google AI name-drop YOU. Plus the weekly intel. Free.
Instant download. No spam. Quit anytime.
Want it done for you?
Learn it in The Dojo, or have us run it. Either way, you win.
Join The Dojo. $67/mo → ← Back to the blog