Best llms.txt generator tools in 2026.
Eight tools can produce an llms.txt file. Most are one-off web forms, a docs-platform switch, or a scrape API. The useful question is not “which is number one” but which matches the job: one website you own, docs you already host, or a pipeline that must mint files at scale.
TL;DR
Pick by the job, not by the loudest claim.
- Website you own. Use llmstxtgenerator.co if you want discovery, a complete file, and a hosted URL that can stay current. The free preview is 5 URLs on purpose.
- Docs already on Mintlify. Turn nothing extra on. The platform can emit llms.txt with the docs.
- Code pipeline. Context.dev or Apify. You assemble the Markdown. There is no dashboard to babysit a single marketing site.
- Tiny one-off. llmstxtgen.com (20 pages, free) or llmstxtgenerate.com if you also want a validator. Firecrawl’s old generator is deprecated.
What the file is
A curated map, not a second sitemap.
llms.txt is a small Markdown file proposed by Jeremy Howard at llmstxt.org. It orients agents at inference time: site name, short summary, then H2 lists of useful links. It is not robots.txt, not sitemap.xml, and not a Google ranking factor. Generators that dump every URL or promise citations are solving the wrong problem. For the format itself, see the specification guide. For the steps to publish, see how to create llms.txt.
At a glance
llms.txt generator comparison.
| Tool | Best for | API | Free tier | Output | Watch-out |
|---|---|---|---|---|---|
| llmstxtgenerator.co | Live websites that should keep /llms.txt current | No public crawl API | Preview of first 5 URLs | llms.txt | One-time $9 / $19 / $29 by page count |
| Mintlify | Hosted documentation sites | Via the docs platform | Hobby tier | llms.txt, llms-full.txt | Only for content Mintlify hosts |
| Context.dev | Developers generating files in code | Yes | Usage-based free tier | You assemble llms.txt from markdown | Not a no-code website product |
| llmstxtgenerate.com | One-off files plus a format check | No | Titles and short descriptions | llms.txt, paid llms-full.txt | One URL at a time; $1 for full content |
| llmstxtgen.com | Marketing sites under 20 pages | No | Yes, 20-page cap | llms.txt, llms-full.txt | 20 pages; titles and descriptions only |
| LLMrefs | Marketing teams in a citation suite | No public generator API | Generator with no card | llms.txt | Page-count cap is not clearly stated |
| Apify llmstxt-generator | Teams already running Apify Actors | Yes (Actor) | Apify free tier | llms.txt | Memory cap can slow large crawls |
| Firecrawl llms.txt generator | Historical reference only | Unmaintained hosted path | Was no-key for basic use | llms.txt, llms-full.txt | Deprecated June 2025 |
How we ranked them
Four checks that actually matter.
We did not score “AI readiness.” We asked whether a site owner or a developer can leave with a file that matches llmstxt.org, knows the page cap before paying, and can keep the public URL honest.
Job fit
A form, a docs host, a hosted website file, or an API. Mixing those audiences produces bad advice.
Spec honesty
Required H1, useful summary, curated H2 lists. Full-site dumps and fake ranking promises lose points.
Scale and caps
Named page limits beat vague “deep crawls.” Deprecated tools are called deprecated.
What happens after download
Who hosts /llms.txt, who updates it, and whether a preview is labeled incomplete.
The tools
Best llms.txt generators, one by one.
Our pick for website owners
llmstxtgenerator.co
Best for website owners who need a hosted file
This is the tool we run. Enter a website, we discover pages from sitemaps and public links, write a business-aware Markdown file, and — after you unlock the full site — host it at a public URL that can refresh about every 24 hours. The job is a publishable llms.txt for a site you own, not a scrape API for thousands of domains.
What it does well
- Sitemap and nested-index discovery
- AI summaries in the site’s own context
- Hosted public URL after unlock
- Daily update attempts on paid projects
Limits
- The free preview is the first 5 URLs, marked incomplete on purpose. Do not publish it as /llms.txt.
- No public API for bulk generation across many unrelated domains.
- We generate llms.txt, not an unofficial llms-full.txt dump.
Pricing. Free 5-URL preview. Unlock is $9 (up to 200 pages), $19 (201–500), or $29 (501+), one time. Daily updates are included.
Mintlify
Best if your docs already live there
Mintlify is a documentation host, not a general website crawler. Every project it publishes can get llms.txt and llms-full.txt with no extra config, kept in sync as docs change. That is the right answer if Anthropic-style developer docs are already on Mintlify. It is the wrong answer if you need a file for an arbitrary marketing site.
What it does well
- Zero-config files on deploy
- Stays synced with the docs
- Used by large developer-doc sites
Limits
- You cannot point it at a random URL.
- Little control over what the LLM endpoints include or exclude.
- No useful view of how agents actually fetch the file.
Pricing. Hobby is free for basic docs hosting. Pro is a monthly platform fee, not a per-file charge.
Context.dev
Best for API-first pipelines
Context.dev sells crawl-and-markdown APIs. You call an endpoint, get clean page text, and write the H1, summary, and link lists yourself. That is the correct shape for an internal pipeline that must refresh hundreds of domains. It is more machinery than a shop, agency, or product site needs to publish one file.
What it does well
- Programmatic crawl and markdown
- Fits scheduled jobs and agents
- You own the final file format
Limits
- You write the assembly code.
- No hosted /llms.txt for a non-technical site owner.
- A web form on the same site exists for one-off files; the API is the product.
Pricing. Pay for crawl and extraction usage. Check context.dev for current rates.
llmstxtgenerate.com
Best free form with a validator
A browser form that accepts a sitemap, a website, or a pasted URL list. The free result is titles, links, and short descriptions. A small Stripe payment unlocks longer per-page text. The bundled validator is the real differentiator: it scores structure and broken links. Use it when you already have a file and want a second opinion. Use a hosted generator when you need the live URL to stay current.
What it does well
- Three input methods
- Validator with a readiness score
- WordPress, Shopify, and Next.js publish notes
Limits
- No API or bulk runs
- Full content is a separate $1 unlock
- You still have to host the file yourself
Pricing. Free generation of the short file. About $1 for fuller page text, with published page caps.
llmstxtgen.com
Best no-signup tool for tiny sites
Fast, no account, groups pages into headings instead of one flat list. Honest about impact: llms.txt is hygiene, not a traffic lever. Past 20 URLs you need a paid crawler or a hosted generator. The crawl does not pull full body text.
What it does well
- No signup
- Sectioned output
- Both condensed and fuller files
Limits
- Hard 20-page ceiling
- No API
- No hosted refresh URL
Pricing. Free.
LLMrefs
Best if you already track AI citations
The generator is a side door into a product that watches brand mentions across ChatGPT, Perplexity, Gemini, and Claude. Editable AI summaries are useful as drafts. Transparency on crawl depth is weaker than tools that name their page cap before you start.
What it does well
- Editable per-page summaries
- Sits next to citation monitoring
- No card for the generator
Limits
- Unclear crawl depth
- Overkill if you only need a file
- Citation claims are hard to verify independently
Pricing. Generator is free to try. The wider platform is a marketing subscription.
Apify llmstxt-generator
Best inside an existing Apify stack
An open-source Actor on Apify’s Website Content Crawler. You set maxCrawlDepth, get a file in the run’s Key-Value Store, and wire it into the same jobs you already schedule. If you do not use Apify, the platform overhead is the product.
What it does well
- Open-source Actor
- Configurable crawl depth
- Fits existing Apify workflows
Limits
- Awkward if you are not on Apify
- 4 GB memory cap on common free-tier settings
- You host and refresh the file yourself
Pricing. Apify pay-per-use. No stable per-file price independent of compute.
Firecrawl llms.txt generator
Deprecated — do not start here
Firecrawl’s standalone generator was a popular no-key URL in 2024. The team deprecated it in June 2025 and points people at core scrape endpoints and an example script. Do not build a publishing workflow on an unmaintained demo. If you still want Firecrawl, use its current scrape API and assemble the file yourself.
What it does well
- Once offered no-key access
- JavaScript rendering via Firecrawl
- Two-file output when it ran
Limits
- Deprecated, no maintenance
- Minutes of latency when it was live
- Not a hosted /llms.txt product
Pricing. The old generator had no documented paid tiers. Current Firecrawl usage is billed on its main API.
A simple rule
If you own the website, host the file.
Download-and-forget generators go stale the week you ship a new product page. Docs platforms solve this only for the docs they host. An API solves it if you already run a crawler. For a public company or product site, the file should live at a stable URL, stay complete, and update when the site changes. That is the product we built. The preview is a sample. Unlock the rest before you publish.
Generate llms.txt from your websiteCommon questions
Questions about llms.txt generators.
What is the best llms.txt generator in 2026?
It depends on the job. Website owners who want a hosted, maintainable file from a live site should start with llmstxtgenerator.co. Teams already on Mintlify get files for free with their docs. Developers assembling files inside a crawl pipeline should look at Context.dev or Apify. A five-page brochure site can use a free form.
Is there a fully free llms.txt generator?
Yes, with caps. llmstxtgen.com crawls up to 20 pages with no signup. Our generator previews the first 5 URLs for free. Mintlify includes generation if you already host docs there. Complete files for large sites are almost never free, and they should not be: a full crawl has a real cost.
Do I need llms-full.txt as well?
No. llms-full.txt is an unofficial companion some platforms emit. The official proposal at llmstxt.org defines llms.txt. Start with a concise curated file. Add a fuller dump only if your readers already expect one.
Will a generator increase AI citations or Google rankings?
No public evidence shows that. Treat the file as cheap hygiene for agents that already fetch documentation, not as a ranking lever. Tools that promise overnight citations are selling the wrong outcome.
Can I point a generator at any website?
Crawl-based tools can. Mintlify cannot: it only emits files for docs it already hosts. Firecrawl’s old hosted generator is deprecated. Always check that the live /llms.txt URL returns text, not an HTML 404 page.
Keep exploring
More useful llms.txt resources.
Move from the format to implementation, examples, and a live check without losing the thread.