Create an llms.txt file that gives AI assistants and LLM-based tools a clean, curated map of your site. Write a short summary, group your key pages into sections, or import them straight from your sitemap.
Last updated:
1. Site overview
Import links from sitemap.xml, a URL list or an existing llms.txt
2. Sections of links
Advertisement
Advertisement
How to use the LLMs.txt Generator
Enter your site name and summary: one or two sentences that tell a language model what the site or project is.
Add sections such as Docs, Guides or Products, each with links, short titles and an optional description after the colon.
Import from your sitemap to save time: paste sitemap.xml or a list of URLs, set exclusions, and links are grouped by folder.
Trim and edit: keep the most useful pages and move nice-to-have links into the Optional section.
Download llms.txt and upload it to the root of your site so it loads at https://example.com/llms.txt.
llms.txt structure
The llms.txt proposal defines a small Markdown file served at /llms.txt. Its parts must appear in this order:
Part
Markdown
Required
Purpose
Name
# Acme Analytics
Yes
The site or project name, as a single H1
Summary
> Privacy-friendly web analytics…
No
A short blockquote with the key information needed to understand the rest of the file
Details
Paragraphs or lists
No
Extra context, terminology or guidance; no headings
Sections
## Docs
No
H2 headings, each followed by a list of links
Links
- [Quickstart](https://…): notes
No
A Markdown link, optionally followed by a colon and a short description
Optional section
## Optional
No
Secondary links that tools may skip when they need a shorter context
Example llms.txt
# Acme Analytics
> Acme Analytics is a privacy-friendly web analytics platform.
## Docs
- [Quickstart](https://example.com/docs/quickstart): Add the script and see your first visit
- [REST API](https://example.com/docs/api): Endpoints, authentication and rate limits
## Optional
- [Changelog](https://example.com/changelog)
Tips for a useful llms.txt
Curate, don't dump. A sitemap lists every URL; llms.txt should list the pages that best explain your product, docs and policies. A few dozen well-described links beat hundreds of bare ones.
Write descriptions for people and models. A short note after each link (what the page covers, who it is for) helps a model choose which page to read.
Use absolute URLs and link to pages that render cleanly without JavaScript. Some sites also publish Markdown versions of pages (for example page.md) and link to those.
Keep it current. Regenerate the file when you add or remove important pages, just like your sitemap.
Related files. Some sites also publish llms-full.txt with the full text of their docs in one file. That is a separate, optional convention.
Frequently asked questions
What is llms.txt?
llms.txt is a proposed standard (published at llmstxt.org in 2024) for a Markdown file at /llms.txt that gives large language models a concise overview of a website and links to its most useful pages, so AI tools can find clean content without parsing complex HTML.
What is the format of llms.txt?
It is Markdown in a fixed order: an H1 with the site or project name (the only required part), a blockquote with a short summary, optional paragraphs of details, then H2 sections that each contain a list of links written as - [Title](URL): optional notes.
What is the Optional section?
A section titled exactly Optional has a special meaning in the proposal: its links are secondary and can be skipped when an AI tool needs a shorter context.
Is llms.txt the same as robots.txt?
No. robots.txt tells crawlers what they may or may not access. llms.txt does not grant or block access; it is a curated guide to your content. Use robots.txt if you want to block AI crawlers.
Do search engines or AI companies use llms.txt?
Adoption is voluntary and still evolving. Many documentation sites and developer tools publish one, and some AI coding assistants and agents read it, but no major search engine has said it uses llms.txt for ranking.
Should I list every page from my sitemap?
No. llms.txt works best as a curated index. Include the pages that explain what you do, your key docs or guides and reference material, and leave out tag pages, pagination and thin pages.
Is anything uploaded?
No. Your sitemap and file are processed in your browser and the draft is only saved in this browser's local storage.
Are all the tools on FreeToolCabin tested for quality and accuracy?
Yes! Every tool on our site undergoes automated Q/A testing in real browser environments to ensure high precision, correct output, and zero errors. If you happen to spot a bug or have a suggestion, please contact us at [email protected] and our team will review it right away.