AI-powered
An llms.txt generator that checks whether AI assistants can read a site and writes an llms.txt file from its own pages.
AvailableReady to use.
Open the tool| Check | Found | Result |
|---|---|---|
| GPTBot | Allowed | OK |
| ClaudeBot | Disallow: / | Blocked |
| llms.txt | Not found | Missing |
| Pages in new file | 24 | Ready |
AI only shortens your own titles and descriptions into summaries. Every link in the file comes from your sitemap.
Which AI crawlers robots.txt allows or blocks.
Whether the file exists and follows the format.
Titles and descriptions are read from the sitemap's pages.
A ready llms.txt, with short summaries from your own pages.
llms.txt is a short text file at the root of a site, like robots.txt, that lists the site's key pages with a one line summary of each, in plain language. AI assistants and their crawlers can read it to understand what a site offers and which pages answer which questions.
It is a young format. It doesn't replace good pages, but it gives AI tools a clean map of a site.
First it checks access: which AI crawlers your robots.txt allows or blocks, and whether you already have an llms.txt. Then it reads your sitemap and the titles and descriptions of your key pages, and writes a file in the expected format, ready to copy to your site.
They favour pages they are allowed to read, that answer a question clearly near the top, and that carry clear facts such as names, prices, dates and steps. Structured data and a clean heading outline help them find those facts.
Search is no longer only ten blue links. Checking AI crawler access and llms.txt sits next to the usual SEO checks in Website Audit, and Change Monitor warns you if a release blocks AI crawlers by mistake.
A short text file at the root of a site that lists its key pages in plain language, so AI assistants can find and understand them.
There is no proof of that so far. It is meant for AI assistants, not as a ranking signal.
No. AI only shortens your own titles and descriptions. Every link in the file comes from your sitemap.
If you want AI assistants to quote and link to your pages, yes. If not, block them in robots.txt. The checker shows what your file says today.