llms.txt runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 9 Oct 2026.
Build llms.txt from local Markdown or a sitemap.xml and check an existing llms.txt file.
Today is the operative word: we check llms.txt every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
Six checks: llms.txt, llms-full.txt, .md twins, Accept: text/markdown, sitemap.md, alt link. Free.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.
Local MCP server for extracting text from PDF files with optional OCR and AI fallback.
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Build and validate IndexNow payloads, check key files, and diff sitemaps into a submission list.
MCP server that reverse-engineers a locked rebuild spec from an existing app.
Answers built from our own checks of this server.