AgentDiet Automated /llms.txt & Agent Documentation Context Compiler is answering right now. Last checked 13 min ago. It exposes 2 tools. Last commit 17 Oct 2026.
Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and J.
Today is the operative word: we check AgentDiet Automated /llms.txt & Agent Documentation Context Compiler every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 13 min ago.
claude mcp add llms-generator --transport http https://llms-generator.agentdiet.dev/mcp
https://llms-generator.agentdiet.dev/mcp
[mcp_servers.llms-generator]
url = "https://llms-generator.agentdiet.dev/mcp"
{
"mcpServers": {
"llms-generator": {
"url": "https://llms-generator.agentdiet.dev/mcp"
}
}
}
{
"servers": {
"llms-generator": {
"type": "http",
"url": "https://llms-generator.agentdiet.dev/mcp"
}
}
}
Read directly from the server with tools/list, grouped by what they act on.
If a tool disappears, we record the date.
get_agent_wallet_status
generate_site_llms_txt
| URL | Transport | State | Latency | Checked |
|---|---|---|---|---|
| https://llms-generator.agentdiet.dev/mcp | streamable-http | answering | 341 ms | 13 min ago |
Crawls any website and generates a standards-compliant /llms.txt file and JSON-LD schema bundle.
Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.
Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.
Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.
Crawl documentation sites into local corpora agents can search, read, and diff fully offline.
Audits AI-crawler access, structured data and llms.txt on a site, and drafts the fixes.
Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation.
Answers built from our own checks of this server.