mcpbeat

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP Server

io.github.foomworks/agent-web
answering

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) is answering right now. Last checked 10 min ago. It exposes 5 tools. Last commit 24 Jun 2026.

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Uptime history 40 hours of history
40 hours agonow
100.0%
Uptime 24h
91 of 91 checks
5
Tools
read from the server
112 ms
Response time
average over 24h
0
Stars
last commit 24 Jun 2026

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 10 min ago.

run in your terminal
claude mcp add agent-web --transport http https://agent-web.foomworks.workers.dev/mcp
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}
~/.codex/config.toml
[mcp_servers.agent-web]
url = "https://agent-web.foomworks.workers.dev/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

Available tools 5

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

render
render_pdf
PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
render_preview
Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
render_screenshot
PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
url
read_url
Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.
read_url_preview
Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.

Endpoints

URLTransportStateLatencyChecked
https://agent-web.foomworks.workers.dev/mcp streamable-http answering 139 ms 10 min ago

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) — questions

Answers built from our own checks of this server.

What can agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) do?
It exposes 5 tools, read directly from the server on our last check. Among them: read_url, read_url_preview, render_pdf, render_preview, render_screenshot. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
What is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) mostly used for?
Its tools cluster around render and url. That is what this server is built to work with — the grouping comes from the actual tool names, not from a category we assigned.
Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 112 ms. The bar chart above shows every period we have measured.
How do I connect agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) need an API key?
No. agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 5 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?
It answers our handshake in 112 ms on average, which is faster than 81% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.
Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) open source?
Yes — it is published under the MIT licence and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.