agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP Server

by foomworks Your server? Claim it

answering

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) is answering right now. Last checked 4 min ago. It exposes 5 tools. Last commit 24 Jun 2026.

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Uptime history 47 days of history

47 days agonow

100.0%

Uptime 24h

92 of 92 checks

Tools

read from the server

131 ms

Response time

average over 24h

Stars

last commit 24 Jun 2026

Nothing serious here today

Today is the operative word: we check agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 4 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add agent-web --transport http https://agent-web.foomworks.workers.dev/mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

~/.codex/config.toml

[mcp_servers.agent-web]
url = "https://agent-web.foomworks.workers.dev/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

Available tools 5

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

render

render_pdf

PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

render_preview

Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.

render_screenshot

PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

url

read_url

Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.

read_url_preview

Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.

Endpoints

URL	Transport	State	Latency	Checked
https://agent-web.foomworks.workers.dev/mcp	streamable-http	answering	118 ms	4 min ago

Alternatives to agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

same job, measured the same way

mdapi — HTML to Markdown for AI agents

by fastdb-md

Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.

3 tools answering

Scrapi

by bamchi

Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

35 installs/wk 5 tools answering

Pagewatch

by pagelens

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

57 installs/wk 5 tools answering

Fastcrawl

by fastcrawl

Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.

answering

Markfetch

by adorellc

Any web page as clean Markdown for agents. Hosted, no install. Free tier; Pro adds JS rendering.

1 tools answering

Deep Research MCP Server

by perufitlife

Web search, clean page reading & one-call research dossiers for AI agents. No API key.

38 installs/wk local only

Web Search

by hec-ovi

Keyless multi-engine web search, fetch, and clean-Markdown read for AI agents. No API keys.

198 installs/wk local only

Jina Reader

by pipeworx-io

Jina AI Reader/Search MCP — turn any URL into clean LLM-ready markdown, plus web search.

38 tools answering

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) — questions

Answers built from our own checks of this server.

What can agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) do?

It exposes 5 tools, read directly from the server on our last check. Among them: read_url, read_url_preview, render_pdf, render_preview, render_screenshot. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →

What is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) mostly used for?

Its tools cluster around render and url. That is what this server is built to work with — the grouping comes from the actual tool names, not from a category we assigned.

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 92 of 92 checks got a reply (100.0%), average response time 131 ms. The bar chart above shows every period we have measured.

How do I connect agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.

Does agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) need an API key?

No. agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 5 of them are readable on this page. This is what we observed, not what the docs claim.

How fast is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

It answers our handshake in 131 ms on average, which is faster than 80% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) open source?

Yes — it is published under the MIT licence and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.