agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) MCP Server

by foomworks Your server? Claim it

answering

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) is answering right now. Last checked 3 min ago. It exposes 5 tools. Last commit 24 Jun 2026.

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Uptime history 91 days of history · worst day 91%

91 days agonow

100.0%

Uptime 24h

92 of 92 checks

Tools

read from the server

124 ms

Response time

average over 24h

Stars

last commit 24 Jun 2026

Nothing serious here today

Today is the operative word: we check agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 3 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add agent-web --transport http https://agent-web.foomworks.workers.dev/mcp

Settings → Connectors → Add custom connector, then paste this address

https://agent-web.foomworks.workers.dev/mcp

~/.codex/config.toml

[mcp_servers.agent-web]
url = "https://agent-web.foomworks.workers.dev/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "agent-web": {
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "agent-web": {
      "type": "http",
      "url": "https://agent-web.foomworks.workers.dev/mcp"
    }
  }
}

Available tools 5

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

render

render_pdf

PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

render_preview

Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.

render_screenshot

PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

url

read_url

Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.

read_url_preview

Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.

Endpoints

URL	Transport	State	Latency	Checked
https://agent-web.foomworks.workers.dev/mcp	streamable-http	answering	90 ms	3 min ago

Alternatives to agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

same job, measured the same way

WebRead

by agentgate-builder

Read any public web page as clean Markdown for LLMs. Respects robots.txt. Free tier; x402 paid API.

1 tools answering

mdapi — HTML to Markdown for AI agents

by fastdb-md

Web page or HTML to clean LLM-ready Markdown or JSON. x402 pay-per-call, $0.005, no API key.

3 tools answering

WebRead

by youraitools

Turn any public web page into clean Markdown for LLMs; respects robots.txt. By Crypto Money Maker

1 tools answering

Distill MCP

by hybridforgelab

Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.

local only

Page2AI — Web to Markdown

by igorsaevets

Convert a web page URL to clean Markdown for LLM context. Local, no external API calls.

1 970 installs/wk local only

Scrapi

by bamchi

Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

35 installs/wk 5 tools answering

Pagewatch

by pagelens

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

78 installs/wk 5 tools answering

ContextFetch

by contextfetch

Web search and any page as LLM-ready Markdown for AI agents. Free keyless tier, no signup.

513 installs/wk 14 tools answering

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) — questions

Answers built from our own checks of this server.

What can agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) do?

It exposes 5 tools, read directly from the server on our last check. Among them: read_url, read_url_preview, render_pdf, render_preview, render_screenshot. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →

What is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) mostly used for?

Its tools cluster around render and url. That is what this server is built to work with — the grouping comes from the actual tool names, not from a category we assigned.

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 92 of 92 checks got a reply (100.0%), average response time 124 ms. The bar chart above shows every period we have measured.

How do I connect agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.

Does agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) need an API key?

No. agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 5 of them are readable on this page. This is what we observed, not what the docs claim.

How fast is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)?

It answers our handshake in 124 ms on average, which is faster than 87% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.

Is agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free) open source?

The code is open source: it is published under the MIT licence and 0 stars on GitHub. The licence covers the code in the repository, not the hosted service at agent-web.foomworks.workers.dev, which runs on its operator's own terms.