mcpbeat Sign in

Crawl4Agent MCP Server

answering

Crawl4Agent is answering right now. Last checked 11 min ago. It exposes 1 tools.

crawl4ai-compatible web crawler API: POST a URL, get clean LLM-ready Markdown with fit_markdown...

Uptime history 11 days of history
11 days agonow
100.0%
Uptime 24h
91 of 91 checks
1
Tools
read from the server
111 ms
Response time
average over 24h
open, no key
Access
streamable-http

What changed 1

Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 3 October 2026. No other catalogue keeps this.

3 Oct a tool description was rewritten md

Nothing serious here today

Today is the operative word: we check Crawl4Agent every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 11 min ago.

run in your terminal
claude mcp add crawl4agent --transport http https://crawl4agent.saastemly.com/mcp
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "crawl4agent": {
      "url": "https://crawl4agent.saastemly.com/mcp"
    }
  }
}
~/.codex/config.toml
[mcp_servers.crawl4agent]
url = "https://crawl4agent.saastemly.com/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "crawl4agent": {
      "url": "https://crawl4agent.saastemly.com/mcp"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "crawl4agent": {
      "url": "https://crawl4agent.saastemly.com/mcp"
    }
  }
}

Available tools 1

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

md
md
Turn a URL into LLM-ready Markdown with crawl4ai's /md contract: f raw|fit (raw or pruned fit_markdown), q optional user query, c cache flag. Answers {url, filter, query, cache, markdown, success}. Price: $0.008 a call (3 free calls a day without an API key).

Endpoints

URLTransportStateLatencyChecked
https://crawl4agent.saastemly.com/mcp streamable-http answering 52 ms 11 min ago

Alternatives to Crawl4Agent

same job, measured the same way
Scrapi
by bamchi

Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

26 installs/wk 5 tools answering
Fastcrawl
by fastcrawl

Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.

answering
P
Perpage MCP Server
by cal-dev-tech

Give AI agents clean, LLM-ready web data — scrape any URL to markdown or extract structured JSON.

21 installs/wk local only
TheCrawler
by manchittlab

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

52 installs/wk local only
Website to Markdown
by saulius876-lgtm

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

answering
X
X1-BaaS Scraping API
by tazpal

Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.

3 tools answering
Scrapiq
by scrapiq

Any URL to clean text, markdown, or JSON for LLM/RAG pipelines.

1 tools answering
rasterly
by rasterly-dev

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

34 installs/wk local only

Crawl4Agent — questions

Answers built from our own checks of this server.

What can Crawl4Agent do?
It exposes 1 tools, read directly from the server on our last check. Among them: md. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is Crawl4Agent working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 111 ms. The bar chart above shows every period we have measured.
How do I connect Crawl4Agent?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does Crawl4Agent need an API key?
No. Crawl4Agent completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 1 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is Crawl4Agent?
It answers our handshake in 111 ms on average, which is faster than 81% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.