mcpbeat Sign in

Webcrawl Anything MCP Server

by brainfish-ai Your server? Claim it
answering

Webcrawl Anything is answering right now. Last checked 12 min ago. 3 292 installs a week from npm. Last commit 4 Nov 2026.

Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.

Installs per day peak 1 555 · avg 109
a month agotoday
Uptime history 9 hours of history
9 hours agonow
100.0%
Uptime 24h
32 of 32 checks
—
Tools
hidden behind auth
412 ms
Response time
average over 24h
3 292
Installs / week
npm and PyPI

Nothing serious here today

Today is the operative word: we check Webcrawl Anything every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 12 min ago.

run in your terminal
claude mcp add webcrawl --transport http https://webcrawl.app/mcp
Settings → Connectors → Add custom connector, then paste this address
https://webcrawl.app/mcp
~/.codex/config.toml
[mcp_servers.webcrawl]
url = "https://webcrawl.app/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "webcrawl": {
      "url": "https://webcrawl.app/mcp"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "webcrawl": {
      "type": "http",
      "url": "https://webcrawl.app/mcp"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, and it signs you in through your browser: there is no API key to paste.

Endpoints

URLTransportStateLatencyChecked
https://webcrawl.app/mcp streamable-http sign-in 346 ms 12 min ago

Alternatives to Webcrawl Anything

same job, measured the same way
PyreCrawl
by sanggonboy

Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.

142 installs/wk local only
Scout Monitoring (local)
by scoutapm

Run Scout Monitoring's MCP tools locally with an API key: endpoints, traces, errors, N+1 insights.

136 installs/wk local only
ScriptHaul API
by scripthaul

YouTube discovery, transcripts, library search, and monitors with API keys or OAuth.

answering
Web
by rog0x

Web scraping, search, monitoring, and HTML-to-markdown for AI agents

43 installs/wk local only
Anakin
by anakin

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

68 installs/wk local only
twitr.sh
by twitr

X/Twitter reads, search, monitors and posting. Pay-per-call in USDC — no signup, no API keys.

14 tools answering
Nanostores MCP
by valyay

Debug and analyze Nanostores apps with AI: scan stores, monitor runtime events, and search docs.

60 installs/wk local only
CiteNexus
by akougkas

Search scholarly sources, verify references, and export citations with traceable evidence.

101 installs/wk local only

Webcrawl Anything — questions

Answers built from our own checks of this server.

Why is there no tool list for Webcrawl Anything?
The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.
Is Webcrawl Anything working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 32 of 32 checks got a reply (100.0%), average response time 412 ms. The bar chart above shows every period we have measured.
How do I connect Webcrawl Anything?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You sign in through your browser once and the client keeps the session: no key to copy, and it refuses anonymous clients.
How do you sign in to Webcrawl Anything?
No API key is involved. Webcrawl Anything answers our knock with an OAuth challenge, so you authorise it once in your browser and the client keeps the session. That is also why we see no tool list: it will not describe itself to an anonymous client, and that is the server working as intended, not a fault.
How fast is Webcrawl Anything?
It answers our handshake in 412 ms on average, which is faster than 33% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.
How many people use Webcrawl Anything?
The npm package @webcrawl/mcp was installed 3 292 times in the last week. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is Webcrawl Anything open source?
The code is open source: it is published under the MIT licence, written in TypeScript, 2 stars on GitHub and 4 open issues. The licence covers the code in the repository, not the hosted service at webcrawl.app, which runs on its operator's own terms.