WebCrawlerAPI MCP Server

by webcrawlerapi Your server? Claim it

answering

WebCrawlerAPI is answering right now. Last checked 10 min ago. Last commit 17 Oct 2026.

Turn any web page into clean Markdown for your AI assistant. OAuth sign-in, no API key.

Uptime history 48 hours of history

48 hours agonow

100.0%

Uptime 24h

91 of 91 checks

—

Tools

hidden behind auth

191 ms

Response time

average over 24h

Stars

last commit 17 Oct 2026

Nothing serious here today

Today is the operative word: we check WebCrawlerAPI every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 10 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add mcp-server --transport http https://mcp.webcrawlerapi.com/mcp

Settings → Connectors → Add custom connector, then paste this address

https://mcp.webcrawlerapi.com/mcp

~/.codex/config.toml

[mcp_servers.mcp-server]
url = "https://mcp.webcrawlerapi.com/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "mcp-server": {
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "mcp-server": {
      "type": "http",
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, and it signs you in through your browser: there is no API key to paste.

Endpoints

URL	Transport	State	Latency	Checked
https://mcp.webcrawlerapi.com/mcp	streamable-http	sign-in	192 ms	10 min ago

Alternatives to WebCrawlerAPI

same job, measured the same way

Fastcrawl

by fastcrawl

Cloud scraping & crawling API for AI agents. Turn any URL into clean, LLM-ready markdown.

answering

Website to Markdown

by saulius876-lgtm

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

answering

Scrapi

by bamchi

Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

35 installs/wk 5 tools answering

X1-BaaS Scraping API

by tazpal

Stealth scraping API for AI agents. Clean Markdown from any URL. x402 crypto payments.

3 tools answering

Web Tools for AI Agents

by projectworks007

Web tools for AI agents: URL to clean Markdown, site crawl, screenshots, PDF/Office to text, OCR.

answering

SnoopScan

by snoopscan

Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.

34 tools answering

oassis — web for agents

by oassis

Read, map and crawl the web, and drive a real browser. Pay per call, no key, no signup.

14 tools answering

WebReaper

by alex-on-ai

AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.

local only

WebCrawlerAPI — questions

Answers built from our own checks of this server.

Why is there no tool list for WebCrawlerAPI?

The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.

Is WebCrawlerAPI working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 191 ms. The bar chart above shows every period we have measured.

How do I connect WebCrawlerAPI?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You sign in through your browser once and the client keeps the session: no key to copy, and it refuses anonymous clients.

How do you sign in to WebCrawlerAPI?

No API key is involved. WebCrawlerAPI answers our knock with an OAuth challenge, so you authorise it once in your browser and the client keeps the session. That is also why we see no tool list: it will not describe itself to an anonymous client, and that is the server working as intended, not a fault.

How fast is WebCrawlerAPI?

It answers our handshake in 191 ms on average, which is faster than 72% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.

Is WebCrawlerAPI open source?

The code is open source: it is published under the MIT licence, written in TypeScript, 0 stars on GitHub and 1 open issue. The licence covers the code in the repository, not the hosted service at mcp.webcrawlerapi.com, which runs on its operator's own terms.