Web Scraping MCP Server

by superagnt Your server? Claim it

answering

Web Scraping is answering right now. Last checked 15 min ago.

Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.

Uptime history 3 hours of history

3 hours agonow

100.0%

Uptime 24h

8 of 8 checks

—

Tools

hidden behind auth

185 ms

Response time

average over 24h

OAuth sign-in

Access

streamable-http

Nothing serious here today

Today is the operative word: we check Web Scraping every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 15 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add web-scraping --transport http https://mcp.superagnt.com/mcp/web-scraping

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "web-scraping": {
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

~/.codex/config.toml

[mcp_servers.web-scraping]
url = "https://mcp.superagnt.com/mcp/web-scraping"

.cursor/mcp.json

{
  "mcpServers": {
    "web-scraping": {
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "web-scraping": {
      "url": "https://mcp.superagnt.com/mcp/web-scraping"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, and it signs you in through your browser: there is no API key to paste.

Endpoints

URL	Transport	State	Latency	Checked
https://mcp.superagnt.com/mcp/web-scraping	streamable-http	sign-in	183 ms	15 min ago

Alternatives to Web Scraping

same job, measured the same way

Anakin

by anakin

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

328 installs/wk local only

Scrapeless MCP Server

by scrapeless-ai

Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.

276 installs/wk answering

rasterly

by rasterly-dev

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

33 installs/wk local only

rasterly

by jhonychain

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

local only

Wick

by wickproject

Browser-grade web access for AI agents. Fetches any webpage, returns clean markdown.

57 installs/wk local only

Wick

by myleshorton

Browser-grade web access for AI agents. Fetches any webpage, returns clean markdown.

local only

Pagewatch

by pagelens

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

57 installs/wk 5 tools answering

Web Scraper

by agishub

10 pay-per-call web tools: markdown, CSS scrape, links, crawl, screenshot, PDF, browser.

11 tools answering

Web Scraping — questions

Answers built from our own checks of this server.

Why is there no tool list for Web Scraping?

The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.

Is Web Scraping working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 8 of 8 checks got a reply (100.0%), average response time 185 ms. The bar chart above shows every period we have measured.

How do I connect Web Scraping?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You sign in through your browser once and the client keeps the session: no key to copy, and it refuses anonymous clients.

How do you sign in to Web Scraping?

No API key is involved. Web Scraping answers our knock with an OAuth challenge, so you authorise it once in your browser and the client keeps the session. That is also why we see no tool list: it will not describe itself to an anonymous client, and that is the server working as intended, not a fault.

How fast is Web Scraping?

It answers our handshake in 185 ms on average, which is faster than 70% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.