Web Scraping MCP Server

by thenextgennexus Your server? Claim it

answering

Web Scraping MCP Server is answering right now. Last checked 14 min ago. It exposes 3 tools.

Website crawling, Google search and Wikipedia lookup as agent tools.

Uptime history 91 days of history · worst day 95%

91 days agonow

100.0%

Uptime 24h

91 of 91 checks

Tools

read from the server

100 ms

Response time

average over 24h

authentication required

Access

streamable-http

Nothing serious here today

Today is the operative word: we check Web Scraping MCP Server every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 14 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add web-scraping-mcp-server --transport http https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Settings → Connectors → Add custom connector, then paste this address

https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

~/.codex/config.toml

[mcp_servers.web-scraping-mcp-server]
url = "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "web-scraping-mcp-server": {
      "type": "http",
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, but it did not say what kind of credentials it expects.

Available tools 3

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

crawl

crawl_website

Crawl a website and extract its content as structured data. Args: url: Website URL to crawl (e.g. 'https://example.com') max_pages: Max pages to crawl (default 5)

google

google_search

Search Google and return organic results with titles, URLs, snippets. Args: query: Search query (e.g. 'best python libraries 2026') max_results: Max results (default 10)

wikipedia

wikipedia_lookup

Look up a Wikipedia article and return its content. Args: topic: Topic to look up (e.g. 'Artificial intelligence')

Endpoints

URL	Transport	State	Latency	Checked
https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp	streamable-http	needs auth	87 ms	14 min ago

Alternatives to Web Scraping MCP Server

same job, measured the same way

News MCP Server

by thenextgennexus

AP, BBC, NPR, Hacker News and Google News search as agent tools.

5 tools answering

Metalift

by metalift-ai

Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools

73 installs/wk local only

Academic Research MCP Server

by thenextgennexus

arXiv and OpenAlex/Crossref paper search (an open Google Scholar alternative) as agent tools.

2 tools answering

Scrapio MCP

by xsronhou

Fetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data.

116 installs/wk local only

Google Chat MCP

by mmedum

Google Chat as MCP tools: read, search and write to your spaces, direct messages and sidebar.

local only

Ujeebu

by ujeebu

Web scraping, Google SERP, Markdown and ChatGPT/Gemini answers as typed tools for AI agents.

17 tools answering

Web Search & Data API

by kadec0

Web search, scraping, Google Trends and data lookups. Paid per call in USDC on Base via x402.

23 tools answering

Climbpast

by archievi

Read and edit GA4, Search Console and Google Tag Manager from any MCP client. 29 tools.

answering

Web Scraping MCP Server — questions

Answers built from our own checks of this server.

What can Web Scraping MCP Server do?

It exposes 3 tools, read directly from the server on our last check. Among them: crawl_website, google_search, wikipedia_lookup. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →

Is Web Scraping MCP Server working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 100 ms. The bar chart above shows every period we have measured.

How do I connect Web Scraping MCP Server?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You will need your own credentials: it refuses anonymous clients.

Does Web Scraping MCP Server need an API key?

Yes. Every time we knock, Web Scraping MCP Server answers with an authorization challenge instead of its tool list — that is how we know it is running and gated rather than broken. Bring your own credentials and it will talk.

How fast is Web Scraping MCP Server?

It answers our handshake in 100 ms on average, which is faster than 92% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.