mcpbeat Sign in

Web Scraper MCP Server

answering

Web Scraper is answering right now. Last checked 14 min ago. It exposes 11 tools. Last commit 11 Sep 2026.

10 pay-per-call web tools: markdown, CSS scrape, links, crawl, screenshot, PDF, browser.

Uptime history 47 days of history · worst day 66%
47 days agonow
100.0%
Uptime 24h
91 of 91 checks
11
Tools
read from the server
3398 ms
Response time
average over 24h
0
Stars
last commit 11 Sep 2026

What changed 13

Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 5 September 2026. No other catalogue keeps this.

11 Sep a tool appeared crawl_status
10 Sep 9 tools appeared browser, crawl, extract_structured and 6 more
10 Sep a tool changed version
5 Sep a tool appeared web_search
5 Sep a tool disappeared web_search

What the code does

We read the source, 20 h ago · tools taken from the live server · rules 3dff92dd89df

Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Executes code built at runtime src/services/browser/core/run.ts:58
              ? ((await page.$eval(s.selector, (el: any) => el.textContent)) as string)

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

This code can reach further than it looks

We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 14 min ago.

run in your terminal
claude mcp add web-scraper --transport http https://api.agishub.com/mcp/web
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "web-scraper": {
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}
~/.codex/config.toml
[mcp_servers.web-scraper]
url = "https://api.agishub.com/mcp/web"
.cursor/mcp.json
{
  "mcpServers": {
    "web-scraper": {
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "web-scraper": {
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}

Available tools 11

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

crawl
crawl
Crawl multiple pages of a site, respecting link depth and domain limits. Returns async job_id; results include markdown or HTML per page. Use it to fetch and process many pages of content at once.
crawl_status
Check the status of a crawl started with crawl, and retrieve its pages once finished. Free: the crawl itself was already paid for when it was queued.
extract
extract
Fetch any public web page and return its main content as clean, token-efficient Markdown (title, description, headings, links, lists). Set render:true to execute JavaScript first for single-page apps or JS-heavy pages that would otherwise come back empty. Built for RAG and for agents that need to read the contents of a URL.
extract_structured
AI-powered structured extraction: give a URL plus a natural-language prompt and/or a JSON Schema, and get back clean structured JSON (e.g. product name, price, rating). Renders the page in a headless browser first, so it works on SPAs.
browser
browser
Drive a headless browser: open a URL and run an ordered list of steps — click, type, press keys, wait, extract text and screenshot. For flows the plain scraper can't reach (logins, forms, multi-step pages).
links
links
Return every hyperlink on a JavaScript-rendered page as a list of absolute URLs, with options to keep only visible links or only same-site links. Backed by a headless browser. Use it to map a site or seed a crawler.
map
map
Discover all URLs reachable from a domain within a link depth limit. Returns a flat list of absolute URLs, respects robots.txt crawl delays. Use it to map a site's structure before crawling.
pdf
pdf
Render a public URL or a raw HTML string into a PDF document, returned base64-encoded. Backed by a headless browser. Use for invoices, reports, receipts and any HTML-to-PDF need.
scrape
scrape
Extract specific elements from a JavaScript-rendered page by CSS selector. Give a list of selectors (e.g. 'h1', '.price', 'a.product') and get back the text and attributes of every match. Backed by a headless browser, so it works on SPAs and JS-heavy pages.
screenshot
screenshot
Capture a PNG screenshot of any public URL — full page or just the viewport, at a chosen size — returned base64-encoded. Backed by a headless browser.
snapshot
snapshot
Capture several representations of a page in one call — rendered HTML plus a PNG screenshot by default, and optionally Markdown and the accessibility tree. Backed by a headless browser. Saves round-trips when an agent needs both the content and a visual of a page.

Tools removed

Tools this server used to expose. Anything built against them stopped working on the day they went.

web_search
removed 5 Sep 2026

Endpoints

URLTransportStateLatencyChecked
https://api.agishub.com/mcp/web streamable-http answering 10525 ms 14 min ago

Alternatives to Web Scraper

same job, measured the same way
agentsvc.io
by agentsvc

27 pay-per-call web tools for agents: scrape, screenshot, PDF, OCR, search, prices, validation. x402

27 tools answering
Pagewatch
by pagelens

Read a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.

57 installs/wk 5 tools answering
rasterly
by rasterly-dev

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

33 installs/wk local only
rasterly
by jhonychain

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

local only
upAPI
by devinosolutions

All public upAPI operations as MCP tools: web scraping, search, screenshots, PDF, OCR and more.

223 installs/wk answering
Readdown MCP
by zcag

Convert web pages to clean, LLM-optimized Markdown. No browser needed.

local only
Geekflare
by geekflare

Geekflare MCP server for scraping, search, screenshots, broken links, DNS lookup, and network tools.

62 installs/wk 18 tools answering
Browser Gateway
by browser-gateway

AI browser tools with Chrome CDP. Navigate, screenshot, interact. Multi-provider failover.

217 installs/wk local only

Web Scraper — questions

Answers built from our own checks of this server.

What can Web Scraper do?
It exposes 11 tools, read directly from the server on our last check. Among them: browser, crawl, crawl_status, extract, extract_structured, links and 5 more. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
What is Web Scraper mostly used for?
Its tools cluster around extract and crawl. That is what this server is built to work with — the grouping comes from the actual tool names, not from a category we assigned.
Is Web Scraper working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 3398 ms. The bar chart above shows every period we have measured.
Did Web Scraper ever remove tools?
Yes. web_search is no longer exposed — we recorded the date each one disappeared. A tool vanishing usually means a breaking change for anything that depended on it.
How do I connect Web Scraper?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does Web Scraper need an API key?
No. Web Scraper completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 11 of them are readable on this page. This is what we observed, not what the docs claim.
Is Web Scraper open source?
Yes — it is published under the MIT licence, written in TypeScript and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.