mcpbeat Sign in

Web Scraper MCP Server

by agishub Your server? Claim it
answering

Web Scraper is answering right now. Last checked 1 h ago. It exposes 11 tools. Last commit 11 Sep 2026.

10 pay-per-call web tools: markdown, CSS scrape, links, crawl, screenshot, PDF, browser.

Uptime history 91 days of history · worst day 66%
91 days agonow
100.0%
Uptime 24h
22 of 22 checks
11
Tools
read from the server
294 ms
Response time
average over 24h
0
Stars
last commit 11 Sep 2026

What changed 13

Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 5 September 2026. No other catalogue keeps this.

11 Sep a tool appeared crawl_status
10 Sep 9 tools appeared browser, crawl, extract_structured and 6 more
10 Sep a tool changed version
5 Sep a tool appeared web_search
5 Sep a tool disappeared web_search

What the code does

We read the source, 6 d ago · tools taken from the live server · rules 995398eba69f

Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Executes code built at runtime src/services/browser/core/run.ts:58 
              ? ((await page.$eval(s.selector, (el: any) => el.textContent)) as string)

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

This code can reach further than it looks

We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 1 h ago.

run in your terminal
claude mcp add web-scraper --transport http https://api.agishub.com/mcp/web
Settings → Connectors → Add custom connector, then paste this address
https://api.agishub.com/mcp/web
~/.codex/config.toml
[mcp_servers.web-scraper]
url = "https://api.agishub.com/mcp/web"
.cursor/mcp.json
{
  "mcpServers": {
    "web-scraper": {
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "web-scraper": {
      "type": "http",
      "url": "https://api.agishub.com/mcp/web"
    }
  }
}

Available tools 11

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

crawl
crawl
Crawl multiple pages of a site, respecting link depth and domain limits. Returns async job_id; results include markdown or HTML per page. Use it to fetch and process many pages of content at once.
crawl_status
Check the status of a crawl started with crawl, and retrieve its pages once finished. Free: the crawl itself was already paid for when it was queued.
extract
extract
Fetch any public web page and return its main content as clean, token-efficient Markdown (title, description, headings, links, lists). Set render:true to execute JavaScript first for single-page apps or JS-heavy pages that would otherwise come back empty. Built for RAG and for agents that need to read the contents of a URL.
extract_structured
AI-powered structured extraction: give a URL plus a natural-language prompt and/or a JSON Schema, and get back clean structured JSON (e.g. product name, price, rating). Renders the page in a headless browser first, so it works on SPAs.
browser
browser
Drive a headless browser: open a URL and run an ordered list of steps — click, type, press keys, wait, extract text and screenshot. For flows the plain scraper can't reach (logins, forms, multi-step pages).
links
links
Return every hyperlink on a JavaScript-rendered page as a list of absolute URLs, with options to keep only visible links or only same-site links. Backed by a headless browser. Use it to map a site or seed a crawler.
map
map
Discover all URLs reachable from a domain within a link depth limit. Returns a flat list of absolute URLs, respects robots.txt crawl delays. Use it to map a site's structure before crawling.
pdf
pdf
Render a public URL or a raw HTML string into a PDF document, returned base64-encoded. Backed by a headless browser. Use for invoices, reports, receipts and any HTML-to-PDF need.
scrape
scrape
Extract specific elements from a JavaScript-rendered page by CSS selector. Give a list of selectors (e.g. 'h1', '.price', 'a.product') and get back the text and attributes of every match. Backed by a headless browser, so it works on SPAs and JS-heavy pages.
screenshot
screenshot
Capture a PNG screenshot of any public URL — full page or just the viewport, at a chosen size — returned base64-encoded. Backed by a headless browser.
snapshot
snapshot
Capture several representations of a page in one call — rendered HTML plus a PNG screenshot by default, and optionally Markdown and the accessibility tree. Backed by a headless browser. Saves round-trips when an agent needs both the content and a visual of a page.

Tools removed

Tools this server used to expose. Anything built against them stopped working on the day they went.

web_search
removed 5 Sep 2026

Endpoints

URLTransportStateLatencyChecked
https://api.agishub.com/mcp/web streamable-http answering 251 ms 1 h ago

Alternatives to Web Scraper

same job, measured the same way
switch402
by switch402

Markdown scrape, site map, page metadata, screenshots, web search and PDF to text. Pay per call

9 tools answering
Agent Tools UK
by lexyholdcraft-source

Pay-per-use agent tools: screenshots, web to Markdown, PDF tables, OCR, UK company checks

10 tools answering
Web Tools for AI Agents
by projectworks007

Web tools for AI agents: URL to clean Markdown, site crawl, screenshots, PDF/Office to text, OCR.

answering
domscout
by jkresearch8

domscout browser API as MCP tools: screenshots, Markdown, structured data, page automation, crawls.

99 installs/wk local only
Adam Hale Tools: Web Research and Open Data
by workers-adamhaleworks-tools

Free web lookups; PDF to Markdown, audio transcripts, screenshots, WHOIS/DNS paid per call via x402.

12 tools answering
screenshot.com.ar
by com-screenshot

Screenshots and clean markdown of any public web page, rendered in a real Chrome browser.

answering
Shotlane
by shotlane

Screenshot web pages, read them as clean Markdown (JS rendered), and render HTML to PDF.

answering
Monie Tools: screenshots, PDF/OCR, PageSpeed & email for agents
by monietools

Agent tools: clean web screenshots/PDFs, PDF & image OCR to Markdown, PageSpeed audits, email checks

answering

Web Scraper — questions

Answers built from our own checks of this server.

What can Web Scraper do?
It exposes 11 tools, read directly from the server on our last check. Among them: browser, crawl, crawl_status, extract, extract_structured, links and 5 more. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
What is Web Scraper mostly used for?
Its tools cluster around extract and crawl. That is what this server is built to work with — the grouping comes from the actual tool names, not from a category we assigned.
Is Web Scraper working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 22 of 22 checks got a reply (100.0%), average response time 294 ms. The bar chart above shows every period we have measured.
Did Web Scraper ever remove tools?
Yes. web_search is no longer exposed — we recorded the date each one disappeared. A tool vanishing usually means a breaking change for anything that depended on it.
How do I connect Web Scraper?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does Web Scraper need an API key?
No. Web Scraper completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 11 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is Web Scraper?
It answers our handshake in 294 ms on average, which is faster than 48% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.
Is Web Scraper open source?
The code is open source: it is published under the MIT licence, written in TypeScript, 0 stars on GitHub and 2 open issues. The licence covers the code in the repository, not the hosted service at api.agishub.com, which runs on its operator's own terms.