Web Scraping MCP Servers
Crawling and structured extraction from pages, separate from full browser control. 222 servers in the registry match this topic; 11 of the top ones are answering right now, exposing 651 tools between them. Checked every 15 minutes.
222 in this topic 11 of the top answering checked every 15 min
Ranked by uptime and installs
how the ranking worksWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
MCP server for Firecrawl — search, scrape, and interact with the web.
Web-scraping toolkit with 22 tools for structured web data as JSON for AI agents.
Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.
Geekflare MCP server for scraping, search, screenshots, broken links, DNS lookup, and network tools.
23 API tools for Claude Code — email, DNS, SSL, NLP, scraping. Free tier included.
Web search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
171 pay-per-call AI agent tools via x402 USDC. Captcha, gas, DNS, web scraping, DeFi, Polymarket.
MCP server for AI agents to search major Chinese internet platforms with local-first login support.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Web search, URL discovery, scraping & extraction with agent-browser and search providers
X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.
Web scraping, browser automation, vision, OCR, audio, RAG — 9 MCP tools via Arachne API
10 no-LLM web tools: URL to Markdown, metadata, JSON-LD, MX, scrape, RSS, DNS, RDAP, SSL, HTTP.
PubMed & Europe PMC literature search, US/UK drug labelling, and clinical trials for AI assistants.
Crawl websites, export SEO data, and manage crawls via Screaming Frog SEO Spider.
Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.
TerraDeed MCP server — x402 web scraping & structured extraction. Pay-per-call with USDC on Base.
Web scraping, code review, content gen, sentiment. Zero Core Tools.
Fetch any web page's HTML or AI-parsed JSON through the ScrapeUnblocker anti-bot API.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Local MCP tools for crawler-readability and discovery-file diagnostics.
AI testing agents for web apps — dispatch test runs, crawls, fetch artifacts and status.
Call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one key
Fetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data.
Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Structured web intelligence for AI agents. 5x fewer tokens than Playwright/Firecrawl, 84.7% accuracy
Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.
MCP server for Riveter's enrichment, scraping, and monitoring API
Web scraping MCP server — scrape, extract structured data, screenshot any site with anti-bot bypass.
Web scraping tools with Chromium JS rendering, rotating proxies, and AI question answering.
Build, deploy, and run web scraping and automation actors in the cloud
Access 21+ social media platforms through one unified API. Profiles, posts, search.
ZenRows MCP server — Universal Scraper API for AI coding assistants
Scrape, crawl, and extract structured data from websites at scale
26-tool MCP server for web scraping, crawling, deep research & autonomous extraction
260 MCP tools across 49 domains. AI Flywheel, quality gates, research, web scraping.
Prometheus MCP — query metrics, inspect alerts, and explore scrape targets (read-only).
145 microservices: PDF, DNS, captcha, scraping, screenshots, datahub, gas, tokens. USDC no KYC.
45 pay-per-call AI agent tools: scraping, SEO, crypto data, lint, agent memory. x402 USDC on Base.
Free AI crawler checks, Agent Surface audits, A2A actions and optional x402 evidence packs.
SEO MCP server — backlinks, domain authority, tech stack, and 18+ tools via Common Crawl.
Scrapingdog MCP — wraps Scrapingdog (scrapingdog.com), a proxy-based web
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web
Decodo MCP — wraps the Decodo Web Scraping API (decodo.com, formerly
Oxylabs MCP — Oxylabs Web Scraper API (oxylabs.io)