Web Scraping MCP Servers
Crawling and structured extraction from pages, separate from full browser control. 659 servers in the registry match this topic; 29 of the top ones are answering right now, exposing 971 tools between them. Checked every 15 minutes.
659 in this topic 29 of the top answering checked every 15 min
Ranked by uptime and installs
how the ranking worksFirecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
Stealthy browser automation, testing, and web-scraping via CDP Mode.
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
Web scraping and automation for AI agents: live prices, quotes, bookings, anything behind a login.
Common Crawl's public web archive — find every time a URL was crawled since 2008 and read the…
Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl). One…
Firecrawl MCP — wraps the Firecrawl API (firecrawl.dev) for web scraping / crawling / search…
Decodo MCP — wraps the Decodo Web Scraping API (decodo.com, formerly Smartproxy). Rotating…
Hyperbrowser MCP — wraps the Hyperbrowser AI-agent browsing API (hyperbrowser.ai). Scrape…
Apify MCP — run web-scraping Actors and fetch their dataset results.
Public social media data: Instagram, TikTok, YouTube, X, Reddit, LinkedIn and 30+ more platforms.
ScrapingAnt MCP — wraps the ScrapingAnt web scraping API (scrapingant.com)
Scrapingdog MCP — wraps Scrapingdog (scrapingdog.com), a proxy-based web scraping API with…
ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)
ScraperAPI MCP — wraps ScraperAPI (scraperapi.com), a proxy-based web scraper with structured-data…
CrawlGraph MCP — backlink intelligence on the public Common Crawl webgraph (4.4B edges, 120M…
Live web access for agents: scrape, SERP search, crawl/map, 100+ collectors, datasets, proxies.
Web scraping MCP server: any URL to Markdown or JSON, with JavaScript rendering and batch jobs.
Web search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.
Web search, Google SERP, scraping, screenshots, PDFs, brand data, and website diagnostics.
Read, crawl and act on websites, signed in as the user, and turn any site into an API.
Official Browserless MCP server: browser automation, scraping, screenshots and PDFs for AI agents.
Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.
One API for 65 platforms and 572 endpoints: social, commerce, retail, jobs, finance, web scraping.
Drive and scrape your existing Chrome profile from any AI assistant — no headless browser.
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
Static and dynamic call tracing MCP server backed by a SQLite property graph of your codebase
Hybrid scraper with escalating effort: cheapest fetch first, reports why each page stopped.
Live web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
Fetch any web page's HTML or AI-parsed JSON, or run 100+ site plugins, via ScrapeUnblocker.
Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.
Agent-native internet gateway: typed search, fetch, scrape, crawl, and extract via the Clawifi API.
Google, Bing, DuckDuckGo and Google Maps search results, free without an API key.
Hundreds of scraping & data APIs through one key. USD pay-per-request, normalized schemas, failover.
Bing Webmaster & IndexNow MCP: search performance, crawl issues, and instant URL indexing.
One MCP server for all web data. Scrape, search, crawl, and AI research in one install.
Web scraping tools with Chromium JS rendering, rotating proxies, and AI question answering.
Web search via SearXNG and/or You.com, plus clean Markdown crawling via Crawl4AI. Self-hosted.
B2B lead generation MCP server - 20+ scrapers, email finder, skip trace, and more.
A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
Web scraping API for AI agents.
Give it a URL, get structured rows. A model writes the parser once; replays are free.
Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites
SpiderIQ Gate: SpiderGate LLM gateway (completions, models, usage, traces)
Check what AI crawlers may read and what a page permits, generate llms.txt and schema.
MCP server for Riveter's enrichment, scraping, and monitoring API
AI testing agents for web apps — dispatch test runs, crawls, fetch artifacts and status.