Web Scraping MCP Servers
Crawling and structured extraction from pages, separate from full browser control. 349 servers in the registry match this topic; 14 of the top ones are answering right now, exposing 104 tools between them. Checked every 15 minutes.
349 in this topic 14 of the top answering checked every 15 min
Ranked by uptime and installs
how the ranking worksWeb scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
MCP server for Firecrawl — web search, scraping, and biomedical/arXiv paper search.
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
One API for 65 platforms and 572 endpoints: social, commerce, retail, jobs, finance, web scraping.
Give it a store URL, get structured rows. A model writes the parser once; replays are free.
Geekflare MCP server for scraping, search, screenshots, broken links, DNS lookup, and network tools.
Live web access for agents: scrape, SERP search, crawl/map, 74 collectors, datasets, proxies.
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
Hundreds of scraping & data APIs through one key. USD pay-per-request, normalized schemas, failover.
Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.
Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally
ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.
Google, Bing, DuckDuckGo and Google Maps search results, free without an API key.
Web-scraping toolkit with 22 tools for structured web data as JSON for AI agents.
13 tools for AI agents: scrape, crawl, extract, map, search, papers, batch, research, monitor.
Headless Screaming Frog SEO Spider via its CLI: run crawls, export and filter data, no GUI needed.
Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.
X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.
Local MCP tools for crawler-readability and discovery-file diagnostics.
Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps
AI testing agents for web apps — dispatch test runs, crawls, fetch artifacts and status.
Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.
Web scraping, code review, content gen, sentiment. Zero Core Tools.
Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation
Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI
260 MCP tools across 49 domains. AI Flywheel, quality gates, research, web scraping.
Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
Web search, direct-URL fetch, crawl, and docs export MCP. smartfetch for URLs.
23 API tools for Claude Code — email, DNS, SSL, NLP, scraping. Free tier included.
Build, deploy, and run web scraping and automation actors in the cloud
Scrape Google search results with SERP data, ads, and knowledge panels
Scrape, crawl, and extract structured data from websites at scale
Scrape webpages, handle JavaScript and CAPTCHA, extract structured data
FineData web scraping MCP — JavaScript rendering, captcha solving, markdown for AI agents
Outscraper MCP business discovery, Maps intelligence, enrichment, reviews, and contact data.
All public upAPI operations as MCP tools: web scraping, search, screenshots, PDF, OCR and more.
Arachne MCP — scraping, browser, vision, OCR, RAG, Social Research, GitHub + VRT (56 tools).
Structured web intelligence for AI agents. 5x fewer tokens than Playwright/Firecrawl, 84.7% accuracy
Reddit posts, comments, search, users & subreddits as JSON via Apify. No Reddit API key. $1.50/1k
Web search, URL discovery, scraping & extraction with agent-browser and search providers
MCP server for AI agents to search major Chinese internet platforms with local-first login support.
Search, chat, upload, and scrape a serverless RAGStack knowledge base on AWS.
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.
Read-only X/Twitter MCP: posts, threads, replies, search via twscrape. No API key.
Detects a company CRM, sequencer, and marketing automation from its public website. Clay-ready.
Bridge a live Chrome browser to your agent: 150 tools for capture, extraction, and observation.