CRW Web Scraper runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 29 Oct 2026.
Open-source web scraper for AI agents with scrape, crawl, and map tools
What changed 1
Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 22 September 2026. No other catalogue keeps this.
What the code does
We read the source, 4 d ago · rules 995398eba69f
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
const bin = path.join(dir, binName);
self._process = subprocess.Popen(
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
This code can reach further than it looks
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
Alternatives to CRW Web Scraper
same job, measured the same wayOpen-source web scraper for AI agents with scrape, crawl, and map tools
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
Read, map and crawl the web, and drive a real browser. Pay per call, no key, no signup.
Maps, geocoding and time zones for AI coding agents, on OpenStreetMap, with hard prepaid spend caps.
CRW Web Scraper — questions
Answers built from our own checks of this server.