CRW Web Scraper runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 6 Oct 2026.
Open-source web scraper for AI agents with scrape, crawl, and map tools
We read the source, 0 min ago · rules ccca72095570
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
const bin = path.join(dir, binName);
const proc = spawn(bin, [], { stdio: ["pipe", "pipe", "ignore"], env: localChildEnv() });
self._process = subprocess.Popen(
return Object.fromEntries(Object.entries(process.env).filter(([k]) => !drop.has(fold(k))));
Found in continuous integration, deployment or infrastructure files, or in a neighbouring package of the same monorepo. None of this is installed when you add the server: it describes how the project is built and released. We list it because a leaked key in a build pipeline is still a real problem, but it is not something this server does on your machine.
curl -s -m 10 "https://api.telegram.org/bot${TG_TOKEN}/sendMessage" \
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
Open-source web scraper for AI agents with scrape, crawl, and map tools
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser.
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Self-hosted, Tavily-compatible web search, extract, crawl and map tools for AI agents.
Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
Scrape to markdown, map and crawl sites, drive a real browser. Pay per call, no API key, no signup.
Answers built from our own checks of this server.