CRW Web Scraper runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 18 Sep 2026.
Open-source web scraper for AI agents with scrape, crawl, and map tools
We read the source, 18 h ago · rules 3dff92dd89df
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
const bin = path.join(dir, binName);
const proc = spawn(bin, [], { stdio: ["pipe", "pipe", "ignore"] });
self._process = subprocess.Popen(
Found in continuous integration, deployment or infrastructure files, or in a neighbouring package of the same monorepo. None of this is installed when you add the server: it describes how the project is built and released. We list it because a leaked key in a build pipeline is still a real problem, but it is not something this server does on your machine.
curl -s -m 10 "https://api.telegram.org/bot${TG_TOKEN}/sendMessage" \
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
13 tools for AI agents: scrape, crawl, extract, map, search, papers, batch, research, monitor.
Live web access for agents: scrape, SERP search, crawl/map, 74 collectors, datasets, proxies.
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
MCP server for AI agents to manage multiple wallets with coordinated trading and batch operations on
Answers built from our own checks of this server.