Crawlberg runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 16 Sep 2026.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
What the code does
We read the source, 19 h ago · rules 3dff92dd89df
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
const result = spawnSync(binPath, process.argv.slice(2), { stdio: "inherit" });
completed = subprocess.run([binary_path, *args], check=False)
RUN apt-get update && \
apt-get install -y --no-install-recommends cmake g++ pkg-config libssl-dev && \
final result = await Process.run('tar', ['-xzf', tempFile.path, '-C', dstDir]);
libDir := filepath.Join(targetDir, "lib", goDir)
$proc = proc_open([$mockServerBin, $fixturesDir], $descriptors, $pipes);
require_once $pkgAutoloader;
_mockServer = Process.Start(psi)
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
This code can reach further than it looks
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
Alternatives to Crawlberg
same job, measured the same wayScrape, crawl, and map websites to Markdown or JSON via local CLI.
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
Open-source web scraper for AI agents with scrape, crawl, and map tools
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Scrape, crawl, map and extract the web. Pay per call in USDC, no account or API key.
Extract public webpages as Markdown, map sites, and run bounded crawl jobs. API key required.
Web scraping, SERP search, crawl/map and 74 Collectors through residential proxies. 25 tools.
Live web access for agents: scrape, SERP search, crawl/map, 74 collectors, datasets, proxies.
Crawlberg — questions
Answers built from our own checks of this server.