Crawlberg runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 3 Nov 2026.
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
What the code does
We read the source, 9 h ago · rules 995398eba69f
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
const result = spawnSync(binPath, process.argv.slice(2), { stdio: "inherit" });
completed = subprocess.run([binary_path, *args], check=False)
libDir := filepath.Join(targetDir, "lib", goDir)
require_once $pkgAutoloader;
final result = await Process.run('tar', [
_mockServer = Process.Start(psi)
$proc = proc_open([$mockServerBin, $fixturesDir], $descriptors, $pipes);
"e2e/node/.npmrc",
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
This code can reach further than it looks
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
Alternatives to Crawlberg
same job, measured the same wayScrape, crawl, and map websites to Markdown or JSON via local CLI.
Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
Open-source web scraper for AI agents with scrape, crawl, and map tools
Open-source web scraper for AI agents with scrape, crawl, and map tools
Markdown scrape, site map, page metadata, screenshots, web search and PDF to text. Pay per call
Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Crawlberg — questions
Answers built from our own checks of this server.