Crawlforge MCP Server runs on your own machine — the client starts it, so there is no endpoint to ping. 1 647 installs a week from npm. Last commit 17 Sep 2026.
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
We read the source, 18 h ago · rules 3dff92dd89df
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
postinstall: echo ' CrawlForge MCP Server installed! Quick start: run "npx crawlforge init" to configure your API key, install skills, and register the MCP server with your AI clients. Or run "npx crawlforge-setup" to configure your API key only. '
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.
This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.
claude mcp add crawlforge-mcp-server -- npx -y crawlforge-mcp-server
{
"mcpServers": {
"crawlforge-mcp-server": {
"args": [
"-y",
"crawlforge-mcp-server"
],
"command": "npx"
}
}
}
[mcp_servers.crawlforge-mcp-server]
command = "npx"
args = ["-y", "crawlforge-mcp-server"]
{
"mcpServers": {
"crawlforge-mcp-server": {
"args": [
"-y",
"crawlforge-mcp-server"
],
"command": "npx"
}
}
}
{
"mcpServers": {
"crawlforge-mcp-server": {
"args": [
"-y",
"crawlforge-mcp-server"
],
"command": "npx"
}
}
}
This one needs environment variables set before it will start:
CRAWLFORGE_API_KEY (CrawlForge API key for authentication and usage/credit tracking. Get a free key at https://www.crawlforge.dev), DATAFORSEO_LOGIN (DataForSEO account login. Optional — only needed to enable the serp_rank tool (real Google organic rank lookups); billed separately to the caller's own DataForSEO account.), DATAFORSEO_PASSWORD (DataForSEO account password. Optional — only needed to enable the serp_rank tool.).
The author declared them in the registry entry; get the values from the project itself.
Web scraping MCP — extract clean markdown, links, and metadata from any URL.
Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.
Give AI agents clean, LLM-ready web data — scrape any URL to markdown or extract structured JSON.
AI-powered web scraping MCP. Distill pages to Markdown or extract structured data via JSON Schema.
AI-powered web scraping MCP. Distill pages to Markdown or extract structured data via JSON Schema.
Pay-per-call MCP tools: web search, scraping, on-chain wallet intel, extraction. x402 USDC on Base.
Turn any URL into clean Markdown and structured data. Scrape, crawl, search and extract.
Web search, scraping, RAG answers with citations, and translation as MCP tools.
Answers built from our own checks of this server.