Crawlwise Data MCP runs on your own machine — the client starts it, so there is no endpoint to ping. 94 installs a week from npm.
Per-URL tech-stack, feed and sitemap change events for AI agents, delivered as signed webhooks.
Today is the operative word: we check Crawlwise Data MCP every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.
claude mcp add crawlwise-mcp -- npx -y crawlwise-mcp
{
"mcpServers": {
"crawlwise-mcp": {
"command": "npx",
"args": [
"-y",
"crawlwise-mcp"
]
}
}
}
[mcp_servers.crawlwise-mcp]
command = "npx"
args = ["-y", "crawlwise-mcp"]
{
"mcpServers": {
"crawlwise-mcp": {
"command": "npx",
"args": [
"-y",
"crawlwise-mcp"
]
}
}
}
{
"servers": {
"crawlwise-mcp": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"crawlwise-mcp"
]
}
}
}
Optional settings from the registry entry, left out of the block above:
CRAWLWISE_API_KEY (Crawlwise Data API key (cw_test_... trial or live). Optional for techstack/feed/sitemap demo mode; required for monitors and account), CRAWLWISE_BASE_URL (API base URL (default https://crawlwisedata.com)).
Web data for agents. Extract web pages, crawl websites, discover URLs, and search the web.
Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps
Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
Live web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Answers built from our own checks of this server.