mcpbeat

Smart Crawler MCP Server

io.github.shulex-voc/smart-crawler
answering

Smart Crawler is answering right now. Last checked 13 min ago. Last commit 8 Jun 2026.

E-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.

Uptime history 41 hours of history
41 hours agonow
100.0%
Uptime 24h
91 of 91 checks
—
Tools
hidden behind auth
588 ms
Response time
average over 24h
0
Stars
last commit 8 Jun 2026

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 13 min ago.

run in your terminal
claude mcp add smart-crawler --transport http https://smartcrawler.io/mcp/
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/"
    }
  }
}
~/.codex/config.toml
[mcp_servers.smart-crawler]
url = "https://smartcrawler.io/mcp/"
.cursor/mcp.json
{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "smart-crawler": {
      "url": "https://smartcrawler.io/mcp/"
    }
  }
}

This endpoint answered with an authorization challenge — the server is running, but you need an API key or OAuth to use it.

Endpoints

URLTransportStateLatencyChecked
https://smartcrawler.io/mcp/ streamable-http needs key 591 ms 13 min ago

Smart Crawler — questions

Answers built from our own checks of this server.

Why is there no tool list for Smart Crawler?
The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.
Is Smart Crawler working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 588 ms. The bar chart above shows every period we have measured.
How do I connect Smart Crawler?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You will need your own key or an OAuth login: it refuses anonymous clients.
Does Smart Crawler need an API key?
Yes. Every time we knock, Smart Crawler answers with an authorization challenge instead of its tool list — that is how we know it is running and gated rather than broken. Bring your own credentials and it will talk.
How fast is Smart Crawler?
It answers our handshake in 588 ms on average, which is faster than 17% of all working MCP servers we measure. That is on the slow side — worth knowing if the tool sits inside an interactive loop. The comparison comes from our own checks across the whole registry, every 15 minutes.
Is Smart Crawler open source?
Yes — 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.