Crawlbit MCP Server

by amati032-dev Your server? Claim it

local only

Crawlbit runs on your own machine — the client starts it, so there is no endpoint to ping. 33 installs a week from npm. Last commit 15 Aug 2026.

Four free tools to check if AI engines can find, read and recognise a site. No API key.

Installs per day peak 51 · avg 1

a month agotoday

Installs / week

npm · crawlbit-mcp

Stars

0 open issues

15 Aug 2026

Last commit

0 releases in 90 days

MIT

License

JavaScript

Nothing serious here today

Today is the operative word: we check Crawlbit every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add crawlbit -- npx -y crawlbit-mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "crawlbit": {
      "args": [
        "-y",
        "crawlbit-mcp"
      ],
      "command": "npx"
    }
  }
}

~/.codex/config.toml

[mcp_servers.crawlbit]
command = "npx"
args = ["-y", "crawlbit-mcp"]

.cursor/mcp.json

{
  "mcpServers": {
    "crawlbit": {
      "args": [
        "-y",
        "crawlbit-mcp"
      ],
      "command": "npx"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "crawlbit": {
      "args": [
        "-y",
        "crawlbit-mcp"
      ],
      "command": "npx"
    }
  }
}

Alternatives to Crawlbit

same job, measured the same way

Superhighway MCP

by patwalls

Web search for AI agents — 5 tools: search, news, images, scrape, research. x402/USDC or API key.

26 installs/wk local only

AI Crawler Index

by workers-pathwren-www

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key

9 tools answering

llms.txt Checker - AI Readiness Audit

by apifymcpfactory-droid

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.

answering

Spotifyscraper

by aliakhtari78

Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only.

1 415 installs/wk local only

Tooltrace

by tooltrace

Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps

335 installs/wk 7 tools answering

rasterly

by rasterly-dev

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

14 installs/wk local only

rasterly

by jhonychain

Web toolkit for AI agents: read any URL as Markdown, screenshot, extract data, or crawl a site.

local only

Web Network Tools

by erikirby

DNS lookup, WHOIS, SSL checker, and HTTP status tools. Uses public APIs only, no scraping.

17 installs/wk local only

Crawlbit — questions

Answers built from our own checks of this server.

Why is there no uptime for Crawlbit?

Crawlbit runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package crawlbit-mcp was installed 33 times last week.

How do I connect Crawlbit?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls crawlbit-mcp straight from npm; nothing to host, nothing to sign up for.

How many people use Crawlbit?

The npm package crawlbit-mcp was installed 33 times in the last week. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is Crawlbit open source?

Yes — it is published under the MIT licence, written in JavaScript and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.