Crawlbit MCP Server

by amati032-dev Your server? Claim it

local only

Crawlbit runs on your own machine — the client starts it, so there is no endpoint to ping. 52 installs a week from npm. Last commit 15 Aug 2026.

Four free tools to check if AI engines can find, read and recognise a site. No API key.

Installs per day peak 11 · avg 5 · -9% w/w

a month agotoday

Installs / week

npm · crawlbit-mcp

Stars

0 open issues

15 Aug 2026

Last commit

2 releases in 90 days

MIT

License

JavaScript

Nothing serious here today

Today is the operative word: we check Crawlbit every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add crawlbit -- npx -y crawlbit-mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "crawlbit": {
      "command": "npx",
      "args": [
        "-y",
        "crawlbit-mcp"
      ]
    }
  }
}

~/.codex/config.toml

[mcp_servers.crawlbit]
command = "npx"
args = ["-y", "crawlbit-mcp"]

.cursor/mcp.json

{
  "mcpServers": {
    "crawlbit": {
      "command": "npx",
      "args": [
        "-y",
        "crawlbit-mcp"
      ]
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "crawlbit": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "crawlbit-mcp"
      ]
    }
  }
}

Optional settings from the registry entry, left out of the block above: CRAWLBIT_BASE_URL (Optional. Point the server at another CrawlBit instance. Defaults to https://www.crawlbit.app. No API key or account is needed to use this server).

Alternatives to Crawlbit

same job, measured the same way

IndexLinks

by indexlinks

Check how crawlers see a site, send new pages to search engines and AI crawlers, see crawl receipts.

answering

AEO Lookup

by aeolookup

Free AI crawler, schema, llms.txt and answer-readiness checks for public web pages. No API key.

11 tools answering

QQQ AI Visibility Checker

by qqq

Free AI visibility check: can AI crawlers read a site, and do ChatGPT, Gemini, Perplexity cite it?

3 tools answering

CitedBy

by citedby

Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.

4 tools answering

PageCritic

by pagecritic

Audit a landing page's conversion (score, top issues, fixes) and check if AI crawlers can read it.

3 tools answering

Fourward AI visibility tools

by fourwardhq

Score any website's AI search visibility out of 100 and see which of 20 AI crawlers can read it.

2 tools answering

QueryRev AI Readiness

by queryrev

Checks a site for AI crawler access, robots.txt and llms.txt. Runs locally, no telemetry.

471 installs/wk local only

upGrowth Growth Toolkit

by upgrowth

29 free read-only growth tools: CAC, ROAS, PPC, schema, meta tags, robots.txt and AI crawler checks.

29 tools answering

Crawlbit — questions

Answers built from our own checks of this server.

Why is there no uptime for Crawlbit?

Crawlbit runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package crawlbit-mcp was installed 52 times last week.

How do I connect Crawlbit?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It runs locally, so the command pulls crawlbit-mcp straight from npm; nothing to host, nothing to sign up for.

How many people use Crawlbit?

The npm package crawlbit-mcp was installed 52 times in the last week. Week over week that is -9%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is Crawlbit open source?

Yes — it is published under the MIT licence, written in JavaScript and 1 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.