Crawl Readiness MCP Server

by grubbomatic Your server? Claim it

local only

Crawl Readiness runs on your own machine — the client starts it, so there is no endpoint to ping. 671 installs a week from npm. Last commit 22 Sep 2026.

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

Installs per day peak 170 · avg 6

a month agotoday

671

Installs / week

npm · crawl-readiness-mcp

Stars

0 open issues

22 Sep 2026

Last commit

0 releases in 90 days

MIT

License

JavaScript

Nothing serious here today

Today is the operative word: we check Crawl Readiness every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add crawl-readiness -- npx -y crawl-readiness-mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "crawl-readiness": {
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ],
      "command": "npx"
    }
  }
}

~/.codex/config.toml

[mcp_servers.crawl-readiness]
command = "npx"
args = ["-y", "crawl-readiness-mcp"]

.cursor/mcp.json

{
  "mcpServers": {
    "crawl-readiness": {
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ],
      "command": "npx"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "crawl-readiness": {
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ],
      "command": "npx"
    }
  }
}

This one needs environment variables set before it will start: CRAWL_READINESS_API_KEY (Free API key from https://www.crawlreadiness.com/dashboard. The four audit tools work without it; the three generators and get_monitor_trend need it.), CRAWL_READINESS_API_BASE (Override the API base URL. Only useful for testing against a preview deployment; defaults to https://www.crawlreadiness.com.). The author declared them in the registry entry; get the values from the project itself.

Alternatives to Crawl Readiness

same job, measured the same way

Geolint

by iliasabk

ESLint for AI search: audits AI-crawler access, llms.txt, schema and citability.

1 214 installs/wk local only

Robotstxt AI

by sharozdawa

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

26 installs/wk local only

Citevana AI visibility tools

by citevana

Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation.

4 tools answering

llms.txt Checker - AI Readiness Audit

by apifymcpfactory-droid

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.

answering

ActableSite AI Crawler Monitor

by actablesite

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

5 tools answering

AEO Audit

by synligdigital

AEO audit: score any website 0-100 for AI visibility. Checks schema, meta, content, AI crawlers.

4 tools answering

AI Visibility

by lastminutedealshq

AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.

4 tools answering

Aeo MCP

by arthurcarlsonn

AEO tools for AI agents: crawler permissions, llms.txt, structured data, AI-readiness audit.

37 installs/wk local only

Crawl Readiness — questions

Answers built from our own checks of this server.

Why is there no uptime for Crawl Readiness?

Crawl Readiness runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package crawl-readiness-mcp was installed 671 times last week.

How do I connect Crawl Readiness?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls crawl-readiness-mcp straight from npm; nothing to host, nothing to sign up for.

How many people use Crawl Readiness?

The npm package crawl-readiness-mcp was installed 671 times in the last week. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is Crawl Readiness open source?

Yes — it is published under the MIT licence, written in JavaScript and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.