Crawl Readiness MCP Server

by grubbomatic Your server? Claim it

local only

Crawl Readiness runs on your own machine — the client starts it, so there is no endpoint to ping. 416 installs a week from npm. Last commit 30 Oct 2026.

Check what AI crawlers may read and what a page permits, generate llms.txt and schema.

Installs per day peak 464 · avg 46 · +72% w/w

a month agotoday

416

Installs / week

npm · crawl-readiness-mcp

Stars

0 open issues

30 Oct 2026

Last commit

12 releases in 90 days

MIT

License

JavaScript

Nothing serious here today

Today is the operative word: we check Crawl Readiness every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add crawl-readiness -- npx -y crawl-readiness-mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "crawl-readiness": {
      "command": "npx",
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ]
    }
  }
}

~/.codex/config.toml

[mcp_servers.crawl-readiness]
command = "npx"
args = ["-y", "crawl-readiness-mcp"]

.cursor/mcp.json

{
  "mcpServers": {
    "crawl-readiness": {
      "command": "npx",
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ]
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "crawl-readiness": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "crawl-readiness-mcp"
      ]
    }
  }
}

Optional settings from the registry entry, left out of the block above: CRAWL_READINESS_API_KEY (Free API key from https://www.crawlreadiness.com/dashboard. The four audit tools and check_permission work without it; the three generators need it, and get_monitor_trend needs one on a plan with Answer Analyses), CRAWL_READINESS_API_BASE (Override the API base URL. Only useful for testing against a preview deployment; defaults to https://www.crawlreadiness.com).

Alternatives to Crawl Readiness

same job, measured the same way

Geoscore

by cloudcorprecords

AI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.

241 installs/wk local only

CitedBy

by citedby

Check a page, AI-crawler access, llms.txt and backlinks of a site. Free, read-only.

4 tools answering

Citevana AI visibility tools

by citevana

Free MCP tools for AI-search visibility: crawler checks, page audits, and llms.txt generation.

4 tools answering

Agent Ready Website Audit

by workpods

SEO and AI search audit for any website: technical SEO, schema, AI crawler access and llms.txt.

12 tools answering

RobotsGate

by workers-mike-tusa-robotsgate

Generate, validate and check robots.txt rules for AI crawlers. Free; optional Pro key.

4 tools answering

Llms Generator MCP

by robertoyanguas-ops

Crawls any website and generates a standards-compliant /llms.txt file and JSON-LD schema bundle.

2 tools answering

llms.txt Checker - AI Readiness Audit

by apifymcpfactory-droid

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.

answering

AI Visibility

by lastminutedealshq

AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.

4 tools answering

Crawl Readiness — questions

Answers built from our own checks of this server.

Why is there no uptime for Crawl Readiness?

Crawl Readiness runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package crawl-readiness-mcp was installed 416 times last week.

How do I connect Crawl Readiness?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It runs locally, so the command pulls crawl-readiness-mcp straight from npm; nothing to host, nothing to sign up for.

How many people use Crawl Readiness?

The npm package crawl-readiness-mcp was installed 416 times in the last week. Week over week that is +72%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is Crawl Readiness open source?

Yes — it is published under the MIT licence, written in JavaScript and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.