mcpbeat Sign in

AI Crawler Access Check MCP Server

by hamzawamiqhq Your server? Claim it
not responding

AI Crawler Access Check is listed as active in the registry but did not answer our last check. It exposes 1 tools.

Can GPTBot, ClaudeBot and PerplexityBot reach a site? Real fetch per crawler, firewall/CDN blocks.

Uptime history 33 days of history · worst day 0%
33 days agonow
0.0%
Uptime 24h
0 of 91 checks
1
Tools
read from the server
115 ms
Response time
average over 24h
open, no key
Access
streamable-http

AI Crawler Access Check does not always answer

Over the last week it answered 0.0% of our checks. We check every 15 minutes, so you hear about the next outage within the hour — not from your users.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 7 min ago.

run in your terminal
claude mcp add ai-crawler-check --transport http 'https://check.citant.ai/mcp?src=registry'
Settings → Connectors → Add custom connector, then paste this address
https://check.citant.ai/mcp?src=registry
~/.codex/config.toml
[mcp_servers.ai-crawler-check]
url = "https://check.citant.ai/mcp?src=registry"
.cursor/mcp.json
{
  "mcpServers": {
    "ai-crawler-check": {
      "url": "https://check.citant.ai/mcp?src=registry"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "ai-crawler-check": {
      "type": "http",
      "url": "https://check.citant.ai/mcp?src=registry"
    }
  }
}

Available tools 1

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

crawler
check_ai_crawler_access
Checks whether AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and others) can actually reach a website. Goes beyond robots.txt: fetches the site as each crawler and detects firewall/CDN blocks (Cloudflare, Akamai, Imperva), challenge pages, noindex and llms.txt. Returns a 0-100 AI Access Score, a per-crawler verdict and the top issues with fixes. Takes 15-60 seconds.

Endpoints

URLTransportStateLatencyChecked
https://check.citant.ai/mcp?src=registry streamable-http answering 115 ms 7 min ago

Alternatives to AI Crawler Access Check

same job, measured the same way
AI Crawler Access Checker
by nero-engine

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

answering
Crawlerpeek
by crawlerpeek

Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

181 installs/wk local only
Atalaya AI crawler check
by atalaya-ai

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

2 tools answering
Rankli: AI search readiness
by rankli-www

Checks if ChatGPT, Claude, Gemini and Perplexity can reach and read a website, with ranked fixes.

1 tools answering
Agentwatch
by comiza

Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

4 tools answering
QQQ AI Visibility Checker
by qqq

Free AI visibility check: can AI crawlers read a site, and do ChatGPT, Gemini, Perplexity cite it?

3 tools answering
citable
by genzagents

Can ChatGPT, Claude and Perplexity read and cite your site? robots.txt, edge blocks, llms.txt.

202 installs/wk local only
Nodpick AI readiness
by nodpick

Free AI-readiness audit: can ChatGPT, Claude and Perplexity read and cite a site? Fix snippets.

5 tools answering

AI Crawler Access Check — questions

Answers built from our own checks of this server.

What can AI Crawler Access Check do?
It exposes 1 tools, read directly from the server on our last check. Among them: check_ai_crawler_access. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is AI Crawler Access Check working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 91 checks got a reply (0.0%), average response time 115 ms. The bar chart above shows every period we have measured.
The registry lists AI Crawler Access Check as active — why does it not respond?
The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.
How do I connect AI Crawler Access Check?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does AI Crawler Access Check need an API key?
No. AI Crawler Access Check completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 1 of them are readable on this page. This is what we observed, not what the docs claim.