mcpbeat Sign in

AI Crawler Access Checker MCP Server

answering

AI Crawler Access Checker is answering right now. Last checked 1 min ago.

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

Uptime history 22 hours of history
22 hours agonow
100.0%
Uptime 24h
81 of 81 checks
—
Tools
hidden behind auth
364 ms
Response time
average over 24h
API key
Access
streamable-http

Nothing serious here today

Today is the operative word: we check AI Crawler Access Checker every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 1 min ago.

run in your terminal
claude mcp add ai-crawler-access-checker --transport http 'https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker'
Settings → Connectors → Add custom connector, then paste this address
https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker
~/.codex/config.toml
[mcp_servers.ai-crawler-access-checker]
url = "https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker"
.cursor/mcp.json
{
  "mcpServers": {
    "ai-crawler-access-checker": {
      "url": "https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "ai-crawler-access-checker": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, but you need an API key from its owner to call it.

Endpoints

URLTransportStateLatencyChecked
https://mcp.apify.com/?tools=nerolabs/ai-crawler-access-checker streamable-http needs key 355 ms 1 min ago

Alternatives to AI Crawler Access Checker

same job, measured the same way
Crawlerpeek
by crawlerpeek

Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

1 435 installs/wk local only
QQQ AI Visibility Checker
by qqq

Free AI visibility check: can AI crawlers read a site, and do ChatGPT, Gemini, Perplexity cite it?

3 tools answering
Agentwatch
by comiza

Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

4 tools answering
Rankli: AI search readiness
by rankli-www

Checks if ChatGPT, Claude, Gemini and Perplexity can reach and read a website, with ranked fixes.

1 tools answering
TraceFlow Lens
by traceflowlabs-lens

SEO and GEO audit: check if a site can be read and cited by Google, ChatGPT, Perplexity and Claude.

answering
AI Readiness
by epistemedeus

Check if a website is visible to AI search (ChatGPT, Perplexity, Claude) and get per-gap fixes.

local only
Citewren
by workers-cybermax-tools-cybermax

AI search readiness MCP: score a site for ChatGPT/Claude/Perplexity crawlers. 3 free/day.

1 tools answering
GEO Scanner
by agundur

Checks whether a website is readable and citable by AI systems (ChatGPT, Claude, Perplexity, etc.)

2 tools answering

AI Crawler Access Checker — questions

Answers built from our own checks of this server.

Why is there no tool list for AI Crawler Access Checker?
The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.
Is AI Crawler Access Checker working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 81 of 81 checks got a reply (100.0%), average response time 364 ms. The bar chart above shows every period we have measured.
How do I connect AI Crawler Access Checker?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You will need your own key: it refuses anonymous clients.
Does AI Crawler Access Checker need an API key?
Yes. Every time we knock, AI Crawler Access Checker answers with an authorization challenge instead of its tool list — that is how we know it is running and gated rather than broken. Bring your own credentials and it will talk.
How fast is AI Crawler Access Checker?
It answers our handshake in 364 ms on average, which is faster than 37% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.