Atalaya AI crawler check MCP Server

by atalaya-ai Your server? Claim it

answering

Atalaya AI crawler check is answering right now. Last checked 7 min ago. It exposes 2 tools.

Which AI crawlers (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot) a website allows, and why.

Uptime history 5 days of history

5 days agonow

100.0%

Uptime 24h

91 of 91 checks

Tools

read from the server

187 ms

Response time

average over 24h

open, no key

Access

streamable-http

Nothing serious here today

Today is the operative word: we check Atalaya AI crawler check every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 7 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add ai-crawler-check --transport http https://atalaya-ai.com/mcp

Settings → Connectors → Add custom connector, then paste this address

https://atalaya-ai.com/mcp

~/.codex/config.toml

[mcp_servers.ai-crawler-check]
url = "https://atalaya-ai.com/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "ai-crawler-check": {
      "url": "https://atalaya-ai.com/mcp"
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "ai-crawler-check": {
      "type": "http",
      "url": "https://atalaya-ai.com/mcp"
    }
  }
}

Available tools 2

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

crawler

check_ai_crawler_access

Checks whether AI crawlers can reach and read a public website or web app: which AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended and more) robots.txt allows and the exact rule for each, how much text the homepage HTML carries for crawlers that do not run JavaScript (flags client-rendered app shells, common in apps built with Lovable, Bolt, Base44 or Replit), title/meta description/H1, llms.txt, sitemap, and the platform or host setting to change (Cloudflare, Vercel, Netlify). Use it when someone asks why their site or app does not show up in ChatGPT, Claude, Perplexity or other AI answers.

crawlers

list_ai_crawlers

Lists the AI crawler user-agent tokens Atalaya checks, by vendor and purpose (training, search index, user-triggered fetch), so you can write a robots.txt that keeps AI search while opting out of training.

Endpoints

URL	Transport	State	Latency	Checked
https://atalaya-ai.com/mcp	streamable-http	answering	142 ms	7 min ago

Alternatives to Atalaya AI crawler check

same job, measured the same way

AI Crawler Access Checker

by nero-engine

Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

answering

Crawlerpeek

by crawlerpeek

Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

181 installs/wk local only

AI Readiness

by epistemedeus

Check if a website is visible to AI search (ChatGPT, Perplexity, Claude) and get per-gap fixes.

local only

AI Readiness (hosted)

by samedaydesk

Check if a website is visible to AI search (ChatGPT, Perplexity, Claude). No install.

7 tools answering

Rankli: AI search readiness

by rankli-www

Checks if ChatGPT, Claude, Gemini and Perplexity can reach and read a website, with ranked fixes.

1 tools answering

Agentwatch

by comiza

Check if ChatGPT, Claude and Perplexity can reach, read and quote a website.

4 tools answering

Citewren

by workers-cybermax-tools-cybermax

AI search readiness MCP: score a site for ChatGPT/Claude/Perplexity crawlers. 3 free/day.

1 tools answering

GEO Scanner

by agundur

Checks whether a website is readable and citable by AI systems (ChatGPT, Claude, Perplexity, etc.)

2 tools answering

Atalaya AI crawler check — questions

Answers built from our own checks of this server.

What can Atalaya AI crawler check do?

It exposes 2 tools, read directly from the server on our last check. Among them: check_ai_crawler_access, list_ai_crawlers. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →

Is Atalaya AI crawler check working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 187 ms. The bar chart above shows every period we have measured.

How do I connect Atalaya AI crawler check?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.

Does Atalaya AI crawler check need an API key?

No. Atalaya AI crawler check completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 2 of them are readable on this page. This is what we observed, not what the docs claim.

How fast is Atalaya AI crawler check?

It answers our handshake in 187 ms on average, which is faster than 73% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.