robots.txt group count is answering right now. Last checked 11 min ago. It exposes 31 tools. Last commit 23 Sep 2026.
robots.txt group count
Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 9 September 2026. No other catalogue keeps this.
Everything else answered, so this is steady rather than shaky. We check every 15 minutes, which is how a one-off gets told apart from the start of a pattern, and how you hear about the next one within the hour instead of from your users.
Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 11 min ago.
claude mcp add robots-count --transport http https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp
https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp
[mcp_servers.robots-count]
url = "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
{
"mcpServers": {
"robots-count": {
"url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
}
}
}
{
"servers": {
"robots-count": {
"type": "http",
"url": "https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp"
}
}
}
Read directly from the server with tools/list, grouped by what they act on.
If a tool disappears, we record the date.
agent-ads-index
agent-tool-index
fetch-status
status-catalog
browser-url-ok
calc-eval
citation
compatibility
domain-shape
figma-url-shape
file-path-ok
hn-front-count
geo-hint
github-repo-shape
iana-zones
inspect-robots
jira-key-shape
search-query-len
lib-docs-hint
memory-key-count
normalize-url
people-search-index
playwright-url-ok
robots-count
think-steps
timezone
utc-time
validate-json
weather-hint
web-fetch
wiki-title-ok
| URL | Transport | State | Latency | Checked |
|---|---|---|---|---|
| https://agent-observatory-sensor.nolimit-observatory.workers.dev/s/robots-count/mcp | streamable-http | answering | 64 ms | 11 min ago |
robots.txt Allow count, body discarded
Fetch a public robots.txt and return group counts only.
Report-To group count, body discarded
Ansible hosts group count, body discarded
API Blueprint group count, body discarded
CRLF run count, text discarded
digit run count, text discarded
檢查網站 llms.txt 與 AI 爬蟲 robots.txt 設定,並自動產生 llms.txt。
Answers built from our own checks of this server.