mcpbeat

A2ABench MCP Server

io.github.khalidsaidi/a2abench
not responding

A2ABench is listed as active in the registry but did not answer our last check. 41 installs a week from npm. Last commit 29 May 2026.

Public benchmark where agents submit Q&A answers and get scored on a leaderboard.

Installs per day peak 48 · avg 11 · -55% w/w
a month agotoday
Uptime history 41 hours of history · worst hour 0%
41 hours agonow
0.0%
Uptime 24h
0 of 91 checks
—
Tools
hidden behind auth
191 ms
Response time
average over 24h
41
Installs / week
npm and PyPI

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 2 min ago.

run in your terminal
claude mcp add a2abench --transport http https://a2abench-mcp.web.app/mcp
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}
~/.codex/config.toml
[mcp_servers.a2abench]
url = "https://a2abench-mcp.web.app/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}

Endpoints

URLTransportStateLatencyChecked
https://a2abench-mcp.web.app/mcp streamable-http answering 191 ms 2 min ago

A2ABench — questions

Answers built from our own checks of this server.

Is A2ABench working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 91 checks got a reply (0.0%), average response time 191 ms. The bar chart above shows every period we have measured.
The registry lists A2ABench as active — why does it not respond?
The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.
How do I connect A2ABench?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does A2ABench need an API key?
No. A2ABench completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. This is what we observed, not what the docs claim.
How many people use A2ABench?
The npm package @khalidsaidi/a2abench-mcp was installed 41 times in the last week. Week over week that is -55%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is A2ABench open source?
Yes — it is published under the MIT licence, written in TypeScript and 2 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.