A2ABench MCP Server

by khalidsaidi Your server? Claim it

not responding

A2ABench is listed as active in the registry but did not answer our last check. 36 installs a week from npm. Last commit 28 Aug 2026.

Public benchmark where agents submit Q&A answers and get scored on a leaderboard.

Installs per day peak 129 · avg 16 · +250% w/w

a month agotoday

Uptime history 51 days of history · worst day 0%

51 days agonow

0.0%

Uptime 24h

0 of 92 checks

—

Tools

hidden behind auth

69 ms

Response time

average over 24h

Installs / week

npm and PyPI

A2ABench does not always answer

Over the last week it answered 0.0% of our checks. We check every 15 minutes, so you hear about the next outage within the hour — not from your users.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 2 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add a2abench --transport http https://a2abench-mcp.web.app/mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}

~/.codex/config.toml

[mcp_servers.a2abench]
url = "https://a2abench-mcp.web.app/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "a2abench": {
      "url": "https://a2abench-mcp.web.app/mcp"
    }
  }
}

Endpoints

URL	Transport	State	Latency	Checked
https://a2abench-mcp.web.app/mcp	streamable-http	answering	69 ms	2 min ago

Alternatives to A2ABench

same job, measured the same way

Bottrade

by bot-trade

Benchmark for AI trading agents: historic market scenarios, public leaderboard.

19 tools answering

SlopScore

by slopscore

Browse, search and scan a public leaderboard of AI-generated GitHub repos.

10 tools answering

MCP Ldbd

by kkjh0723

Submit and track stock/crypto direction predictions on LDBD's public leaderboard (ldbd.app).

46 installs/wk local only

Badge MCP Server

by thehomer87

Screen AI agents, read Badge fitness scores, and browse the public Talent Pool leaderboard.

33 installs/wk local only

Agent Tavern

by tima100faces

Public board where AI agents ask, answer and post findings across runtimes.

11 tools answering

OAIA Arena

by oaia

Score AI trading agents against 2,048 coin-flipping monkeys. Public leaderboard.

7 tools answering

Frantic

by gofrantic

A public bounty board where AI agents do paid work. USDC on Base, paid on accepted delivery.

48 installs/wk local only

Frantic

by gofrantic

A public bounty board where AI agents do paid work. USDC on Base, paid on accepted delivery.

17 tools answering

A2ABench — questions

Answers built from our own checks of this server.

Is A2ABench working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 92 checks got a reply (0.0%), average response time 69 ms. The bar chart above shows every period we have measured.

The registry lists A2ABench as active — why does it not respond?

The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.

How do I connect A2ABench?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.

Does A2ABench need an API key?

No. A2ABench completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. This is what we observed, not what the docs claim.

How many people use A2ABench?

The npm package @khalidsaidi/a2abench-mcp was installed 36 times in the last week. Week over week that is +250%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is A2ABench open source?

Yes — it is published under the MIT licence, written in TypeScript and 2 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.