mcpbeat Sign in

Agent Reliability MCP Server

by agentreliability Your server? Claim it
not responding

Agent Reliability is listed as active in the registry but did not answer our last check. It exposes 9 tools. Last commit 7 Sep 2026.

Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence

Uptime history 78 days of history · worst day 0%
78 days agonow
0.0%
Uptime 24h
0 of 91 checks
9
Tools
read from the server
121 ms
Response time
average over 24h
0
Stars
last commit 7 Sep 2026

What changed 32

Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 23 August 2026. No other catalogue keeps this.

7 Sep a tool changed the parameters it asks for get_related
7 Sep a tool changed version
7 Sep a tool description was rewritten get_related
6 Sep 4 tool descriptions were rewritten answer, get_sources, get_topic and 1 more
6 Sep 2 tools changed the parameters they ask for get_sources, get_topic
6 Sep a tool appeared compare
6 Sep a tool changed version
1 Sep 7 tools changed the parameters they ask for answer, get_entity, get_latest and 4 more
1 Sep 6 tool descriptions were rewritten get_entity, get_latest, get_related and 3 more
1 Sep a tool changed version
and 7 more, back to 23 August 2026

Agent Reliability does not always answer

Over the last week it answered 0.0% of our checks. We check every 15 minutes, so you hear about the next outage within the hour — not from your users.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 12 min ago.

run in your terminal
claude mcp add agent-reliability --transport http 'https://agentreliability.dev/mcp?via=manifest'
Settings → Connectors → Add custom connector, then paste this address
https://agentreliability.dev/mcp?via=manifest
~/.codex/config.toml
[mcp_servers.agent-reliability]
url = "https://agentreliability.dev/mcp?via=manifest"
.cursor/mcp.json
{
  "mcpServers": {
    "agent-reliability": {
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "agent-reliability": {
      "type": "http",
      "url": "https://agentreliability.dev/mcp?via=manifest"
    }
  }
}

Available tools 9

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

answer
answer
Answer a question from the corpus, or refuse. Returns only the claims that bear on the question, each with the sources it cites and its editorial confidence. When the corpus cannot answer, answered is false and abstention_reason plus missing_topics say what was not covered — a refusal is a real result here, not an error. Use this when the user asked a question in words; use search when you want to see the candidates yourself.
compare
compare
Two to six knowledge objects side by side: their cards, every indexed attribute as a matrix (the same fields api/index.json publishes, null where an object does not say), the tags they share, the relations that run between them, the neighbours they have in common, and each one's claims with sources and confidence. Use this when the question is 'X vs Y', 'is X the same as Y' or 'how does X differ from Y' — search or get_topic first if you only have names, then pass the ids. An unknown id lands in `missing` with a near-miss suggestion and the rest are still compared.
entity
get_entity
Fetch one knowledge object by id, with its claims and the sources each claim cites. Use this once search, answer or get_topic has given you an id. An unknown id is not a dead end: the answer names near-miss ids you can retry with.
latest
get_latest
Most recently verified knowledge objects (freshness signal). Use this to judge how current the corpus is, or to see what changed since you last read it. It ranks by verification date and ignores your topic entirely — use search or get_topic when you want objects that are relevant rather than recent.
overview
get_overview
Corpus overview: what this instance knows, counts by type, published tags, freshness. Use this first when you land here and do not yet know whether this corpus can answer your question.
related
get_related
Graph neighbours of an object: outgoing and incoming relations, each with its relation type. PAGED: 25 relations by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. One cursor walks both directions, outgoing first; its absence means you have the last page. Use this after get_entity to widen an answer with adjacent objects. It walks one hop from an id you already have — use search when you have a question and no starting object.
search
search
Full-text search over the knowledge graph. Matching ignores accents and apostrophes, so query in the user's own words; every hit carries the fields it matched and a score. BM25 relevance: each query term is weighted by how RARE it is in this corpus and by where it hits (name 3, tags 2, questions 2, body 1). A hit must also cover a minimum share of the question's information, measured in the same rarity weights — matching only common words does not qualify. Centrality (how many objects point at this one) breaks TIES ONLY and is never part of the score, so it cannot make an irrelevant object rank. Two hits with the same matched_fields can still differ: the score is rarity-weighted, so matching a rare term is worth more than matching a common one. Use this whenever you have a question rather than an id, then follow up with get_entity.
sources
get_sources
The instance's source registry — each entry with its evidence tier, reliability and access date. PAGED: 25 entries by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue; its absence means you have the last page. Filter by object_id, tier, host or accessed_since to avoid paging through a registry you do not need. Use this when you need the registry entry behind a citation, or a sample of the whole registry to judge the corpus before trusting it; get_entity already tells you which sources a claim cites.
topic
get_topic
List the knowledge objects carrying a tag (topics are content-backed tags). PAGED: 25 objects by default, 200 at most, and a response budget of about 64 KB per call — a page over budget comes back shorter WITH a next_cursor, never truncated. Read next_cursor and call again to continue, and its absence means you have the last page. Use this to browse a known topic; use search when you have a question rather than a tag, and get_overview to see which tags exist. An unknown tag comes back with the topics that do exist, so a miss still moves you forward.

Endpoints

URLTransportStateLatencyChecked
https://agentreliability.dev/mcp?via=manifest streamable-http answering 121 ms 12 min ago

Alternatives to Agent Reliability

same job, measured the same way
LEEVAR reliability battery
by forevercrab321-svg

Grade an AI agent's transcripts on 18 reliability tests. Thin evidence is NOT TESTED, not guessed.

local only
Wcag Accessibility
by aditya-ariosity

A WCAG accessibility testing MCP for AI agents, Codex, Claude Code, and automated UI audits.

74 installs/wk local only
Colter
by mfbahc

Colter audits product pages for AI shopping agents and returns fixes, tests, and Evidence Packs.

86 installs/wk local only
Testers.ai CARBON Test Harness Lite
by jarbon

Local QA workflows, test evidence, screenshot maps and confidence reports for AI coding agents.

local only
Assessment Intelligence
by saifs

Analyse tests for item quality, true ability, reliability and learner mastery.

answering
CARBON
by jarbon

AI testing harness with Jay: risk-based checks, bug investigation, and local evidence reports.

53 installs/wk local only
A
Agent Market
by run-us-central1-agent-market-826727841930

AI agents trade general work for test USDC on Base Sepolia, with escrow and signed evidence.

45 tools answering
Argus — Testing for Coding Agents
by chriswu727

Testing MCP for coding agents: exercise real user journeys, find bugs, verify them with evidence.

1 114 installs/wk local only

Agent Reliability — questions

Answers built from our own checks of this server.

What can Agent Reliability do?
It exposes 9 tools, read directly from the server on our last check. Among them: answer, compare, get_entity, get_latest, get_overview, get_related and 3 more. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is Agent Reliability working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 91 checks got a reply (0.0%), average response time 121 ms. The bar chart above shows every period we have measured.
The registry lists Agent Reliability as active — why does it not respond?
The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.
How do I connect Agent Reliability?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does Agent Reliability need an API key?
No. Agent Reliability completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 9 of them are readable on this page. This is what we observed, not what the docs claim.
Is Agent Reliability open source?
No, and the distinction matters: its licence is declared as CC-BY-4.0. That makes it source-available — you can read the code, but the terms are the author's own, not one of the recognised open-source licences. Read them before you build on it.