Agent Reliability is listed as active in the registry but did not answer our last check. It exposes 9 tools. Last commit 7 Sep 2026.
Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 23 August 2026. No other catalogue keeps this.
Over the last week it answered 0.0% of our checks. We check every 15 minutes, so you hear about the next outage within the hour — not from your users.
Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 12 min ago.
claude mcp add agent-reliability --transport http 'https://agentreliability.dev/mcp?via=manifest'
https://agentreliability.dev/mcp?via=manifest
[mcp_servers.agent-reliability]
url = "https://agentreliability.dev/mcp?via=manifest"
{
"mcpServers": {
"agent-reliability": {
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}
{
"servers": {
"agent-reliability": {
"type": "http",
"url": "https://agentreliability.dev/mcp?via=manifest"
}
}
}
Read directly from the server with tools/list, grouped by what they act on.
If a tool disappears, we record the date.
answer
compare
get_entity
get_latest
get_overview
get_related
search
get_sources
get_topic
| URL | Transport | State | Latency | Checked |
|---|---|---|---|---|
| https://agentreliability.dev/mcp?via=manifest | streamable-http | answering | 121 ms | 12 min ago |
Grade an AI agent's transcripts on 18 reliability tests. Thin evidence is NOT TESTED, not guessed.
A WCAG accessibility testing MCP for AI agents, Codex, Claude Code, and automated UI audits.
Colter audits product pages for AI shopping agents and returns fixes, tests, and Evidence Packs.
Local QA workflows, test evidence, screenshot maps and confidence reports for AI coding agents.
Analyse tests for item quality, true ability, reliability and learner mastery.
AI testing harness with Jay: risk-based checks, bug investigation, and local evidence reports.
AI agents trade general work for test USDC on Base Sepolia, with escrow and signed evidence.
Testing MCP for coding agents: exercise real user journeys, find bugs, verify them with evidence.
Answers built from our own checks of this server.