mcpbeat

Eval Engine API MCP Server

io.github.invertedhoologan/eval-engine-mcp
not responding

Eval Engine API is listed as active in the registry but did not answer our last check.

Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

Uptime history 46 hours of history · worst hour 0%
46 hours agonow
0.0%
Uptime 24h
0 of 91 checks
—
Tools
hidden behind auth
79 ms
Response time
average over 24h
open, no key
Access
streamable-http

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 6 min ago.

run in your terminal
claude mcp add eval-engine-mcp --transport http https://eval.zuluworksai.com/mcp
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}
~/.codex/config.toml
[mcp_servers.eval-engine-mcp]
url = "https://eval.zuluworksai.com/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}

Endpoints

URLTransportStateLatencyChecked
https://eval.zuluworksai.com/mcp streamable-http answering 79 ms 6 min ago

Eval Engine API — questions

Answers built from our own checks of this server.

Is Eval Engine API working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 91 checks got a reply (0.0%), average response time 79 ms. The bar chart above shows every period we have measured.
The registry lists Eval Engine API as active — why does it not respond?
The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.
How do I connect Eval Engine API?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does Eval Engine API need an API key?
No. Eval Engine API completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. This is what we observed, not what the docs claim.