Eval Engine API MCP Server

by invertedhoologan Your server? Claim it

not responding

Eval Engine API is listed as active in the registry but did not answer our last check.

Pay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.

Uptime history 51 days of history · worst day 0%

51 days agonow

0.0%

Uptime 24h

0 of 91 checks

—

Tools

hidden behind auth

146 ms

Response time

average over 24h

open, no key

Access

streamable-http

Eval Engine API does not always answer

Over the last week it answered 0.0% of our checks. We check every 15 minutes, so you hear about the next outage within the hour — not from your users.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 0 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add eval-engine-mcp --transport http https://eval.zuluworksai.com/mcp

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}

~/.codex/config.toml

[mcp_servers.eval-engine-mcp]
url = "https://eval.zuluworksai.com/mcp"

.cursor/mcp.json

{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}

.vscode/mcp.json

{
  "mcpServers": {
    "eval-engine-mcp": {
      "url": "https://eval.zuluworksai.com/mcp"
    }
  }
}

Endpoints

URL	Transport	State	Latency	Checked
https://eval.zuluworksai.com/mcp	streamable-http	answering	146 ms	0 min ago

Alternatives to Eval Engine API

same job, measured the same way

Toolroute

by grossiweb

Route AI agent tasks to the best MCP server and LLM, scored on 132+ real benchmark executions.

846 installs/wk local only

MCP Scorecard MCP

by csoai-org

Score any MCP server against a 100-point production-readiness rubric (static AST + PyPI +...

101 installs/wk local only

JSON Repair MCP

by grupoanesthy-spec

Repairs malformed JSON from LLM output, validated against a schema. Paid per call via Stripe.

61 installs/wk local only

AI Eval

by lazymac2x

Cloudflare Workers MCP server: ai-eval

3 tools answering

operant-mcp

by saagpatel

Read-only MCP server for the OPERANT AI operating-agent calibration benchmark.

33 installs/wk 5 tools answering

Agent Workflow Engine

by lazymac2x

Cloudflare Workers MCP server: agent-workflow-engine

5 tools answering

LLM Output Quality Monitor

by lazymac2x

Cloudflare Workers MCP server: llm-output-quality-monitor

5 tools answering

Donovanh

by donovanh

MCP server for Lightning Tools — pay-per-call AI tools via Bitcoin Lightning

22 installs/wk local only

Eval Engine API — questions

Answers built from our own checks of this server.

Is Eval Engine API working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 0 of 91 checks got a reply (0.0%), average response time 146 ms. The bar chart above shows every period we have measured.

The registry lists Eval Engine API as active — why does it not respond?

The official MCP registry stores what the author submitted; it does not verify that the server still runs. We check the endpoint ourselves, and this one does not answer. Catalogues that copy the registry without checking will show it as working.

How do I connect Eval Engine API?

Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.

Does Eval Engine API need an API key?

No. Eval Engine API completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. This is what we observed, not what the docs claim.