mcpbeat Sign in

Evals MCP Server

local only

Evals MCP Server runs on your own machine — the client starts it, so there is no endpoint to ping. 47 installs a week from npm. Last commit 22 Aug 2026.

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Installs per day peak 169 · avg 14 · +79% w/w
a month agotoday
47
Installs / week
npm · @cyanheads/evals-mcp-server
1
Stars
5 open issues
22 Aug 2026
Last commit
0 releases in 90 days
Apache-2.0
License
TypeScript

Nothing serious here today

Today is the operative word: we check Evals MCP Server every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Three servers free · no card

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

run in your terminal
claude mcp add evals-mcp-server -- npx -y @cyanheads/evals-mcp-server
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "evals-mcp-server": {
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ],
      "command": "npx"
    }
  }
}
~/.codex/config.toml
[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server"]
.cursor/mcp.json
{
  "mcpServers": {
    "evals-mcp-server": {
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ],
      "command": "npx"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "evals-mcp-server": {
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ],
      "command": "npx"
    }
  }
}

This one needs environment variables set before it will start: MCP_HTTP_HOST (The hostname for the HTTP server.), MCP_HTTP_PORT (The port to run the HTTP server on.), MCP_HTTP_ENDPOINT_PATH (The endpoint path for the MCP server.), MCP_AUTH_MODE (Authentication mode to use: 'none', 'jwt', or 'oauth'.), EVALS_DATA_DIR (Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.), EVALS_REQUIRE_CONFIRMATION (When 'true', evals_submit_draft requests human confirmation before finalizing.), EVALS_DEFAULT_LICENSE (Default metadata.license applied when a draft omits one.), EVALS_CAPTURE_DIR (Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps.), MCP_LOG_LEVEL (Sets the minimum log level for output (e.g., 'debug', 'info', 'warn').). The author declared them in the registry entry; get the values from the project itself.

Alternatives to Evals MCP Server

same job, measured the same way
N
Glyt
by glyt

Human-in-the-loop approval for agent actions, with verifiable action-bound receipts.

6 tools answering
ALEETH Authority MCP
by aleeth

The first MCP governed by ICA. Every action is gated and sealed with a verifiable receipt.

answering
Elicitly Pro
by elicitly

Human-in-the-loop for AI agents over MCP: durable approvals with a hosted review page & audit trail

answering
Nexusfeed Abc
by nexusfeed

US liquor license compliance records (CA, TX, NY, FL, IL) with verifiable provenance.

local only
Rate-My-Agent
by rate-my-agent-mcp

Get matched with a top-rated, review-verified real estate agent in the US or Canada.

3 tools answering
Agent Notary
by jdhart81

Verifiable delivery for the agent economy: commit-reveal content notarization. Sellers commit to a d

6 tools answering
Agentseal
by joeybrar

Verifiable action logs for AI agents. Every action is recorded in a SHA-256 hash chain.

33 installs/wk local only
Longwire
by longwiremedia

Your private media library and records, with receipts: search, recordings, and a verifiable ledger.

local only

Evals MCP Server — questions

Answers built from our own checks of this server.

Why is there no uptime for Evals MCP Server?
Evals MCP Server runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package @cyanheads/evals-mcp-server was installed 47 times last week.
How do I connect Evals MCP Server?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls @cyanheads/evals-mcp-server straight from npm; nothing to host, nothing to sign up for.
How many people use Evals MCP Server?
The npm package @cyanheads/evals-mcp-server was installed 47 times in the last week. Week over week that is +79%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is Evals MCP Server open source?
Yes — it is published under the Apache-2.0 licence, written in TypeScript, 1 stars on GitHub and 5 open issues. The source link is on this page, so you can read exactly what it does with your data before you connect it.