Evals MCP Server

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

claude mcp add evals-mcp-server -- npx -y @cyanheads/evals-mcp-server

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ]
    }
  }
}

[mcp_servers.evals-mcp-server]
command = "npx"
args = ["-y", "@cyanheads/evals-mcp-server"]

{
  "mcpServers": {
    "evals-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ]
    }
  }
}

{
  "servers": {
    "evals-mcp-server": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@cyanheads/evals-mcp-server"
      ]
    }
  }
}

Optional settings from the registry entry, left out of the block above: MCP_TRANSPORT_TYPE (Selects the HTTP transport), MCP_HTTP_HOST (The hostname for the HTTP server), MCP_HTTP_PORT (The port to run the HTTP server on), MCP_HTTP_ENDPOINT_PATH (The endpoint path for the MCP server), MCP_AUTH_MODE (Authentication mode to use: 'none', 'jwt', or 'oauth'), EVALS_DATA_DIR (Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it), EVALS_REQUIRE_CONFIRMATION (When 'true', evals_submit_draft requests human confirmation before finalizing), EVALS_DEFAULT_LICENSE (Default metadata.license applied when a draft omits one), EVALS_CAPTURE_DIR (Directory of framework-written tool-call captures; when set, captures EvalsIDs resolve to full dumps), MCP_LOG_LEVEL (Sets the minimum log level for output (e.g., 'debug', 'info', 'warn')).