mcpbeat Sign in

MCP Eval Runner MCP Server

local only

MCP Eval Runner runs on your own machine — the client starts it, so there is no endpoint to ping. 27 installs a week from npm. Last commit 24 Mar 2026.

A standardized testing harness for MCP servers and agent workflows

Installs per day peak 22 · avg 6 · +0% w/w
a month agotoday
27
Installs / week
npm · mcp-eval-runner
0
Stars
0 open issues
24 Mar 2026
Last commit
0 releases in 90 days
MIT
License
TypeScript

What the code does

We read the source, 18 h ago · rules 3dff92dd89df

Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Builds a file path from a variable src/fixture-library.ts:89
    const destPath = path.join(dest, fileName);
Runs an external command src/runner.ts:124
    this.proc = spawn(command, args, {

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

This code can reach further than it looks

We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.

Three servers free · no card

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

run in your terminal
claude mcp add mcp-eval-runner -- npx -y mcp-eval-runner
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "mcp-eval-runner"
      ],
      "command": "npx"
    }
  }
}
~/.codex/config.toml
[mcp_servers.mcp-eval-runner]
command = "npx"
args = ["-y", "mcp-eval-runner"]
.cursor/mcp.json
{
  "mcpServers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "mcp-eval-runner"
      ],
      "command": "npx"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "mcp-eval-runner": {
      "args": [
        "-y",
        "mcp-eval-runner"
      ],
      "command": "npx"
    }
  }
}

This one needs environment variables set before it will start: YOUR_API_KEY (Your API key for the service). The author declared them in the registry entry; get the values from the project itself.

Alternatives to MCP Eval Runner

same job, measured the same way
Testkube MCP
by kubeshop

MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants

local only
I
Elias MCP Sample Server
by elpadev

A sample MCP server for testing

81 installs/wk local only
I
CTnP MCP Server
by jitsmaster

Ingeniux CTnP MCP server for personalization, A/B testing, and audience management.

local only
Testdino MCP
by testdino-inc

A MCP server for TestDino

856 installs/wk local only
Coverctl
by klarlabs-studio

Go code coverage analysis tool with MCP server for AI-powered coverage workflows

local only
Coverctl
by felixgeelhaar

Go code coverage analysis tool with MCP server for AI-powered coverage workflows

local only
Mobile MCP
by mobile-next

MCP server for iOS and Android Mobile Development, Automation and Testing

39 229 installs/wk local only
D
Ceraph
by ceraph

MCP server for agent-driven React Native and Expo development and mobile testing

656 installs/wk local only

MCP Eval Runner — questions

Answers built from our own checks of this server.

Why is there no uptime for MCP Eval Runner?
MCP Eval Runner runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package mcp-eval-runner was installed 27 times last week.
How do I connect MCP Eval Runner?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls mcp-eval-runner straight from npm; nothing to host, nothing to sign up for.
How many people use MCP Eval Runner?
The npm package mcp-eval-runner was installed 27 times in the last week. Week over week that is +0%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is MCP Eval Runner open source?
Yes — it is published under the MIT licence, written in TypeScript and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.