mcpbeat Sign in

Evalview MCP Server

local only

Evalview MCP runs on your own machine — the client starts it, so there is no endpoint to ping. 984 installs a week from pypi. Last commit 5 Sep 2026.

Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

Installs per day peak 570 · avg 155 · -28% w/w
a month agotoday
984
Installs / week
pypi · evalview
134
Stars
2 open issues
5 Sep 2026
Last commit
0 releases in 90 days
Apache-2.0
License
Python

What the code does

We read the source, 19 h ago · rules 3dff92dd89df

A tool parameter reaches a dangerous call

A value the model can set ends up inside a file or shell call. That is not a flaw by itself — for a terminal server it is the job — but it is where things go wrong when it is not.

A tool parameter reaches a dangerous call validate_skill.skill_path → evalview/mcp_server.py:663, replay.test_path → evalview/mcp_server.py:724, replay.test_path → evalview/mcp_server.py:803
            result = subprocess.run(
Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

A tool parameter here reaches a dangerous call

That is not a flaw by itself — but it is where things go wrong when it is not the job. We re-read this code on every release. Watch it and you hear from us the day another one appears.

Three servers free · no card

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

run in your terminal
claude mcp add evalview-mcp -- uvx evalview
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "evalview-mcp": {
      "args": [
        "evalview"
      ],
      "command": "uvx"
    }
  }
}
~/.codex/config.toml
[mcp_servers.evalview-mcp]
command = "uvx"
args = ["evalview"]
.cursor/mcp.json
{
  "mcpServers": {
    "evalview-mcp": {
      "args": [
        "evalview"
      ],
      "command": "uvx"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "evalview-mcp": {
      "args": [
        "evalview"
      ],
      "command": "uvx"
    }
  }
}

This one needs environment variables set before it will start: OPENAI_API_KEY (OpenAI API key for LLM-as-judge output quality scoring. Optional — deterministic tool/sequence evaluation works without it.). The author declared them in the registry entry; get the values from the project itself.

Alternatives to Evalview MCP

same job, measured the same way
Agent Eval
by rudrendupaul

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

161 installs/wk local only
Dungbeetle
by dungbeetle

Visual regression & snapshot testing for AI agents — list runs, read semantic diffs, review.

42 installs/wk local only
S
marginal
by marginal

Email A/B tests for AI agents: subject lines, managed sends, open/click tracking, and results.

answering
Lastest
by las-team

Run visual regression tests, review diffs, and manage baselines on a Lastest instance.

37 installs/wk local only
Wcag Accessibility
by aditya-ariosity

A WCAG accessibility testing MCP for AI agents, Codex, Claude Code, and automated UI audits.

62 installs/wk local only
Tesults MCP
by tesults

Ask your AI agent why your tests are failing. Instant analysis on failures and regressions.

25 installs/wk local only
App Manager
by lance

App Store Connect operator for AI agents: icons, TestFlight builds, listings, IAP, rejection fixes.

answering
Code Factory
by zrk222

Local proof facts for AI coding clients: intent, tests, Graph Ops, and review evidence.

2 646 installs/wk local only

Evalview MCP — questions

Answers built from our own checks of this server.

Why is there no uptime for Evalview MCP?
Evalview MCP runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the pypi package evalview was installed 984 times last week.
How do I connect Evalview MCP?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls evalview straight from pypi; nothing to host, nothing to sign up for.
How many people use Evalview MCP?
The pypi package evalview was installed 984 times in the last week. Week over week that is -28%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is Evalview MCP open source?
Yes — it is published under the Apache-2.0 licence, written in Python, 134 stars on GitHub and 2 open issues. The source link is on this page, so you can read exactly what it does with your data before you connect it.