mcpbeat Sign in

Evalview MCP Server

local only

Evalview MCP runs on your own machine — the client starts it, so there is no endpoint to ping. 2 167 installs a week from pypi. Last commit 16 Oct 2026.

Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.

Installs per day peak 808 · avg 307 · -15% w/w
a month agotoday
2 167
Installs / week
pypi · evalview
140
Stars
4 open issues
16 Oct 2026
Last commit
from GitHub
Apache-2.0
License
Python

What the code does

We read the source, 2 d ago · rules 995398eba69f

A tool parameter reaches a dangerous call

A value the model can set ends up inside a file or shell call. That is not a flaw by itself — for a terminal server it is the job — but it is where things go wrong when it is not.

A tool parameter reaches a dangerous call validate_skill.skill_path → evalview/mcp_server.py:663, replay.test_path → evalview/mcp_server.py:724, replay.test_path → evalview/mcp_server.py:803 и ещё 3
            result = subprocess.run(
Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

A tool parameter here reaches a dangerous call

That is not a flaw by itself — but it is where things go wrong when it is not the job. We re-read this code on every release. Watch it and you hear from us the day another one appears.

Three servers free · no card

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

run in your terminal
claude mcp add evalview-mcp -- uvx evalview
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "evalview-mcp": {
      "command": "uvx",
      "args": [
        "evalview"
      ]
    }
  }
}
~/.codex/config.toml
[mcp_servers.evalview-mcp]
command = "uvx"
args = ["evalview"]
.cursor/mcp.json
{
  "mcpServers": {
    "evalview-mcp": {
      "command": "uvx",
      "args": [
        "evalview"
      ]
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "evalview-mcp": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "evalview"
      ]
    }
  }
}

Optional settings from the registry entry, left out of the block above: OPENAI_API_KEY (OpenAI API key for LLM-as-judge output quality scoring. Optional — deterministic tool/sequence evaluation works without it).

Alternatives to Evalview MCP

same job, measured the same way
Agent Eval
by rudrendupaul

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

143 installs/wk local only
Dungbeetle
by dungbeetle

Visual regression & snapshot testing for AI agents — list runs, read semantic diffs, review.

43 installs/wk local only
M
marginal
by marginal

Email A/B tests for AI agents: subject lines, managed sends, open/click tracking, and results.

answering
Lastest
by las-team

Run visual regression tests, review diffs, and manage baselines on a Lastest instance.

50 installs/wk local only
Wcag Accessibility
by aditya-ariosity

A WCAG accessibility testing MCP for AI agents, Codex, Claude Code, and automated UI audits.

60 installs/wk local only
Tesults MCP
by tesults

Ask your AI agent why your tests are failing. Instant analysis on failures and regressions.

72 installs/wk local only
App Manager
by lance

App Store Connect operator for AI agents: icons, TestFlight builds, listings, IAP, rejection fixes.

answering
Currents
by currents

Self-healing CI tests and proof of work for AI agents

answering

Evalview MCP — questions

Answers built from our own checks of this server.

Why is there no uptime for Evalview MCP?
Evalview MCP runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the pypi package evalview was installed 2 167 times last week.
How do I connect Evalview MCP?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It runs locally, so the command pulls evalview straight from pypi; nothing to host, nothing to sign up for.
How many people use Evalview MCP?
The pypi package evalview was installed 2 167 times in the last week. Week over week that is -15%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is Evalview MCP open source?
Yes — it is published under the Apache-2.0 licence, written in Python, 140 stars on GitHub and 4 open issues. The source link is on this page, so you can read exactly what it does with your data before you connect it.