Evalview MCP runs on your own machine — the client starts it, so there is no endpoint to ping. 2 167 installs a week from pypi. Last commit 16 Oct 2026.
Regression testing for AI agents. Golden baselines, CI/CD, LangGraph, CrewAI, OpenAI, Claude.
We read the source, 2 d ago · rules 995398eba69f
A value the model can set ends up inside a file or shell call. That is not a flaw by itself — for a terminal server it is the job — but it is where things go wrong when it is not.
result = subprocess.run(
What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.
proc = subprocess.Popen(
shell=True,
return os.path.join(cwd, path)
Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.
That is not a flaw by itself — but it is where things go wrong when it is not the job. We re-read this code on every release. Watch it and you hear from us the day another one appears.
This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.
claude mcp add evalview-mcp -- uvx evalview
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
]
}
}
}
[mcp_servers.evalview-mcp]
command = "uvx"
args = ["evalview"]
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview"
]
}
}
}
{
"servers": {
"evalview-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"evalview"
]
}
}
}
Optional settings from the registry entry, left out of the block above:
OPENAI_API_KEY (OpenAI API key for LLM-as-judge output quality scoring. Optional — deterministic tool/sequence evaluation works without it).
Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
Visual regression & snapshot testing for AI agents — list runs, read semantic diffs, review.
Email A/B tests for AI agents: subject lines, managed sends, open/click tracking, and results.
Run visual regression tests, review diffs, and manage baselines on a Lastest instance.
A WCAG accessibility testing MCP for AI agents, Codex, Claude Code, and automated UI audits.
Ask your AI agent why your tests are failing. Instant analysis on failures and regressions.
App Store Connect operator for AI agents: icons, TestFlight builds, listings, IAP, rejection fixes.
Self-healing CI tests and proof of work for AI agents
Answers built from our own checks of this server.