mcpbeat Sign in

Iris Eval MCP Server

by iris-eval Your server? Claim it
local only

Iris Eval runs on your own machine — the client starts it, so there is no endpoint to ping. 209 installs a week from npm. Last commit 17 Sep 2026.

Stop shipping agents on vibes. Score every agent output for quality, safety, and cost.

Installs per day peak 547 · avg 65 · -80% w/w
a month agotoday
209
Installs / week
npm · @iris-eval/mcp-server
9
Stars
17 open issues
17 Sep 2026
Last commit
0 releases in 90 days
MIT
License
TypeScript

What the code does

We read the source, 20 h ago · rules 3dff92dd89df

Capabilities

What this server is able to do. For an MCP server this is often the job itself — a terminal server runs commands because that is what it is for. Listed so you know what you are plugging in, not as an accusation.

Is this your server and something here is wrong? Tell us — corrections are free and do not require a plan.

This code can reach further than it looks

We found places where it runs commands, builds paths or queries from values it is given. None of that is a flaw by itself — it becomes one when the code changes, and code changes quietly between releases. We re-read it on every one.

Three servers free · no card

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

run in your terminal
claude mcp add mcp-server -- npx -y @iris-eval/mcp-server
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "mcp-server": {
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "command": "npx"
    }
  }
}
~/.codex/config.toml
[mcp_servers.mcp-server]
command = "npx"
args = ["-y", "@iris-eval/mcp-server"]
.cursor/mcp.json
{
  "mcpServers": {
    "mcp-server": {
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "command": "npx"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "mcp-server": {
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ],
      "command": "npx"
    }
  }
}

This one needs environment variables set before it will start: IRIS_API_KEY (API key for HTTP authentication. Required to bind the HTTP transport or the dashboard beyond loopback (0.0.0.0, a LAN address, a container): without it the server refuses to start), IRIS_ALLOW_UNAUTHENTICATED (Set to 1 to run a non-loopback bind with NO API key on purpose (lifts the startup refusal; the network is then your boundary)), IRIS_DB_PATH (SQLite database path), IRIS_LOG_LEVEL (Log level: debug, info, warn, error), IRIS_HOME (Directory for the database, custom rules and preferences (default ~/.iris)), IRIS_ANTHROPIC_API_KEY (Enables evaluate_with_llm_judge and verify_citations with an Anthropic model. Optional: the deterministic rules never need a key), IRIS_OPENAI_API_KEY (Enables evaluate_with_llm_judge and verify_citations with an OpenAI model. Optional: the deterministic rules never need a key), IRIS_LLM_JUDGE_MAX_COST_USD_PER_EVAL (Hard cap on the worst-case cost of one judge or citation call (default 0.25)), IRIS_CITATION_ALLOW_FETCH (Let verify_citations fetch URLs (off by default)), IRIS_DASHBOARD (Start the dashboard alongside the server (same as --dashboard)), IRIS_DASHBOARD_PORT (Dashboard port (default 6920); IRIS_PORT is the MCP HTTP transport port (default 3000)), IRIS_PORT (MCP HTTP transport port (default 3000); only used with --transport http), IRIS_OTEL_ENDPOINT (OTLP/HTTP collector URL; when set, every stored trace is also exported as OpenTelemetry spans (best-effort, asynchronous)), IRIS_CITATION_DOMAINS (Comma-separated domain allowlist for verify_citations fetches (only consulted when IRIS_CITATION_ALLOW_FETCH is on)), IRIS_TRANSPORT (Transport: stdio (default) or http; same as --transport), IRIS_HOST (Bind host for the HTTP transport (default 127.0.0.1); only used with --transport http), IRIS_ALLOWED_ORIGINS (Comma-separated Origin allowlist for the HTTP transport and dashboard CORS (default http://localhost:*)), IRIS_DASHBOARD_HOST (Bind host for the dashboard (default 127.0.0.1); same as --dashboard-host), IRIS_OTEL_HEADERS (Comma-separated key=value headers sent with every OTLP export (for example an auth token for your collector)), IRIS_OTEL_SERVICE_NAME (service.name resource attribute on exported spans (default iris-eval)), IRIS_OTEL_TIMEOUT_MS (Timeout in milliseconds for each OTLP export request). The author declared them in the registry entry; get the values from the project itself.

Alternatives to Iris Eval

same job, measured the same way
Qc Validator
by mdfifty50-boop

Output quality control and validation for AI agents

36 installs/wk local only
Twig
by kind-ling

MCP server quality scoring and optimization for the agent economy.

96 installs/wk local only
Otr Protocol
by yb48666-ctrl

Merchant trust verification for AI agents. One call = trust score, badge, and purchase safety.

29 installs/wk local only
AgentTrust
by vitaliiserbynassisterr

Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.

96 installs/wk local only
AgentTrust
by assister-xyz

Quality verification for AI agents and MCP servers. 6-axis scoring, adversarial probes.

local only
Aggors Merchant Evidence
by aggors

Read-only observable merchant evidence for people and agents, without scores or safety verdicts.

answering
Topos
by krv-labs

Structural code-quality tools for AI coding agents.

439 installs/wk local only
I
Agent Guardrails
by logi-cmd

Merge gates and safety checks for AI coding agents via MCP.

125 installs/wk local only

Iris Eval — questions

Answers built from our own checks of this server.

Why is there no uptime for Iris Eval?
Iris Eval runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the npm package @iris-eval/mcp-server was installed 209 times last week.
How do I connect Iris Eval?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It runs locally, so the command pulls @iris-eval/mcp-server straight from npm; nothing to host, nothing to sign up for.
How many people use Iris Eval?
The npm package @iris-eval/mcp-server was installed 209 times in the last week. Week over week that is -80%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.
Is Iris Eval open source?
Yes — it is published under the MIT licence, written in TypeScript, 9 stars on GitHub and 17 open issues. The source link is on this page, so you can read exactly what it does with your data before you connect it.