EvalForge Lite MCP Server

by thejaredchapman Your server? Claim it

local only

EvalForge Lite runs on your own machine — the client starts it, so there is no endpoint to ping. 122 installs a week from pypi. Last commit 15 Oct 2026.

Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

Installs per day peak 223 · avg 24 · +85% w/w

a month agotoday

122

Installs / week

pypi · evalforge-lite

Stars

0 open issues

15 Oct 2026

Last commit

from GitHub

MIT

License

Python

Nothing serious here today

Today is the operative word: we check EvalForge Lite every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add evalforge-lite -- uvx evalforge-lite

~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ]
    }
  }
}

~/.codex/config.toml

[mcp_servers.evalforge-lite]
command = "uvx"
args = ["evalforge-lite"]

.cursor/mcp.json

{
  "mcpServers": {
    "evalforge-lite": {
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ]
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "evalforge-lite": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "evalforge-lite"
      ]
    }
  }
}

Optional settings from the registry entry, left out of the block above: OPENROUTER_API_KEY (Optional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call).

Alternatives to EvalForge Lite

same job, measured the same way

Claudexor

by razzant

Route coding work across Claude Code, Codex, Cursor, and OpenCode with shared context.

722 installs/wk local only

GrayMatter

by valkyrlabs

Secure durable memory and bounded context for AI agents, with hosted OAuth and local Lite support.

answering

Openrouter Multimodal

by stabgan

Chat with 300+ LLMs via OpenRouter. Analyze and generate images, audio, and video from MCP.

488 installs/wk local only

Foresee

by foresee-tech

Let AI assistants shop for home and auto insurance: compare quote estimates across every carrier.

2 tools answering

Veqen Pricing: AI model costs

by keyveve

Compare AI model prices and estimate workload costs with four read-only tools. No account needed.

4 tools answering

STEM — Persistent AI Memory

by awase

Persistent memory and shared context across compatible AI assistants, with account-scoped OAuth.

answering

Bedrock Multi-Model

by sagargupta16

Ask, compare and judge 33 Bedrock text models, generate and edit images, plus video and embeddings.

643 installs/wk local only

Google Ads Transparency (via Apify)

by retracn

Competitors' Google ads for AI agents: every ad a brand runs, with dates and ad text.

answering

EvalForge Lite — questions

Answers built from our own checks of this server.

Why is there no uptime for EvalForge Lite?

EvalForge Lite runs on your own machine over stdio — there is no network address to reach, so uptime cannot be measured for it by anyone. What can be measured is adoption: the pypi package evalforge-lite was installed 122 times last week.

How do I connect EvalForge Lite?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It runs locally, so the command pulls evalforge-lite straight from pypi; nothing to host, nothing to sign up for.

How many people use EvalForge Lite?

The pypi package evalforge-lite was installed 122 times in the last week. Week over week that is +85%. We show installs rather than GitHub stars on purpose: a star is a bookmark, an install is someone actually running it.

Is EvalForge Lite open source?

Yes — it is published under the MIT licence, written in Python and 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.