mcpbeat Sign in

The Aggregate — LLM benchmark aggregate MCP Server

by theaggregate Your server? Claim it
answering

The Aggregate — LLM benchmark aggregate is answering right now. Last checked 10 min ago. It exposes 8 tools.

LLM rankings from public benchmarks, model comparisons and source-linked results. Updated daily.

Uptime history 91 days of history · worst day 93%
91 days agonow
100.0%
Uptime 24h
91 of 91 checks
8
Tools
read from the server
299 ms
Response time
average over 24h
open, no key
Access
streamable-http

What changed 12

Every tool that appeared, vanished or quietly changed what it asks for. Recorded since 15 August 2026. No other catalogue keeps this.

12 Oct 5 tool descriptions were rewritten compare_models, get_leaderboard, get_model and 2 more
10 Oct a tool changed version
12 Sep a tool description was rewritten get_leaderboard
7 Sep a tool description was rewritten get_leaderboard
15 Aug 2 tool descriptions were rewritten get_leaderboard, search_models
15 Aug 2 tools changed the parameters they ask for get_leaderboard, search_models

Nothing serious here today

Today is the operative word: we check The Aggregate — LLM benchmark aggregate every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 10 min ago.

run in your terminal
claude mcp add the-aggregate --transport http https://theaggregate.ai/mcp
Settings → Connectors → Add custom connector, then paste this address
https://theaggregate.ai/mcp
~/.codex/config.toml
[mcp_servers.the-aggregate]
url = "https://theaggregate.ai/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "the-aggregate": {
      "url": "https://theaggregate.ai/mcp"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "the-aggregate": {
      "type": "http",
      "url": "https://theaggregate.ai/mcp"
    }
  }
}

Available tools 8

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

about
about_the_aggregate
What this data is: how the IRT fusion works, current coverage counts, update cadence, and how to cite it.
benchmark
get_benchmark
One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights, and the current top models on it.
benchmarks
search_benchmarks
Find benchmarks in the aggregate by (partial) name. Returns model coverage, difficulty on the rating scale, and the benchmark page URL.
compare
compare_models
Head-to-head between 2-4 models: aggregate ranks, rating gap with a significance note based on the standard errors, and notable benchmarks they share.
leaderboard
get_leaderboard
Top of the cross-benchmark aggregate ranking: every model placed on one rating scale by an IRT model fit over public benchmark leaderboards (call about_the_aggregate for the current coverage counts). One row per model by default, fused across reasoning-effort settings. Supports paging via limit/offset.
model
get_model
One model in depth: aggregate rank, Aggregate Rating with standard error, provider, what it is, cost per task where known, and its most notable benchmark results (with percentiles).
models
search_models
Find ranked models by (partial) name or provider. Returns rank, Aggregate Rating and the model page URL. One row per model by default, fused across reasoning-effort settings.
prediction
get_prediction_duel
Guesswork — the public prediction duel: every day frontier LLMs and The Aggregate's own IRT model predict newly scraped benchmark scores before seeing them, and the errors are scored. Returns the current monthly standings, wins and losses included.

Endpoints

URLTransportStateLatencyChecked
https://theaggregate.ai/mcp streamable-http answering 91 ms 10 min ago

Alternatives to The Aggregate — LLM benchmark aggregate

same job, measured the same way
BenchLeader
by benchleader

Daily LLM leaderboard from independent benchmarks: ranks, scores, prices, speed and comparisons.

7 tools answering
Rival
by nuance-dev

Query AI model benchmarks, pricing, and comparisons from rival.tips

53 installs/wk local only
AI Pricing Hub
by gishh

Source-backed AI model pricing, rankings, history, and benchmark data.

11 tools answering
SOTA2 — AI Solution Rankings
by leo9

Compare published AI solution rankings, company facts and research benchmarks with sources.

7 tools answering
Seraphix Public Records
by seraphixsystems

Dated, source-linked public records about companies, from SEC filings and other primary documents.

6 tools answering
The Dose Guy
by cjkehoe

Read-only compound rankings and live vendor price comparison with canonical source links.

4 tools answering
Whatbreaks Mot
by physics-star-cat

Real UK MOT failure data by car model and mileage, aggregated from official DfT test results.

2 tools answering
LLM Advisor
by daichi-kudo

Real-time LLM/VLM benchmarks, pricing, and recommendations. 300+ models, 5 sources.

100 installs/wk local only

The Aggregate — LLM benchmark aggregate — questions

Answers built from our own checks of this server.

What can The Aggregate — LLM benchmark aggregate do?
It exposes 8 tools, read directly from the server on our last check. Among them: about_the_aggregate, compare_models, get_benchmark, get_leaderboard, get_model, get_prediction_duel and 2 more. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is The Aggregate — LLM benchmark aggregate working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 299 ms. The bar chart above shows every period we have measured.
How do I connect The Aggregate — LLM benchmark aggregate?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does The Aggregate — LLM benchmark aggregate need an API key?
No. The Aggregate — LLM benchmark aggregate completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 8 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is The Aggregate — LLM benchmark aggregate?
It answers our handshake in 299 ms on average, which is faster than 47% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.