mcpbeat

LLM Output Quality Monitor MCP Server

io.github.lazymac2x/llm-output-quality-monitor
answering

LLM Output Quality Monitor is answering right now. Last checked 8 min ago. It exposes 5 tools. Last commit 17 May 2026.

Cloudflare Workers MCP server: llm-output-quality-monitor

Uptime history 39 hours of history
39 hours agonow
100.0%
Uptime 24h
91 of 91 checks
5
Tools
read from the server
168 ms
Response time
average over 24h
0
Stars
last commit 17 May 2026

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 8 min ago.

run in your terminal
claude mcp add llm-output-quality-monitor --transport http https://api.lazy-mac.com/llm-output-quality-monitor/mcp
~/Library/Application Support/Claude/claude_desktop_config.json
{
  "mcpServers": {
    "llm-output-quality-monitor": {
      "url": "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
    }
  }
}
~/.codex/config.toml
[mcp_servers.llm-output-quality-monitor]
url = "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "llm-output-quality-monitor": {
      "url": "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
    }
  }
}
.vscode/mcp.json
{
  "mcpServers": {
    "llm-output-quality-monitor": {
      "url": "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
    }
  }
}

Available tools 5

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

consistency
consistency_check
Check consistency across multiple LLM responses
drift
drift_detector
Detect quality drift between current and previous LLM responses
hallucination
hallucination_scorer
Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.
quality
quality_validator
Validate LLM response quality based on length, format, and structure
schema
schema_enforcer
Validate JSON response against schema

Endpoints

URLTransportStateLatencyChecked
https://api.lazy-mac.com/llm-output-quality-monitor/mcp streamable-http answering 59 ms 8 min ago

LLM Output Quality Monitor — questions

Answers built from our own checks of this server.

What can LLM Output Quality Monitor do?
It exposes 5 tools, read directly from the server on our last check. Among them: consistency_check, drift_detector, hallucination_scorer, quality_validator, schema_enforcer. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is LLM Output Quality Monitor working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 168 ms. The bar chart above shows every period we have measured.
How do I connect LLM Output Quality Monitor?
Copy the ready config from this page — we generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each with the file path that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does LLM Output Quality Monitor need an API key?
No. LLM Output Quality Monitor completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 5 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is LLM Output Quality Monitor?
It answers our handshake in 168 ms on average, which is faster than 69% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.
Is LLM Output Quality Monitor open source?
Yes — 0 stars on GitHub. The source link is on this page, so you can read exactly what it does with your data before you connect it.