mcpbeat Sign in

LLM Output Quality Monitor MCP Server

answering

LLM Output Quality Monitor is answering right now. Last checked 10 min ago. It exposes 5 tools. Last commit 17 May 2026.

Cloudflare Workers MCP server: llm-output-quality-monitor

Uptime history 91 days of history · worst day 93%
91 days agonow
100.0%
Uptime 24h
91 of 91 checks
5
Tools
read from the server
173 ms
Response time
average over 24h
0
Stars
last commit 17 May 2026

LLM Output Quality Monitor missed one check this week

Everything else answered, so this is steady rather than shaky. We check every 15 minutes, which is how a one-off gets told apart from the start of a pattern, and how you hear about the next one within the hour instead of from your users.

Three servers free · no card

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 10 min ago.

run in your terminal
claude mcp add llm-output-quality-monitor --transport http https://api.lazy-mac.com/llm-output-quality-monitor/mcp
Settings → Connectors → Add custom connector, then paste this address
https://api.lazy-mac.com/llm-output-quality-monitor/mcp
~/.codex/config.toml
[mcp_servers.llm-output-quality-monitor]
url = "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
.cursor/mcp.json
{
  "mcpServers": {
    "llm-output-quality-monitor": {
      "url": "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
    }
  }
}
.vscode/mcp.json
{
  "servers": {
    "llm-output-quality-monitor": {
      "type": "http",
      "url": "https://api.lazy-mac.com/llm-output-quality-monitor/mcp"
    }
  }
}

Available tools 5

Read directly from the server with tools/list, grouped by what they act on. If a tool disappears, we record the date.

consistency
consistency_check
Check consistency across multiple LLM responses
drift
drift_detector
Detect quality drift between current and previous LLM responses
hallucination
hallucination_scorer
Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.
quality
quality_validator
Validate LLM response quality based on length, format, and structure
schema
schema_enforcer
Validate JSON response against schema

Endpoints

URLTransportStateLatencyChecked
https://api.lazy-mac.com/llm-output-quality-monitor/mcp streamable-http answering 34 ms 10 min ago

Alternatives to LLM Output Quality Monitor

same job, measured the same way
Cron Monitor
by lazymac2x

Cloudflare Workers MCP server: cron-monitor

6 tools answering
API Diff Monitor
by lazymac2x

Cloudflare Workers MCP server: api-diff-monitor

6 tools answering
Agent Trace Auditor
by lazymac2x

Cloudflare Workers MCP server: agent-trace-auditor

3 tools answering
MCP Server Health Monitor
by dbsectrainer

Health monitoring for all your MCP servers

36 installs/wk local only
Australia Air Quality Sites (NSW) MCP
by donniertf-hub

NSW air quality monitoring sites.

3 tools answering
Site Spy
by vkuprin

MCP server for Site Spy — lets AI agents monitor websites for changes

80 installs/wk local only
SaaS Alerts
by wyre-ai

MCP server for Kaseya SaaS Alerts — SaaS security monitoring for M365 & Google Workspace.

local only
SaaS Alerts
by wyre-technology

MCP server for Kaseya SaaS Alerts — SaaS security monitoring for M365 & Google Workspace.

local only

LLM Output Quality Monitor — questions

Answers built from our own checks of this server.

What can LLM Output Quality Monitor do?
It exposes 5 tools, read directly from the server on our last check. Among them: consistency_check, drift_detector, hallucination_scorer, quality_validator, schema_enforcer. The full list with descriptions is on this page — we take it from the server itself via tools/list, not from a README. How MCP servers expose tools in the first place →
Is LLM Output Quality Monitor working right now?
We send a real MCP handshake every 15 minutes. Over the last 24 hours 91 of 91 checks got a reply (100.0%), average response time 173 ms. The bar chart above shows every period we have measured.
How do I connect LLM Output Quality Monitor?
Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address.
Does LLM Output Quality Monitor need an API key?
No. LLM Output Quality Monitor completed a full MCP handshake with us as an anonymous client and listed its tools without asking for anything. All 5 of them are readable on this page. This is what we observed, not what the docs claim.
How fast is LLM Output Quality Monitor?
It answers our handshake in 173 ms on average, which is faster than 76% of all working MCP servers we measure. That puts it in the quick quarter of the ecosystem. The comparison comes from our own checks across the whole registry, every 15 minutes.
Is LLM Output Quality Monitor open source?
We cannot say either way: 0 stars on GitHub, but we could not determine the licence, and without one the code is not open source by default.