Website to Markdown — Bounded Crawls for Agents MCP Server

by kriton-dev Your server? Claim it

answering

Website to Markdown — Bounded Crawls for Agents is answering right now. Last checked 2 min ago.

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

Uptime history 36 hours of history

36 hours agonow

100.0%

Uptime 24h

92 of 92 checks

—

Tools

hidden behind auth

343 ms

Response time

average over 24h

API key

Access

streamable-http

Nothing serious here today

Today is the operative word: we check Website to Markdown — Bounded Crawls for Agents every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.

Connect this server

Endpoint below is the one we actually reach during checks — not the one copied from a README. Last verified 2 min ago.

Claude Code Claude Desktop Codex Cursor VS Code

run in your terminal

claude mcp add website-to-markdown --transport http 'https://mcp.apify.com/?tools=hermeskd/website-to-markdown'

Settings → Connectors → Add custom connector, then paste this address

https://mcp.apify.com/?tools=hermeskd/website-to-markdown

~/.codex/config.toml

[mcp_servers.website-to-markdown]
url = "https://mcp.apify.com/?tools=hermeskd/website-to-markdown"

.cursor/mcp.json

{
  "mcpServers": {
    "website-to-markdown": {
      "url": "https://mcp.apify.com/?tools=hermeskd/website-to-markdown"
    }
  }
}

.vscode/mcp.json

{
  "servers": {
    "website-to-markdown": {
      "type": "http",
      "url": "https://mcp.apify.com/?tools=hermeskd/website-to-markdown"
    }
  }
}

This endpoint answered with an authorization challenge. The server is running, but you need an API key from its owner to call it.

Endpoints

URL	Transport	State	Latency	Checked
https://mcp.apify.com/?tools=hermeskd/website-to-markdown	streamable-http	needs key	323 ms	2 min ago

Alternatives to Website to Markdown — Bounded Crawls for Agents

same job, measured the same way

Website to Markdown

by saulius876-lgtm

Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.

answering

Scrapi

by bamchi

Web scraping for AI agents. Converts URLs to clean, LLM-ready Markdown with anti-bot bypass.

35 installs/wk 5 tools answering

Tooltrace

by tooltrace

Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps

43 installs/wk 7 tools answering

Web Tools for AI Agents

by projectworks007

Web tools for AI agents: URL to clean Markdown, site crawl, screenshots, PDF/Office to text, OCR.

answering

Agent Crawl Readiness

by sadri-dridi

Bounded crawl-readiness check for agent access: robots.txt, sitemap.xml, llms.txt, homepage.

31 tools answering

Crawlberg

by xberg-io

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

local only

CRW Web Scraper

by fastcrw

Open-source web scraper for AI agents with scrape, crawl, and map tools

local only

CRW Web Scraper

by us

Open-source web scraper for AI agents with scrape, crawl, and map tools

local only

Website to Markdown — Bounded Crawls for Agents — questions

Answers built from our own checks of this server.

Why is there no tool list for Website to Markdown — Bounded Crawls for Agents?

The server answered our handshake with an authorization challenge, so it is running — but it will not describe its tools to an anonymous client. To see them you need to connect with your own credentials. We record it as alive, not as broken: 100.0% of checks in the last 24 hours got a reply.

Is Website to Markdown — Bounded Crawls for Agents working right now?

We send a real MCP handshake every 15 minutes. Over the last 24 hours 92 of 92 checks got a reply (100.0%), average response time 343 ms. The bar chart above shows every period we have measured.

How do I connect Website to Markdown — Bounded Crawls for Agents?

Copy the ready config from this page. We generate it for Claude Code, Claude Desktop, Codex, Cursor and VS Code, each in the form that client actually reads. It is a remote server, so there is nothing to install — the client connects to the address. You will need your own key: it refuses anonymous clients.

Does Website to Markdown — Bounded Crawls for Agents need an API key?

Yes. Every time we knock, Website to Markdown — Bounded Crawls for Agents answers with an authorization challenge instead of its tool list — that is how we know it is running and gated rather than broken. Bring your own credentials and it will talk.

How fast is Website to Markdown — Bounded Crawls for Agents?

It answers our handshake in 343 ms on average, which is faster than 39% of all working MCP servers we measure. The comparison comes from our own checks across the whole registry, every 15 minutes.