AI-First Scraper runs on your own machine — the client starts it, so there is no endpoint to ping. 151 installs a week from pypi. Last commit 26 Aug 2026.
Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.
Today is the operative word: we check AI-First Scraper every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
This server runs on your own machine — install it with the package manager and the client starts it for you. Package name taken from the official registry entry.
claude mcp add ai-first-scraper-mcp -- uvx ai-first-scraper-mcp
{
"mcpServers": {
"ai-first-scraper-mcp": {
"args": [
"ai-first-scraper-mcp"
],
"command": "uvx"
}
}
}
[mcp_servers.ai-first-scraper-mcp]
command = "uvx"
args = ["ai-first-scraper-mcp"]
{
"mcpServers": {
"ai-first-scraper-mcp": {
"args": [
"ai-first-scraper-mcp"
],
"command": "uvx"
}
}
}
{
"mcpServers": {
"ai-first-scraper-mcp": {
"args": [
"ai-first-scraper-mcp"
],
"command": "uvx"
}
}
}
This one needs environment variables set before it will start:
SCRAPER_URL (URL of the ai-first-scraper instance to use. Default: https://ai-first-scraper.onrender.com), SEARCH_URL (URL of the ai-first-search instance to use. Default: https://ai-first-search.onrender.com), AFS_TIMEOUT (Upstream HTTP timeout in seconds. Default: 45).
The author declared them in the registry entry; get the values from the project itself.
Web scraping, search, monitoring, and HTML-to-markdown for AI agents
Web tools for AI agents: scrape pages to Markdown, audit SEO, detect tech stacks, check sitemaps
Metalift MCP for AI agents: web search (2 credits), scrape, crawl, and map tools
13 tools for AI agents: scrape, crawl, extract, map, search, papers, batch, research, monitor.
Scrape, crawl and search the web for AI agents via MCP.
Search, scrape, and crawl the web for AI agents. Batch scraping and answers with citations.
Structured web research tool for AI agents: search, fetch and shape web data into the JSON schema…
Web search for AI agents — 5 tools: search, news, images, scrape, research. x402/USDC or API key.
Answers built from our own checks of this server.