web-shooter runs on your own machine — the client starts it, so there is no endpoint to ping. Last commit 3 Nov 2026.
Fast, low-token web reader and focused crawler. Returns ranked passages, not whole pages.
Today is the operative word: we check web-shooter every 15 minutes and re-read its code on every release. Watch it and you find out the day that stops being true.
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Web pages and PDFs to clean, LLM-ready Markdown with token counts, small crawls and RAG chunks.
Crawl a site for broken links, 404s, dead images, redirect chains and slow pages, with sources
Audit pages for SEO and AI search: scores, fixes, AI crawler access, llms.txt. Pay per use.
Clone websites, scrape pages to markdown and crawl whole sites. A free Firecrawl alternative.
Is this page readable for AI search? Crawler access, structure and citability checks, runs locally.
Read, map and crawl the web, and drive a real browser. Pay per call, no key, no signup.
Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.
Answers built from our own checks of this server.