Strix Katana 爬虫命令手册,覆盖深度、JS 抓取与稳定并发控制;触发名:strix-katana
npx skills add https://github.com/asdfgh1445/ctf-super-hub --skill Strix•Katana 用法
Official docs:
Canonical syntax:
katana [flags]
High-signal flags:
-u, -list <url|file> target URL(s)-d, -depth <n> crawl depth-jc, -js-crawl parse JavaScript-discovered endpoints-jsl, -jsluice deeper JS parsing (memory intensive)-kf, -known-files <all|robotstxt|sitemapxml> known-file crawling mode-proxy <http|socks5 proxy> explicit proxy setting-c, -concurrency <n> concurrent fetchers-p, -parallelism <n> concurrent input targets-rl, -rate-limit <n> request rate limit-timeout <seconds> request timeout-retry <n> retry count-ef, -extension-filter <list> extension exclusions-tlsi, -tls-impersonate experimental JA3/TLS impersonation-hl, -headless enable hybrid headless crawling-sc, -system-chrome use local Chrome for headless mode-ho, -headless-options <csv> extra Chrome options (for example proxy-server)-nos, -no-sandbox run Chrome headless with no-sandbox-noi, -no-incognito disable incognito in headless mode-cdd, -chrome-data-dir <dir> persist browser profile/session-xhr, -xhr-extraction include XHR endpoints in JSONL output-silent, -j, -jsonl, -o <file> output controlsAgent-safe baseline for automation:
mkdir -p crawl && katana -u https://target.tld -d 3 -jc -kf robotstxt -c 10 -p 10 -rl 50 -timeout 10 -retry 1 -ef png,jpg,jpeg,gif,svg,css,woff,woff2,ttf,eot,map -silent -j -o crawl/katana.jsonl
Common patterns:
katana -u https://target.tld -d 3 -jc -silent
katana -u https://target.tld -d 5 -jc -jsl -kf all -c 10 -p 10 -rl 50 -o katana_urls.txt
katana -list urls.txt -d 3 -jc -silent -j -o katana.jsonl
katana -u https://target.tld -hl -sc -nos -xhr -j -o crawl/katana_headless.jsonl
katana -u https://target.tld -hl -sc -ho proxy-server=http://127.0.0.1:48080 -j -o crawl/katana_proxy.jsonl
Critical correctness rules:
-kf must be followed by one of all, robotstxt, or sitemapxml.-hl for headless mode.-proxy expects a single proxy URL string (for example http://127.0.0.1:8080).-ho expects comma-separated Chrome options (example: -ho --disable-gpu,proxy-server=http://127.0.0.1:8080).-kf, keep depth at least -d 3 so known files are fully covered.-o.Usage rules:
-d, -c, -p, and -rl explicit for reproducible runs.-ef early to reduce static-file noise before fuzzing.-proxy over environment proxy variables when proxying only Katana traffic.-hc only for one-time diagnostics, not routine crawling loops.-h/--help for routine runs unless absolutely necessary.Failure recovery:
-d and optionally add -ct.-jsl and lower -c/-p.-sc or install system Chrome.-ef filters.If uncertain, query web_search with:
site:docs.projectdiscovery.io katana <flag> usage
Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Composio Apify integration.
Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.
Web search, content extraction, crawling, and research capabilities using Tavily API
| Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.
Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API. Use when you need deep content extraction from web pages, page interaction is required (clicking, scrolling, etc.), or you want screenshots or PDF parsing.
Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions. Use when the user wants to monitor, collect, or track any public data automatically.
Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.
Scrape, crawl, search, and extract structured data from websites using Firecrawl API - converts web pages to LLM-ready markdown
Take asdfgh1445/strix•katana 用法 from the repository into ~/.claude/skills for personal
use, or into .claude/skills inside a project.
The agent identifies a skill by the name field in its header. Two skills with the
same name cannot sit side by side — one of them will be ignored.