| AI-powered autonomous data extraction that navigates complex sites and returns structured JSON. Use this skill when the user wants structured data from websites, needs to extract pricing tiers, product listings, directory entries, or any data as JSON with a schema. Triggers on "extract structured data", "get all the products", "pull pricing info", "extract as JSON", or when the user provides a JSON schema for website data. More powerful than simple scraping for multi-page structured extraction.
npx skills add https://github.com/firecrawl/cli --skill firecrawl-agent
AI-powered autonomous extraction. The agent navigates sites and extracts structured data (takes 2-5 minutes).
# Extract structured data
firecrawl agent "extract all pricing tiers" --wait -o .firecrawl/pricing.json
# With a JSON schema for structured output
firecrawl agent "extract products" --schema '{"type":"object","properties":{"name":{"type":"string"},"price":{"type":"number"}}}' --wait -o .firecrawl/products.json
# Focus on specific pages
firecrawl agent "get feature list" --urls "<url>" --wait -o .firecrawl/features.json
| Option | Description |
| ---------------------- | ----------------------------------------- |
| --urls <urls> | Starting URLs for the agent |
| --model <model> | Model to use: spark-1-mini or spark-1-pro |
| --schema <json> | JSON schema for structured output |
| --schema-file <path> | Path to JSON schema file |
| --max-credits <n> | Credit limit for this agent run |
| --wait | Wait for agent to complete |
| --pretty | Pretty print JSON output |
| -o, --output <path> | Output file path |
--wait to get results inline. Without it, returns a job ID.--schema for predictable, structured output — otherwise the agent returns freeform data.--max-credits to cap spending.scrape — it's faster and cheaper.Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Composio Apify integration.
Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.
Web search, content extraction, crawling, and research capabilities using Tavily API
Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API. Use when you need deep content extraction from web pages, page interaction is required (clicking, scrolling, etc.), or you want screenshots or PDF parsing.
Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions. Use when the user wants to monitor, collect, or track any public data automatically.
Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.
Scrape, crawl, search, and extract structured data from websites using Firecrawl API - converts web pages to LLM-ready markdown
Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API
Take firecrawl/firecrawl-agent from the repository into ~/.claude/skills for personal
use, or into .claude/skills inside a project.
The agent identifies a skill by the name field in its header. Two skills with the
same name cannot sit side by side — one of them will be ignored.
The instructions reference npx.
Without those the skill loads but fails at the first command.