Web Scraper Agent Skill

by skrun-dev

Browse websites and extract structured information. Use when the user needs data from a web page.

562 tokens

context cost

the whole folder, loaded on every use

files

instructions only

copies elsewhere

how many repositories repackaged it

208

stars on the repo

on the repository, not the skill itself

Install

one command, takes just this skill from the repository

npx skills add https://github.com/skrun-dev/skrun --skill web-scraper

The instruction itself

5 sections, as written by the author

Web Scraper

You are a web scraping agent with access to a headless browser via Playwright MCP tools.

Instructions

When given a URL and a question, use browser_navigate to visit the page
Use browser_snapshot to get the page content (accessibility tree)
Analyze the content to answer the user's question
Extract the relevant information and return a structured response

Available Browser Tools

browser_navigate — go to a URL
browser_snapshot — get page content as accessibility snapshot
browser_click — click an element
browser_type — type text into an input

Rules

Always use the browser tools to access web content — never make up content
Start with browser_navigate to the URL, then browser_snapshot to read the page
If the page has multiple sections, focus on what's relevant to the question
Keep responses factual — only report what's actually on the page

Output Format

Return a JSON object with:

title: the page title
answer: direct answer to the user's question
extracted_data: relevant data points from the page

Other skills for the same job

different authors, same section of the catalogue

Apify Automation

by christophacham

×2

Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Composio Apify integration.

Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.

Web search, content extraction, crawling, and research capabilities using Tavily API

| Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.

Deep web scraping, screenshots, PDF parsing, and website crawling using Firecrawl API. Use when you need deep content extraction from web pages, page interaction is required (clicking, scrolling, etc.), or you want screenshots or PDF parsing.

Build a fully automated AI-powered data collection agent for any public source — job boards, prices, news, GitHub, sports, anything. Scrapes on a schedule, enriches data with a free LLM (Gemini Flash), stores results in Notion/Sheets/Supabase, and learns from user feedback. Runs 100% free on GitHub Actions. Use when the user wants to monitor, collect, or track any public data automatically.

Scrapes content based on a preset URL list, filters high-quality technical information, and generates daily Markdown reports.

Scrape, crawl, search, and extract structured data from websites using Firecrawl API - converts web pages to LLM-ready markdown

6k tokens scripts

How to use it

Copy the folder

Take skrun-dev/web-scraper from the repository into ~/.claude/skills for personal use, or into .claude/skills inside a project.

Check the name does not clash

The agent identifies a skill by the name field in its header. Two skills with the same name cannot sit side by side — one of them will be ignored.