mcpbeat

Scrapedo Web Scraper

artwist-polyakov/scrapedo-web-scraper

| Веб-скрапинг через Scrape.do. Обходит блокировки и CAPTCHA. timeout, access denied, Cloudflare block.

2k tokens
context cost
the whole folder, loaded on every use
5
files
ships runnable scripts
0
copies elsewhere
how many repositories repackaged it
175
stars on the repo
on the repository, not the skill itself

Install

one command, takes just this skill from the repository
npx skills add https://github.com/artwist-polyakov/polyakov-claude-skills --skill scrapedo-web-scraper

What comes with it

7 597 bytes besides the instruction
.gitignore
config/README.md
config/token.txt.example
scripts/scrape.py

What it tells the agent to use

found in the instruction text
WebFetch fetches pages from the network

The instruction itself

2 sections, as written by the author

Scrape.do Web Scraper

Скрапинг веб-страниц через Scrape.do API. Используй когда обычный fetch не работает (блокировка, JavaScript).

Использование

# Получить текст страницы
python scripts/scrape.py https://example.com

# Получить HTML
python scripts/scrape.py --html https://example.com

Из Python

from scripts.scrape import fetch_via_scrapedo

result = fetch_via_scrapedo('https://example.com')
if result['success']:
    print(result['content'])  # текст
    # result['html'] — оригинальный HTML
else:
    print(result['content'])  # описание ошибки

Результат

  • Успех: текст страницы (или HTML с --html)
  • Ошибка: понятное сообщение (нет токена / лимит / недоступно)

Если вернулась ошибка — страница недоступна через этот метод.

How to use it

Copy the folder

Take artwist-polyakov/scrapedo-web-scraper from the repository into ~/.claude/skills for personal use, or into .claude/skills inside a project.

Check the name does not clash

The agent identifies a skill by the name field in its header. Two skills with the same name cannot sit side by side — one of them will be ignored.