Skip to content
Productivity
Skill

/web-scraper

Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.

From plugin
cowork-os
452155 skills
Install
$ npx -y skills add CoWork-OS/CoWork-OS --skill web-scraper --agent claude-code

How it fires

How this skill gets triggered: by you, by Claude, or both.

  • Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
  • You can call itInvoke it directly when you want it.
  • Slash command/web-scraper

Context preview

The summary Claude sees to decide when to auto-load this skill.

Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.

SKILL.md

web-scraper.SKILL.md
name: web-scraper
description: "Scrape web pages with anti-bot bypass and structured data extraction using Scrapling."
version: "1.0.0"
metadata:
  author: CoWork OS Contributors <info@coworkosapp.com>

Web Scraper

Purpose

Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.

Routing

  • Use when: Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
  • Do not use when: Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
  • Outputs: Extracted web content including text, tables, links, images, and metadata.
  • Success criteria: Successfully extracts the requested content from the target URL with clean formatting.

Trigger Examples

Positive

  • Use the web-scraper skill for this request.
  • Help me with web scraper.
  • Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
  • Web Scraper: provide an actionable result.

Negative

  • Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
  • Do not use web-scraper for unrelated requests.
  • This request is outside web scraper scope.
  • This is conceptual discussion only; no tool workflow is needed.

Parameters

| Name | Type | Required | Description | |---|---|---|---| | url | string | Yes | URL to scrape | | selector | string | No | CSS selector for specific content (optional) |

Runtime Prompt

  • Current runtime prompt length: 1117 characters.
  • Runtime prompt is defined directly in `../web-scraper.json`.
Read more
Ships withcowork-os

Local-first personal agentic OS and everything app for coding, knowledge work, web design, automations, and artifacts.

Get the whole plugin
Stats
450
Stars
77
Forks
Active
Maintenance
TypeScript
Language
MIT
License
7d ago
Last commit
7mo ago
Created

Repo: CoWork-OS/CoWork-OS

Other skills on cowork-os.