/web-scraper
Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.
$ npx -y skills add CoWork-OS/CoWork-OS --skill web-scraper --agent claude-codeHow it fires
How this skill gets triggered: by you, by Claude, or both.
- Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
- You can call itInvoke it directly when you want it.
- Slash command
/web-scraper
Context preview
The summary Claude sees to decide when to auto-load this skill.
Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.
SKILL.md
web-scraper.SKILL.mdname: web-scraper
description: "Scrape web pages with anti-bot bypass and structured data extraction using Scrapling."
Web Scraper
Purpose
Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.
Routing
- Use when: Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
- Do not use when: Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Outputs: Extracted web content including text, tables, links, images, and metadata.
- Success criteria: Successfully extracts the requested content from the target URL with clean formatting.
Trigger Examples
Positive
- Use the web-scraper skill for this request.
- Help me with web scraper.
- Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
- Web Scraper: provide an actionable result.
Negative
- Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Do not use web-scraper for unrelated requests.
- This request is outside web scraper scope.
- This is conceptual discussion only; no tool workflow is needed.
Parameters
| Name | Type | Required | Description | |---|---|---|---| | url | string | Yes | URL to scrape | | selector | string | No | CSS selector for specific content (optional) |
Runtime Prompt
- Current runtime prompt length: 1117 characters.
- Runtime prompt is defined directly in `../web-scraper.json`.
Read more
name: web-scraper description: "Scrape web pages with anti-bot bypass and structured data extraction using Scrapling."
Web Scraper
Purpose
Scrape web pages with anti-bot bypass and structured data extraction using Scrapling.
Routing
- Use when: Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
- Do not use when: Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Outputs: Extracted web content including text, tables, links, images, and metadata.
- Success criteria: Successfully extracts the requested content from the target URL with clean formatting.
Trigger Examples
Positive
- Use the web-scraper skill for this request.
- Help me with web scraper.
- Use when the user wants to scrape content from websites, especially sites with anti-bot protection, dynamic content, or structured data that needs extraction.
- Web Scraper: provide an actionable result.
Negative
- Don't use for simple URL fetching where web_fetch works fine. Don't use for internal files or local content.
- Do not use web-scraper for unrelated requests.
- This request is outside web scraper scope.
- This is conceptual discussion only; no tool workflow is needed.
Parameters
| Name | Type | Required | Description | |---|---|---|---| | url | string | Yes | URL to scrape | | selector | string | No | CSS selector for specific content (optional) |
Runtime Prompt
- Current runtime prompt length: 1117 characters.
- Runtime prompt is defined directly in `../web-scraper.json`.
Local-first personal agentic OS and everything app for coding, knowledge work, web design, automations, and artifacts.
Repo: CoWork-OS/CoWork-OS
Other skills on cowork-os.
- /attack-path-analysis
Use when Codex is already in the attack-path-analysis phase of a security scan or the user explicitly asks to trace a security finding from source to sink and calibrate severity. Do not use as the primary trigger for full PR, commit, branch, patch, or repository scans.
Open skill - /deep-security-scan
Use when the user asks for a deep, exhaustive, multi-pass, or variance-reducing repository-wide Codex Security scan. Run repeated independent repository-wide discovery passes with worker-specific threat models, semantically merge candidates, synthesize one canonical validation
Open skill - /finding-discovery
Use when Codex is already in the finding-discovery phase of a security scan or the user explicitly asks to discover candidate security findings in a repository or code change. Do not use as the primary trigger for full PR, commit, branch, patch, or repository scans.
Open skill - /fix-finding
Use when the user explicitly asks to fix and verify a validated or plausible security finding. Do not use as the primary trigger for full PR, commit, branch, patch, or repository scans.
Open skill - /security-diff-scan
Use when the user asks for a security review of a pull request, commit, branch diff, working-tree patch, or other Git-backed change set.
Open skill - /security-scan
Use when the user asks for a repository-wide or scoped-path security scan.
Open skill