brightdata-plugin

---

Overview

This plugin brings Bright Data's powerful web infrastructure directly into Claude Code, enabling AI agents to:

• Scrape any webpage as clean markdown — bypassing bot detection, CAPTCHAs, and JavaScript rendering
• Search Google with structured JSON results — titles, links, and descriptions ready for processing
• Extract structured data from 40+ websites — Amazon, LinkedIn, Instagram, TikTok, YouTube, and more
• Orchestrate 60+ MCP tools — search, scrape, extract structured data, and automate browsers via Bright Data's MCP server
• Use the Bright Data CLI — scrape, search, extract data, manage zones, and check budget directly from the terminal with brightdata / bdata
• Run competitive intelligence — real-time competitor analysis, pricing monitoring, review mining, hiring signal analysis, and market landscape mapping using live web data
• Write correct Bright Data code — built-in best practices for Web Unlocker, SERP API, Web Scraper API, and Browser API
• Route requests through proxies — generate working code for Datacenter, ISP, Residential, and Mobile proxy networks, with the right network, IP pool type, targeting, and SSL setup
• Build with the Python SDK — comprehensive guide for the brightdata-sdk package with patterns for async/sync clients, platform scrapers, SERP, datasets, and more
• Build with the JavaScript/TypeScript SDK — comprehensive guide for the @brightdata/sdk package (bdclient) with patterns for web unlocker, platform scrapers, SERP, discover, datasets, browser automation, and Scraper Studio
• Run the Discover API — intent-ranked, AI-relevance-scored semantic web search with parsed page content, across REST/CLI/SDK (the foundation for research and RAG)
• Produce live research briefs — decompose a question into multi-angle Discover queries, dedup and rank by relevance, and synthesize a cited report from live web data
• Build RAG / search-engine pipelines — use Discover as the retrieval layer for an LLM, via live web-grounded retrieval or vector-store ingestion

Built on Bright Data's Web Unlocker, SERP API, and Web Data APIs, this plugin handles the complexity of web access so your AI agents can focus on what matters.

---

Skills

Skill	Description
agent-onboarding	Entry point for agents new to Bright Data — one install command, then routes to the right path: live CLI tools, app integration, MCP server, auth-only, or REST without installing
search	Search Google and get structured JSON results with titles, links, and descriptions
scrape	Scrape any webpage as clean markdown with automatic bot detection bypass
data-feeds	Extract structured data from 40+ websites with automatic polling
bright-data-mcp	Orchestrate 60+ Bright Data MCP tools for search, scraping, structured extraction, and browser automation
scraper-builder	Build production-ready scrapers for any website — guides through site analysis, API selection, selector extraction, pagination, and complete implementation. Triggers on "build a scraper for..."
scraper-studio	Build and run AI-generated Bright Data scrapers from the terminal via bdata scraper create (generate from a natural-language description) and bdata scraper run (execute against a URL). Handles async + poll, --sync fast-path, and silent auto-fallback to batch for paginated pages
bright-data-best-practices	Built-in reference for Web Unlocker, SERP API, Web Scraper API, and Browser API — Claude consults this automatically when writing Bright Data code
brightdata-proxy	Generate working code to route requests through Bright Data's Datacenter, ISP, Residential, and Mobile proxy networks — network and IP-pool selection, username targeting/session params, SSL CA setup, and integrations for cURL, Python (requests/httpx/aiohttp/Scrapy), Node (fetch/axios), Playwright, Puppeteer, and Selenium
python-sdk-best-practices	Comprehensive guide for the brightdata-sdk Python package — async/sync clients, platform scrapers, SERP, datasets, Scraper Studio, Browser API, error handling, and common patterns
js-sdk-best-practices	Comprehensive guide for the @brightdata/sdk JavaScript/TypeScript package (bdclient, Node ≥20, ESM+CJS) — web unlocker, 11 platform scrapers, SERP, Discover, datasets, Browser API, Scraper Studio, error classes, and batch/trigger orchestration
discover-api	Use the Discover API — intent-ranked, AI-relevance-scored semantic web search with parsed page content. Covers REST (POST/GET /discover), CLI (bdata discover), the SDKs (client.discover), the standard/zeroRanking/deep/fast modes, and the trigger→poll flow. Foundation for live-research and rag-pipeline
live-research	Produce a deep, multi-source, cited research brief — decompose a question into multiple intent-ranked Discover queries, pull page content, dedup and rank by relevance, then synthesize a structured report with inline citations
rag-pipeline	Build a RAG pipeline or custom search engine on top of Discover — live web-grounded retrieval for an LLM, or ingestion into a vector store (discover → chunk → embed → retrieve). Provider-agnostic JS + Python code
brightdata-cli	Guide for using the Bright Data CLI (brightdata / bdata) to scrape, search, extract structured data from 40+ platforms, manage proxy zones, and check account budget — all from the terminal
competitive-intel	Real-time competitive intelligence using live web data — competitor snapshots, pricing comparison, review mining, hiring signal analysis, content & SEO battles, and market landscape mapping. Replaces $15K+/yr enterprise CI tools at pennies per analysis
brand-listening	Social listening and brand reputation research — collects what people are saying about a brand across Reddit, X, Instagram, TikTok, YouTube, news, and review sites, then classifies sentiment, clusters themes, and delivers a cited digest with recommendations. Triggers on "what are people saying about us", "monitor mentions", "brand sentiment"
price-comparison	Shopping price comparison using live retailer data — resolves a product (name, ASIN, or URL) across Amazon, Walmart, eBay, Best Buy, and Google Shopping, normalizes prices/availability/condition into one ranked table, and names the cheapest in-stock buy. Region-aware (currency, stock, local retailers). Triggers on "compare prices", "find the cheapest", "price check", "how much is X on Amazon vs Walmart"
seo-audit	Comprehensive SEO audit using live web data — sitemap-stratified sampling, JS-injected schema detection (Yoast/RankMath/AIOSEO), hreflang validation, signal-driven SERP ranking checks, HTML-level Core Web Vitals proxies. Auto-routes between single-page and site-wide audits
design-mirror	Replicates design system patterns, tokens, and components to build consistent, high-quality UIs
brd-browser-debug	Debug Bright Data Scraping Browser sessions — smart triage of failures, per-session bandwidth tracking, captcha reporting, and pattern detection using the Browser Sessions API

---

Agent Onboarding Skill

The agent-onboarding skill is the entry point for any coding agent that's new to Bright Data. It runs the install once, walks the human through OAuth, verifies the environment, and then routes the agent to the right narrower skill instead of dumping everything into one place.

How it works

One install command sets up the CLI, agent skills, and authentication:

# macOS / Linux
curl -fsSL https://cli.brightdata.com/install.sh | bash

# Cross-platform
npm install -g @brightdata/cli

# Then authenticate once (browser OAuth)
bdata login

# Headless / SSH
bdata login --device

bdata login saves the API key locally, auto-creates the cli_unlocker and cli_browser zones, and sets defaults — no token plumbing required.

Path routing

After install, the skill routes the agent based on the task:

Situation	Path	Hands off to
Need web data during this session	A — live CLI tools	brightdata-cli, search, scrape, data-feeds, competitive-intel, seo-audit
Need to add Bright Data to app code	B — SDK / REST integration	python-sdk-best-practices, bright-data-best-practices, scraper-builder
Want a drop-in tool layer for an LLM agent	M — MCP server	bright-data-mcp
Need an API key first	C — auth only	dashboard or bdata login
Don't want to install anything	D — REST API directly	direct calls to api.brightdata.com

Why this skill matters

Without onboarding, agents either skip auth and crash on the first request, or pick the wrong path (calling REST when the CLI would do, or scraping a site that has a pre-built dataset). This skill makes the first 60 seconds deterministic: install, log in, verify, then hand off.

Reference files

• skills/agent-onboarding/SKILL.md — install, auth, path routing, and the post-onboarding skill map

---

Quick Start

1. Get Your Credentials

1. Sign up at brightdata.com if you haven't already
2. Go to the Bright Data Dashboard
3. Create a Web Unlocker zone: Click "Add" → Select "Unlocker zone"
4. Copy your API Key from the dashboard

2. Set Environment Variables

export BRIGHTDATA_API_KEY="your-api-key"
export BRIGHTDATA_UNLOCKER_ZONE="your-zone-name"

3. Start Using