/index-fix

name: index-fix
description: Diagnose and fix non-indexed pages using GSC and Bing Webmaster data. Finds exactly why each page isn't indexed and applies the fix.
argument-hint: "<site-url>"
allowed-tools: Bash, Read, Edit, Grep, Glob

Index Fix — Get Every Page Indexed

Diagnose why pages aren't indexed in Google and Bing, fix the root causes, and resubmit for indexing. This skill uses real data from GSC URL Inspection API and Bing Webmaster Tools — no guessing.

**Goal: 100% index coverage for pages that SHOULD be indexed. Not every URL belongs in the index — staging pages, admin panels, thin pagination, and intentionally private content should stay excluded.**

Phase 1: Credential Check

Verify data sources: 1. **GSC** (required): `ULTRASHIP_GSC_CREDENTIALS` or `ULTRASHIP_GSC_ACCESS_TOKEN` 2. **Bing** (recommended): `ULTRASHIP_BING_KEY`

If GSC is not configured, show setup guide and stop — GSC is required for URL inspection.

Phase 2: Index Coverage Overview

Get the current index state:

node ${CLAUDE_PLUGIN_ROOT}/tools/index-doctor.mjs coverage <site-url>

This shows:

• Total pages submitted via sitemaps
• Total pages indexed
• Index rate percentage
• Health status (HEALTHY/WARNING/CRITICAL)

Phase 3: Cross-Engine Comparison

If Bing key is available:

node ${CLAUDE_PLUGIN_ROOT}/tools/index-doctor.mjs compare <site-url> <sitemap-url>

Compare Google vs Bing indexing to find:

• Pages indexed by Google but not Bing (submit to Bing)
• Pages indexed by Bing but not Google (investigate Google issues)
• Overall gap analysis

Phase 4: Diagnose Non-Indexed Pages

Run the full diagnosis:

node ${CLAUDE_PLUGIN_ROOT}/tools/index-doctor.mjs diagnose <site-url> <sitemap-url>

This inspects up to 50 URLs via GSC URL Inspection API and reports:

• Which pages are indexed vs not
• The specific reason each page isn't indexed
• Severity rating (critical/high/medium/low)
• Exact fix for each issue

Common Non-Indexing Reasons and Fixes:

**Blocked by robots.txt** (critical):

• **FIRST: Determine if the block is intentional.** Common legitimate reasons to block:
• Admin/dashboard pages, staging environments, internal tools
• User-generated content pages, search result pages, faceted navigation
• API endpoints, health check routes
• If the block is intentional, do NOT remove it — remove the page from the sitemap instead
• If the block is unintentional, find the Disallow rule and modify it using the Edit tool
• Verify the fix: the page should be crawlable

**Noindex tag** (critical):

• **FIRST: Determine WHY noindex was added.** Common legitimate reasons:
• Staging/preview pages, paginated archives, tag/category pages
• Thank-you/confirmation pages with sensitive info
• Legal/compliance requirements, duplicate content by design
• Pages that should only be accessible via direct link
• **Ask the user before removing noindex** — removing it from staging or admin pages can expose sensitive content to search engines
• If removal is confirmed appropriate, find `<meta name="robots" content="noindex">` in the page HTML
• Remove the noindex directive using the Edit tool
• Check for X-Robots-Tag header in server config

**Soft 404** (high):

• Google thinks the page looks empty or error-like
• Add substantial unique content (minimum 300 words)
• Ensure the page returns HTTP 200 with real content
• Remove any empty state or placeholder content

**Crawled but not indexed** (high):

• Google found the page but decided not to index it
• Usually means content is too thin, duplicate, or low quality
• Add more unique, valuable content
• Build 3+ internal links pointing to this page
• Differentiate from similar pages on the site

**Discovered but not crawled** (medium):

• Google knows the URL exists but hasn't visited it yet
• Build internal links from high-traffic pages
• Submit directly for indexing
• Usually resolves within 1-2 weeks

**Redirect** (medium):

• Page redirects to another URL
• Update sitemap and internal links to use the final destination URL
• Remove the redirecting URL from sitemap

**Canonical mismatch** (medium):

• Google chose a different canonical URL
• Either fix the canonical tag to point to this URL, or accept Google's choice
• Remove from sitemap if it's truly a duplicate

**Server error** (critical):

• Page returns 5xx error when Google crawls it
• Fix the server error (check logs)
• Ensure the page loads correctly under load

**404 Not Found** (high):

• Page doesn't exist anymore
• Remove from sitemap
• Set up 301 redirect to relevant page

Phase 5: Apply Fixes

**⚠️ SAFETY FIRST: Before applying ANY fix, verify the block/exclusion wasn't intentional. Ask the user if unsure. Removing noindex from staging pages or robots.txt Disallow from admin paths can expose sensitive content.**

For each diagnosed issue, apply the fix:

**robots.txt fixes:**

• Read the current robots.txt
• **Check if the Disallow rule protects staging, admin, or private pages** — if so, remove the page from the sitemap instead of unblocking it
• Only edit rules that are clearly unintentional blocks on public content
• Ensure important public paths are not blocked

**noindex fixes:**

• **Verify with the user that the page should be public** before removing noindex
• Search HTML files for noindex tags
• Remove them using Edit tool only after confirming they're not protecting sensitive content

**Content quality fixes:**

• Identify thin pages (<300 words)
• Flag for content expansion
• Cannot auto-generate content, but can restructure and add schema

**Sitemap cleanup:**

• Remove 404 and redirect URLs from sitemap
• Regenerate if needed:

node ${CLAUDE_PLUGIN_ROOT}/tools/sitemap-generator.mjs <dir> <base-url>

**Internal linking:**

• Find high-traffic pages (from GSC query data)
• Add contextual links from high-traffic pages to non-indexed pages
• Use descriptive anchor text with target keywords

Phase 6: Resubmit for Indexing

**Only resubm