/test-metrics-dashboard

name: test-metrics-dashboard
description: "Use when querying test history, analyzing flakiness rates, tracking MTTR, or building quality trend dashboards from test execution data."
user-invocable: true

Test Metrics Dashboard

Data & Analysis skill for querying test execution history, identifying trends, and surfacing actionable quality metrics.

Activation

/test-metrics-dashboard

Key Metrics

Test Health Metrics

| Metric | Formula | Target | Alert | |--------|---------|--------|-------| | **Pass Rate** | Passed / Total | > 95% | < 90% | | **Flakiness Rate** | Flaky / Total | < 5% | > 10% | | **MTTR** | Avg time from failure to fix | < 4 hours | > 24 hours | | **Execution Time** | Total suite duration | < 10 min | > 20 min | | **Coverage Delta** | Current - Previous | >= 0% | < -2% |

Data Collection

# Export Jest results to JSON
npx jest --json --outputFile=test-results/$(date +%Y-%m-%d).json

# Parse results for dashboard
jq '{
  date: .startTime,
  total: .numTotalTests,
  passed: .numPassedTests,
  failed: .numFailedTests,
  duration_ms: (.testResults | map(.endTime - .startTime) | add),
  pass_rate: ((.numPassedTests / .numTotalTests) * 100),
  flaky: [.testResults[] | select(.numPendingTests > 0)] | length
}' test-results/$(date +%Y-%m-%d).json

Trend Analysis

# Compare last 5 runs
for f in $(ls -t test-results/*.json | head -5); do
  jq --arg file "$f" '{
    file: $file,
    pass_rate: ((.numPassedTests / .numTotalTests) * 100 | floor),
    duration_s: ((.testResults | map(.endTime - .startTime) | add) / 1000 | floor)
  }' "$f"
done

Top Failing Tests

# Find most frequently failing tests across runs
for f in test-results/*.json; do
  jq -r '.testResults[] | select(.numFailingTests > 0) | .testFilePath' "$f"
done | sort | uniq -c | sort -rn | head -10

Run History

Store dashboard data in `${CLAUDE_PLUGIN_DATA}/test-metrics.log`:

2026-03-18|95.2|4.1|312|82.5|3

Format: `date|pass_rate|flakiness_rate|duration_s|coverage_pct|failed_count`

Read history for trend detection:

# Coverage trending down?
tail -5 "${CLAUDE_PLUGIN_DATA}/test-metrics.log" | awk -F'|' '{print $5}' | sort -n | head -1

Composition

Feeds into:

• **`/qe-quality-assessment`** — quality gate decisions based on metrics
• **`/test-failure-investigator`** — investigate top failing tests
• **`/coverage-drop-investigator`** — when coverage trends down

Gotchas

• Metrics without baselines are meaningless — establish baselines before tracking trends
• Flakiness rate is underreported — a test that fails 1/100 times still breaks CI weekly
• Duration trends upward over time as test count grows — set alerts on rate of increase, not absolute value
• Agent may report metrics from a single run as "trends" — need 5+ data points for meaningful trends