nw-ab-critique-dimensi…
Review dimensions for validating agent quality - template compliance, safety, testing, and priority validation
Teaches agents how to run a timeboxed spike - throwaway code that validates one assumption before DESIGN
$ npx -y skills add nWave-ai/nWave --skill nw-spike-methodology --agent claude-codeHow it fires
How this skill gets triggered: by you, by Claude, or both.
/nw-spike-methodologyContext preview
The summary Claude sees to decide when to auto-load this skill.
Teaches agents how to run a timeboxed spike - throwaway code that validates one assumption before DESIGN
name: nw-spike-methodology description: Teaches agents how to run a timeboxed spike - throwaway code that validates one assumption before DESIGN user-invocable: false disable-model-invocation: true
Throwaway code that validates exactly one assumption. Max 1 hour. Binary outcome: works or doesn't work. Code is deleted after validation; only findings persist.
| Not This | Why | |----------|-----| | Prototype | Prototypes evolve into production code. Spikes are deleted. | | MVP | MVPs ship to users. Spikes never leave the developer's machine. | | Walking Skeleton | Skeletons wire end-to-end architecture. Spikes test one mechanism. | | POC | POCs demonstrate feasibility to stakeholders. Spikes answer a developer question. |
Every spike answers exactly these:
1. **Does the core mechanism work?** Can we parse the output? Call the API? Does the algorithm produce correct results? 2. **Does it meet the performance requirement?** Is it under the time/memory/throughput budget? 3. **What edge cases exist?** Empty input, malformed data, missing dependencies, concurrent access. 4. **What did we assume wrong?** The design said X, but reality is Y. Document the delta.
1. Max 1 hour wall clock. If it takes longer, the problem is bigger than expected. Stop and escalate. 2. No tests. No types. No error handling. No ports. No abstractions. 3. Code lives in `/tmp/spike_{feature_id}/` or a scratch directory. Never in `src/`. 4. One file preferred. Two files maximum. 5. Use `time.perf_counter()` for timing, not `time.time()`. 6. Print results to stdout. No logging frameworks. 7. After validation: delete the code, keep the findings.
#!/usr/bin/env python3
"""SPIKE: {feature} -- {one-line question being validated}
Throwaway code. Not production. Will be deleted after validation.
"""
import time
# 1. Setup (minimal, no frameworks)
# ...
# 2. Core mechanism attempt
start = time.perf_counter()
# ... the thing you're testing ...
elapsed = time.perf_counter() - start
# 3. Print findings
print(f"Mechanism: {'WORKS' if success else 'FAILS'}")
print(f"Timing: {elapsed*1000:.1f}ms (budget: {budget}ms)")
print(f"Edge cases: {edge_cases}")Output goes to `docs/feature/{feature-id}/spike/findings.md`:
# Spike Findings -- {feature-id}
## Verdict: WORKS / DOESN'T WORK
## Question tested
{the one assumption being validated}
## Core mechanism
- Tested: {what was tested}
- Result: {what happened}
## Timing
- {operation}: {time}ms
- Total: {time}ms (budget: {budget}ms) -- PASS / FAIL
## Edge cases discovered
1. {edge case}: {what happened}
2. {edge case}: {what happened}
## Design implications
- {assumption that was wrong}: {correct reality}
- {approach the spike validated or invalidated}
## Spike code
Deleted. Was at /tmp/spike_{feature_id}/If the spike reveals the problem is fundamentally different from what was assumed: 1. Stop the spike 2. Write findings with verdict "DOESN'T WORK" or "BIGGER THAN EXPECTED" 3. Return to DISCUSS to re-scope the feature 4. The spike findings become input to the revised DISCUSS wave
AI agents that guide you from idea to working code, with human judgment at every gate. nWave runs inside Claude Code. It breaks feature delivery into seven waves (discover, diverge, discuss, design, devops, distill, deliver).
Repo: nWave-ai/nWave
Review dimensions for validating agent quality - template compliance, safety, testing, and priority validation
Review dimensions for validating agent quality - template compliance, safety, testing, and priority validation
Review dimensions for acceptance test quality - happy path bias, GWT compliance, business language purity, coverage completeness, walking skeleton…
Detailed 5-phase workflow for creating agents - from requirements analysis through validation and iterative refinement
5-layer testing approach for agent validation including adversarial testing, security validation, and prompt injection resistance
Architectural style selection decision matrices, trade-off analysis, structural enforcement rules, and combination patterns. Load when choosing or evaluating…