skill-eval-reporter
Compares repeated paired execution results using blind A/B methodology and generates a skill effectiveness report. Use when valid skill-evaluation result pairs are available.
$ npx -y skills add shinpr/rashomon --agent claude-codeShips with rashomon. Installing the plugin gets this agent.
How it fires
How this agent gets triggered: by you, by Claude, or both.
- Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.
- You can call itInvoke it directly when you want it.
Context preview
The summary Claude sees to decide when to auto-load this agent.
Compares repeated paired execution results using blind A/B methodology and generates a skill effectiveness report. Use when valid skill-evaluation result pairs are available.
Measure prompt and skill improvements with blind A/B comparison.
Other agents on rashomon.
- knowledge-optimizer
Collects user feedback on comparison results and optimizes the knowledge base. Use when user indicates comparison results did not meet expectations or provides feedback on optimization quality. Adjusts confidence scores and manages knowledge entries.
Open agent - prompt-analyzer
Analyzes prompts against BP-001 through BP-008 and returns the prompt-optimization skill's gated JSON result. Use when prompt text or a prompt file is provided for optimization.
Open agent - prompt-executor
Executes a prompt in an isolated worktree environment and captures results. Use when worktree path and prompt are provided for execution. Returns execution status, outputs, and observations with strictly factual reporting only.
Open agent - report-generator
Performs blind comparison of repeated prompt-execution pairs, then maps observed differences to optimization findings after identity reveal. Use when original and optimized prompt trials are available.
Open agent - skill-creator
Generates or modifies optimized skill files. In creation mode, builds from raw user knowledge. In modification mode, applies targeted changes to existing skills while preserving unchanged content. Use when creating new skills or updating existing ones.
Open agent - skill-reviewer
Evaluates skill file quality against optimization patterns and editing principles. Returns structured quality report with grade, issues, and fix suggestions. Use when reviewing created or modified skill content.
Open agent