Skip to content
Development
Command

/fable-eval

Run the fable-mode eval suite (probes → pairwise judge → report). Costs tokens — runs headless claude many times. Optional arg: a probe id substring to filter.

From plugin
fable-mode
342 skills1 agent2 commands7 hooks
Install
> /plugin marketplace add rennf93/opus-fable-playbook
> /plugin install fable-mode@opus-fable-playbook

How it fires

How this command gets triggered: by you, by Claude, or both.

  • Fires itselfClaude auto-loads it when your prompt matches the work.
  • You can call itInvoke it directly when you want it.
  • Slash command/fable-eval

Context preview

What this command does when you run it.

Run the fable-mode eval suite (probes → pairwise judge → report). Costs tokens — runs headless claude many times. Optional arg: a probe id substring to filter.

Command definition

fable-eval.md
description: Run the fable-mode eval suite (probes → pairwise judge → report). Costs tokens — runs headless claude many times. Optional arg: a probe id substring to filter.

Run the fable-mode convergence evals. `$ARGUMENTS` may contain a probe id filter (e.g. `03`), and `--yes` to skip the cost confirmation.

1. Unless `--yes` was passed, tell the user how many probe runs this is (matched probes × 2 candidate modes + judging) and ask to proceed. 2. Ensure goldens exist in `evals/golden/` for the matched probes; for any missing, generate: `evals/run-probe.sh <probe> golden evals/golden`. 3. Run baseline + fable candidates into `evals/results/<today>/`, then judge each against its golden, per evals/LOOP.md steps 1–2 (respect the filter). 4. Run `evals/report.sh evals/results/<today>/` and present the table. 5. Interpret per LOOP.md step 4: name the weakest dimension and the exact doctrine section/hook/skill to strengthen. Do not apply changes — recommend them.

Ships withfable-mode

Make Claude Opus 4.8 in Claude Code behave as much like Claude Fable 5 as possible. The doctrine was transcribed by Fable 5 itself; hooks enforce it at the harness level; an eval loop measures convergence against golden Fable transcripts.

Get the whole plugin
Stats
34
Stars
11
Forks
Maintained
Maintenance
Shell
Language
MIT
License
2mo ago
Last commit
2mo ago
Created

Repo: rennf93/opus-fable-playbook

Other commands on fable-mode.