evals-skills
Skills that guide AI coding agents to help you build LLM evaluations. These skills guard against common mistakes I've seen helping 50+ companies and teaching students in our AI Evals course.
Install one, then just prompt in plain English. The FLOW.md fires the right skill at the right moment. No re-orchestration, no babysitting.
Skills that guide AI coding agents to help you build LLM evaluations. These skills guard against common mistakes I've seen helping 50+ companies and teaching students in our AI Evals course.
Build a custom browser-based annotation interface tailored to your data for reviewing LLM traces and collecting structured feedback. Use when you need to build…
Help the user systematically identify and categorize failure modes in an LLM pipeline by reading traces. Use when starting a new eval project, after…
Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when…
Guides evaluation of RAG pipeline retrieval and generation quality. Use when evaluating a retrieval-augmented generation system, measuring retrieval quality,…
Create diverse synthetic test inputs for LLM pipeline evaluation using dimension-based tuple generation. Use when bootstrapping an eval dataset, when real user…
Calibrate an LLM judge against human labels using data splits, TPR/TNR, and bias correction. Use after writing a judge prompt (write-judge-prompt) when you…
© 2026 Flowy · Free and open source
Built for Claude Code · Not affiliated with Anthropic