Install one, then just prompt in plain English. The FLOW.md fires the right skill at the right moment. No re-orchestration, no babysitting.
Featured
promptfoo is a CLI and library for evaluating and red-teaming LLM-based apps. Stop using trial-and-error... start shipping secure, reliable agents Website · Getting Started · Red Teaming · Documentation · Discord Promptfoo is now part of OpenAI.
@promptfooWrite, refine, run, and QA promptfoo evaluation suites: promptfooconfig.yaml, prompts, providers, vars, tests, assertions, model-graded rubrics, transforms,…
@promptfooConnect Promptfoo to a model, live HTTP API, local Python/JavaScript provider, or app code. Use for request/auth mapping, response parsing, OpenAPI setup, and…
@promptfooExecute, inspect, and rerun an existing Promptfoo redteam scan. Use for generated YAML, result exports, attack success rates, grader/target errors, filtered…
@promptfooCreate or refine a Promptfoo redteam config and generate probes from target behavior, code, or OpenAPI evidence. Use for purpose, trust boundaries, plugins,…
@promptfooStandards for creating redteam plugins and graders. Use when creating new plugins, writing graders, or modifying attack templates.
@promptfooURL search param and hash state management. Use when adding or modifying URL search params, working with useSearchParams, setSearchParams, useSearchParamState,…
@promptfoo© 2026 Flowy · Free and open source
Built for Claude Code · Not affiliated with Anthropic
