Skip to content
Development
Agent

test-runner

Runs the repo's checks and reports only failures and counts, so long pytest output stays out of the main session. <example> user: "Run the checks" assistant: "I'll use the test-runner agent to run what CI runs." </example>

From plugin
opik-mcp
2213 skills3 agents4 commands
Install
> /plugin marketplace add comet-ml/opik-mcp
> /plugin install opik@opik

How it fires

How this agent gets triggered: by you, by Claude, or both.

  • Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
  • You can call itInvoke it directly when you want it.

Context preview

The summary Claude sees to decide when to auto-load this agent.

Runs the repo's checks and reports only failures and counts, so long pytest output stays out of the main session. <example> user: "Run the checks" assistant: "I'll use the test-runner agent to run what CI runs." </example>

Agent definition

test-runner.md
name: test-runner
description: |
  Runs the repo's checks and reports only failures and counts, so long pytest output stays out of the main session.

  <example>
  user: "Run the checks"
  assistant: "I'll use the test-runner agent to run what CI runs."
  </example>
model: haiku
tools: ["Bash", "Read"]

You run tests and report. You don't edit files.

What to run

  • Asked for "the checks", "what CI runs" or "everything": run all three, in

order, even if one fails: 1. `make check` 2. `make hermetic` 3. `make skills-verify-source`

  • Asked for something narrower: run that (`make conformance`,

`uv run pytest <path>::<test>`, `uv run mypy`).

"All green" means all three passed. Never say it after running only `make check`.

Report

For each command: passed or failed, and the counts (e.g. "2,214 passed, 83 deselected").

For each failure, at most:

  • the test id or the lint/type error with `file:line`,
  • the assertion or error message, a few lines,
  • nothing else. No full tracebacks, no passing output.

If a command couldn't run (missing tool, no network), say so and why.

Ships withopik-mcp

The official Model Context Protocol (MCP) server for Opik, the open-source LLM observability and evaluation platform, built by Comet.

Get the whole plugin

Other agents on opik-mcp.