opik-mcp
Adds skills for Opik, the open-source LLM observability and evaluation platform: instrumenting apps with tracing, diagnosing traces, explaining root causes, running evaluations, and comparing runs against a baseline.
11 skills225
@comet-ml- 250Stars earned
- 2Plugins
- 21Skills
- 4Agents
- 6Commands
- 1MCP server
- 8Hooks
Plugins
2@comet-mlopik
Logs Claude Code sessions to Opik, the open-source LLM observability and evaluation platform, and adds skills to trace, evaluate, diagnose and compare AI applications. Built by Comet.
10 skills25
@comet-mlSkills
21opik
Reference for the Opik SDK — tracing, span types, framework integrations, threads, and the prompt library (Python, TypeScript,…
@comet-mlopik
Reference for the Opik SDK — tracing, span types, framework integrations, threads, and the prompt library (Python, TypeScript,…
@comet-mlopik-annotate
Set up human review in Opik — create an annotation queue for a project's traces or threads and give it a custom annotator view,…
@comet-mlopik-compare
Run a candidate against the baseline over an Opik test suite and read the numbers back — which cases broke, which got fixed, the…
@comet-mlopik-compare
Run a candidate against the baseline over an Opik test suite and read the numbers back — which cases broke, which got fixed, the…
@comet-mlopik-diagnose
Surface the Opik traces worth a developer's attention, ranked by signal — Diagnostics issues first, then errors, failed tool…
@comet-mlopik-diagnose
Surface the Opik traces worth a developer's attention, ranked by signal — Diagnostics issues first, then errors, failed tool…
@comet-mlopik-evaluate
Build an LLM evaluation and run it against the app, returning an Opik experiment with scores and its link. Picks a test suite…
@comet-mlopik-evaluate
Build an LLM evaluation and run it against the app, returning an Opik experiment with scores and its link. Picks a test suite…
@comet-mlopik-explain
Root-cause a specific Opik trace, or a pattern across traces, and return a grounded explanation. Uses the hosted Opik MCP when it…
@comet-mlopik-explain
Root-cause a specific Opik trace, or a pattern across traces, and return a grounded explanation. Uses the hosted Opik MCP when it…
@comet-mlopik-instrument
Add Opik tracing to an existing app and verify a real trace lands. Installs the Opik package, detects the language and LLM…
@comet-mlAgents
4code-reviewer
AgentReviews the current branch against origin/main before a PR, or when asked to review changes. Checks correctness, the MCP…
@comet-mltest-runner
AgentRuns the repo's checks and reports only failures and counts, so long pytest output stays out of the main session. <example> user:…
@comet-mlunderstand
AgentAnswers "how does X work" and "why is X like this" about opik-mcp from the specs, ADRs and code, and says where they disagree.…
@comet-mlagent-reviewer
AgentUse this agent when reviewing agent code for quality and best practices. Examples: <example> Context: User has written an agent…
@comet-mlCommands
6address-pr-comments
CommandCollect unaddressed review comments on this branch's PR, fix or answer each, and reply in the thread.
@comet-mlcreate-pr
CommandRun what CI runs, review the branch, and open a draft PR in comet-ml/opik-mcp with the template filled in.
@comet-mldogfood
CommandUse this branch's MCP server like a customer, next to main, and report what a customer would notice changed.
@comet-mlinstall-branch
CommandInstall the current worktree as MCP server opik-<ticket>, for sessions in this repo only.
@comet-mlinstrument
CommandAdd Opik observability to your code - automatically detects frameworks and adds the correct integration
@comet-mltrace-claude-code
CommandControl Opik tracing for your Claude Code sessions
@comet-mlIs this you? Claim your profilePut a plugin at the top of Plugins, from $9