Skip to content
Automation
Skill

/compare-evaluation-protocols

Build a protocol-difference matrix and estimate which differences can materially change measured performance.

From plugin
de-anthropocentric-research-engine
507200 skills

Claude Code

$ npx -y skills add yogsoth-ai/de-anthropocentric-research-engine --skill compare-evaluation-protocols --agent claude-code

SKILL.md

compare-evaluation-protocols.SKILL.md
name: compare-evaluation-protocols
description: "Build a protocol-difference matrix and estimate which differences can materially change measured performance."

compare-evaluation-protocols

Purpose

Build a protocol-difference matrix and estimate which differences can materially change measured performance.

Input contract

required: [protocol_records, metric_schema, comparison_target]
optional: [paired_results, sensitivity_assumptions]
constraints: [differences require explicit protocol fields and a comparable outcome]

Procedure

1. Extract protocol elements into a normalized comparison schema. 2. Align datasets, populations, metrics, baselines, and evaluation conditions. 3. Mark differences and assess their plausible performance effect. 4. Separate observed effects from unresolved protocol confounding.

Output contract

produces: [protocol_difference_matrix, materiality_assessment, confounding_notes, comparability_judgment]
delta_fields: [findings, evidence_updates, uncertainties, open_questions]

Quality gates

  • The compared metric and target are held constant or explicitly qualified.
  • Missing protocol fields remain visible.

Failure and counterexamples

Do not attribute score differences to method quality when protocol differences are unmeasured.

Provenance map

  • `resolved: knowledge-acquisition-evaluation-protocol-comparison`
Read more
@yogsoth-ai
Ships withde-anthropocentric-research-engine

A research skill graph for AI-native science. 271 markdown files. No runtime, no dependencies, no build step.

Stars on GitHub

Momentum

stars in total
507
Star history of yogsoth-ai/de-anthropocentric-research-engine on GitHub, a chart by star-history.com

More skills from other plugins.

agent-builder

agent-builder

Load immediately after an Agent intent, before the first agent_builder_* call. Governs how you create, configure, test, and…

n8n11d209k
@n8n-io@n8n-ioInstall Skill
browser-use

browser-use

Direct browser control via CDP for web interaction: automation, scraping, testing, screenshots, and site/app work. Also covers…

@browser-use@browser-useInstall Skill
agent-browser

agent-browser

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling…

@vercel-labs-2@vercel-labs-2Install Skill
add-anydoc

add-anydoc

Add local office-document-to-Markdown conversion to NanoClaw agent containers with the pinned Firecrawl AnyDoc CLI. Use when…

@nanocoai@nanocoaiInstall Skill

Questions about compare-evaluation-protocols.

Which coding agents can use compare-evaluation-protocols?
compare-evaluation-protocols installs in Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode and Windsurf with the skills CLI, using each agent's flag shown on this page. Flowy's auto-invocation, which fires a skill when your prompt matches, runs in Claude Code only.