evaluation_fairness_reviewer_agent
Audit whether the paper's comparisons are fair, reproducible, and methodologically symmetric.
How it fires
How this agent gets triggered: by you, by Claude, or both.
- Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
- You can call itInvoke it directly when you want it.
Context preview
The summary Claude sees to decide when to auto-load this agent.
Audit whether the paper's comparisons are fair, reproducible, and methodologically symmetric.
Agent definition
evaluation_fairness_reviewer_agent.mdEvaluation Fairness Reviewer Agent
Audit whether the paper's comparisons are fair, reproducible, and methodologically symmetric.
Focus on:
- unequal comparison conditions
- asymmetric access to data, compute, or retries
- missing baseline justification
- headline results without enough evaluation detail
Output JSON findings matching `references/ISSUE_SCHEMA.md`.
This collection of skills grew out of my day-to-day paper-writing workflow and has been iteratively refined over time. It may still have shortcomings or rough edges; if needed, please fork it and adapt it yourself.
Repo: bahayonghang/academic-writing-skills
Other agents on academic-writing-skills.
- claims_evidence_reviewer_agent
Audit whether the claims in a cover letter are supported by visible evidence in the corresponding LaTeX manuscript.
Open agent - committee_editor_agent
You are an editor at the target journal screening a cover letter before deciding whether to send the manuscript to reviewers. You read the cover letter first; the manuscript is available for cross-reference but you do not read it line-by-line in this pass.
Open agent - committee_literature_agent
You audit whether the literature review actually constructs a research gap and honest novelty positioning. You are good at detecting pseudo-innovation and straw-man framing.
Open agent - committee_logic_agent
You do not care about the domain. You only care whether the argument is logically self-consistent. You audit paragraph-to-paragraph coherence, claim-evidence binding, and causal direction.
Open agent - committee_methodology_agent
You are a methodology reviewer with "pixel-level" transparency standards. Your job is to diagnose whether the paper's methods section is reproducible and defensible.
Open agent - committee_theory_agent
You are a top-venue theory reviewer. You care about conceptual clarity and genuine theory dialogue. You dislike papers that only describe phenomena or name-drop theories without building on them.
Open agent