/workflows-review
Run multi-agent econometric review on estimation code, identification arguments, and research artifacts
$ npx -y skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill workflows-review --agent claude-codeHow it fires
How this skill gets triggered: by you, by Claude, or both.
- Fires itselfAuto-invocation. Claude auto-loads it when your prompt matches the work.Auto-invocation is when the right skill fires by itself at the right moment, driven by a FLOW.md router and a hook, instead of you invoking it by name. It is the difference between a skill being installed and a skill actually getting used.Read the full definition →
- You can call itInvoke it directly when you want it.
- Slash command
/workflows-review
Context preview
The summary Claude sees to decide when to auto-load this skill.
Run multi-agent econometric review on estimation code, identification arguments, and research artifacts
SKILL.md
workflows-review.SKILL.mdname: workflows:review
description: Run multi-agent econometric review on estimation code, identification arguments, and research artifacts
argument-hint: "<file paths, directory, plan reference, PR number, or empty for auto-detect>"
allowed-tools: Read, Grep, Glob, Bash
Review Command
**Pipeline mode:** This command operates fully autonomously. All decisions are made automatically.
Perform exhaustive econometric and methodological review using multi-agent parallel analysis. Domain-specific reviewers check estimation quality, identification strategy, numerical stability, and mathematical rigor.
Input
<review_target> #$ARGUMENTS </review_target>
Execution Workflow
Phase 1: Scope Detection
0. **Eligibility Check**
Before launching review agents, verify there is something to review. If no research artifacts are found (no estimation code, no proofs, no pipeline files, no data scripts, no output files), state "No research artifacts found to review" and stop. Do not launch agents against an empty target.
1. **Determine Review Target**
The review is artifact-centric: it reviews research files (estimation code, proofs, pipelines, data scripts), not git metadata. Determine the target in priority order:
- **File paths or directories** (e.g., `estimation.py`, `src/models/`, `proof.tex`) → review those artifacts directly
- **Plan reference** (e.g., `plan-3`) → find the plan in `docs/plans/`, review files it references
- **PR number** → fetch file list with `gh pr view --json files`
- **Empty** → auto-detect: scan the project for estimation code, proofs, pipeline files, and data scripts. If git shows recent changes, include those.
2. **Classify Artifacts**
Scan the target files and classify by type:
estimation_code: *.py with statsmodels/scipy.optimize/pyblp/linearmodels imports
*.R with fixest/lfe/AER/gmm imports
*.jl with Optim/NLsolve imports
*.do with reg/ivregress/gmm commands
simulation_code: Monte Carlo loops, DGP code, bias/RMSE computation
proofs: *.tex with theorem/proof environments, *.md with derivation sections
pipeline_files: Makefile, Snakefile, dvc.yaml, master.do
data_code: data loading, cleaning, merge operations
output_files: tables/*, figures/*, *.csv result filesThis classification drives which domain reviewers to launch.
3. **Load Review Settings**
Read `compound-science.local.md` in the project root. If found, use `review_agents` from YAML frontmatter. If the markdown body contains review context (e.g., "focus on identification strategy" or "this is a replication package"), pass it to each agent as additional instructions.
If no settings file exists, use defaults:
review_agents:
- econometric-reviewer
- numerical-auditor
- identification-criticProtected Artifacts
The following paths are compound-science pipeline artifacts and must never be flagged for deletion or removal by any review agent:
- `docs/plans/*.md` — Plan files created by `/workflows:plan`
- `docs/brainstorms/*.md` — Brainstorm files created by `/workflows:brainstorm`
- `docs/solutions/*.md` — Solution documents created by `/workflows:compound`
- `docs/simulations/*.md` — Simulation study documentation
If a review agent flags any file in these directories for cleanup or removal, discard that finding during synthesis.
Phase 2: Agent Dispatch
**Entry condition:** Phase 1 classified at least one artifact; review settings loaded. **Exit condition:** All dispatched agents have returned findings.
Launch domain reviewers in parallel using the Task tool. The specific agents depend on artifact classification from Phase 1.
Always Run (Core Domain Review)
<parallel_tasks>
Launch `econometric-reviewer`, `numerical-auditor`, and `identification-critic` in parallel:
Task econometric-reviewer(changed files + review context)
→ Checks: identification strategy, endogeneity, standard errors, instrument validity,
sample selection, asymptotic properties, correct package usage
Task numerical-auditor(changed files + review context)
→ Checks: floating-point stability, convergence diagnostics, integration accuracy,
RNG seeding, matrix conditioning, overflow/underflow, gradient accuracy
Task identification-critic(changed files + review context)
→ Checks: completeness of identification argument, exclusion restriction plausibility,
functional form assumptions, parametric vs nonparametric claims, support conditions,
point vs set identification</parallel_tasks>
Conditional Agents (Run Based on Artifact Types)
<conditional_agents>
**WRITTEN ARTIFACTS: If PR contains proofs, derivations, or paper sections:** (Files matching: `*.tex`, `*.md` with theorem/proof/lemma/proposition content, `docs/proofs/*`)
Task journal-referee(written artifact files + review context)
→ Simulates top-5 journal referee: contribution clarity, relation to literature,
identification concerns, economic vs statistical significance, R&R concerns
(robustness, external validity, mechanism)**PIPELINE/DATA CODE: If PR contains pipeline files or data processing:** (Files matching: `Makefile`, `Snakefile`, `dvc.yaml`, `*.do`, data loading/cleaning code)
Task reproducibility-auditor(pipeline files + review context)
→ Checks: intermediate files generated by code (no manual steps), seeds documented,
package versions pinned, end-to-end pipeline, relative paths, data not committed**TABLES/FIGURES: If tables or figures were generated:** (Files matching: `tables/*`, `figures/*`, `*.tex` with tabular content, `*.csv` result files)
Task econometric-reviewer(output files + estimation code + review context)
→ Checks: table numbers match underlying code output, no manual edits to generated tables,
statistical summaries consistent with estimation logs, formatting coRead more
name: workflows:review description: Run multi-agent econometric review on estimation code, identification arguments, and research artifacts argument-hint: "<file paths, directory, plan reference, PR number, or empty for auto-detect>" allowed-tools: Read, Grep, Glob, Bash
Review Command
**Pipeline mode:** This command operates fully autonomously. All decisions are made automatically.
Perform exhaustive econometric and methodological review using multi-agent parallel analysis. Domain-specific reviewers check estimation quality, identification strategy, numerical stability, and mathematical rigor.
Input
<review_target> #$ARGUMENTS </review_target>
Execution Workflow
Phase 1: Scope Detection
0. **Eligibility Check**
Before launching review agents, verify there is something to review. If no research artifacts are found (no estimation code, no proofs, no pipeline files, no data scripts, no output files), state "No research artifacts found to review" and stop. Do not launch agents against an empty target.
1. **Determine Review Target**
The review is artifact-centric: it reviews research files (estimation code, proofs, pipelines, data scripts), not git metadata. Determine the target in priority order:
- **File paths or directories** (e.g., `estimation.py`, `src/models/`, `proof.tex`) → review those artifacts directly
- **Plan reference** (e.g., `plan-3`) → find the plan in `docs/plans/`, review files it references
- **PR number** → fetch file list with `gh pr view --json files`
- **Empty** → auto-detect: scan the project for estimation code, proofs, pipeline files, and data scripts. If git shows recent changes, include those.
2. **Classify Artifacts**
Scan the target files and classify by type:
estimation_code: *.py with statsmodels/scipy.optimize/pyblp/linearmodels imports
*.R with fixest/lfe/AER/gmm imports
*.jl with Optim/NLsolve imports
*.do with reg/ivregress/gmm commands
simulation_code: Monte Carlo loops, DGP code, bias/RMSE computation
proofs: *.tex with theorem/proof environments, *.md with derivation sections
pipeline_files: Makefile, Snakefile, dvc.yaml, master.do
data_code: data loading, cleaning, merge operations
output_files: tables/*, figures/*, *.csv result filesThis classification drives which domain reviewers to launch.
3. **Load Review Settings**
Read `compound-science.local.md` in the project root. If found, use `review_agents` from YAML frontmatter. If the markdown body contains review context (e.g., "focus on identification strategy" or "this is a replication package"), pass it to each agent as additional instructions.
If no settings file exists, use defaults:
review_agents:
- econometric-reviewer
- numerical-auditor
- identification-criticProtected Artifacts
The following paths are compound-science pipeline artifacts and must never be flagged for deletion or removal by any review agent:
- `docs/plans/*.md` — Plan files created by `/workflows:plan`
- `docs/brainstorms/*.md` — Brainstorm files created by `/workflows:brainstorm`
- `docs/solutions/*.md` — Solution documents created by `/workflows:compound`
- `docs/simulations/*.md` — Simulation study documentation
If a review agent flags any file in these directories for cleanup or removal, discard that finding during synthesis.
Phase 2: Agent Dispatch
**Entry condition:** Phase 1 classified at least one artifact; review settings loaded. **Exit condition:** All dispatched agents have returned findings.
Launch domain reviewers in parallel using the Task tool. The specific agents depend on artifact classification from Phase 1.
Always Run (Core Domain Review)
<parallel_tasks>
Launch `econometric-reviewer`, `numerical-auditor`, and `identification-critic` in parallel:
Task econometric-reviewer(changed files + review context)
→ Checks: identification strategy, endogeneity, standard errors, instrument validity,
sample selection, asymptotic properties, correct package usage
Task numerical-auditor(changed files + review context)
→ Checks: floating-point stability, convergence diagnostics, integration accuracy,
RNG seeding, matrix conditioning, overflow/underflow, gradient accuracy
Task identification-critic(changed files + review context)
→ Checks: completeness of identification argument, exclusion restriction plausibility,
functional form assumptions, parametric vs nonparametric claims, support conditions,
point vs set identification</parallel_tasks>
Conditional Agents (Run Based on Artifact Types)
<conditional_agents>
**WRITTEN ARTIFACTS: If PR contains proofs, derivations, or paper sections:** (Files matching: `*.tex`, `*.md` with theorem/proof/lemma/proposition content, `docs/proofs/*`)
Task journal-referee(written artifact files + review context)
→ Simulates top-5 journal referee: contribution clarity, relation to literature,
identification concerns, economic vs statistical significance, R&R concerns
(robustness, external validity, mechanism)**PIPELINE/DATA CODE: If PR contains pipeline files or data processing:** (Files matching: `Makefile`, `Snakefile`, `dvc.yaml`, `*.do`, data loading/cleaning code)
Task reproducibility-auditor(pipeline files + review context)
→ Checks: intermediate files generated by code (no manual steps), seeds documented,
package versions pinned, end-to-end pipeline, relative paths, data not committed**TABLES/FIGURES: If tables or figures were generated:** (Files matching: `tables/*`, `figures/*`, `*.tex` with tabular content, `*.csv` result files)
Task econometric-reviewer(output files + estimation code + review context)
→ Checks: table numbers match underlying code output, no manual edits to generated tables,
statistical summaries consistent with estimation logs, formatting co📌 文档结构(2026-07-22 起): 本文件是中文默认入口 —— banner + badges + 信任面 + 9 阶段流水线速览 + 76 行合集总表。 每个合集的完整描述、按用途分组、精确数字、验证方法在 docs/CONTENT_ZH.md(扩展正文,总表行内的 → 直接跳转到对应锚点)。 English version: README-en.md · 中文扩展正文:docs/CONTENT_ZH.md · README-zh-CN.md 已弃用(重定向占位) 🌐 语言: English |
Other skills on auto-empirical-research-skills.
- /pipeline
Classical end-to-end empirical analysis workflow in the traditional Python econometric stack — pandas + numpy + scipy + statsmodels + linearmodels + pyfixest + rdrobust + econml + causalml + matplotlib/seaborn. **Defaults to economics empirical-paper style** (AER / QJE / AEJ) —
Open skill - /pipeline
Classical end-to-end empirical analysis workflow in the modern tidyverse + econometrics R ecosystem — dplyr + tidyr + haven + fixest + sandwich + lmtest + clubSandwich + AER + ivreg + did + bacondecomp + HonestDiD + eventstudyr + rdrobust + rddensity + Synth + gsynth + synthdid
Open skill - /pipeline
Classical end-to-end empirical analysis workflow in the traditional Stata ecosystem — native Stata + reghdfe + ivreg2 + csdid + did_imputation + eventstudyinteract + sdid + rdrobust + rddensity + synth + synth_runner + psmatch2 + teffects + ebalance + coefplot + esttab + asdoc +
Open skill - /00-Full-empirical-analysis-skill_StatsPAI
Use when the user asks to run a full empirical / causal analysis in Python — by default in the style of an applied economics paper (AER / QJE / JPE / ReStud / AEJ) with DID / RD / IV / SCM / DML / matching, written-out estimating equation + identifying assumption, Table 1 /
Open skill - /00.1-Full-empirical-analysis-skill_Python
Classical end-to-end empirical analysis workflow in the traditional Python econometric stack — pandas + numpy + scipy + statsmodels + linearmodels + pyfixest + rdrobust + econml + causalml + matplotlib/seaborn. **Defaults to economics empirical-paper style** (AER / QJE / AEJ) —
Open skill - /00.2-Full-empirical-analysis-skill_Stata
Classical end-to-end empirical analysis workflow in the traditional Stata ecosystem — native Stata + reghdfe + ivreg2 + csdid + did_imputation + eventstudyinteract + sdid + rdrobust + rddensity + synth + synth_runner + psmatch2 + teffects + ebalance + coefplot + esttab + asdoc +
Open skill

