Skip to content
Automation
Skill

/d4

Agent D4 - Measurement Instrument Developer - Scale construction and psychometric validation. Covers item development, validity evidence, and reliability testing for social science research.

From plugin
auto-empirical-research-skills
4.9k200 skills

Claude Code

$ npx -y skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill d4 --agent claude-code

SKILL.md

d4.SKILL.md
name: d4
description: |
  Agent D4 - Measurement Instrument Developer - Scale construction and psychometric validation.
  Covers item development, validity evidence, and reliability testing for social science research.
version: "12.0.1"

⛔ Prerequisites (v8.2 — MCP Enforcement)

`diverga_check_prerequisites("d4")` → must return `approved: true` If not approved → AskUserQuestion for each missing checkpoint (see `.claude/references/checkpoint-templates.md`)

Checkpoints During Execution

  • 🔴 CP_METHODOLOGY_APPROVAL → `diverga_mark_checkpoint("CP_METHODOLOGY_APPROVAL", decision, rationale)`

Fallback (MCP unavailable)

Read `.research/decision-log.yaml` directly to verify prerequisites. Conversation history is last resort.

---

Measurement Instrument Developer

Core Mission

Develop psychometrically sound measurement instruments (scales, questionnaires, surveys) for social science research, ensuring construct validity, reliability, and appropriate psychometric properties.

Capabilities

1. Survey Item Development

Question Wording Principles

item_writing_guidelines:
  clarity:
    - Use simple, direct language
    - One idea per item
    - Appropriate reading level for target population
    - Avoid jargon and technical terms

  neutrality:
    - Avoid leading questions
    - No double-barreled questions
    - No loaded language
    - Balanced positive and negative items

  specificity:
    - Concrete behaviors over abstract traits
    - Specific time frames when relevant
    - Clear referent (who/what is being asked about)

  avoid:
    - Double negatives ("not unlikely")
    - Ambiguous frequency words ("sometimes", "often")
    - Extreme modifiers ("always", "never")
    - Hypothetical scenarios without context

Response Format Design

response_formats:
  likert_scale:
    points: "5-7 points (odd for neutral option)"
    labels:
      all_points: "More precise but takes more space"
      endpoints_only: "Cleaner but assumes equal intervals"
    direction: "Maintain consistency across entire scale"
    examples:
      agreement: ["Strongly Disagree", "Disagree", "Neutral", "Agree", "Strongly Agree"]
      frequency: ["Never", "Rarely", "Sometimes", "Often", "Always"]

  semantic_differential:
    format: "Bipolar adjective pairs with 7-point scale"
    spacing: "Equal visual spacing between points"
    example: |
      Good ___:___:___:___:___:___:___ Bad
           1   2   3   4   5   6   7

  visual_analog:
    format: "Continuous line with endpoints labeled"
    scoring: "Convert to 0-100 scale"
    use_case: "Pain, mood, subjective states"

  forced_choice:
    format: "Choose between two statements"
    use_case: "Reduce social desirability bias"
    example: "Which describes you better? A or B"

  ranking:
    format: "Order items by importance/preference"
    limitation: "Complex for respondents, limited items (max 7-10)"

  checklist:
    format: "Select all that apply"
    use_case: "Behaviors, experiences, symptoms"

2. Scale Construction Process

scale_development_stages:

  stage_1_conceptualization:
    duration: "2-4 weeks"
    activities:
      - Define construct with theoretical grounding
      - Literature review for existing scales
      - Develop operational definition
      - Identify dimensions/facets if multidimensional
    outputs:
      - Construct definition document
      - Conceptual framework diagram
      - Decision: Unidimensional vs. Multidimensional

  stage_2_item_generation:
    duration: "3-6 weeks"
    guidelines:
      initial_pool_size: "3-4x the target final number of items"
      sources:
        - Literature review (adapt existing items)
        - Expert interviews (domain specialists)
        - Target population interviews (actual language used)
        - Theory (deductive approach)
      coverage:
        - Ensure all facets/dimensions represented
        - Balance positive and negative items
        - Range from low to high levels of construct
    outputs:
      - Item pool (40-60 items for 10-15 final items)
      - Item classification by dimension

  stage_3_expert_review:
    duration: "2-3 weeks"
    participants: "5-10 content experts"
    method:
      content_validity_ratio:
        formula: "CVR = (ne - N/2) / (N/2)"
        interpretation: "CVR > 0.62 for N=7 experts (Lawshe, 1975)"
        decision_rule: "Retain items with CVR above threshold"

      expert_ratings:
        - Relevance (1=Not relevant, 4=Highly relevant)
        - Clarity (1=Not clear, 4=Very clear)
        - Representativeness of dimension

      qualitative_feedback:
        - Wording suggestions
        - Missing content areas
        - Cultural appropriateness
    outputs:
      - Revised item pool (30-40 items)
      - Content validity evidence

  stage_4_cognitive_interview:
    duration: "2-3 weeks"
    participants: "8-15 members of target population"
    method:
      think_aloud:
        - Read item aloud
        - Say what they're thinking
        - Explain their answer choice

      verbal_probing:
        comprehension: "What does this question mean to you?"
        retrieval: "How did you arrive at your answer?"
        judgment: "How easy or difficult was it to answer?"
        response: "Why did you choose that option?"

      analysis:
        - Identify comprehension problems
        - Detect unintended interpretations
        - Find offensive/inappropriate items
    outputs:
      - Revised items based on feedback
      - Response process validity evidence

  stage_5_pilot_test:
    duration: "4-6 weeks"
    sample_size: "150-300 (5-10 per item minimum)"
    recruitment: "Representative of target population"

    analysis:
      descriptive_statistics:
        - Mean, SD, skewness, kurtosis for each item
        - Floor/ceiling effects (>15% at extremes = problem)
        - Missing data patterns

      item_analysis:
        item_total_correlation:
          threshold: "r > .
Read more
@brycewang-stanford
Ships withauto-empirical-research-skills

## 🔥 力荐 · StatsPAI — Stata 与 R 的 Python 平替,为 AI Agent 而生 🔁 Stata / R 平替:reghdfe、csdid、rdrobust、synth、fixest、did 等常用命令在 Python 中一站式替代,一个 import statspai as sp 搞定 DID / RD / IV / SCM / DML / matching 🤖 面向 Agent 设计:结构化结果对象 + 内置 MCP Server,Claude / Codex

4.9k200 skills
Get the whole plugin

Stars on GitHub

Momentum

stars in total
4.9k
Star history of brycewang-stanford/Auto-Empirical-Research-Skills on GitHub, a chart by star-history.com

More skills from other plugins.

agent-builder

agent-builder

Load immediately after an Agent intent, before the first agent_builder_* call. Governs how you create, configure, test, and…

n8n12d209k
@n8n-io@n8n-ioInstall Skill
browser-use

browser-use

Direct browser control via CDP for web interaction: automation, scraping, testing, screenshots, and site/app work. Also covers…

@browser-use@browser-useInstall Skill
agent-browser

agent-browser

Browser automation CLI for AI agents. Use when the user needs to interact with websites, including navigating pages, filling…

@vercel-labs-2@vercel-labs-2Install Skill
add-anydoc

add-anydoc

Add local office-document-to-Markdown conversion to NanoClaw agent containers with the pinned Firecrawl AnyDoc CLI. Use when…

@nanocoai@nanocoaiInstall Skill

Questions about d4.

Which coding agents can use d4?
d4 installs in Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode and Windsurf with the skills CLI, using each agent's flag shown on this page. Flowy's auto-invocation, which fires a skill when your prompt matches, runs in Claude Code only.