Skip to content
Development
Skill

/auto-test-execution

Automatically execute tests when code-generating agents modify source files, enforcing the execute-before-return pattern

From plugin
aiwg
229200 skills199 agents26 commands

Claude Code

$ npx -y skills add jmagly/aiwg --skill auto-test-execution --agent claude-code

SKILL.md

auto-test-execution.SKILL.md
namespace: aiwg
name: auto-test-execution
platforms: [all]
description: Automatically execute tests when code-generating agents modify source files, enforcing the execute-before-return pattern

auto-test-execution

Automatically execute tests when code-generating agents write to source files, enforcing the execute-before-return pattern.

Triggers

Primary phrases matched automatically from skill description. No additional alternate expressions defined.

Purpose

This skill enforces the MetaGPT executable feedback pattern: code-generating agents must execute tests before returning results to the user. It activates automatically when agents modify source code files.

Behavior

When triggered, this skill:

1. **Detect modified files**:

  • Track which source files the agent has written to
  • Identify the relevant test framework

2. **Find related tests**:

  • Look for test files matching the modified source
  • Convention: `src/foo/bar.ts` -> `test/unit/foo/bar.test.ts`
  • If no tests exist, prompt agent to generate them

3. **Execute tests**:

  • Run the project's test command focused on relevant tests
  • Capture results: passed, failed, errors

4. **Handle results**:

  • All pass: Allow agent to return results
  • Failures: Trigger debug-and-retry loop (max 3 attempts)
  • Persistent failures: Escalate with debug memory context

5. **Update debug memory**:

  • Record session in `.aiwg/ralph/debug-memory/sessions/`
  • Extract patterns for future reference

Activation Conditions

activation:
  always_active_for:
    - software-implementer
    - debugger
    - test-engineer

  triggered_by:
    - file_write:
        patterns:
          - "src/**/*.ts"
          - "src/**/*.js"
          - "src/**/*.py"
          - "**/*.go"
          - "**/*.rs"

  skip_when:
    - test_files_only: true
    - documentation_only: true
    - configuration_only: true

Integration

This skill uses:

  • `project-awareness`: Detect test framework and configuration
  • Debug memory at `.aiwg/ralph/debug-memory/` for pattern learning

References

  • @$AIWG_ROOT/agentic/code/frameworks/sdlc-complete/rules/executable-feedback.md - Feedback rules
  • @$AIWG_ROOT/agentic/code/addons/agent-loop/docs/executable-feedback-guide.md - Guide
  • @$AIWG_ROOT/agentic/code/addons/agent-loop/schemas/debug-memory.yaml - Memory schema
  • @.aiwg/research/findings/REF-013-metagpt.md - Research foundation
Read more
@jmagly
Ships withaiwg

Reusable project context and specialist workflows for the AI tools you already use. Plan software, coordinate specialist reviews, prepare campaigns, investigate incidents, organize research, curate media, and maintain operational knowledge.

229200 skills199 agents
Get the whole plugin

Stars on GitHub

Momentum

stars in total
229
Star history of jmagly/aiwg on GitHub, a chart by star-history.com

Other skills on aiwg.

agent-loop-ext

agent-loop-ext

Crash-resilient external agent loop with state persistence and CI/CD integration

@jmagly@jmaglyInstall Skill
agent-loop

agent-loop

Detect requests for iterative autonomous agent loops and route to the appropriate loop executor

@jmagly@jmaglyInstall Skill
infer-completion-criteria

infer-completion-crite…

Infer measurable completion criteria for an agent-loop task from project docs, code, and AIWG standards when the user has not…

@jmagly@jmaglyInstall Skill

More skills from other plugins.

brainstorming
Auto-invoked

brainstorming

You MUST use this before any creative work - creating features, building components, adding functionality, modifying behavior, or…

@obra@obraInstall Skill
ask-matt

ask-matt

Ask which skill or flow fits your situation. A router over the skills in this repo.

skills12d309k
@mattpocock@mattpocockInstall Skill
accessibility
Auto-invoked

accessibility

Design, implement, and audit accessible UI to WCAG 2.2 Level AA across Web, iOS, and Android — semantic ARIA roles and labels,…

ecc13d293k
@affaan-m@affaan-mInstall Skill
compiler-commit

compiler-commit

Use when you want to verify compiler changes and commit with the correct convention. Runs tests, lint, and format, then commits…

react2d252k
@facebook@facebookInstall Skill

Questions about auto-test-execution.

Which coding agents can use auto-test-execution?
auto-test-execution installs in Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode and Windsurf with the skills CLI, using each agent's flag shown on this page. Flowy's auto-invocation, which fires a skill when your prompt matches, runs in Claude Code only.