advanced-evaluation
This skill should be used for advanced LLM evaluation: LLM-as-judge systems, direct scoring, pairwise comparison, rubric calibration, evaluator bias…
This skill should be used for project-level decisions about LLM-powered systems: whether an LLM is the right primitive for the task at hand, the shape of a multi-stage batch or agent pipeline, token and cost estimation, choosing between single-agent and multi-agent at the
$ npx -y skills add muratcankoylan/agent-skills-for-context-engineering --skill project-development --agent claude-codeHow it fires
How this skill gets triggered: by you, by Claude, or both.
/project-developmentContext preview
The summary Claude sees to decide when to auto-load this skill.
This skill should be used for project-level decisions about LLM-powered systems: whether an LLM is the right primitive for the task at hand, the shape of a multi-stage batch or agent pipeline, token and cost estimation, choosing between single-agent and multi-agent at the
name: project-development description: "This skill should be used for project-level decisions about LLM-powered systems: whether an LLM is the right primitive for the task at hand, the shape of a multi-stage batch or agent pipeline, token and cost estimation, choosing between single-agent and multi-agent at the project level, structured output design for downstream parsing, and structuring agent-assisted iteration. Use this when the unit of work is a whole project or a multi-stage pipeline. Route individual tool design to tool-design and individual skill-loading or context-budget tactics to context-optimization."
This skill covers the principles for identifying tasks suited to LLM processing, designing effective project architectures, and iterating rapidly using agent-assisted development. The methodology applies whether building a batch processing pipeline, a multi-agent research system, or an interactive agent application.
The unit of work for this skill is the whole project or a multi-stage pipeline. Individual tool design (descriptions, schemas, error messages) belongs to `tool-design`. Per-skill activation routing belongs to the corresponding skill plus the corpus index. This skill owns the project-level questions: should you build this with an LLM at all, what shape should the pipeline take, what does it cost, how should it be iterated.
Activate this skill when the unit of work is a whole project or pipeline:
Do not activate this skill for adjacent work owned by other skills:
Evaluate task-model fit before writing any code, because building automation on a fundamentally mismatched task wastes days of effort. Run every proposed task through these two tables to decide proceed-or-stop.
**Proceed when the task has these characteristics:**
| Characteristic | Rationale | |----------------|-----------| | Synthesis across sources | LLMs combine information from multiple inputs better than rule-based alternatives | | Subjective judgment with rubrics | Grading, evaluation, and classification with criteria map naturally to language reasoning | | Natural language output | When the goal is human-readable text, LLMs deliver it natively | | Error tolerance | Individual failures do not break the overall system, so LLM non-determinism is acceptable | | Batch processing | No conversational state required between items, which keeps context clean | | Domain knowledge in training | The model already has relevant context, reducing prompt engineering overhead |
**Stop when the task has these characteristics:**
| Characteristic | Rationale | |----------------|-----------| | Precise computation | Math, counting, and exact algorithms are unreliable in language models | | Real-time requirements | LLM latency is too high for sub-second responses | | Perfect accuracy requirements | Hallucination risk makes 100% accuracy impossible | | Proprietary data dependence | The model lacks necessary context and cannot acquire it from prompts alone | | Sequential dependencies | Each step depends heavily on the previous result, compounding errors | | Deterministic output requirements | Same input must produce identical output, which LLMs cannot guarantee |
Always validate task-model fit with a manual test before investing in automation. Copy one representative input into the model interface, evaluate the output quality, and use the result to answer these questions:
Do this because a failed manual prototype predicts a failed automated system, while a successful one provides both a quality baseline and a prompt-design template. The test takes minutes and prevents hours of wasted development.
Structure LLM projects as staged pipelines because separation of deterministic and non-deterministic stages enables fast iteration and cost control. Design each stage to be:
**Use this canonical pipeline structure:**
acquire -> prepare -> process -> parse -> render
1. **Acquire**: Fetch raw data from sources (APIs, files, databases) 2. **Prepare**: Transform data into prompt format 3. **Process**: Execute LLM calls (the expensive, non-deterministic step) 4. **Parse**: Extract structured data from LLM outputs 5. **Render**: Generate final outputs (reports, files, visualizations)
Stages 1, 2, 4, and 5 are deterministic. Stage 3 is non-deterministic and expensive. Maintain this separation becaus
A comprehensive, open collection of Agent Skills focused on context engineering and harness engineering principles for building production-grade AI agent systems.
Repo: muratcankoylan/agent-skills-for-context-engineering
This skill should be used for advanced LLM evaluation: LLM-as-judge systems, direct scoring, pairwise comparison, rubric calibration, evaluator bias…
This skill should be used when modeling agent mental states with BDI concepts: beliefs, desires, intentions, RDF-to-belief transformations, rational agency…
This skill should be used when long-running agent sessions need context compression, structured summarization, compaction, token-per-task optimization, or…
This skill should be used for diagnosing and mitigating context degradation: lost-in-middle failures, context poisoning, context clash, context confusion,…
This skill should be used to explain or reason about the foundational concepts of context engineering: what context is, the anatomy of a context window, how…
This skill should be used for improving context efficiency: context budgeting, observation masking, prefix or KV-cache strategy, partitioning, token-cost…