/prompt-engineering

name: prompt-engineering
description: Engineer effective LLM prompts using zero-shot, few-shot, chain-of-thought, and structured output techniques. Use when building LLM applications requiring reliable outputs, implementing RAG systems, creating AI agents, or optimizing prompt quality and cost. Covers OpenAI, Anthropic, and open-source models with multi-language examples (Python/TypeScript).

Prompt Engineering

Design and optimize prompts for large language models (LLMs) to achieve reliable, high-quality outputs across diverse tasks.

Purpose

This skill provides systematic techniques for crafting prompts that consistently elicit desired behaviors from LLMs. Rather than trial-and-error prompt iteration, apply proven patterns (zero-shot, few-shot, chain-of-thought, structured outputs) to improve accuracy, reduce costs, and build production-ready LLM applications. Covers multi-model deployment (OpenAI GPT, Anthropic Claude, Google Gemini, open-source models) with Python and TypeScript examples.

When to Use This Skill

**Trigger this skill when:**

• Building LLM-powered applications requiring consistent outputs
• Model outputs are unreliable, inconsistent, or hallucinating
• Need structured data (JSON) from natural language inputs
• Implementing multi-step reasoning tasks (math, logic, analysis)
• Creating AI agents that use tools and external APIs
• Optimizing prompt costs or latency in production systems
• Migrating prompts across different model providers
• Establishing prompt versioning and testing workflows

**Common requests:**

• "How do I make Claude/GPT follow instructions reliably?"
• "My JSON parsing keeps failing - how to get valid outputs?"
• "Need to build a RAG system for question-answering"
• "How to reduce hallucination in model responses?"
• "What's the best way to implement multi-step workflows?"

Quick Start

**Zero-Shot Prompt (Python + OpenAI):**

from openai import OpenAI
client = OpenAI()

response = client.chat.completions.create(
    model="gpt-4",
    messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "Summarize this article in 3 sentences: [text]"}
    ],
    temperature=0  # Deterministic output
)
print(response.choices[0].message.content)

**Structured Output (TypeScript + Vercel AI SDK):**

import { generateObject } from 'ai';
import { openai } from '@ai-sdk/openai';
import { z } from 'zod';

const schema = z.object({
  name: z.string(),
  sentiment: z.enum(['positive', 'negative', 'neutral']),
});

const { object } = await generateObject({
  model: openai('gpt-4'),
  schema,
  prompt: 'Extract sentiment from: "This product is amazing!"',
});

Prompting Technique Decision Framework

**Choose the right technique based on task requirements:**

| Goal | Technique | Token Cost | Reliability | Use Case | |------|-----------|------------|-------------|----------| | **Simple, well-defined task** | Zero-Shot | ⭐⭐⭐⭐⭐ Minimal | ⭐⭐⭐ Medium | Translation, simple summarization | | **Specific format/style** | Few-Shot | ⭐⭐⭐ Medium | ⭐⭐⭐⭐ High | Classification, entity extraction | | **Complex reasoning** | Chain-of-Thought | ⭐⭐ Higher | ⭐⭐⭐⭐⭐ Very High | Math, logic, multi-hop QA | | **Structured data output** | JSON Mode / Tools | ⭐⭐⭐⭐ Low-Med | ⭐⭐⭐⭐⭐ Very High | API responses, data extraction | | **Multi-step workflows** | Prompt Chaining | ⭐⭐⭐ Medium | ⭐⭐⭐⭐ High | Pipelines, complex tasks | | **Knowledge retrieval** | RAG | ⭐⭐ Higher | ⭐⭐⭐⭐ High | QA over documents | | **Agent behaviors** | ReAct (Tool Use) | ⭐ Highest | ⭐⭐⭐ Medium | Multi-tool, complex tasks |

**Decision tree:**

START
├─ Need structured JSON? → Use JSON Mode / Tool Calling (references/structured-outputs.md)
├─ Complex reasoning required? → Use Chain-of-Thought (references/chain-of-thought.md)
├─ Specific format/style needed? → Use Few-Shot Learning (references/few-shot-learning.md)
├─ Knowledge from documents? → Use RAG (references/rag-patterns.md)
├─ Multi-step workflow? → Use Prompt Chaining (references/prompt-chaining.md)
├─ Agent with tools? → Use Tool Use / ReAct (references/tool-use-guide.md)
└─ Simple task → Use Zero-Shot (references/zero-shot-patterns.md)

Core Prompting Patterns

1. Zero-Shot Prompting

**Pattern:** Clear instruction + optional context + input + output format specification

**When to use:** Simple, well-defined tasks with clear expected outputs (summarization, translation, basic classification).

**Best practices:**

• Be specific about constraints and requirements
• Use imperative voice ("Summarize...", not "Can you summarize...")
• Specify output format upfront
• Set `temperature=0` for deterministic outputs

**Example:**

prompt = """
Summarize the following customer review in 2 sentences, focusing on key concerns:

Review: [customer feedback text]

Summary:
"""

See `references/zero-shot-patterns.md` for comprehensive examples and anti-patterns.

2. Chain-of-Thought (CoT)

**Pattern:** Task + "Let's think step by step" + reasoning steps → answer

**When to use:** Complex reasoning tasks (math problems, multi-hop logic, analysis requiring intermediate steps).

**Research foundation:** Wei et al. (2022) demonstrated 20-50% accuracy improvements on reasoning benchmarks.

**Zero-shot CoT:**

prompt = """
Solve this problem step by step:

A train leaves Station A at 2 PM going 60 mph.
Another leaves Station B at 3 PM going 80 mph.
Stations are 300 miles apart. When do they meet?

Let's think through this step by step:
"""

**Few-shot CoT:** Provide 2-3 examples showing reasoning steps before the actual task.

See `references/chain-of-thought.md` for advanced patterns (Tree-of-Thoughts, self-consistency).

3. Few-Shot Learning

**Pattern:** Task description + 2-5 examples (input → output) + actual task

**When to use:** Need specific formatting, style, or classification patterns not easily described.

**Sweet spot: