/haystack-pipeline

name: haystack-pipeline
description: Haystack NLP pipeline configuration for document processing and QA
allowed-tools:
  - Read
  - Write
  - Edit
  - Bash
  - Glob
  - Grep
graph:
  domains: [domain:software-engineering]
  specializations: [specialization:ai-agents-conversational]
  skillAreas: [skill-area:retrieval-augmented-generation, skill-area:natural-language-processing]
  roles: [role:ml-engineer, role:backend-engineer]
  workflows: [workflow:ml-model-lifecycle, workflow:feature-development]

Haystack Pipeline Skill

Capabilities

• Configure Haystack pipeline components
• Set up document stores and retrievers
• Implement reader/generator models
• Design custom pipeline graphs
• Configure preprocessing pipelines
• Implement evaluation pipelines

Target Processes

• rag-pipeline-implementation
• intent-classification-system

Implementation Details

Core Components

1. **DocumentStores**: Elasticsearch, Weaviate, FAISS, etc. 2. **Retrievers**: BM25, Dense, Hybrid 3. **Readers/Generators**: Extractive and generative QA 4. **Preprocessors**: Document cleaning and splitting

Pipeline Types

• Retrieval pipelines
• RAG pipelines
• Evaluation pipelines
• Indexing pipelines

Configuration Options

• Component selection
• Pipeline graph design
• Document store backend
• Model selection
• Preprocessing settings

Best Practices

• Modular pipeline design
• Proper preprocessing
• Evaluation integration
• Component versioning

Dependencies

• haystack-ai
• farm-haystack (legacy)