@ruaruababa/vibe-kit 1.0.0

package/skills/prompt-engineering-patterns/SKILL.md

@@ -0,0 +1,213 @@
+---
+name: prompt-engineering-patterns
+description: Master advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability in production. Use when optimizing prompts, improving LLM outputs, or designing production prompt templates.
+---
+
+# Prompt Engineering Patterns
+
+Master advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability.
+
+## Do not use this skill when
+
+- The task is unrelated to prompt engineering patterns
+- You need a different domain or tool outside this scope
+
+## Instructions
+
+- Clarify goals, constraints, and required inputs.
+- Apply relevant best practices and validate outcomes.
+- Provide actionable steps and verification.
+- If detailed examples are required, open `resources/implementation-playbook.md`.
+
+## Use this skill when
+
+- Designing complex prompts for production LLM applications
+- Optimizing prompt performance and consistency
+- Implementing structured reasoning patterns (chain-of-thought, tree-of-thought)
+- Building few-shot learning systems with dynamic example selection
+- Creating reusable prompt templates with variable interpolation
+- Debugging and refining prompts that produce inconsistent outputs
+- Implementing system prompts for specialized AI assistants
+
+## Core Capabilities
+
+### 1. Few-Shot Learning
+- Example selection strategies (semantic similarity, diversity sampling)
+- Balancing example count with context window constraints
+- Constructing effective demonstrations with input-output pairs
+- Dynamic example retrieval from knowledge bases
+- Handling edge cases through strategic example selection
+
+### 2. Chain-of-Thought Prompting
+- Step-by-step reasoning elicitation
+- Zero-shot CoT with "Let's think step by step"
+- Few-shot CoT with reasoning traces
+- Self-consistency techniques (sampling multiple reasoning paths)
+- Verification and validation steps
+
+### 3. Prompt Optimization
+- Iterative refinement workflows
+- A/B testing prompt variations
+- Measuring prompt performance metrics (accuracy, consistency, latency)
+- Reducing token usage while maintaining quality
+- Handling edge cases and failure modes
+
+### 4. Template Systems
+- Variable interpolation and formatting
+- Conditional prompt sections
+- Multi-turn conversation templates
+- Role-based prompt composition
+- Modular prompt components
+
+### 5. System Prompt Design
+- Setting model behavior and constraints
+- Defining output formats and structure
+- Establishing role and expertise
+- Safety guidelines and content policies
+- Context setting and background information
+
+## Quick Start
+
+```python
+from prompt_optimizer import PromptTemplate, FewShotSelector
+
+# Define a structured prompt template
+template = PromptTemplate(
+    system="You are an expert SQL developer. Generate efficient, secure SQL queries.",
+    instruction="Convert the following natural language query to SQL:\n{query}",
+    few_shot_examples=True,
+    output_format="SQL code block with explanatory comments"
+)
+
+# Configure few-shot learning
+selector = FewShotSelector(
+    examples_db="sql_examples.jsonl",
+    selection_strategy="semantic_similarity",
+    max_examples=3
+)
+
+# Generate optimized prompt
+prompt = template.render(
+    query="Find all users who registered in the last 30 days",
+    examples=selector.select(query="user registration date filter")
+)
+```
+
+## Key Patterns
+
+### Progressive Disclosure
+Start with simple prompts, add complexity only when needed:
+
+1. **Level 1**: Direct instruction
+   - "Summarize this article"
+
+2. **Level 2**: Add constraints
+   - "Summarize this article in 3 bullet points, focusing on key findings"
+
+3. **Level 3**: Add reasoning
+   - "Read this article, identify the main findings, then summarize in 3 bullet points"
+
+4. **Level 4**: Add examples
+   - Include 2-3 example summaries with input-output pairs
+
+### Instruction Hierarchy
+```
+[System Context] → [Task Instruction] → [Examples] → [Input Data] → [Output Format]
+```
+
+### Error Recovery
+Build prompts that gracefully handle failures:
+- Include fallback instructions
+- Request confidence scores
+- Ask for alternative interpretations when uncertain
+- Specify how to indicate missing information
+
+## Best Practices
+
+1. **Be Specific**: Vague prompts produce inconsistent results
+2. **Show, Don't Tell**: Examples are more effective than descriptions
+3. **Test Extensively**: Evaluate on diverse, representative inputs
+4. **Iterate Rapidly**: Small changes can have large impacts
+5. **Monitor Performance**: Track metrics in production
+6. **Version Control**: Treat prompts as code with proper versioning
+7. **Document Intent**: Explain why prompts are structured as they are
+
+## Common Pitfalls
+
+- **Over-engineering**: Starting with complex prompts before trying simple ones
+- **Example pollution**: Using examples that don't match the target task
+- **Context overflow**: Exceeding token limits with excessive examples
+- **Ambiguous instructions**: Leaving room for multiple interpretations
+- **Ignoring edge cases**: Not testing on unusual or boundary inputs
+
+## Integration Patterns
+
+### With RAG Systems
+```python
+# Combine retrieved context with prompt engineering
+prompt = f"""Given the following context:
+{retrieved_context}
+
+{few_shot_examples}
+
+Question: {user_question}
+
+Provide a detailed answer based solely on the context above. If the context doesn't contain enough information, explicitly state what's missing."""
+```
+
+### With Validation
+```python
+# Add self-verification step
+prompt = f"""{main_task_prompt}
+
+After generating your response, verify it meets these criteria:
+1. Answers the question directly
+2. Uses only information from provided context
+3. Cites specific sources
+4. Acknowledges any uncertainty
+
+If verification fails, revise your response."""
+```
+
+## Performance Optimization
+
+### Token Efficiency
+- Remove redundant words and phrases
+- Use abbreviations consistently after first definition
+- Consolidate similar instructions
+- Move stable content to system prompts
+
+### Latency Reduction
+- Minimize prompt length without sacrificing quality
+- Use streaming for long-form outputs
+- Cache common prompt prefixes
+- Batch similar requests when possible
+
+## Resources
+
+- **references/few-shot-learning.md**: Deep dive on example selection and construction
+- **references/chain-of-thought.md**: Advanced reasoning elicitation techniques
+- **references/prompt-optimization.md**: Systematic refinement workflows
+- **references/prompt-templates.md**: Reusable template patterns
+- **references/system-prompts.md**: System-level prompt design
+- **assets/prompt-template-library.md**: Battle-tested prompt templates
+- **assets/few-shot-examples.json**: Curated example datasets
+- **scripts/optimize-prompt.py**: Automated prompt optimization tool
+
+## Success Metrics
+
+Track these KPIs for your prompts:
+- **Accuracy**: Correctness of outputs
+- **Consistency**: Reproducibility across similar inputs
+- **Latency**: Response time (P50, P95, P99)
+- **Token Usage**: Average tokens per request
+- **Success Rate**: Percentage of valid outputs
+- **User Satisfaction**: Ratings and feedback
+
+## Next Steps
+
+1. Review the prompt template library for common patterns
+2. Experiment with few-shot learning for your specific use case
+3. Implement prompt versioning and A/B testing
+4. Set up automated evaluation pipelines
+5. Document your prompt engineering decisions and learnings

package/skills/prompt-engineering-patterns/assets/few-shot-examples.json

@@ -0,0 +1,106 @@
+{
+  "sentiment_analysis": [
+    {
+      "input": "This product exceeded my expectations! The quality is outstanding.",
+      "output": "Positive"
+    },
+    {
+      "input": "Terrible experience. The item arrived damaged and customer service was unhelpful.",
+      "output": "Negative"
+    },
+    {
+      "input": "The product works as described. Nothing special, but does the job.",
+      "output": "Neutral"
+    }
+  ],
+  "entity_extraction": [
+    {
+      "input": "Apple CEO Tim Cook announced the new iPhone at an event in Cupertino on September 12th.",
+      "output": {
+        "persons": ["Tim Cook"],
+        "organizations": ["Apple"],
+        "products": ["iPhone"],
+        "locations": ["Cupertino"],
+        "dates": ["September 12th"]
+      }
+    },
+    {
+      "input": "Microsoft acquired GitHub for $7.5 billion in 2018.",
+      "output": {
+        "persons": [],
+        "organizations": ["Microsoft", "GitHub"],
+        "products": [],
+        "locations": [],
+        "dates": ["2018"],
+        "monetary_values": ["$7.5 billion"]
+      }
+    }
+  ],
+  "code_generation": [
+    {
+      "input": "Write a Python function to check if a string is a palindrome",
+      "output": "def is_palindrome(s: str) -> bool:\n    \"\"\"Check if string is palindrome, ignoring case and spaces.\"\"\"\n    # Remove spaces and convert to lowercase\n    cleaned = s.replace(' ', '').lower()\n    # Compare with reversed string\n    return cleaned == cleaned[::-1]"
+    }
+  ],
+  "text_classification": [
+    {
+      "input": "How do I reset my password?",
+      "output": "account_management"
+    },
+    {
+      "input": "My order hasn't arrived yet. Where is it?",
+      "output": "shipping_inquiry"
+    },
+    {
+      "input": "I'd like to cancel my subscription.",
+      "output": "subscription_cancellation"
+    },
+    {
+      "input": "The app keeps crashing when I try to log in.",
+      "output": "technical_support"
+    }
+  ],
+  "data_transformation": [
+    {
+      "input": "John Smith, john@email.com, (555) 123-4567",
+      "output": {
+        "name": "John Smith",
+        "email": "john@email.com",
+        "phone": "(555) 123-4567"
+      }
+    },
+    {
+      "input": "Jane Doe | jane.doe@company.com | +1-555-987-6543",
+      "output": {
+        "name": "Jane Doe",
+        "email": "jane.doe@company.com",
+        "phone": "+1-555-987-6543"
+      }
+    }
+  ],
+  "question_answering": [
+    {
+      "context": "The Eiffel Tower is a wrought-iron lattice tower in Paris, France. It was constructed from 1887 to 1889 and stands 324 meters (1,063 ft) tall.",
+      "question": "When was the Eiffel Tower built?",
+      "answer": "The Eiffel Tower was constructed from 1887 to 1889."
+    },
+    {
+      "context": "Python 3.11 was released on October 24, 2022. It includes performance improvements and new features like exception groups and improved error messages.",
+      "question": "What are the new features in Python 3.11?",
+      "answer": "Python 3.11 includes exception groups, improved error messages, and performance improvements."
+    }
+  ],
+  "summarization": [
+    {
+      "input": "Climate change refers to long-term shifts in global temperatures and weather patterns. While climate change is natural, human activities have been the main driver since the 1800s, primarily due to the burning of fossil fuels like coal, oil and gas which produces heat-trapping greenhouse gases. The consequences include rising sea levels, more extreme weather events, and threats to biodiversity.",
+      "output": "Climate change involves long-term alterations in global temperatures and weather patterns, primarily driven by human fossil fuel consumption since the 1800s, resulting in rising sea levels, extreme weather, and biodiversity threats."
+    }
+  ],
+  "sql_generation": [
+    {
+      "schema": "users (id, name, email, created_at)\norders (id, user_id, total, order_date)",
+      "request": "Find all users who have placed orders totaling more than $1000",
+      "output": "SELECT u.id, u.name, u.email, SUM(o.total) as total_spent\nFROM users u\nJOIN orders o ON u.id = o.user_id\nGROUP BY u.id, u.name, u.email\nHAVING SUM(o.total) > 1000;"
+    }
+  ]
+}

package/skills/prompt-engineering-patterns/assets/prompt-template-library.md

@@ -0,0 +1,246 @@
+# Prompt Template Library
+
+## Classification Templates
+
+### Sentiment Analysis
+```
+Classify the sentiment of the following text as Positive, Negative, or Neutral.
+
+Text: {text}
+
+Sentiment:
+```
+
+### Intent Detection
+```
+Determine the user's intent from the following message.
+
+Possible intents: {intent_list}
+
+Message: {message}
+
+Intent:
+```
+
+### Topic Classification
+```
+Classify the following article into one of these categories: {categories}
+
+Article:
+{article}
+
+Category:
+```
+
+## Extraction Templates
+
+### Named Entity Recognition
+```
+Extract all named entities from the text and categorize them.
+
+Text: {text}
+
+Entities (JSON format):
+{
+  "persons": [],
+  "organizations": [],
+  "locations": [],
+  "dates": []
+}
+```
+
+### Structured Data Extraction
+```
+Extract structured information from the job posting.
+
+Job Posting:
+{posting}
+
+Extracted Information (JSON):
+{
+  "title": "",
+  "company": "",
+  "location": "",
+  "salary_range": "",
+  "requirements": [],
+  "responsibilities": []
+}
+```
+
+## Generation Templates
+
+### Email Generation
+```
+Write a professional {email_type} email.
+
+To: {recipient}
+Context: {context}
+Key points to include:
+{key_points}
+
+Email:
+Subject:
+Body:
+```
+
+### Code Generation
+```
+Generate {language} code for the following task:
+
+Task: {task_description}
+
+Requirements:
+{requirements}
+
+Include:
+- Error handling
+- Input validation
+- Inline comments
+
+Code:
+```
+
+### Creative Writing
+```
+Write a {length}-word {style} story about {topic}.
+
+Include these elements:
+- {element_1}
+- {element_2}
+- {element_3}
+
+Story:
+```
+
+## Transformation Templates
+
+### Summarization
+```
+Summarize the following text in {num_sentences} sentences.
+
+Text:
+{text}
+
+Summary:
+```
+
+### Translation with Context
+```
+Translate the following {source_lang} text to {target_lang}.
+
+Context: {context}
+Tone: {tone}
+
+Text: {text}
+
+Translation:
+```
+
+### Format Conversion
+```
+Convert the following {source_format} to {target_format}.
+
+Input:
+{input_data}
+
+Output ({target_format}):
+```
+
+## Analysis Templates
+
+### Code Review
+```
+Review the following code for:
+1. Bugs and errors
+2. Performance issues
+3. Security vulnerabilities
+4. Best practice violations
+
+Code:
+{code}
+
+Review:
+```
+
+### SWOT Analysis
+```
+Conduct a SWOT analysis for: {subject}
+
+Context: {context}
+
+Analysis:
+Strengths:
+-
+
+Weaknesses:
+-
+
+Opportunities:
+-
+
+Threats:
+-
+```
+
+## Question Answering Templates
+
+### RAG Template
+```
+Answer the question based on the provided context. If the context doesn't contain enough information, say so.
+
+Context:
+{context}
+
+Question: {question}
+
+Answer:
+```
+
+### Multi-Turn Q&A
+```
+Previous conversation:
+{conversation_history}
+
+New question: {question}
+
+Answer (continue naturally from conversation):
+```
+
+## Specialized Templates
+
+### SQL Query Generation
+```
+Generate a SQL query for the following request.
+
+Database schema:
+{schema}
+
+Request: {request}
+
+SQL Query:
+```
+
+### Regex Pattern Creation
+```
+Create a regex pattern to match: {requirement}
+
+Test cases that should match:
+{positive_examples}
+
+Test cases that should NOT match:
+{negative_examples}
+
+Regex pattern:
+```
+
+### API Documentation
+```
+Generate API documentation for this function:
+
+Code:
+{function_code}
+
+Documentation (follow {doc_format} format):
+```
+
+## Use these templates by filling in the {variables}