@uluops/setup 0.2.0 → 0.6.0

package/assets/{commands → claude-code/commands}/agents/prompt-quality.md

@@ -1,134 +1,155 @@
----
-name: prompt-quality
-description: Validates prompts against prompt engineering best practices for clarity, context, structure, and effectiveness.
----
-
-# Prompt Quality Validator
-Validates prompts against prompt engineering best practices for clarity, context, structure, and effectiveness.
-
-## Arguments
-
-**Usage:** `/agents:prompt-quality <directory>`
-
-**Examples:**
-- `/agents:prompt-quality agents/my-agent.md`
-- `/agents:prompt-quality commands/my-cmd.md`
-
-**Target Directory:** $ARGUMENTS
-
----
-
-## Pre-Flight
-
-```bash
-echo "Running prompt quality validation on $ARGUMENTS..."
-echo "=================================================="
-```
-
-Verify the target directory exists:
-
-```bash
-test -d "$ARGUMENTS" && echo "✓ Directory exists: $ARGUMENTS" || echo "ERROR: Directory '$ARGUMENTS' not found"
-```
-
-Enter and confirm location:
-
-```bash
-cd "$ARGUMENTS" && pwd
-```
-
-Check file exists:
-
-```bash
-[ -f "$ARGUMENTS" ] && echo "✓ $ARGUMENTS found" || echo "Target file does not exist"
-```
-
-
----
-
-## Agent Invocation
-
-Run the Prompt Quality Validator agent on the validated target directory:
-
-**Agent:** prompt-quality-validator-agent.md
-**Model:** Sonnet
-**Target:** $ARGUMENTS
-
-The agent performs code quality validation across 5 categories (100 points total):
-
-| Category | Points | Focus |
-|----------|--------|-------|
-| Clarity & Specificity | 25 | Validates task definition, scope, format, vagueness, and examples |
-| Context & Background | 20 | Validates context sufficiency, audience, constraints, and role assignment |
-| Structure & Organization | 20 | Validates section headers, step decomposition, formatting, and modularity |
-| Effectiveness Techniques | 20 | Validates few-shot examples, chain-of-thought, error prevention, and edge cases |
-| Quality Assurance | 15 | Validates success criteria, testability, and instruction consistency |
-
----
-
-## Auto-Fail Conditions
-
-Critical issues that trigger immediate FAIL regardless of score:
-
-| ID | Condition |
-|----|-----------|
-| **AF-001** | Missing task definition/mission |
-| **AF-002** | No output format specification |
-| **AF-003** | Conflicting instructions detected |
-| **AF-004** | More than 3 vague qualifiers in directives |
-| **AF-005** | Complex pattern with zero examples |
-
----
-
-## Decision Thresholds
-
-| Score | Decision | Meaning |
-|-------|----------|---------|
-| **>=75** | ✅ PASS | Validation passed, proceed to next phase |
-| **<75** | ❌ FAIL | Validation failed, fix issues before proceeding |
-
-**Note:** Any critical issue triggers FAIL regardless of score.
-
----
-
-
-## PERSIST TO TRACKER (Required)
-
-> **IMPORTANT:** Save to tracker IMMEDIATELY after agent completes, BEFORE presenting the summary to the user. The workflow is not complete until results are persisted.
-**1. Get token metrics from buffer:**
-```bash
-agent-metrics buffer list --since 5m -f tracker
-```
-
-**2. Save to tracker (DO THIS FIRST):**
-
-mcp__uluops-tracker__save_features_list
-
-**3. Verify saved:** Compare `json.summary.total_issues` with saved count.
-
-**4. THEN present summary to user.**
-
-### Field Mappings
-
-**From JSON OUTPUT to Tracker:**
-| Source | Tracker Field | Notes |
-|--------|---------------|-------|
-| `json.result.score` | `validators[].score` | Total score |
-| `json.result.decision` | `validators[].status` | PASS/FAIL |
-| `buffer.model` | `validators[].model` | From agent-metrics buffer |
-| `buffer.tokens.input_tokens` | `input_tokens` | Raw input tokens |
-| `buffer.tokens.output_tokens` | `output_tokens` | Output tokens |
-| `buffer.tokens.cache_creation_tokens` | `cache_creation_tokens` | Cache creation |
-| `buffer.tokens.cache_read_tokens` | `cache_read_tokens` | Cache reads |
-| `buffer.tokens.total_effective_tokens` | `total_effective_tokens` | Effective total |
-| `json.categories[].findings[].issues[]` | `recommendations[]` | Flatten nested structure |
-
-**Note:** `json` = agent's JSON OUTPUT, `buffer` = `agent-metrics buffer list -f tracker`
-
----
-
-## Source
-
-**CDL Schema:** `udl/definition-languages/cdl-schema-v1.1.0.json`
-**CDL Source:** `/home/alexs/uluops/uluops-agent-workflows/udl/cdl/v1/prompt-quality.command.yaml`
-**Agent:** `agents/prompt-quality-validator-agent.md`
+---
+name: prompt-quality
+description: Validates prompts against prompt engineering best practices for clarity, context, structure, and effectiveness.
+---
+
+# Prompt Quality Validator v1
+Validates prompts against prompt engineering best practices for clarity, context, structure, and effectiveness.
+
+## What's New in v1
+
+| Feature | Description |
+|---------|-------------|
+| **Calibration Examples** | Reference scenarios for consistent scoring |
+| **Failure Code Examples** | Worked examples mapping issues to taxonomy codes |
+| **Token Budget** | Output length guidance |
+| **Display IDs** | Auto-fail conditions have numbered IDs |
+
+## Arguments
+
+**Usage:** `/agents:prompt-quality <directory>`
+
+**Examples:**
+- `/agents:prompt-quality agents/my-agent.md`
+- `/agents:prompt-quality commands/my-cmd.md`
+
+**Target Directory:** $ARGUMENTS
+
+
+---
+
+## Pre-Flight
+
+```bash
+echo "Running prompt quality validation on $ARGUMENTS..."
+echo "=================================================="
+```
+
+Verify the target directory exists:
+
+```bash
+test -d "$ARGUMENTS" && echo "✓ Directory exists: $ARGUMENTS" || echo "ERROR: Directory '$ARGUMENTS' not found"
+```
+
+Enter and confirm location:
+
+```bash
+cd "$ARGUMENTS" && pwd
+```
+
+Check file exists:
+
+```bash
+[ -f "$ARGUMENTS" ] && echo "✓ $ARGUMENTS found" || echo "Target file does not exist"
+```
+
+
+---
+
+## Agent Invocation
+
+Run the Prompt Quality Validator agent on the validated target directory:
+
+**Agent:** prompt-quality-validator-agent.md
+**Model:** Sonnet
+**Target:** $ARGUMENTS
+
+
+---
+
+## Decision Thresholds
+
+| Score | Decision | Meaning |
+|-------|----------|---------|
+| **>=75** | ✅ PASS | Validation passed, proceed to next phase |
+| **<75** | ❌ FAIL | Validation failed, fix issues before proceeding |
+
+**Note:** Any critical issue triggers FAIL regardless of score.
+
+---
+
+## Post-Flight Actions
+
+### On Success
+
+Prompt quality validation passed with score >= 75
+
+```bash
+exit 0
+```
+
+### On Failure
+
+Prompt quality validation failed. Review issues above.
+
+```bash
+exit 1
+```
+
+
+---
+
+
+## PERSIST TO TRACKER (Required)
+
+> **IMPORTANT:** Save to tracker IMMEDIATELY after agent completes, BEFORE presenting the summary to the user. The workflow is not complete until results are persisted.
+**1. Get token metrics from buffer:**
+```bash
+agent-metrics buffer list --since 5m -f tracker
+```
+
+**2. Save to tracker (DO THIS FIRST):**
+
+mcp__uluops-tracker__save_run
+
+**3. Verify saved:** Compare `json.summary.total_issues` with saved count.
+
+**4. THEN present summary to user.**
+
+### Field Mappings
+
+**Definition identity (REQUIRED for execution tracking):**
+| Tracker Field | Value | Notes |
+|---------------|-------|-------|
+| `definition_type` | `command` | From CDL interface |
+| `definition_name` | `prompt-quality` | From CDL interface |
+| `definition_version` | `1.0.2` | From CDL interface |
+
+**From JSON OUTPUT to Tracker:**
+| Source | Tracker Field | Notes |
+|--------|---------------|-------|
+| `json.result.score` | `agents[].score` | Total score |
+| `json.result.decision` | `agents[].decision` | PASS/FAIL |
+| `buffer.model` | `validators[].model` | From agent-metrics buffer |
+| `buffer.tokens.input_tokens` | `input_tokens` | Raw input tokens |
+| `buffer.tokens.output_tokens` | `output_tokens` | Output tokens |
+| `buffer.tokens.cache_creation_tokens` | `cache_creation_tokens` | Cache creation |
+| `buffer.tokens.cache_read_tokens` | `cache_read_tokens` | Cache reads |
+| `buffer.tokens.total_effective_tokens` | `total_effective_tokens` | Effective total |
+| `json.categories[].findings[].issues[]` | `recommendations[]` | Flatten nested structure |
+| `json.analysis.records[]` | `analysis_records[]` | Structured analysis records (v1.4.0) |
+| `json.analysis.system_metrics` | `analysis_summary.system_metrics` | Agent-type-specific metrics |
+| `json.analysis.category_scores[]` | `analysis_summary.category_scores[]` | Category score breakdown |
+| `json.analysis.epistemic_assessment` | `analysis_summary.epistemic_assessment` | Failure signature risk ratings |
+| `json.analysis.audit_implications[]` | `analysis_summary.audit_implications[]` | Trajectory projections |
+
+**Note:** `json` = agent's JSON OUTPUT, `buffer` = `agent-metrics buffer list -f tracker`
+**Note:** `analysis_records` and `analysis_summary` are optional (v1.4.0). Omit if agent output has no `analysis` section.
+
+---
+
+## Source
+
+**CDL Schema:** `udl/definition-languages/cdl-schema-v1_3_0.json`
+**CDL Source:** `/Users/aself/uluops/uluops-agent-workflows/udl/cdl/v1/prompt-quality.command.yaml`
+**Agent:** `agents/prompt-quality-validator-agent.md`

package/assets/claude-code/commands/agents/prompt-validate.md

@@ -0,0 +1,155 @@
+---
+name: prompt-validate
+description: Validates AI agent prompts for clarity, effectiveness, and consistency using impact-weighted scoring. Blocks deployment if critical issues found. Provides DEPLOY/CONDITIONAL/REVISE decision at ≥85/≥70 thresholds.
+---
+
+# Prompt Validator v2
+Validates AI agent prompts for clarity, effectiveness, and consistency using impact-weighted scoring. Blocks deployment if critical issues found. Provides DEPLOY/CONDITIONAL/REVISE decision at ≥85/≥70 thresholds.
+
+## What's New in v2
+
+| Feature | Description |
+|---------|-------------|
+| **Calibration Examples** | Reference scenarios for consistent scoring |
+| **Failure Code Examples** | Worked examples mapping issues to taxonomy codes |
+| **Token Budget** | Output length guidance |
+| **Display IDs** | Auto-fail conditions have numbered IDs |
+
+## Arguments
+
+**Usage:** `/agents:prompt-validate <directory>`
+
+**Examples:**
+- `/agents:prompt-validate agents/my-agent.md`
+- `/agents:prompt-validate udl/adl/my-validator.agent.yaml`
+
+**Target Directory:** $ARGUMENTS
+
+
+---
+
+## Pre-Flight
+
+```bash
+echo "Running prompt validation on $ARGUMENTS..."
+echo "=========================================="
+```
+
+Verify the target directory exists:
+
+```bash
+test -d "$ARGUMENTS" && echo "✓ Directory exists: $ARGUMENTS" || echo "ERROR: Directory '$ARGUMENTS' not found"
+```
+
+Enter and confirm location:
+
+```bash
+cd "$ARGUMENTS" && pwd
+```
+
+Check file exists:
+
+```bash
+[ -f "$ARGUMENTS" ] && echo "✓ $ARGUMENTS found" || echo "Target file does not exist"
+```
+
+
+---
+
+## Agent Invocation
+
+Run the Prompt Validator agent on the validated target directory:
+
+**Agent:** prompt-engineer-agent.md
+**Model:** Opus
+**Target:** $ARGUMENTS
+
+
+---
+
+## Decision Thresholds
+
+| Score | Decision | Meaning |
+|-------|----------|---------|
+| **>=85** | ✅ PASS | Validation passed, proceed to next phase |
+| **<85** | ❌ FAIL | Validation failed, fix issues before proceeding |
+
+**Note:** Any critical issue triggers FAIL regardless of score.
+
+---
+
+## Post-Flight Actions
+
+### On Success
+
+Prompt validation passed — DEPLOY (score >= 85)
+
+```bash
+exit 0
+```
+
+### On Failure
+
+Prompt validation failed. Review issues above.
+
+```bash
+exit 1
+```
+
+
+---
+
+
+## PERSIST TO TRACKER (Required)
+
+> **IMPORTANT:** Save to tracker IMMEDIATELY after agent completes, BEFORE presenting the summary to the user. The workflow is not complete until results are persisted.
+**1. Get token metrics from buffer:**
+```bash
+agent-metrics buffer list --since 5m -f tracker
+```
+
+**2. Save to tracker (DO THIS FIRST):**
+
+mcp__uluops-tracker__save_run
+
+**3. Verify saved:** Compare `json.summary.total_issues` with saved count.
+
+**4. THEN present summary to user.**
+
+### Field Mappings
+
+**Definition identity (REQUIRED for execution tracking):**
+| Tracker Field | Value | Notes |
+|---------------|-------|-------|
+| `definition_type` | `command` | From CDL interface |
+| `definition_name` | `prompt-validate` | From CDL interface |
+| `definition_version` | `2.0.2` | From CDL interface |
+
+**From JSON OUTPUT to Tracker:**
+| Source | Tracker Field | Notes |
+|--------|---------------|-------|
+| `json.result.score` | `agents[].score` | Total score |
+| `json.result.decision` | `agents[].decision` | PASS/FAIL |
+| `buffer.model` | `validators[].model` | From agent-metrics buffer |
+| `buffer.tokens.input_tokens` | `input_tokens` | Raw input tokens |
+| `buffer.tokens.output_tokens` | `output_tokens` | Output tokens |
+| `buffer.tokens.cache_creation_tokens` | `cache_creation_tokens` | Cache creation |
+| `buffer.tokens.cache_read_tokens` | `cache_read_tokens` | Cache reads |
+| `buffer.tokens.total_effective_tokens` | `total_effective_tokens` | Effective total |
+| `json.categories[].findings[].issues[]` | `recommendations[]` | Flatten nested structure |
+| `json.analysis.records[]` | `analysis_records[]` | Structured analysis records (v1.4.0) |
+| `json.analysis.system_metrics` | `analysis_summary.system_metrics` | Agent-type-specific metrics |
+| `json.analysis.category_scores[]` | `analysis_summary.category_scores[]` | Category score breakdown |
+| `json.analysis.epistemic_assessment` | `analysis_summary.epistemic_assessment` | Failure signature risk ratings |
+| `json.analysis.audit_implications[]` | `analysis_summary.audit_implications[]` | Trajectory projections |
+
+**Note:** `json` = agent's JSON OUTPUT, `buffer` = `agent-metrics buffer list -f tracker`
+**Note:** `analysis_records` and `analysis_summary` are optional (v1.4.0). Omit if agent output has no `analysis` section.
+
+---
+
+## Source
+
+**CDL Schema:** `udl/definition-languages/cdl-schema-v1_3_0.json`
+**CDL Source:** `/Users/aself/uluops/uluops-agent-workflows/udl/cdl/v1/prompt-validate.command.yaml`
+**Agent:** `agents/prompt-engineer-agent.md`