agentic-qe 1.8.3 → 1.8.4

package/.claude/skills/cicd-pipeline-qe-orchestrator/README.md

@@ -277,8 +277,8 @@ See main SKILL.md [Troubleshooting section](SKILL.md#troubleshooting) for:
 - [Microservice Pipeline Workflow](resources/workflows/microservice-pipeline.md)
 - [Monolith Pipeline Workflow](resources/workflows/monolith-pipeline.md)
 - [Mobile Pipeline Workflow](resources/workflows/mobile-pipeline.md)
-- [All 37 QE Skills Reference](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/reference/skills.md)
-- [All 18 QE Agents Reference](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/reference/agents.md)
+- [All 37 QE Skills Reference](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/reference/skills.md)
+- [All 18 QE Agents Reference](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/reference/agents.md)
 
 ## Contributing
 

package/.claude/skills/cicd-pipeline-qe-orchestrator/SKILL.md

@@ -438,7 +438,7 @@ Task("Targeted Testing", "Run minimal test suite based on risk analysis", "qe-te
 Task("Batched Tests", "Run tests in batches of 10 with memory limits", "qe-test-executor")
 ```
 
-See [Test Execution Policy](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/policies/test-execution.md)
+See [Test Execution Policy](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/policies/test-execution.md)
 
 ### Issue: Pipeline Takes Too Long
 
@@ -483,18 +483,18 @@ See [resources/workflows/mobile-pipeline.md](resources/workflows/mobile-pipeline
 ## Resources
 
 ### Skills Reference
-- [All 37 QE Skills](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/reference/skills.md)
+- [All 37 QE Skills](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/reference/skills.md)
 - [Shift-Left Testing](../shift-left-testing/SKILL.md)
 - [Shift-Right Testing](../shift-right-testing/SKILL.md)
 - [Chaos Engineering](../chaos-engineering-resilience/SKILL.md)
 
 ### Agent Reference
-- [All 18 QE Agents](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/reference/agents.md)
-- [Fleet Commander](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/reference/agents.md#qe-fleet-commander)
+- [All 18 QE Agents](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/reference/agents.md)
+- [Fleet Commander](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/reference/agents.md#qe-fleet-commander)
 
 ### Policies
-- [Test Execution Policy](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/policies/test-execution.md)
-- [Release Verification Policy](https://github.com/ruvnet/agentic-qe-cf/blob/main/docs/policies/release-verification.md)
+- [Test Execution Policy](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/policies/test-execution.md)
+- [Release Verification Policy](https://github.com/proffesor-for-testing/agentic-qe/blob/main/docs/policies/release-verification.md)
 
 ### External Resources
 - [Continuous Testing in DevOps](https://www.atlassian.com/continuous-delivery/principles/continuous-integration-vs-delivery-vs-deployment)

package/CHANGELOG.md

@@ -7,6 +7,226 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## [Unreleased]
 
+## [1.8.4] - 2025-01-19
+
+### 🚀 Major Release: Phase 1 Infrastructure + Critical Fixes
+
+This release implements Phase 1 Foundation & Infrastructure (issue #63) with enterprise-grade telemetry, persistence, and constitution systems, plus critical fixes for learning persistence and pre-edit hooks.
+
+**Key Achievements**:
+- ✅ Complete OpenTelemetry integration with 12 OTEL packages
+- ✅ SQLite-based persistence layer for events, reasoning, and metrics
+- ✅ Constitution system with JSON Schema validation and inheritance
+- ✅ Fixed learning data persistence for subagents (#66)
+- ✅ Fixed pre-edit hook schema mismatch
+- ✅ 16,698+ lines of production code and comprehensive tests
+
+**References**:
+- [Issue #63 - Phase 1: Foundation & Infrastructure](https://github.com/proffesor-for-testing/agentic-qe/issues/63)
+- [Issue #66 - Learning data not persisting](https://github.com/proffesor-for-testing/agentic-qe/issues/66)
+
+---
+
+## 🏗️ Phase 1: Foundation & Infrastructure
+
+### Added
+
+#### 📊 Telemetry Foundation (Task 1.1)
+**OpenTelemetry Integration**:
+- `@opentelemetry/sdk-node` - Node.js SDK for telemetry
+- `@opentelemetry/api` - OpenTelemetry API
+- `@opentelemetry/semantic-conventions` - Standard attribute naming
+- `@opentelemetry/exporter-metrics-otlp-grpc` - Metrics export via gRPC
+- `@opentelemetry/exporter-metrics-otlp-http` - Metrics export via HTTP
+- `@opentelemetry/instrumentation-http` - HTTP auto-instrumentation
+- `@opentelemetry/instrumentation-fs` - File system monitoring
+- `@opentelemetry/resources` - Resource attributes
+- `@opentelemetry/sdk-metrics` - Metrics SDK
+- Additional OTEL packages (12 total)
+
+**Telemetry Components**:
+- `src/telemetry/bootstrap.ts` (362 lines) - Bootstrap module with auto-instrumentation
+- `src/telemetry/metrics/agent-metrics.ts` (300 lines) - Agent-specific metrics (task completion, success rate, error tracking)
+- `src/telemetry/metrics/quality-metrics.ts` (411 lines) - Quality metrics (coverage, defects, test effectiveness)
+- `src/telemetry/metrics/system-metrics.ts` (458 lines) - System metrics (memory, CPU, latency, throughput)
+- `src/telemetry/types.ts` (227 lines) - TypeScript types for all metrics
+- `src/telemetry/index.ts` (60 lines) - Public API exports
+
+**Configuration**:
+- `config/otel-collector.yaml` (234 lines) - OTEL Collector configuration with gRPC/HTTP exporters
+
+#### 💾 Data Persistence Layer (Task 1.2)
+**Persistence Components**:
+- `src/persistence/event-store.ts` (412 lines) - Event sourcing with correlation tracking
+  - Domain events (AgentTaskStarted, QualityGateEvaluated, TestExecuted, etc.)
+  - Correlation ID tracking for distributed tracing
+  - Prepared statements for performance
+  - Time-range queries with pagination
+
+- `src/persistence/reasoning-store.ts` (546 lines) - Reasoning chain capture
+  - Agent decision tracking
+  - Prompt/response capture
+  - Reasoning step analysis
+  - Pattern identification
+
+- `src/persistence/metrics-aggregator.ts` (653 lines) - Quality metrics aggregation
+  - Time-window aggregation (hourly, daily, weekly)
+  - Statistical analysis (percentiles, moving averages)
+  - Trend detection
+  - Performance optimization with indexes
+
+- `src/persistence/schema.ts` (396 lines) - Database schema definitions
+  - Events table with correlation tracking
+  - Reasoning chains table
+  - Metrics aggregation tables
+  - Indexes for performance
+
+- `src/persistence/index.ts` (301 lines) - Public API and initialization
+
+**Migration Support**:
+- `scripts/run-migrations.ts` (122 lines) - Database migration runner
+
+#### 📋 Constitution Schema (Task 1.3)
+**Constitution System**:
+- `src/constitution/schema.ts` (503 lines) - Constitution schema validation
+  - JSON Schema for constitution structure
+  - Type-safe constitution definitions
+  - Validation with detailed error messages
+
+- `src/constitution/loader.ts` (584 lines) - Constitution loader
+  - Inheritance/merge support
+  - Agent-specific constitution lookup
+  - Path resolution fixes
+  - Caching for performance
+
+- `src/constitution/index.ts` (240 lines) - Public API exports
+
+**Base Constitutions**:
+- `src/constitution/base/default.constitution.json` (265 lines) - Default constitution
+- `src/constitution/base/test-generation.constitution.json` (394 lines) - Test generation rules
+- `src/constitution/base/code-review.constitution.json` (425 lines) - Code review guidelines
+- `src/constitution/base/performance.constitution.json` (447 lines) - Performance optimization rules
+
+**Schema Configuration**:
+- `config/constitution.schema.json` (423 lines) - JSON Schema for validation
+
+#### 🧪 Comprehensive Test Suite
+**Unit Tests** (45+ tests):
+- `tests/unit/telemetry/bootstrap.test.ts` (152 lines) - Telemetry bootstrap tests
+- `tests/unit/telemetry/metrics.test.ts` (677 lines) - Metrics tests
+- `tests/unit/constitution/loader.test.ts` (684 lines) - Constitution loader tests
+- `tests/unit/constitution/schema.test.ts` (280 lines) - Schema validation tests
+- `tests/unit/persistence/event-store.test.ts` (220 lines) - Event store tests
+- `tests/unit/persistence/metrics-aggregator.test.ts` (730 lines) - Metrics aggregator tests
+- `tests/unit/persistence/reasoning-store.test.ts` (645 lines) - Reasoning store tests
+
+**Integration Tests**:
+- `tests/integration/phase1/full-pipeline.test.ts` (648 lines) - End-to-end pipeline tests
+- `tests/integration/phase1/telemetry-persistence.test.ts` (566 lines) - Telemetry+Persistence integration
+- `tests/integration/phase1/constitution-validation.test.ts` (585 lines) - Constitution validation
+- `tests/integration/phase1/real-integration.test.ts` (235 lines) - Real implementation tests
+- `tests/integration/adapter-fail-fast.test.ts` (241 lines) - Adapter failure handling
+
+**Test Fixtures**:
+- `tests/fixtures/phase1/valid-constitution.json` (92 lines)
+- `tests/fixtures/phase1/invalid-constitution.json` (139 lines)
+- `tests/fixtures/phase1/sample-events.json` (90 lines)
+- `tests/fixtures/phase1/sample-metrics.json` (107 lines)
+- `tests/fixtures/phase1/sample-reasoning-chain.json` (117 lines)
+
+**Performance Benchmarks**:
+- `tests/benchmarks/pattern-query-performance.test.ts` (293 lines) - Query performance benchmarks
+
+---
+
+## 🔧 Critical Fixes
+
+### Fixed
+
+#### 🐛 Memory Manager Fragmentation
+- **Root Cause**: Multiple isolated `SwarmMemoryManager` instances (MCP server, AgentRegistry, Phase2Tools each created their own)
+- **Solution**: Implemented singleton pattern via `MemoryManagerFactory`
+- **Result**: All components now share the same database connection
+
+#### 🐛 Database Closure on Exit
+- **Root Cause**: sql.js (WASM SQLite) only persists to disk on explicit `close()` call
+- **Solution**: Added process exit handlers to ensure proper database closure
+- **Result**: Data survives process termination
+
+#### 🐛 Schema Column Mismatch in Memory Backup Handler
+- **Root Cause**: `memory-backup.ts` referenced `record.namespace` but database schema uses `partition`
+- **Affected Lines**: Lines 80, 84, 85, 132, 134 in `src/mcp/handlers/memory/memory-backup.ts`
+- **Solution**: Updated all references from `namespace` to `partition` and `timestamp` to `createdAt`
+- **Result**: Pre-edit hooks now work correctly without "no such column: namespace" errors
+
+### Added
+
+#### 🏭 MemoryManagerFactory (`src/core/memory/MemoryManagerFactory.ts`)
+- `getSharedMemoryManager()` - Singleton accessor for shared database connection
+- `initializeSharedMemoryManager()` - Async initialization with deduplication
+- `resetSharedMemoryManager()` - For testing/path changes
+- `resolveDbPath()` - Resolves relative paths to absolute
+- `ensureDbDirectoryExists()` - Creates `.agentic-qe/` directory if needed
+- `setupExitHandlers()` - Ensures database closure on SIGINT/SIGTERM/exit
+- `getDbPathInfo()` - Debugging utility for path resolution
+
+### Changed
+
+#### 🔄 Updated Components to Use Singleton
+- `src/mcp/server.ts` - Uses `getSharedMemoryManager()` instead of `new SwarmMemoryManager()`
+- `src/mcp/services/AgentRegistry.ts` - Uses shared memory manager
+- `src/mcp/handlers/phase2/Phase2Tools.ts` - Uses shared memory manager
+
+#### 📚 Documentation URL Fixes
+- Fixed all GitHub repository URLs from `ruvnet/agentic-qe-cf` to `proffesor-for-testing/agentic-qe`
+- Updated documentation links in CLAUDE.md, skills, and guides
+
+### Files Summary
+
+**Phase 1 Infrastructure** (39 new files, 16,698 lines):
+- Telemetry: 7 files (1,819 lines)
+- Persistence: 5 files (2,308 lines)
+- Constitution: 8 files (2,885 lines)
+- Tests: 18 files (7,651 lines)
+- Configuration: 2 files (657 lines)
+- Migration scripts: 1 file (122 lines)
+
+**Critical Fixes** (2 files created, 6 files modified):
+- Created: `src/core/memory/MemoryManagerFactory.ts` (258 lines)
+- Modified: Memory management, hooks, documentation (10 files)
+
+**Documentation Updates**:
+- Fixed all GitHub URLs from `ruvnet/agentic-qe-cf` to `proffesor-for-testing/agentic-qe`
+- Updated CLAUDE.md, skills, and guides
+
+### Dependencies Added
+
+**OpenTelemetry** (12 packages):
+- `@opentelemetry/sdk-node@^0.45.0`
+- `@opentelemetry/api@^1.7.0`
+- `@opentelemetry/semantic-conventions@^1.18.0`
+- `@opentelemetry/exporter-metrics-otlp-grpc@^0.45.0`
+- `@opentelemetry/exporter-metrics-otlp-http@^0.45.0`
+- `@opentelemetry/instrumentation-http@^0.45.0`
+- `@opentelemetry/instrumentation-fs@^0.9.0`
+- `@opentelemetry/resources@^1.18.0`
+- `@opentelemetry/sdk-metrics@^1.18.0`
+- Plus 3 additional OTEL packages
+
+### Technical Details
+
+The persistence issue occurred because:
+1. Each component created its own `SwarmMemoryManager` instance
+2. Data written to one instance was not visible to others
+3. When running as subagents, the database file existed but contained fragmented data
+4. Temporary `temp_*.db` files appeared due to SQLite transaction handling
+
+The singleton pattern ensures:
+1. All components share the same database connection
+2. Data written by any component is immediately visible to all others
+3. Proper database closure on process exit (critical for sql.js persistence)
+4. No more orphan temp files in project root
+
 ## [1.8.3] - 2025-01-19
 
 ### 🔄 Phase 4: Subagent Workflows for TDD

package/README.md

@@ -9,11 +9,11 @@
 <img alt="NPM Downloads" src="https://img.shields.io/npm/dw/agentic-qe">
 
 
-**Version 1.8.3** (TDD Subagent Coordination) | [Changelog](CHANGELOG.md) | [Issues](https://github.com/proffesor-for-testing/agentic-qe/issues) | [Discussions](https://github.com/proffesor-for-testing/agentic-qe/discussions)
+**Version 1.8.4** (Phase 1 Infrastructure + Critical Fixes) | [Changelog](CHANGELOG.md) | [Issues](https://github.com/proffesor-for-testing/agentic-qe/issues) | [Discussions](https://github.com/proffesor-for-testing/agentic-qe/discussions)
 
-> Enterprise-grade test automation with AI learning, comprehensive skills library (38 QE skills), and intelligent model routing.
+> Enterprise-grade test automation with AI learning, OpenTelemetry observability, persistent event storage, constitutional AI governance, and intelligent model routing.
 
-🧠 **QE Agent Learning System** | 📚 **38 World-Class QE Skills** | 🎯 **Advanced Flaky Detection** | 💰 **Multi-Model Router** | 🔧 **32 Domain-Specific Tools**
+🧠 **QE Agent Learning** | 📊 **OpenTelemetry Integration** | 💾 **Event Sourcing** | 📋 **Constitution System** | 📚 **38 QE Skills** | 🎯 **Flaky Detection** | 💰 **Multi-Model Router**
 
 </div>
 
@@ -54,6 +54,7 @@ claude "Use qe-flaky-test-hunter to analyze the last 100 test runs and identify
 ```
 
 **What gets initialized:**
+- ✅ **Phase 1 Infrastructure**: OpenTelemetry, Event Store, Constitution System (v1.8.4)
 - ✅ Multi-Model Router (70-81% cost savings - opt-in)
 - ✅ Learning System (20% improvement target)
 - ✅ Pattern Bank (cross-project reuse)
@@ -68,6 +69,38 @@ claude "Use qe-flaky-test-hunter to analyze the last 100 test runs and identify
 
 ## ✨ Features
 
+### 🏗️ Phase 1 Infrastructure (v1.8.4)
+
+**Enterprise-Grade Observability & Governance**
+
+#### 📊 OpenTelemetry Integration
+- **Full OTEL SDK**: 12 OpenTelemetry packages for comprehensive observability
+- **Auto-Instrumentation**: HTTP, file system, and custom metrics
+- **Metrics Export**: gRPC and HTTP exporters for Grafana, Prometheus, Jaeger
+- **Agent Metrics**: Task completion, success rate, error tracking
+- **Quality Metrics**: Coverage %, defect density, test effectiveness
+- **System Metrics**: Memory, CPU, latency, throughput
+
+#### 💾 Event Sourcing & Persistence
+- **Event Store**: SQLite-based event sourcing with correlation tracking
+- **Reasoning Capture**: Agent decision tracking and prompt/response analysis
+- **Metrics Aggregation**: Time-window aggregation (hourly, daily, weekly)
+- **Performance Optimization**: Prepared statements, indexes, connection pooling
+- **Query API**: Time-range queries with pagination support
+
+#### 📋 Constitutional AI Governance
+- **JSON Schema Validation**: Type-safe constitution definitions
+- **4 Base Constitutions**: Default, test-generation, code-review, performance
+- **Inheritance & Merge**: Constitution composition with override support
+- **Agent-Specific**: Per-agent constitutional rules and guidelines
+- **Validation Pipeline**: Ensure agents follow constitutional principles
+
+**Benefits:**
+- 🔍 **Full Observability**: Track every agent action, metric, and decision
+- 📈 **Data-Driven**: Historical analysis for continuous improvement
+- 🛡️ **Governance**: Constitutional AI ensures quality and compliance
+- 🚀 **Production Ready**: Enterprise-grade persistence and monitoring
+
 ### 🤖 Autonomous Agent Fleet
 - **18 Specialized Agents**: Expert agents for every QE domain (test generation, coverage analysis, security scanning, performance testing, code complexity analysis)
 - **11 TDD Subagents**: Specialized subagents for Test-Driven Development workflow (RED/GREEN/REFACTOR phases + quality validation + analysis)