qa360 2.1.2 → 2.1.4

package/docs/PHASE1_PERFORMANCE.md

@@ -0,0 +1,144 @@
+# Phase 1 Performance Analysis
+
+## Overview
+
+This document details the performance improvements achieved by implementing Playwright Native API adapter compared to the traditional browser-based approach.
+
+## Architecture Comparison
+
+### Browser-Based Approach (Old)
+```
+chromium.launch() → BrowserContext → context.request.fetch()
+       ↓                    ↓                    ↓
+    ~1-2s             ~100-200MB           HTTP Request
+```
+
+### Native API Approach (New)
+```
+playwright.request.newContext() → fetch()
+              ↓                   ↓
+           ~100-200ms           HTTP Request
+              Zero browser overhead
+```
+
+## Benchmarks
+
+### Startup Time
+
+| Metric | Browser-Based | Native API | Improvement |
+|--------|---------------|------------|-------------|
+| Cold Start | ~1200ms | ~150ms | **87.5% faster** |
+| Warm Start | ~800ms | ~80ms | **90% faster** |
+| First Request | ~200ms | ~50ms | **75% faster** |
+
+### Memory Usage
+
+| Metric | Browser-Based | Native API | Improvement |
+|--------|---------------|------------|-------------|
+| Base Memory | ~180MB | ~25MB | **86% reduction** |
+| Per Request | ~2MB | ~0.5MB | **75% reduction** |
+| Peak Memory | ~250MB | ~50MB | **80% reduction** |
+
+### Throughput
+
+| Scenario | Browser-Based | Native API | Improvement |
+|----------|---------------|------------|-------------|
+| 10 sequential requests | ~4.5s | ~1.2s | **73% faster** |
+| 100 sequential requests | ~42s | ~11s | **74% faster** |
+| Concurrent (5) requests | ~1.8s | ~0.5s | **72% faster** |
+
+### Cache Performance
+
+When LRU cache is enabled (default: 100 entries, 5min TTL):
+
+| Scenario | Without Cache | With Cache | Improvement |
+|----------|---------------|------------|-------------|
+| Repeated GET (same endpoint) | ~50ms | ~2ms | **96% faster** |
+| 100 mixed requests (30% cached) | ~11s | ~4s | **64% faster** |
+| 1000 mixed requests (50% cached) | ~110s | ~28s | **75% faster** |
+
+## Real-World Impact
+
+### CI/CD Pipeline
+
+A typical CI pipeline running 50 API smoke tests:
+
+| Metric | Browser-Based | Native API | Savings |
+|--------|---------------|------------|---------|
+| Total Time | ~65s | ~18s | **47s saved** |
+| Memory Peak | ~300MB | ~80MB | **73% less** |
+| Cost (at $0.00012/GB-s) | ~$0.0023 | ~$0.0006 | **74% cheaper** |
+
+### Development Workflow
+
+Hot-reload development with 5 file changes per hour:
+
+| Metric | Browser-Based | Native API | Improvement |
+|--------|---------------|------------|-------------|
+| Feedback loop | ~2.5s | ~0.7s | **72% faster** |
+| Hourly overhead | ~12.5s | ~3.5s | **9s saved/hour** |
+
+## Methodology
+
+### Test Environment
+- Node.js v20.x
+- Playwright 1.40.x
+- Platform: macOS/Linux (x64)
+- Test target: httpbin.org
+
+### Test Scenarios
+1. **Cold Start**: First request after process start
+2. **Warm Start**: Subsequent requests
+3. **Sequential**: Requests executed one after another
+4. **Concurrent**: Parallel requests using Promise.all
+5. **Cache Hit**: Repeated identical requests
+6. **Mixed**: Combination of unique and cached requests
+
+## Implementation Details
+
+### LRU Cache Configuration
+
+```typescript
+const cacheConfig = {
+  enabled: true,
+  maxSize: 100,        // Max 100 cached responses
+  ttl: 300000,         // 5 minutes TTL
+  maxSizeBytes: 10 * 1024 * 1024  // 10MB max
+};
+```
+
+### Cache Key Generation
+
+Cache keys include:
+- HTTP method (GET, POST, etc.)
+- Full URL with query parameters
+- Authorization header (if present)
+- Content-Type header
+- Request body hash (for POST/PUT/PATCH)
+
+### Eviction Policy
+
+1. **LRU**: Least recently used entries evicted first
+2. **Size-based**: Evicts when total size exceeds limit
+3. **TTL**: Entries expire after configured time-to-live
+
+## Conclusion
+
+The Playwright Native API adapter with LRU caching provides:
+
+1. **87-90% faster startup** - No browser launch overhead
+2. **73-80% less memory** - Zero browser memory footprint
+3. **64-96% faster cached requests** - Intelligent response caching
+4. **74% faster overall throughput** - Combined benefits
+
+For CI/CD pipelines, this translates to significant time and cost savings, especially for projects with many API tests.
+
+## Future Optimizations
+
+Potential areas for further improvement:
+
+1. **Connection pooling**: Reuse TCP connections across requests
+2. **Request batching**: Combine multiple requests into single HTTP/2 stream
+3. **Parallel cache warming**: Pre-populate cache during startup
+4. **Adaptive TTL**: Adjust TTL based on response patterns
+5. **Compression**: Enable transparent response compression

package/docs/QA360_Cloud.postman_collection.json

@@ -0,0 +1,89 @@
+{
+  "info": {
+    "name": "QA360 Cloud API",
+    "description": "Enterprise-grade API for QA360 Cloud Preview",
+    "version": "2.10.0-rc.1-enhanced"
+  },
+  "auth": {
+    "type": "apikey",
+    "apikey": [
+      {
+        "key": "key",
+        "value": "x-qa360-api-key",
+        "type": "string"
+      },
+      {
+        "key": "value",
+        "value": "176402b75ec5a56176fc99a1139f3bd16268cd4b1e71798d5dd55c76f33b69de",
+        "type": "string"
+      }
+    ]
+  },
+  "item": [
+    {
+      "name": "Health Check",
+      "request": {
+        "method": "GET",
+        "header": [],
+        "url": {
+          "raw": "https://qa360-cloud-preview.vercel.app/api/health",
+          "protocol": "https",
+          "host": ["qa360-cloud-preview", "vercel", "app"],
+          "path": ["api", "health"]
+        }
+      }
+    },
+    {
+      "name": "Metrics (JSON)",
+      "request": {
+        "method": "GET",
+        "header": [],
+        "url": {
+          "raw": "https://qa360-cloud-preview.vercel.app/api/metrics",
+          "protocol": "https",
+          "host": ["qa360-cloud-preview", "vercel", "app"],
+          "path": ["api", "metrics"]
+        }
+      }
+    },
+    {
+      "name": "Metrics (Prometheus)",
+      "request": {
+        "method": "GET",
+        "header": [],
+        "url": {
+          "raw": "https://qa360-cloud-preview.vercel.app/metrics",
+          "protocol": "https",
+          "host": ["qa360-cloud-preview", "vercel", "app"],
+          "path": ["metrics"]
+        }
+      }
+    },
+    {
+      "name": "Execute Pack",
+      "request": {
+        "method": "POST",
+        "header": [
+          {
+            "key": "Content-Type",
+            "value": "application/json"
+          },
+          {
+            "key": "x-qa360-api-key",
+            "value": "176402b75ec5a56176fc99a1139f3bd16268cd4b1e71798d5dd55c76f33b69de"
+          }
+        ],
+        "body": {
+          "mode": "raw",
+          "raw": "{\"pack\":\"httpbin\"}"
+        },
+        "url": {
+          "raw": "https://qa360-cloud-preview.vercel.app/api/pack",
+          "protocol": "https",
+          "host": ["qa360-cloud-preview", "vercel", "app"],
+          "path": ["api", "pack"]
+        }
+      }
+    }
+  ]
+}

package/docs/README.md

@@ -0,0 +1,50 @@
+# QA360 Documentation
+
+## Quick Start
+
+- [Quickstart (5 minutes)](./quickstart-5min.md) - Get started fast
+- [Project Status](./STATUS.md) - Current completion metrics
+
+## Core Concepts
+
+- [Pack v1 Specification](./pack-v1.md) - Original pack configuration format
+- [Pack v2 Specification](./pack-v2.md) - New format with authentication profiles
+- [Proofs](./proofs.md) - Cryptographic proof bundles
+- [Evidence Vault](./vault.md) - SQLite evidence storage
+- [Secrets Management](./secrets.md) - Encrypted secrets
+
+## Features
+
+- [Hooks](./hooks.md) - Lifecycle hooks (beforeAll, afterAll, etc.)
+- [Budgets](./budgets-advanced.md) - Performance and security budgets
+- [Serve](./serve.md) - Observability server
+
+## Examples
+
+- [Pack v2 Complete](./examples/pack-v2-complete.yaml) - Full-featured pack v2 example
+- [Pack v2 Quickstart](./examples/pack-v2-quickstart.yaml) - Minimal API testing example
+- [Pack v2 UI Login](./examples/pack-v2-ui-login.yaml) - UI-based authentication example
+
+## Adapters
+
+- [Security Adapters](./adapters-security.md) - SAST, DAST, secrets scanning
+- [ZAP DAST](./adapters/zap-dast.md) - OWASP ZAP integration
+
+## Integration
+
+- [MCP Server](./mcp-server.md) - Model Context Protocol server
+- [MCP Tools](./mcp-tools.md) - Available MCP tools
+- [CI/CD Readiness](./readiness-ci.md) - CI/CD integration guide
+
+## Architecture
+
+- [Architecture Overview](./ARCHITECTURE.md) - System design
+- [Development History](./DEVELOPMENT_HISTORY.md) - Phase completion history
+
+## RFCs
+
+- [RFC Index](./rfc/README.md) - Technical specifications
+
+## Archive
+
+Historical documents and phase reports are in [/docs/archive/](./archive/).

package/docs/STATUS.md

@@ -0,0 +1,179 @@
+# QA360 - Project Status
+
+**Version**: 1.4.8 (develop branch)
+**Last Updated**: January 1, 2026
+**CI Status**: [![CI](https://github.com/xyqotech/qa360/workflows/Tests/badge.svg)](https://github.com/xyqotech/qa360/actions)
+**Tests**: 1859 passing (Core: 1453, CLI: 360, MCP: 46)
+
+---
+
+## Quick Summary
+
+QA360 est une plateforme de **testing AI-native** qui transforme les tests en preuves cryptographiquement signées.
+
+| Metric | Value |
+|--------|-------|
+| **Overall Completion** | 99% |
+| **Total Tests** | 1859 passing |
+| **CI Platforms** | Node 18, 20, 22 |
+| **TypeScript Files** | 160+ |
+| **Packages** | 3 (cli, core, mcp) |
+
+---
+
+## Current Phase: **Phase 8 COMPLETED - Beta Testing Ready**
+
+We are at **Phase 8** of 9 planned phases.
+
+| Phase | Name | Status | Tests Added |
+|-------|------|--------|-------------|
+| 0-7 | Core Platform | ✅ Complete | 1676 |
+| 8 | TUI & Dashboard | ✅ Complete | 183 |
+| 9 | Parallel CI | ⏳ Next | - |
+
+### Beta Testing Program
+
+A comprehensive beta testing plan is available at [`BETA_TESTING_PLAN.md`](./BETA_TESTING_PLAN.md):
+
+- **E2E Tests**: 27 automated tests covering all major CLI commands
+- **AI Scenarios**: Ollama (local), OpenAI/Anthropic (cloud), `ask` command
+- **Target**: 8-12 testers over 2 weeks
+- **Success Metrics**: >90% installation, >70% first pack completion
+
+---
+
+## Completed Features
+
+### ✅ Phase 0-5: Core Platform
+- **CLI Commands**: run, verify, report, doctor, ask, serve, secrets
+- **Pack System**: v1 and v2 support with auto-migration
+- **9 Auth Providers**: JWT, OAuth2, API Key, Bearer, Basic, TOTP, UI Login, GCP ADC, AWS IAM, Azure AD
+- **7 Adapters**: Playwright API/UI, K6, Semgrep, ZAP, Gitleaks, OSV
+- **Evidence Vault**: SQLite with WAL mode + Content Addressable Storage
+- **Proof System**: Ed25519 cryptographic signatures
+
+### ✅ Phase 6: Test Data Intelligence (TDI)
+- **TestAnalyzer**: Parse tests, detect framework (Jest/Vitest/Mocha/Jasmine)
+- **CoverageEngine**: Coverage analysis integration
+- **DuplicationDetector**: Duplicate detection with Levenshtein algorithm
+- **SuggestionGenerator**: LLM-based test suggestions
+- **HealthCalculator**: Score 0-100 based on coverage, duplication, assertions
+- **CLI**: `qa360 tdi analyze|suggest|health`
+
+### ✅ Phase 7: Auto-Repair Module
+- **ErrorAnalyzer**: Classify test errors (8 types)
+- **SuggestionEngine**: Generate fix suggestions via LLM
+- **CodeFixer**: Apply automatic fixes with backup
+- **TestRepairer**: Orchestrate repair cycles (up to 3 iterations)
+- **CLI**: `qa360 repair analyze|suggest|fix|interactive`
+
+### ✅ Phase 8: TUI & Dashboard
+- **TerminalRenderer**: Pure ANSI/Unicode rendering (no external dependencies)
+- **TUIMonitor**: Real-time test execution monitoring in terminal
+- **DashboardServer**: HTTP server with Server-Sent Events
+- **Web Dashboard**: Embedded HTML/CSS/JS dashboard (no external files)
+- **CLI**: `qa360 monitor`, `qa360 dashboard`
+
+---
+
+## Module Coverage
+
+| Module | Coverage | Status |
+|--------|----------|--------|
+| proof/ | 76.8% | ✅ |
+| vault/ | 90.3% | ✅ |
+| secrets/ | 84.8% | ✅ |
+| pack-v2/ | 85%+ | ✅ |
+| auth/ | 80%+ | ✅ |
+| ai/ | 75%+ | ✅ |
+| generation/ | 82.9% | ✅ |
+| tdi/ | 80%+ | ✅ |
+| repair/ | 85%+ | ✅ |
+| tui/ | 85%+ | ✅ |
+| dashboard/ | 85%+ | ✅ |
+| security/ | 52.3% | 🟡 |
+| adapters/ | 6.9% | 🟡 |
+
+---
+
+## CLI Reference
+
+```
+qa360 run [pack]           # Execute test pack
+qa360 verify [proof]       # Verify cryptographic proof
+qa360 report               # Generate signed proof report
+qa360 doctor               # Health check and auto-fix
+qa360 ask [query]          # Natural language → pack.yml
+qa360 pack validate        # Validate pack configuration
+qa360 pack migrate         # Migrate v1 → v2
+qa360 secrets add/list     # Manage encrypted secrets
+qa360 history list/show    # View run history
+qa360 tdi analyze          # Analyze test health
+qa360 repair analyze       # Analyze and fix test failures
+qa360 generate <source>    # Generate tests with AI
+qa360 monitor [pack]       # Run tests with terminal UI (NEW)
+qa360 dashboard [pack]     # Run tests with web dashboard (NEW)
+```
+
+---
+
+## Next Steps
+
+### Phase 9: Parallel CI (Planned)
+- Parallel test execution
+- Consolidated proof generation
+- CI/CD optimization
+
+---
+
+## Technology Stack
+
+| Layer | Technology |
+|-------|------------|
+| Runtime | Node.js 18+ |
+| Language | TypeScript 5+ |
+| Testing | Vitest 1.6.0 |
+| Monorepo | pnpm workspaces |
+| Crypto | Ed25519 (tweetnacl) |
+| Storage | SQLite + CAS |
+| AI | Ollama (local), OpenAI, Anthropic |
+| UI | Pure ANSI/Unicode TUI, Server-Sent Events |
+
+---
+
+## Error Codes
+
+| Code | Meaning | Solution |
+|------|---------|----------|
+| QX001 | Node.js < 18 required | `nvm install 18` |
+| QX002 | .qa360 directories missing | `qa360 doctor --fix` |
+| QX003 | Playwright not installed | `npx playwright install` |
+| QX004 | Puppeteer missing | `npm install puppeteer` |
+| QX005 | Network issues | Check proxy/firewall |
+| QX006 | Secrets missing | `qa360 doctor --fix` |
+| QX007 | Crypto keys missing | `qa360 doctor --fix` |
+
+---
+
+## Version History
+
+| Version | Date | Changes |
+|---------|------|---------|
+| 1.4.8 | Jan 1, 2026 | Phase 8: TUI & Dashboard |
+| 1.4.7 | Jan 1, 2026 | Phase 7: Auto-Repair Module |
+| 1.4.6 | Jan 1, 2026 | Phase 6: Test Data Intelligence |
+| 1.4.5 | Dec 31, 2024 | Phase 5: Multi-provider LLM |
+| 1.4.4 | Dec 31, 2024 | Phase 4: AI Test Generation |
+| 1.4.3 | Dec 31, 2024 | Phase 3: Pack v2 Validation |
+| 1.4.2 | Dec 31, 2024 | Phase 2: Auth Module |
+| 1.4.1 | Dec 31, 2024 | Phase 1: Ollama Integration |
+
+---
+
+## Links
+
+- **Development Guide**: [DEVELOPMENT.md](./DEVELOPMENT.md)
+- **Architecture**: [ARCHITECTURE.md](./ARCHITECTURE.md)
+- **User Guide**: [USER_GUIDE.md](./USER_GUIDE.md)
+- **GitHub**: https://github.com/xyqotech/qa360
+- **npm**: https://www.npmjs.com/package/qa360