agentic-qe 3.5.4 → 3.6.0

package/v3/assets/skills/sfdipot-product-factors/SKILL.md

@@ -0,0 +1,239 @@
+---
+name: sfdipot-product-factors
+description: "James Bach's HTSM Product Factors (SFDIPOT) analysis for comprehensive test strategy generation. Use when analyzing requirements, epics, or user stories to generate prioritized test ideas across Structure, Function, Data, Interfaces, Platform, Operations, and Time dimensions."
+category: requirements-analysis
+priority: high
+tokenEstimate: 1500
+agents: [qe-product-factors-assessor, qe-test-idea-rewriter]
+implementation_status: optimized
+optimization_version: 1.0
+last_optimized: 2026-01-17
+dependencies: [brutal-honesty-review]
+quick_reference_card: true
+tags: [sfdipot, htsm, product-factors, test-strategy, requirements, james-bach]
+---
+
+# SFDIPOT Product Factors Analysis
+
+<default_to_action>
+When analyzing requirements:
+1. IDENTIFY document type (epic, user story, spec, architecture doc)
+2. DETECT domain context (ecommerce, healthcare, finance, etc.)
+3. ANALYZE each SFDIPOT category systematically
+4. GENERATE test ideas with action verbs (no "Verify" patterns)
+5. ASSIGN priorities (P0-P3) and automation fitness
+6. SURFACE clarifying questions for coverage gaps
+7. OUTPUT in requested format (HTML, JSON, MD, Gherkin)
+
+**Quality Gates:**
+- Human exploration >= 10%
+- No "Verify X" test patterns
+- Priority distribution: P0 (8-12%), P1 (20-30%), P2 (35-45%), P3 (20-30%)
+</default_to_action>
+
+## Quick Reference Card
+
+### The 7 Product Factors
+
+| Factor | Question | Example Focus Areas |
+|--------|----------|---------------------|
+| **S**tructure | What IS it? | Components, code, dependencies |
+| **F**unction | What does it DO? | Features, calculations, errors |
+| **D**ata | What does it PROCESS? | Input, output, persistence |
+| **I**nterfaces | How does it CONNECT? | UI, API, integrations |
+| **P**latform | What does it DEPEND ON? | OS, browser, hardware |
+| **O**perations | How is it USED? | Workflows, admin, recovery |
+| **T**ime | WHEN do things happen? | Concurrency, scheduling |
+
+### When to Use This Skill
+
+| Scenario | Priority | Output |
+|----------|----------|--------|
+| New epic planning | High | Full SFDIPOT assessment + test ideas |
+| Sprint requirement review | Medium | Targeted analysis + clarifying questions |
+| Test strategy definition | High | Comprehensive test coverage plan |
+| Risk assessment | High | Domain-weighted priority assignment |
+| Coverage gap analysis | Medium | Penetrating questions + recommendations |
+
+---
+
+## SFDIPOT Analysis Framework
+
+### Structure (What the product IS)
+
+**Subcategories:**
+- Code Integrity: Code quality, complexity, maintainability
+- Hardware: Physical components, devices, peripherals
+- Non-Executable Files: Config, data files, documents
+- Executable Files: Binaries, scripts, libraries
+- Dependencies: Third-party libraries, external services
+
+**Sample Test Ideas:**
+- Analyze cyclomatic complexity of critical modules; flag functions > 10
+- Inject corrupted config file; confirm graceful degradation
+- Upgrade dependency version; validate no breaking changes
+
+### Function (What the product DOES)
+
+**Subcategories:**
+- Application: Core business features
+- Calculation: Mathematical operations, transformations
+- Error Handling: Exception management, recovery
+- Security: Authentication, authorization, encryption
+- State Transitions: Workflow states, data lifecycle
+- Messaging: Notifications, events, queues
+- Data Transformation: Format conversion, mapping
+
+**Sample Test Ideas:**
+- Submit order with 1000 line items; measure processing time
+- Inject SQL in search field; confirm sanitization prevents execution
+- Trigger state transition timeout; observe retry behavior
+
+### Data (What the product PROCESSES)
+
+**Subcategories:**
+- Input: User input, file uploads, API payloads
+- Output: Responses, reports, exports
+- Persistence: Database storage, caching
+- Storage: File systems, cloud storage
+- Boundaries: Min/max values, edge cases
+- Validation: Format rules, business rules
+- Formats: JSON, XML, CSV handling
+
+**Sample Test Ideas:**
+- Upload 100MB file; confirm chunked processing completes
+- Insert emoji in text field; validate storage and retrieval
+- Query boundary date (2038-01-19); check timestamp handling
+
+### Interfaces (How the product CONNECTS)
+
+**Subcategories:**
+- User Interface: Web, mobile, desktop UI
+- APIs: REST, GraphQL, gRPC endpoints
+- Integrations: Third-party service connections
+- Protocols: HTTP, WebSocket, MQTT
+- CLI: Command-line interfaces
+
+**Sample Test Ideas:**
+- Resize browser to 320px width; confirm responsive breakpoints
+- Send malformed JSON to API; assert 400 response with details
+- Disconnect WebSocket mid-transaction; observe reconnection
+
+### Platform (What the product DEPENDS ON)
+
+**Subcategories:**
+- Browser: Chrome, Firefox, Safari, Edge
+- OS: Windows, macOS, Linux, iOS, Android
+- Hardware: CPU, memory, storage constraints
+- External Software: Databases, message queues
+- Network: Latency, bandwidth, offline
+
+**Sample Test Ideas:**
+- Execute on 1GB RAM device; profile memory usage
+- Run with 500ms network latency; measure user experience
+- Test on iOS 15 Safari; validate CSS grid support
+
+### Operations (How the product is USED)
+
+**Subcategories:**
+- Common Use: Happy path workflows
+- Extreme Use: Edge cases, stress conditions
+- User Management: Roles, permissions, profiles
+- Admin Operations: Configuration, monitoring
+- Recovery: Backup, restore, disaster recovery
+
+**Sample Test Ideas:**
+- Execute 10,000 concurrent user sessions; monitor resource usage
+- Revoke admin access mid-session; confirm immediate effect
+- Restore from 24-hour-old backup; validate data integrity
+
+### Time (WHEN things happen)
+
+**Subcategories:**
+- Concurrency: Parallel operations, race conditions
+- Scheduling: Cron jobs, timed events
+- Sequences: Order of operations, dependencies
+
+**Sample Test Ideas:**
+- Two users update same record simultaneously; confirm conflict resolution
+- Execute scheduled job at DST transition; validate correct timing
+- Cancel operation mid-sequence; observe partial state handling
+
+---
+
+## Quality Rules
+
+### Test Idea Quality
+
+**NEVER use "Verify X" patterns. Always use action verbs.**
+
+| Bad Pattern | Good Pattern |
+|-------------|--------------|
+| Verify login works | Submit credentials; confirm session created |
+| Verify API returns 200 | Send request; assert 200 response |
+| Verify error displays | Trigger error; observe message |
+
+### Priority Distribution
+
+| Priority | Percentage | Criteria |
+|----------|------------|----------|
+| P0 (Critical) | 8-12% | Security, data loss, regulatory |
+| P1 (High) | 20-30% | Core functionality, user impact |
+| P2 (Medium) | 35-45% | Standard features, edge cases |
+| P3 (Low) | 20-30% | Polish, minor improvements |
+
+### Automation Fitness
+
+| Type | Percentage | Use For |
+|------|------------|---------|
+| Unit | 30-40% | Isolated logic, calculations |
+| Integration | 15-25% | API contracts, data flow |
+| E2E | <=50% | User journeys, workflows |
+| Human Exploration | >=10% | Usability, edge cases |
+
+---
+
+## Agent Integration
+
+```typescript
+// Full SFDIPOT assessment
+await Task("SFDIPOT Assessment", {
+  input: epicDocument,
+  outputFormat: "html",
+  domains: ["ecommerce"],
+  brutalHonesty: true
+}, "qe-product-factors-assessor");
+
+// Transform verify patterns
+await Task("Rewrite Test Ideas", {
+  inputFile: assessmentHtml,
+  preserveMetadata: true
+}, "qe-test-idea-rewriter");
+```
+
+---
+
+## Memory Namespace
+
+```
+aqe/sfdipot/
+├── assessments/*     - Assessment results
+├── patterns/*        - Learned domain patterns
+├── test-ideas/*      - Generated test ideas
+└── questions/*       - Clarifying questions
+```
+
+---
+
+## Related Skills
+
+- [brutal-honesty-review](../brutal-honesty-review/) - Quality validation
+- [risk-based-testing](../risk-based-testing/) - Priority assignment
+- [context-driven-testing](../context-driven-testing/) - Domain awareness
+- [exploratory-testing-advanced](../exploratory-testing-advanced/) - Session design
+
+---
+
+## Remember
+
+**SFDIPOT ensures comprehensive test coverage by examining products from 7 distinct perspectives.** Each category reveals risks that other perspectives might miss. Use domain detection to weight priorities appropriately.

package/v3/assets/skills/test-idea-rewriting/SKILL.md

@@ -0,0 +1,229 @@
+---
+name: test-idea-rewriting
+description: "Transform passive 'Verify X' test descriptions into active, observable test actions. Use when test ideas lack specificity, use vague language, or fail quality validation. Converts to action-verb format for clearer, more testable descriptions."
+category: test-design
+priority: medium
+tokenEstimate: 800
+agents: [qe-test-idea-rewriter]
+implementation_status: optimized
+optimization_version: 1.0
+last_optimized: 2026-01-17
+dependencies: []
+quick_reference_card: true
+tags: [test-ideas, rewriting, action-verbs, quality, transformation]
+---
+
+# Test Idea Rewriting
+
+<default_to_action>
+When transforming test ideas:
+1. DETECT all "Verify X" patterns via regex
+2. IDENTIFY appropriate action verb category
+3. TRANSFORM to "[ACTION] [trigger]; [OBSERVE] [result]" pattern
+4. PRESERVE all metadata (IDs, priorities, automation types)
+5. VALIDATE zero "Verify" patterns remain
+6. OUTPUT in same format as input
+
+**Success Criteria:** `/<td>Verify\s/gi` returns 0 matches
+</default_to_action>
+
+## Quick Reference Card
+
+### Transformation Pattern
+
+```
+[ACTION VERB] [specific trigger]; [OUTCOME VERB] [observable result]
+```
+
+### Action Verb Quick Reference
+
+| Category | Verbs | Use When |
+|----------|-------|----------|
+| **Interaction** | Click, Type, Submit, Navigate, Scroll | UI actions |
+| **Trigger** | Send, Inject, Force, Simulate, Load | API/system actions |
+| **Measurement** | Measure, Time, Count, Profile | Performance checks |
+| **State** | Set, Configure, Enable, Disable, Toggle | Setup actions |
+| **Observation** | Confirm, Assert, Check, Observe | Outcome verification |
+
+### Common Transformations
+
+| Before | After |
+|--------|-------|
+| Verify login works | Submit valid credentials; confirm session created |
+| Verify API returns 200 | Send GET request; assert 200 response within 500ms |
+| Verify error displays | Trigger validation error; observe error message |
+| Verify data saves | Insert record; query database; confirm fields match |
+| Verify performance | Execute 100 requests; measure p99 < 200ms |
+
+---
+
+## Transformation Rules
+
+### Pattern Detection
+
+```regex
+/<td>Verify\s/gi     // HTML table cells
+/^Verify\s/gim       // Line starts
+/"Verify\s[^"]+"/gi  // Quoted strings
+```
+
+### Transformation Categories
+
+#### API/Network Tests
+
+| Input Pattern | Output Pattern |
+|---------------|----------------|
+| Verify API returns X | Send [METHOD] request; assert [STATUS] response |
+| Verify endpoint accepts Y | Post [PAYLOAD] to endpoint; confirm [RESPONSE] |
+| Verify webhook fires | Trigger [EVENT]; observe webhook received |
+
+#### UI/UX Tests
+
+| Input Pattern | Output Pattern |
+|---------------|----------------|
+| Verify button works | Click [BUTTON]; observe [EFFECT] |
+| Verify form submits | Fill [FIELDS]; submit form; confirm [RESULT] |
+| Verify navigation works | Click [LINK]; observe [PAGE] loads |
+
+#### Data Tests
+
+| Input Pattern | Output Pattern |
+|---------------|----------------|
+| Verify data saves | Insert [RECORD]; query; confirm [MATCH] |
+| Verify validation works | Enter [INVALID]; observe [ERROR] |
+| Verify format accepted | Submit [FORMAT]; confirm [PROCESSED] |
+
+#### Performance Tests
+
+| Input Pattern | Output Pattern |
+|---------------|----------------|
+| Verify performance is good | Execute [LOAD]; measure [METRIC] < [THRESHOLD] |
+| Verify scalability | Increase [USERS] to [N]; monitor [RESOURCE] |
+| Verify timeout works | Inject [DELAY]; confirm timeout after [TIME] |
+
+---
+
+## Action Verb Reference
+
+### Interaction Verbs
+
+| Verb | When to Use | Example |
+|------|-------------|---------|
+| Click | UI element interaction | Click "Submit" button |
+| Type | Text entry | Type "user@example.com" |
+| Submit | Form completion | Submit registration form |
+| Navigate | Page changes | Navigate to /settings |
+| Scroll | Viewport movement | Scroll to page bottom |
+| Drag | Drag-and-drop | Drag file to upload zone |
+| Hover | Mouse positioning | Hover over tooltip trigger |
+| Select | Dropdown/checkbox | Select "Admin" from role dropdown |
+
+### Trigger Verbs
+
+| Verb | When to Use | Example |
+|------|-------------|---------|
+| Send | HTTP requests | Send POST to /api/orders |
+| Inject | Fault injection | Inject 500ms latency |
+| Force | State manipulation | Force offline mode |
+| Simulate | Event generation | Simulate device rotation |
+| Load | Resource loading | Load 50MB test file |
+| Execute | Script/command | Execute database migration |
+| Invoke | Function/webhook | Invoke payment callback |
+| Trigger | Event firing | Trigger scheduled job |
+
+### Measurement Verbs
+
+| Verb | When to Use | Example |
+|------|-------------|---------|
+| Measure | Quantitative check | Measure response time |
+| Time | Duration tracking | Time page render |
+| Count | Quantity check | Count search results |
+| Profile | Resource analysis | Profile CPU usage |
+| Benchmark | Comparison | Benchmark against v1.0 |
+| Capture | State recording | Capture network traffic |
+| Monitor | Ongoing observation | Monitor memory for 5 minutes |
+
+### Observation Verbs
+
+| Verb | When to Use | Example |
+|------|-------------|---------|
+| Confirm | Boolean check | Confirm user is logged in |
+| Assert | Value comparison | Assert total equals $99.99 |
+| Check | State verification | Check cart has 3 items |
+| Observe | Behavior watching | Observe spinner appears |
+| Validate | Rule compliance | Validate email format |
+| Expect | Predicted outcome | Expect redirect to /home |
+| Verify (avoid) | Use alternatives | Use confirm/assert instead |
+
+---
+
+## Quality Validation
+
+### Pre-Transform Checks
+
+1. Count "Verify" patterns in input
+2. Identify context for each pattern
+3. Map to appropriate action verb category
+
+### Post-Transform Checks
+
+1. Regex validation: zero "Verify" matches
+2. Every test idea starts with action verb
+3. Each test includes observable outcome
+4. All metadata preserved unchanged
+
+### Validation Regex
+
+```javascript
+// Must return 0 matches for success
+const verifyPattern = /<td>Verify\s/gi;
+const matches = content.match(verifyPattern);
+if (matches && matches.length > 0) {
+  throw new Error(`${matches.length} "Verify" patterns remain`);
+}
+```
+
+---
+
+## Agent Integration
+
+```typescript
+// Single file transformation
+await Task("Rewrite Test Ideas", {
+  inputFile: "assessment.html",
+  outputFile: "assessment-rewritten.html",
+  preserveFormatting: true
+}, "qe-test-idea-rewriter");
+
+// Batch transformation
+await Task("Batch Rewrite", {
+  inputDir: "./assessments/",
+  outputDir: "./assessments-clean/",
+  pattern: "*.html"
+}, "qe-test-idea-rewriter");
+```
+
+---
+
+## Memory Namespace
+
+```
+aqe/rewriting/
+├── transformations/*  - Transformation logs
+├── patterns/*         - Learned patterns
+└── vocabulary/*       - Custom verb mappings
+```
+
+---
+
+## Related Skills
+
+- [sfdipot-product-factors](../sfdipot-product-factors/) - Assessment generation
+- [test-design-techniques](../test-design-techniques/) - Proper test structuring
+- [brutal-honesty-review](../brutal-honesty-review/) - Quality validation
+
+---
+
+## Remember
+
+**Every test idea should be actionable.** "Verify X works" tells you nothing about HOW to test. "[Action] X; [Observe] Y" gives clear steps and expected outcomes. Transform passive descriptions into active, observable tests.