agentic-qe 3.4.0 → 3.4.2

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (498) hide show
  1. package/.claude/skills/.validation/README.md +111 -0
  2. package/.claude/skills/.validation/examples/chaos-engineering-output.example.json +530 -0
  3. package/.claude/skills/.validation/examples/performance-testing-output.example.json +252 -0
  4. package/.claude/skills/.validation/examples/security-testing-output.example.json +413 -0
  5. package/.claude/skills/.validation/examples/testability-scoring-output.example.json +350 -0
  6. package/.claude/skills/.validation/schemas/skill-eval.schema.json +452 -0
  7. package/.claude/skills/.validation/schemas/skill-frontmatter.schema.json +341 -0
  8. package/.claude/skills/.validation/schemas/skill-output-meta.schema.json +199 -0
  9. package/.claude/skills/.validation/schemas/skill-output.template.json +610 -0
  10. package/.claude/skills/.validation/skill-validation-mcp-integration.md +250 -0
  11. package/.claude/skills/.validation/templates/eval.template.yaml +366 -0
  12. package/.claude/skills/.validation/templates/schemas/output.json +145 -0
  13. package/.claude/skills/.validation/templates/security-testing-eval.template.yaml +725 -0
  14. package/.claude/skills/.validation/templates/skill-frontmatter.example.yaml +225 -0
  15. package/.claude/skills/.validation/templates/validate.template.sh +1060 -0
  16. package/.claude/skills/.validation/templates/validator-lib.sh +1031 -0
  17. package/.claude/skills/.validation/test-data/invalid-output.json +5 -0
  18. package/.claude/skills/.validation/test-data/minimal-output.json +9 -0
  19. package/.claude/skills/.validation/test-data/sample-output.json +73 -0
  20. package/.claude/skills/TRUST-TIERS.md +158 -0
  21. package/.claude/skills/a11y-ally/SKILL.md +1664 -1658
  22. package/.claude/skills/a11y-ally/evals/a11y-ally.yaml +376 -0
  23. package/.claude/skills/a11y-ally/schemas/output.json +549 -0
  24. package/.claude/skills/a11y-ally/scripts/validate.sh +690 -0
  25. package/.claude/skills/accessibility-testing/SKILL.md +8 -1
  26. package/.claude/skills/accessibility-testing/evals/accessibility-testing.yaml +719 -0
  27. package/.claude/skills/accessibility-testing/schemas/output.json +776 -0
  28. package/.claude/skills/accessibility-testing/scripts/validate.sh +943 -0
  29. package/.claude/skills/accessibility-testing/test-data/sample-output.json +191 -0
  30. package/.claude/skills/agentic-quality-engineering/SKILL.md +4 -0
  31. package/.claude/skills/agentic-quality-engineering/schemas/output.json +577 -0
  32. package/.claude/skills/api-testing-patterns/SKILL.md +5 -0
  33. package/.claude/skills/api-testing-patterns/evals/api-testing-patterns.yaml +696 -0
  34. package/.claude/skills/api-testing-patterns/schemas/output.json +845 -0
  35. package/.claude/skills/api-testing-patterns/scripts/validate.sh +931 -0
  36. package/.claude/skills/aqe-v2-v3-migration/schemas/output.json +513 -0
  37. package/.claude/skills/aqe-v2-v3-migration/skill.md +4 -0
  38. package/.claude/skills/brutal-honesty-review/SKILL.md +5 -0
  39. package/.claude/skills/brutal-honesty-review/schemas/output.json +291 -0
  40. package/.claude/skills/brutal-honesty-review/scripts/validate.sh +130 -0
  41. package/.claude/skills/bug-reporting-excellence/SKILL.md +5 -0
  42. package/.claude/skills/bug-reporting-excellence/schemas/output.json +288 -0
  43. package/.claude/skills/bug-reporting-excellence/scripts/validate.sh +108 -0
  44. package/.claude/skills/chaos-engineering-resilience/SKILL.md +5 -0
  45. package/.claude/skills/chaos-engineering-resilience/evals/chaos-engineering-resilience.yaml +761 -0
  46. package/.claude/skills/chaos-engineering-resilience/schemas/output.json +1205 -0
  47. package/.claude/skills/chaos-engineering-resilience/scripts/validate.sh +1107 -0
  48. package/.claude/skills/cicd-pipeline-qe-orchestrator/SKILL.md +6 -0
  49. package/.claude/skills/cicd-pipeline-qe-orchestrator/evals/cicd-pipeline-qe-orchestrator.yaml +157 -0
  50. package/.claude/skills/cicd-pipeline-qe-orchestrator/schemas/output.json +542 -0
  51. package/.claude/skills/cicd-pipeline-qe-orchestrator/scripts/validate.sh +310 -0
  52. package/.claude/skills/code-review-quality/SKILL.md +5 -0
  53. package/.claude/skills/code-review-quality/schemas/output.json +264 -0
  54. package/.claude/skills/code-review-quality/scripts/validate.sh +113 -0
  55. package/.claude/skills/compatibility-testing/evals/compatibility-testing.yaml +410 -0
  56. package/.claude/skills/compatibility-testing/schemas/output.json +551 -0
  57. package/.claude/skills/compatibility-testing/scripts/validate.sh +605 -0
  58. package/.claude/skills/compliance-testing/SKILL.md +7 -0
  59. package/.claude/skills/compliance-testing/evals/compliance-testing.yaml +1107 -0
  60. package/.claude/skills/compliance-testing/schemas/output.json +845 -0
  61. package/.claude/skills/compliance-testing/scripts/validate.sh +888 -0
  62. package/.claude/skills/consultancy-practices/SKILL.md +4 -0
  63. package/.claude/skills/consultancy-practices/schemas/output.json +282 -0
  64. package/.claude/skills/context-driven-testing/SKILL.md +3 -0
  65. package/.claude/skills/contract-testing/SKILL.md +5 -0
  66. package/.claude/skills/contract-testing/evals/contract-testing.yaml +748 -0
  67. package/.claude/skills/contract-testing/schemas/output.json +638 -0
  68. package/.claude/skills/contract-testing/scripts/validate.sh +1033 -0
  69. package/.claude/skills/database-testing/SKILL.md +5 -0
  70. package/.claude/skills/database-testing/evals/database-testing.yaml +968 -0
  71. package/.claude/skills/database-testing/schemas/output.json +1446 -0
  72. package/.claude/skills/database-testing/scripts/validate.sh +1099 -0
  73. package/.claude/skills/exploratory-testing-advanced/SKILL.md +3 -0
  74. package/.claude/skills/holistic-testing-pact/SKILL.md +3 -0
  75. package/.claude/skills/localization-testing/SKILL.md +6 -0
  76. package/.claude/skills/localization-testing/evals/localization-testing.yaml +544 -0
  77. package/.claude/skills/localization-testing/schemas/output.json +325 -0
  78. package/.claude/skills/localization-testing/scripts/validate.sh +131 -0
  79. package/.claude/skills/mobile-testing/SKILL.md +6 -0
  80. package/.claude/skills/mobile-testing/evals/mobile-testing.yaml +537 -0
  81. package/.claude/skills/mobile-testing/schemas/output.json +318 -0
  82. package/.claude/skills/mobile-testing/scripts/validate.sh +127 -0
  83. package/.claude/skills/mutation-testing/SKILL.md +8 -1
  84. package/.claude/skills/mutation-testing/evals/mutation-testing.yaml +652 -0
  85. package/.claude/skills/mutation-testing/schemas/output.json +707 -0
  86. package/.claude/skills/mutation-testing/scripts/validate.sh +992 -0
  87. package/.claude/skills/mutation-testing/test-data/sample-output.json +295 -0
  88. package/.claude/skills/n8n-expression-testing/SKILL.md +6 -0
  89. package/.claude/skills/n8n-expression-testing/evals/n8n-expression-testing.yaml +450 -0
  90. package/.claude/skills/n8n-expression-testing/schemas/output.json +369 -0
  91. package/.claude/skills/n8n-expression-testing/scripts/validate.sh +162 -0
  92. package/.claude/skills/n8n-integration-testing-patterns/SKILL.md +6 -0
  93. package/.claude/skills/n8n-integration-testing-patterns/evals/n8n-integration-testing-patterns.yaml +522 -0
  94. package/.claude/skills/n8n-integration-testing-patterns/schemas/output.json +291 -0
  95. package/.claude/skills/n8n-integration-testing-patterns/scripts/validate.sh +104 -0
  96. package/.claude/skills/n8n-security-testing/SKILL.md +6 -0
  97. package/.claude/skills/n8n-security-testing/evals/n8n-security-testing.yaml +493 -0
  98. package/.claude/skills/n8n-security-testing/schemas/output.json +293 -0
  99. package/.claude/skills/n8n-security-testing/scripts/validate.sh +120 -0
  100. package/.claude/skills/n8n-trigger-testing-strategies/SKILL.md +6 -0
  101. package/.claude/skills/n8n-trigger-testing-strategies/evals/n8n-trigger-testing-strategies.yaml +500 -0
  102. package/.claude/skills/n8n-trigger-testing-strategies/schemas/output.json +295 -0
  103. package/.claude/skills/n8n-trigger-testing-strategies/scripts/validate.sh +121 -0
  104. package/.claude/skills/n8n-workflow-testing-fundamentals/SKILL.md +6 -0
  105. package/.claude/skills/n8n-workflow-testing-fundamentals/evals/n8n-workflow-testing-fundamentals.yaml +497 -0
  106. package/.claude/skills/n8n-workflow-testing-fundamentals/schemas/output.json +254 -0
  107. package/.claude/skills/n8n-workflow-testing-fundamentals/scripts/validate.sh +126 -0
  108. package/.claude/skills/performance-analysis/SKILL.md +6 -0
  109. package/.claude/skills/performance-analysis/evals/performance-analysis.yaml +144 -0
  110. package/.claude/skills/performance-analysis/schemas/output.json +588 -0
  111. package/.claude/skills/performance-analysis/scripts/validate.sh +63 -0
  112. package/.claude/skills/performance-testing/SKILL.md +5 -0
  113. package/.claude/skills/performance-testing/evals/performance-testing.yaml +772 -0
  114. package/.claude/skills/performance-testing/schemas/output.json +1184 -0
  115. package/.claude/skills/performance-testing/scripts/validate.sh +1090 -0
  116. package/.claude/skills/qcsd-ideation-swarm/SKILL.md +1759 -1753
  117. package/.claude/skills/qcsd-ideation-swarm/evals/qcsd-ideation-swarm.yaml +138 -0
  118. package/.claude/skills/qcsd-ideation-swarm/schemas/output.json +568 -0
  119. package/.claude/skills/qcsd-ideation-swarm/scripts/validate.sh +56 -0
  120. package/.claude/skills/qe-chaos-resilience/SKILL.md +6 -0
  121. package/.claude/skills/qe-chaos-resilience/evals/qe-chaos-resilience.yaml +443 -0
  122. package/.claude/skills/qe-chaos-resilience/schemas/output.json +314 -0
  123. package/.claude/skills/qe-chaos-resilience/scripts/validate.sh +401 -0
  124. package/.claude/skills/qe-code-intelligence/SKILL.md +6 -0
  125. package/.claude/skills/qe-code-intelligence/evals/qe-code-intelligence.yaml +459 -0
  126. package/.claude/skills/qe-code-intelligence/schemas/output.json +315 -0
  127. package/.claude/skills/qe-code-intelligence/scripts/validate.sh +408 -0
  128. package/.claude/skills/qe-contract-testing/SKILL.md +6 -0
  129. package/.claude/skills/qe-contract-testing/evals/qe-contract-testing.yaml +513 -0
  130. package/.claude/skills/qe-contract-testing/schemas/output.json +295 -0
  131. package/.claude/skills/qe-contract-testing/scripts/validate.sh +421 -0
  132. package/.claude/skills/qe-coverage-analysis/SKILL.md +6 -0
  133. package/.claude/skills/qe-coverage-analysis/evals/qe-coverage-analysis.yaml +494 -0
  134. package/.claude/skills/qe-coverage-analysis/schemas/output.json +286 -0
  135. package/.claude/skills/qe-coverage-analysis/scripts/validate.sh +453 -0
  136. package/.claude/skills/qe-defect-intelligence/SKILL.md +6 -0
  137. package/.claude/skills/qe-defect-intelligence/evals/qe-defect-intelligence.yaml +511 -0
  138. package/.claude/skills/qe-defect-intelligence/schemas/output.json +283 -0
  139. package/.claude/skills/qe-defect-intelligence/scripts/validate.sh +466 -0
  140. package/.claude/skills/qe-iterative-loop/SKILL.md +445 -440
  141. package/.claude/skills/qe-iterative-loop/schemas/output.json +264 -0
  142. package/.claude/skills/qe-iterative-loop/scripts/validate.sh +474 -0
  143. package/.claude/skills/qe-learning-optimization/SKILL.md +6 -0
  144. package/.claude/skills/qe-learning-optimization/evals/qe-learning-optimization.yaml +144 -0
  145. package/.claude/skills/qe-learning-optimization/schemas/output.json +288 -0
  146. package/.claude/skills/qe-learning-optimization/scripts/validate.sh +56 -0
  147. package/.claude/skills/qe-quality-assessment/SKILL.md +6 -0
  148. package/.claude/skills/qe-quality-assessment/evals/qe-quality-assessment.yaml +506 -0
  149. package/.claude/skills/qe-quality-assessment/schemas/output.json +550 -0
  150. package/.claude/skills/qe-quality-assessment/scripts/validate.sh +352 -0
  151. package/.claude/skills/qe-requirements-validation/SKILL.md +6 -0
  152. package/.claude/skills/qe-requirements-validation/evals/qe-requirements-validation.yaml +598 -0
  153. package/.claude/skills/qe-requirements-validation/schemas/output.json +587 -0
  154. package/.claude/skills/qe-requirements-validation/scripts/validate.sh +275 -0
  155. package/.claude/skills/qe-security-compliance/SKILL.md +6 -0
  156. package/.claude/skills/qe-security-compliance/evals/qe-security-compliance.yaml +595 -0
  157. package/.claude/skills/qe-security-compliance/schemas/output.json +498 -0
  158. package/.claude/skills/qe-security-compliance/scripts/validate.sh +305 -0
  159. package/.claude/skills/qe-test-execution/SKILL.md +6 -0
  160. package/.claude/skills/qe-test-execution/evals/qe-test-execution.yaml +607 -0
  161. package/.claude/skills/qe-test-execution/schemas/output.json +529 -0
  162. package/.claude/skills/qe-test-execution/scripts/validate.sh +323 -0
  163. package/.claude/skills/qe-test-generation/SKILL.md +6 -0
  164. package/.claude/skills/qe-test-generation/evals/qe-test-generation.yaml +148 -0
  165. package/.claude/skills/qe-test-generation/schemas/output.json +439 -0
  166. package/.claude/skills/qe-test-generation/scripts/validate.sh +56 -0
  167. package/.claude/skills/qe-visual-accessibility/SKILL.md +6 -0
  168. package/.claude/skills/qe-visual-accessibility/evals/qe-visual-accessibility.yaml +142 -0
  169. package/.claude/skills/qe-visual-accessibility/schemas/output.json +491 -0
  170. package/.claude/skills/qe-visual-accessibility/scripts/validate.sh +56 -0
  171. package/.claude/skills/quality-metrics/SKILL.md +6 -0
  172. package/.claude/skills/quality-metrics/evals/quality-metrics.yaml +494 -0
  173. package/.claude/skills/quality-metrics/schemas/output.json +403 -0
  174. package/.claude/skills/quality-metrics/scripts/validate.sh +434 -0
  175. package/.claude/skills/refactoring-patterns/SKILL.md +5 -0
  176. package/.claude/skills/refactoring-patterns/schemas/output.json +475 -0
  177. package/.claude/skills/refactoring-patterns/scripts/validate.sh +241 -0
  178. package/.claude/skills/regression-testing/SKILL.md +6 -0
  179. package/.claude/skills/regression-testing/evals/regression-testing.yaml +504 -0
  180. package/.claude/skills/regression-testing/schemas/output.json +311 -0
  181. package/.claude/skills/regression-testing/scripts/validate.sh +130 -0
  182. package/.claude/skills/risk-based-testing/SKILL.md +6 -0
  183. package/.claude/skills/risk-based-testing/evals/risk-based-testing.yaml +141 -0
  184. package/.claude/skills/risk-based-testing/schemas/output.json +480 -0
  185. package/.claude/skills/risk-based-testing/scripts/validate.sh +56 -0
  186. package/.claude/skills/security-testing/SKILL.md +5 -0
  187. package/.claude/skills/security-testing/evals/security-testing.yaml +789 -0
  188. package/.claude/skills/security-testing/schemas/output.json +879 -0
  189. package/.claude/skills/security-testing/scripts/validate.sh +967 -0
  190. package/.claude/skills/security-visual-testing/SKILL.md +223 -217
  191. package/.claude/skills/security-visual-testing/evals/security-visual-testing.yaml +163 -0
  192. package/.claude/skills/security-visual-testing/schemas/output.json +486 -0
  193. package/.claude/skills/security-visual-testing/scripts/validate.sh +748 -0
  194. package/.claude/skills/sherlock-review/SKILL.md +5 -0
  195. package/.claude/skills/sherlock-review/schemas/output.json +297 -0
  196. package/.claude/skills/sherlock-review/scripts/validate.sh +115 -0
  197. package/.claude/skills/shift-left-testing/SKILL.md +6 -0
  198. package/.claude/skills/shift-left-testing/evals/shift-left-testing.yaml +145 -0
  199. package/.claude/skills/shift-left-testing/schemas/output.json +459 -0
  200. package/.claude/skills/shift-left-testing/scripts/validate.sh +56 -0
  201. package/.claude/skills/shift-right-testing/SKILL.md +6 -0
  202. package/.claude/skills/shift-right-testing/evals/shift-right-testing.yaml +147 -0
  203. package/.claude/skills/shift-right-testing/schemas/output.json +418 -0
  204. package/.claude/skills/shift-right-testing/scripts/validate.sh +56 -0
  205. package/.claude/skills/six-thinking-hats/SKILL.md +3 -0
  206. package/.claude/skills/tdd-london-chicago/SKILL.md +5 -0
  207. package/.claude/skills/tdd-london-chicago/schemas/output.json +444 -0
  208. package/.claude/skills/tdd-london-chicago/scripts/validate.sh +214 -0
  209. package/.claude/skills/technical-writing/SKILL.md +4 -0
  210. package/.claude/skills/technical-writing/schemas/output.json +268 -0
  211. package/.claude/skills/test-automation-strategy/SKILL.md +6 -0
  212. package/.claude/skills/test-automation-strategy/evals/test-automation-strategy.yaml +148 -0
  213. package/.claude/skills/test-automation-strategy/schemas/output.json +444 -0
  214. package/.claude/skills/test-automation-strategy/scripts/validate.sh +195 -0
  215. package/.claude/skills/test-data-management/SKILL.md +6 -0
  216. package/.claude/skills/test-data-management/evals/test-data-management.yaml +504 -0
  217. package/.claude/skills/test-data-management/schemas/output.json +284 -0
  218. package/.claude/skills/test-data-management/scripts/validate.sh +137 -0
  219. package/.claude/skills/test-design-techniques/SKILL.md +6 -0
  220. package/.claude/skills/test-design-techniques/evals/test-design-techniques.yaml +142 -0
  221. package/.claude/skills/test-design-techniques/schemas/output.json +295 -0
  222. package/.claude/skills/test-design-techniques/scripts/validate.sh +91 -0
  223. package/.claude/skills/test-environment-management/SKILL.md +4 -0
  224. package/.claude/skills/test-environment-management/schemas/output.json +310 -0
  225. package/.claude/skills/test-reporting-analytics/SKILL.md +6 -0
  226. package/.claude/skills/test-reporting-analytics/evals/test-reporting-analytics.yaml +155 -0
  227. package/.claude/skills/test-reporting-analytics/schemas/output.json +329 -0
  228. package/.claude/skills/test-reporting-analytics/scripts/validate.sh +77 -0
  229. package/.claude/skills/testability-scoring/SKILL.md +5 -0
  230. package/.claude/skills/testability-scoring/evals/testability-scoring.yaml +814 -0
  231. package/.claude/skills/testability-scoring/schemas/output.json +606 -0
  232. package/.claude/skills/testability-scoring/scripts/validate.sh +891 -0
  233. package/.claude/skills/trust-tier-manifest.json +2333 -0
  234. package/.claude/skills/verification-quality/SKILL.md +6 -0
  235. package/.claude/skills/verification-quality/evals/verification-quality.yaml +150 -0
  236. package/.claude/skills/verification-quality/schemas/output.json +432 -0
  237. package/.claude/skills/verification-quality/scripts/validate.sh +77 -0
  238. package/.claude/skills/visual-testing-advanced/SKILL.md +6 -0
  239. package/.claude/skills/visual-testing-advanced/evals/visual-testing-advanced.yaml +154 -0
  240. package/.claude/skills/visual-testing-advanced/schemas/output.json +294 -0
  241. package/.claude/skills/visual-testing-advanced/scripts/validate.sh +77 -0
  242. package/.claude/skills/xp-practices/SKILL.md +3 -0
  243. package/CHANGELOG.md +23 -0
  244. package/README.md +39 -2
  245. package/package.json +4 -1
  246. package/scripts/run-skill-eval.ts +1097 -0
  247. package/scripts/test-schema-validation.js +301 -0
  248. package/scripts/update-skill-manifest.ts +751 -0
  249. package/scripts/validate-skill-frontmatter.js +141 -0
  250. package/v3/CHANGELOG.md +21 -0
  251. package/v3/README.md +43 -3
  252. package/v3/assets/agents/v3/qe-test-idea-rewriter.md +375 -375
  253. package/v3/assets/skills/.validation/README.md +111 -0
  254. package/v3/assets/skills/.validation/examples/chaos-engineering-output.example.json +530 -0
  255. package/v3/assets/skills/.validation/examples/performance-testing-output.example.json +252 -0
  256. package/v3/assets/skills/.validation/examples/security-testing-output.example.json +413 -0
  257. package/v3/assets/skills/.validation/examples/testability-scoring-output.example.json +350 -0
  258. package/v3/assets/skills/.validation/schemas/skill-eval.schema.json +452 -0
  259. package/v3/assets/skills/.validation/schemas/skill-frontmatter.schema.json +341 -0
  260. package/v3/assets/skills/.validation/schemas/skill-output-meta.schema.json +199 -0
  261. package/v3/assets/skills/.validation/schemas/skill-output.template.json +610 -0
  262. package/v3/assets/skills/.validation/skill-validation-mcp-integration.md +250 -0
  263. package/v3/assets/skills/.validation/templates/eval.template.yaml +366 -0
  264. package/v3/assets/skills/.validation/templates/schemas/output.json +145 -0
  265. package/v3/assets/skills/.validation/templates/security-testing-eval.template.yaml +725 -0
  266. package/v3/assets/skills/.validation/templates/skill-frontmatter.example.yaml +225 -0
  267. package/v3/assets/skills/.validation/templates/validate.template.sh +1060 -0
  268. package/v3/assets/skills/.validation/templates/validator-lib.sh +1031 -0
  269. package/v3/assets/skills/.validation/test-data/invalid-output.json +5 -0
  270. package/v3/assets/skills/.validation/test-data/minimal-output.json +9 -0
  271. package/v3/assets/skills/.validation/test-data/sample-output.json +73 -0
  272. package/v3/assets/skills/accessibility-testing/SKILL.md +8 -1
  273. package/v3/assets/skills/accessibility-testing/evals/accessibility-testing.yaml +719 -0
  274. package/v3/assets/skills/accessibility-testing/schemas/output.json +776 -0
  275. package/v3/assets/skills/accessibility-testing/scripts/validate.sh +943 -0
  276. package/v3/assets/skills/accessibility-testing/test-data/sample-output.json +191 -0
  277. package/v3/assets/skills/agentic-quality-engineering/SKILL.md +4 -0
  278. package/v3/assets/skills/agentic-quality-engineering/schemas/output.json +577 -0
  279. package/v3/assets/skills/api-testing-patterns/SKILL.md +5 -0
  280. package/v3/assets/skills/api-testing-patterns/evals/api-testing-patterns.yaml +696 -0
  281. package/v3/assets/skills/api-testing-patterns/schemas/output.json +845 -0
  282. package/v3/assets/skills/api-testing-patterns/scripts/validate.sh +931 -0
  283. package/v3/assets/skills/aqe-v2-v3-migration/schemas/output.json +513 -0
  284. package/v3/assets/skills/aqe-v2-v3-migration/skill.md +20 -16
  285. package/v3/assets/skills/bug-reporting-excellence/SKILL.md +5 -0
  286. package/v3/assets/skills/bug-reporting-excellence/schemas/output.json +288 -0
  287. package/v3/assets/skills/bug-reporting-excellence/scripts/validate.sh +108 -0
  288. package/v3/assets/skills/chaos-engineering-resilience/SKILL.md +5 -0
  289. package/v3/assets/skills/chaos-engineering-resilience/evals/chaos-engineering-resilience.yaml +761 -0
  290. package/v3/assets/skills/chaos-engineering-resilience/schemas/output.json +1205 -0
  291. package/v3/assets/skills/chaos-engineering-resilience/scripts/validate.sh +1107 -0
  292. package/v3/assets/skills/code-review-quality/SKILL.md +5 -0
  293. package/v3/assets/skills/code-review-quality/schemas/output.json +264 -0
  294. package/v3/assets/skills/code-review-quality/scripts/validate.sh +113 -0
  295. package/v3/assets/skills/compatibility-testing/evals/compatibility-testing.yaml +410 -0
  296. package/v3/assets/skills/compatibility-testing/schemas/output.json +551 -0
  297. package/v3/assets/skills/compatibility-testing/scripts/validate.sh +605 -0
  298. package/v3/assets/skills/compliance-testing/SKILL.md +7 -0
  299. package/v3/assets/skills/compliance-testing/evals/compliance-testing.yaml +1107 -0
  300. package/v3/assets/skills/compliance-testing/schemas/output.json +845 -0
  301. package/v3/assets/skills/compliance-testing/scripts/validate.sh +888 -0
  302. package/v3/assets/skills/consultancy-practices/SKILL.md +4 -0
  303. package/v3/assets/skills/consultancy-practices/schemas/output.json +282 -0
  304. package/v3/assets/skills/context-driven-testing/SKILL.md +3 -0
  305. package/v3/assets/skills/contract-testing/SKILL.md +5 -0
  306. package/v3/assets/skills/contract-testing/evals/contract-testing.yaml +748 -0
  307. package/v3/assets/skills/contract-testing/schemas/output.json +638 -0
  308. package/v3/assets/skills/contract-testing/scripts/validate.sh +1033 -0
  309. package/v3/assets/skills/database-testing/SKILL.md +5 -0
  310. package/v3/assets/skills/database-testing/evals/database-testing.yaml +968 -0
  311. package/v3/assets/skills/database-testing/schemas/output.json +1446 -0
  312. package/v3/assets/skills/database-testing/scripts/validate.sh +1099 -0
  313. package/v3/assets/skills/exploratory-testing-advanced/SKILL.md +3 -0
  314. package/v3/assets/skills/holistic-testing-pact/SKILL.md +3 -0
  315. package/v3/assets/skills/localization-testing/SKILL.md +6 -0
  316. package/v3/assets/skills/localization-testing/evals/localization-testing.yaml +544 -0
  317. package/v3/assets/skills/localization-testing/schemas/output.json +325 -0
  318. package/v3/assets/skills/localization-testing/scripts/validate.sh +131 -0
  319. package/v3/assets/skills/mobile-testing/SKILL.md +6 -0
  320. package/v3/assets/skills/mobile-testing/evals/mobile-testing.yaml +537 -0
  321. package/v3/assets/skills/mobile-testing/schemas/output.json +318 -0
  322. package/v3/assets/skills/mobile-testing/scripts/validate.sh +127 -0
  323. package/v3/assets/skills/mutation-testing/SKILL.md +8 -1
  324. package/v3/assets/skills/mutation-testing/evals/mutation-testing.yaml +652 -0
  325. package/v3/assets/skills/mutation-testing/schemas/output.json +707 -0
  326. package/v3/assets/skills/mutation-testing/scripts/validate.sh +992 -0
  327. package/v3/assets/skills/mutation-testing/test-data/sample-output.json +295 -0
  328. package/v3/assets/skills/n8n-expression-testing/scripts/validate.sh +162 -0
  329. package/v3/assets/skills/n8n-integration-testing-patterns/scripts/validate.sh +104 -0
  330. package/v3/assets/skills/n8n-security-testing/scripts/validate.sh +120 -0
  331. package/v3/assets/skills/n8n-trigger-testing-strategies/scripts/validate.sh +121 -0
  332. package/v3/assets/skills/n8n-workflow-testing-fundamentals/scripts/validate.sh +126 -0
  333. package/v3/assets/skills/performance-testing/SKILL.md +5 -0
  334. package/v3/assets/skills/performance-testing/evals/performance-testing.yaml +772 -0
  335. package/v3/assets/skills/performance-testing/schemas/output.json +1184 -0
  336. package/v3/assets/skills/performance-testing/scripts/validate.sh +1090 -0
  337. package/v3/assets/skills/qe-chaos-resilience/SKILL.md +6 -0
  338. package/v3/assets/skills/qe-chaos-resilience/evals/qe-chaos-resilience.yaml +443 -0
  339. package/v3/assets/skills/qe-chaos-resilience/schemas/output.json +314 -0
  340. package/v3/assets/skills/qe-chaos-resilience/scripts/validate.sh +401 -0
  341. package/v3/assets/skills/qe-code-intelligence/SKILL.md +6 -0
  342. package/v3/assets/skills/qe-code-intelligence/evals/qe-code-intelligence.yaml +459 -0
  343. package/v3/assets/skills/qe-code-intelligence/schemas/output.json +315 -0
  344. package/v3/assets/skills/qe-code-intelligence/scripts/validate.sh +408 -0
  345. package/v3/assets/skills/qe-contract-testing/SKILL.md +6 -0
  346. package/v3/assets/skills/qe-contract-testing/evals/qe-contract-testing.yaml +513 -0
  347. package/v3/assets/skills/qe-contract-testing/schemas/output.json +295 -0
  348. package/v3/assets/skills/qe-contract-testing/scripts/validate.sh +421 -0
  349. package/v3/assets/skills/qe-coverage-analysis/SKILL.md +6 -0
  350. package/v3/assets/skills/qe-coverage-analysis/evals/qe-coverage-analysis.yaml +494 -0
  351. package/v3/assets/skills/qe-coverage-analysis/schemas/output.json +286 -0
  352. package/v3/assets/skills/qe-coverage-analysis/scripts/validate.sh +453 -0
  353. package/v3/assets/skills/qe-defect-intelligence/SKILL.md +6 -0
  354. package/v3/assets/skills/qe-defect-intelligence/evals/qe-defect-intelligence.yaml +511 -0
  355. package/v3/assets/skills/qe-defect-intelligence/schemas/output.json +283 -0
  356. package/v3/assets/skills/qe-defect-intelligence/scripts/validate.sh +466 -0
  357. package/v3/assets/skills/qe-iterative-loop/SKILL.md +445 -443
  358. package/v3/assets/skills/qe-iterative-loop/schemas/output.json +264 -0
  359. package/v3/assets/skills/qe-iterative-loop/scripts/validate.sh +474 -0
  360. package/v3/assets/skills/qe-learning-optimization/SKILL.md +6 -0
  361. package/v3/assets/skills/qe-learning-optimization/evals/qe-learning-optimization.yaml +144 -0
  362. package/v3/assets/skills/qe-learning-optimization/schemas/output.json +288 -0
  363. package/v3/assets/skills/qe-learning-optimization/scripts/validate.sh +56 -0
  364. package/v3/assets/skills/qe-quality-assessment/SKILL.md +6 -0
  365. package/v3/assets/skills/qe-quality-assessment/evals/qe-quality-assessment.yaml +506 -0
  366. package/v3/assets/skills/qe-quality-assessment/schemas/output.json +550 -0
  367. package/v3/assets/skills/qe-quality-assessment/scripts/validate.sh +352 -0
  368. package/v3/assets/skills/qe-requirements-validation/SKILL.md +6 -0
  369. package/v3/assets/skills/qe-requirements-validation/evals/qe-requirements-validation.yaml +598 -0
  370. package/v3/assets/skills/qe-requirements-validation/schemas/output.json +587 -0
  371. package/v3/assets/skills/qe-requirements-validation/scripts/validate.sh +275 -0
  372. package/v3/assets/skills/qe-security-compliance/SKILL.md +6 -0
  373. package/v3/assets/skills/qe-security-compliance/evals/qe-security-compliance.yaml +595 -0
  374. package/v3/assets/skills/qe-security-compliance/schemas/output.json +498 -0
  375. package/v3/assets/skills/qe-security-compliance/scripts/validate.sh +305 -0
  376. package/v3/assets/skills/qe-test-execution/SKILL.md +6 -0
  377. package/v3/assets/skills/qe-test-execution/evals/qe-test-execution.yaml +607 -0
  378. package/v3/assets/skills/qe-test-execution/schemas/output.json +529 -0
  379. package/v3/assets/skills/qe-test-execution/scripts/validate.sh +323 -0
  380. package/v3/assets/skills/qe-test-generation/SKILL.md +6 -0
  381. package/v3/assets/skills/qe-test-generation/evals/qe-test-generation.yaml +148 -0
  382. package/v3/assets/skills/qe-test-generation/schemas/output.json +439 -0
  383. package/v3/assets/skills/qe-test-generation/scripts/validate.sh +56 -0
  384. package/v3/assets/skills/qe-visual-accessibility/SKILL.md +6 -0
  385. package/v3/assets/skills/qe-visual-accessibility/evals/qe-visual-accessibility.yaml +142 -0
  386. package/v3/assets/skills/qe-visual-accessibility/schemas/output.json +491 -0
  387. package/v3/assets/skills/qe-visual-accessibility/scripts/validate.sh +56 -0
  388. package/v3/assets/skills/quality-metrics/SKILL.md +6 -0
  389. package/v3/assets/skills/quality-metrics/evals/quality-metrics.yaml +494 -0
  390. package/v3/assets/skills/quality-metrics/schemas/output.json +403 -0
  391. package/v3/assets/skills/quality-metrics/scripts/validate.sh +434 -0
  392. package/v3/assets/skills/refactoring-patterns/SKILL.md +5 -0
  393. package/v3/assets/skills/refactoring-patterns/schemas/output.json +475 -0
  394. package/v3/assets/skills/refactoring-patterns/scripts/validate.sh +241 -0
  395. package/v3/assets/skills/regression-testing/SKILL.md +6 -0
  396. package/v3/assets/skills/regression-testing/evals/regression-testing.yaml +504 -0
  397. package/v3/assets/skills/regression-testing/schemas/output.json +311 -0
  398. package/v3/assets/skills/regression-testing/scripts/validate.sh +130 -0
  399. package/v3/assets/skills/risk-based-testing/SKILL.md +6 -0
  400. package/v3/assets/skills/risk-based-testing/evals/risk-based-testing.yaml +141 -0
  401. package/v3/assets/skills/risk-based-testing/schemas/output.json +480 -0
  402. package/v3/assets/skills/risk-based-testing/scripts/validate.sh +56 -0
  403. package/v3/assets/skills/security-testing/SKILL.md +5 -0
  404. package/v3/assets/skills/security-testing/evals/security-testing.yaml +789 -0
  405. package/v3/assets/skills/security-testing/schemas/output.json +879 -0
  406. package/v3/assets/skills/security-testing/scripts/validate.sh +967 -0
  407. package/v3/assets/skills/shift-left-testing/SKILL.md +6 -0
  408. package/v3/assets/skills/shift-left-testing/evals/shift-left-testing.yaml +145 -0
  409. package/v3/assets/skills/shift-left-testing/schemas/output.json +459 -0
  410. package/v3/assets/skills/shift-left-testing/scripts/validate.sh +56 -0
  411. package/v3/assets/skills/shift-right-testing/SKILL.md +6 -0
  412. package/v3/assets/skills/shift-right-testing/evals/shift-right-testing.yaml +147 -0
  413. package/v3/assets/skills/shift-right-testing/schemas/output.json +418 -0
  414. package/v3/assets/skills/shift-right-testing/scripts/validate.sh +56 -0
  415. package/v3/assets/skills/six-thinking-hats/SKILL.md +3 -0
  416. package/v3/assets/skills/tdd-london-chicago/SKILL.md +5 -0
  417. package/v3/assets/skills/tdd-london-chicago/schemas/output.json +444 -0
  418. package/v3/assets/skills/tdd-london-chicago/scripts/validate.sh +214 -0
  419. package/v3/assets/skills/technical-writing/SKILL.md +4 -0
  420. package/v3/assets/skills/technical-writing/schemas/output.json +268 -0
  421. package/v3/assets/skills/test-automation-strategy/SKILL.md +6 -0
  422. package/v3/assets/skills/test-automation-strategy/evals/test-automation-strategy.yaml +148 -0
  423. package/v3/assets/skills/test-automation-strategy/schemas/output.json +444 -0
  424. package/v3/assets/skills/test-automation-strategy/scripts/validate.sh +195 -0
  425. package/v3/assets/skills/test-data-management/SKILL.md +6 -0
  426. package/v3/assets/skills/test-data-management/evals/test-data-management.yaml +504 -0
  427. package/v3/assets/skills/test-data-management/schemas/output.json +284 -0
  428. package/v3/assets/skills/test-data-management/scripts/validate.sh +137 -0
  429. package/v3/assets/skills/test-design-techniques/SKILL.md +6 -0
  430. package/v3/assets/skills/test-design-techniques/evals/test-design-techniques.yaml +142 -0
  431. package/v3/assets/skills/test-design-techniques/schemas/output.json +295 -0
  432. package/v3/assets/skills/test-design-techniques/scripts/validate.sh +91 -0
  433. package/v3/assets/skills/test-environment-management/SKILL.md +4 -0
  434. package/v3/assets/skills/test-environment-management/schemas/output.json +310 -0
  435. package/v3/assets/skills/test-reporting-analytics/SKILL.md +6 -0
  436. package/v3/assets/skills/test-reporting-analytics/evals/test-reporting-analytics.yaml +155 -0
  437. package/v3/assets/skills/test-reporting-analytics/schemas/output.json +329 -0
  438. package/v3/assets/skills/test-reporting-analytics/scripts/validate.sh +77 -0
  439. package/v3/assets/skills/verification-quality/SKILL.md +6 -0
  440. package/v3/assets/skills/verification-quality/evals/verification-quality.yaml +150 -0
  441. package/v3/assets/skills/verification-quality/schemas/output.json +432 -0
  442. package/v3/assets/skills/verification-quality/scripts/validate.sh +77 -0
  443. package/v3/assets/skills/visual-testing-advanced/SKILL.md +6 -0
  444. package/v3/assets/skills/visual-testing-advanced/evals/visual-testing-advanced.yaml +154 -0
  445. package/v3/assets/skills/visual-testing-advanced/schemas/output.json +294 -0
  446. package/v3/assets/skills/visual-testing-advanced/scripts/validate.sh +77 -0
  447. package/v3/assets/skills/xp-practices/SKILL.md +3 -0
  448. package/v3/assets/templates/validation-report.md.hbs +139 -0
  449. package/v3/assets/templates/validation-summary.json +56 -0
  450. package/v3/dist/cli/bundle.js +11853 -5316
  451. package/v3/dist/cli/commands/eval.d.ts +18 -0
  452. package/v3/dist/cli/commands/eval.d.ts.map +1 -0
  453. package/v3/dist/cli/commands/eval.js +505 -0
  454. package/v3/dist/cli/commands/eval.js.map +1 -0
  455. package/v3/dist/cli/commands/validate-swarm.d.ts +16 -0
  456. package/v3/dist/cli/commands/validate-swarm.d.ts.map +1 -0
  457. package/v3/dist/cli/commands/validate-swarm.js +251 -0
  458. package/v3/dist/cli/commands/validate-swarm.js.map +1 -0
  459. package/v3/dist/cli/commands/validate.d.ts +14 -0
  460. package/v3/dist/cli/commands/validate.d.ts.map +1 -0
  461. package/v3/dist/cli/commands/validate.js +408 -0
  462. package/v3/dist/cli/commands/validate.js.map +1 -0
  463. package/v3/dist/cli/index.js +6 -0
  464. package/v3/dist/cli/index.js.map +1 -1
  465. package/v3/dist/index.d.ts +2 -0
  466. package/v3/dist/index.d.ts.map +1 -1
  467. package/v3/dist/index.js +10 -0
  468. package/v3/dist/index.js.map +1 -1
  469. package/v3/dist/init/skills-installer.d.ts +6 -0
  470. package/v3/dist/init/skills-installer.d.ts.map +1 -1
  471. package/v3/dist/init/skills-installer.js +48 -0
  472. package/v3/dist/init/skills-installer.js.map +1 -1
  473. package/v3/dist/learning/index.d.ts +2 -0
  474. package/v3/dist/learning/index.d.ts.map +1 -1
  475. package/v3/dist/learning/index.js +4 -0
  476. package/v3/dist/learning/index.js.map +1 -1
  477. package/v3/dist/learning/skill-validation-learner.d.ts +264 -0
  478. package/v3/dist/learning/skill-validation-learner.d.ts.map +1 -0
  479. package/v3/dist/learning/skill-validation-learner.js +515 -0
  480. package/v3/dist/learning/skill-validation-learner.js.map +1 -0
  481. package/v3/dist/mcp/bundle.js +10043 -3630
  482. package/v3/dist/validation/index.d.ts +19 -0
  483. package/v3/dist/validation/index.d.ts.map +1 -0
  484. package/v3/dist/validation/index.js +31 -0
  485. package/v3/dist/validation/index.js.map +1 -0
  486. package/v3/dist/validation/parallel-eval-runner.d.ts +307 -0
  487. package/v3/dist/validation/parallel-eval-runner.d.ts.map +1 -0
  488. package/v3/dist/validation/parallel-eval-runner.js +566 -0
  489. package/v3/dist/validation/parallel-eval-runner.js.map +1 -0
  490. package/v3/dist/validation/swarm-skill-validator.d.ts +282 -0
  491. package/v3/dist/validation/swarm-skill-validator.d.ts.map +1 -0
  492. package/v3/dist/validation/swarm-skill-validator.js +460 -0
  493. package/v3/dist/validation/swarm-skill-validator.js.map +1 -0
  494. package/v3/dist/validation/validation-result-aggregator.d.ts +232 -0
  495. package/v3/dist/validation/validation-result-aggregator.d.ts.map +1 -0
  496. package/v3/dist/validation/validation-result-aggregator.js +630 -0
  497. package/v3/dist/validation/validation-result-aggregator.js.map +1 -0
  498. package/v3/package.json +1 -1
@@ -1,443 +1,445 @@
1
- ---
2
- name: "QE Iterative Loop"
3
- description: "Quality Engineering iteration loops for autonomous test improvement, coverage achievement, and quality gate compliance. Use when tests need to pass, coverage targets must be met, quality gates require compliance, or flaky tests need stabilization. Integrates with AQE v3 fleet agents for coordinated quality iteration."
4
- ---
5
-
6
- # QE Iterative Loop
7
-
8
- ## Overview
9
-
10
- QE Iterative Loop is a specialized adaptation of the Ralph Wiggum technique for **Quality Engineering workflows**. It enables autonomous, self-correcting quality cycles where AI agents iterate until quality objectives are achieved - tests pass, coverage targets met, quality gates satisfied, or flaky tests stabilized.
11
-
12
- ## Why QE Benefits from Iteration
13
-
14
- Quality Engineering has **objective, measurable success criteria**:
15
- - Tests either pass or fail (exit code 0 vs non-zero)
16
- - Coverage is quantifiable (78.5% vs 80% target)
17
- - Quality gates have binary outcomes (pass/fail)
18
- - Contract validation has clear schemas
19
-
20
- This makes QE ideal for iterative loops - we know exactly when we're done.
21
-
22
- ## Prerequisites
23
-
24
- - AQE v3 fleet initialized
25
- - Test framework configured (Jest, Vitest, Pytest, etc.)
26
- - Coverage tooling (c8, istanbul, coverage.py)
27
- - Quality gate definitions
28
-
29
- ---
30
-
31
- ## Quick Start
32
-
33
- ### Pattern 1: Test Fix Iteration
34
-
35
- ```bash
36
- # Task: Fix all failing tests
37
- /qe-loop "Run npm test and fix all failing tests.
38
- Success: npm test exits with code 0
39
- Output <promise>TESTS_GREEN</promise> when all tests pass."
40
- ```
41
-
42
- ### Pattern 2: Coverage Target Iteration
43
-
44
- ```bash
45
- # Task: Achieve 80% coverage
46
- /qe-loop "Increase test coverage to 80%.
47
- Success: Coverage report shows >= 80%
48
- Output <promise>COVERAGE_MET</promise> when target achieved."
49
- ```
50
-
51
- ### Pattern 3: Quality Gate Iteration
52
-
53
- ```bash
54
- # Task: Pass all quality gates
55
- /qe-loop "Pass all quality gates for deployment.
56
- Gates:
57
- - Unit tests: pass
58
- - Integration tests: pass
59
- - Coverage: >= 80%
60
- - No critical vulnerabilities
61
- - Performance < 200ms P95
62
- Output <promise>QUALITY_GATES_PASSED</promise> when all pass."
63
- ```
64
-
65
- ---
66
-
67
- ## QE Iteration Patterns
68
-
69
- ### Pattern 1: Test-Fix Iteration Loop
70
-
71
- **Goal**: All tests pass
72
-
73
- ```markdown
74
- ## QE Test-Fix Loop
75
-
76
- ### Success Criteria
77
- - `npm test` (or test command) returns exit code 0
78
- - No skipped tests (unless explicitly allowed)
79
- - No pending tests
80
-
81
- ### Iteration Steps
82
- 1. Run full test suite
83
- 2. Parse output for failures
84
- 3. Analyze first failure:
85
- - Identify failing test file
86
- - Understand assertion that failed
87
- - Check if production code or test is wrong
88
- 4. Fix the issue
89
- 5. Re-run failed test file only (faster feedback)
90
- 6. If file passes, run full suite
91
- 7. If all pass -> output <promise>TESTS_GREEN</promise>
92
- 8. If failures remain -> continue to next failure
93
-
94
- ### Safety
95
- - Max iterations: 30
96
- - After 10 iterations: report remaining failures
97
- - Stop if same test fails 5 times (possible design issue)
98
- ```
99
-
100
- ### Pattern 2: Coverage Improvement Loop
101
-
102
- **Goal**: Achieve coverage target
103
-
104
- ```markdown
105
- ## QE Coverage Loop
106
-
107
- ### Success Criteria
108
- - Line coverage >= {target}%
109
- - Branch coverage >= {target - 5}% (typically lower target)
110
- - No critical paths uncovered
111
-
112
- ### Iteration Steps
113
- 1. Run tests with coverage: `npm test -- --coverage`
114
- 2. Parse coverage report
115
- 3. If target met -> output <promise>COVERAGE_MET</promise>
116
- 4. Identify uncovered files, sorted by:
117
- - Critical business logic (highest priority)
118
- - Lines uncovered (most impact)
119
- - Complexity (McCabe score)
120
- 5. Generate test for highest-impact uncovered code
121
- 6. Run tests to verify new test passes
122
- 7. Check coverage improvement
123
- 8. Continue until target met
124
-
125
- ### Intelligence Integration
126
- - Store successful test patterns in memory
127
- - Learn from coverage achievements
128
- - Predict best coverage strategies
129
-
130
- ### Commands
131
- ```bash
132
- # Check coverage status
133
- npx @claude-flow/cli@latest memory retrieve --key "coverage-status"
134
-
135
- # Store coverage achievement pattern
136
- npx @claude-flow/cli@latest memory store \
137
- --key "coverage-pattern-auth" \
138
- --value '{"approach": "mock external deps", "improvement": "12%"}' \
139
- --namespace coverage-patterns
140
- ```
141
- ```
142
-
143
- ### Pattern 3: Quality Gate Compliance Loop
144
-
145
- **Goal**: Pass all quality gates
146
-
147
- ```markdown
148
- ## QE Quality Gate Loop
149
-
150
- ### Gate Definitions
151
- | Gate | Criteria | Priority |
152
- |------|----------|----------|
153
- | unit-tests | All pass | P0 |
154
- | integration-tests | All pass | P0 |
155
- | coverage | >= 80% | P1 |
156
- | lint | No errors | P1 |
157
- | typecheck | No errors | P1 |
158
- | security | No critical/high CVEs | P0 |
159
- | performance | P95 < 200ms | P2 |
160
-
161
- ### Iteration Strategy
162
- 1. Run all gate checks
163
- 2. Identify failing gates (sorted by priority)
164
- 3. Fix highest-priority failing gate
165
- 4. Re-run that gate to verify
166
- 5. When gate passes, move to next failing gate
167
- 6. When all pass -> output <promise>QUALITY_GATES_PASSED</promise>
168
-
169
- ### Gate Check Commands
170
- ```bash
171
- # Check all gates
172
- npm test && npm run lint && npm run typecheck && npm run coverage && npm audit
173
-
174
- # Individual gate checks
175
- npm test # unit-tests
176
- npm run test:integration # integration-tests
177
- npm run coverage # coverage
178
- npm run lint # lint
179
- npx tsc --noEmit # typecheck
180
- npm audit --audit-level=high # security
181
- npm run benchmark # performance
182
- ```
183
-
184
- ### Integration with AQE v3
185
- ```bash
186
- # Submit quality gate assessment task
187
- mcp__agentic-qe-v3__quality_assess --runGate true
188
-
189
- # Task orchestration for gate compliance
190
- mcp__agentic-qe-v3__task_orchestrate --task "Pass all quality gates" --strategy adaptive
191
- ```
192
- ```
193
-
194
- ### Pattern 4: Flaky Test Stabilization Loop
195
-
196
- **Goal**: Eliminate test flakiness
197
-
198
- ```markdown
199
- ## QE Flaky Test Loop
200
-
201
- ### Flakiness Detection
202
- 1. Run test suite N times (e.g., 5 runs)
203
- 2. Identify tests that pass/fail inconsistently
204
- 3. Calculate flakiness score: (inconsistent runs / total runs)
205
-
206
- ### Iteration Steps
207
- 1. Run: `for i in {1..5}; do npm test; done`
208
- 2. Aggregate results per test
209
- 3. Identify flaky tests (passed some, failed some)
210
- 4. For each flaky test:
211
- - Analyze failure modes
212
- - Common causes:
213
- - Timing issues (add retries/waits)
214
- - Shared state (isolate test data)
215
- - Network calls (mock external services)
216
- - Random data (use deterministic seeds)
217
- - Apply appropriate fix
218
- - Re-run 5 times to verify stability
219
- 5. When all tests stable -> output <promise>TESTS_STABLE</promise>
220
-
221
- ### AQE v3 Flaky Detection
222
- ```bash
223
- # Use qe-flaky-hunter agent
224
- Task("Hunt flaky tests", "Detect and stabilize flaky tests", "qe-flaky-hunter")
225
-
226
- # Or submit flaky detection task
227
- mcp__agentic-qe-v3__task_submit --type "flaky-detection" --priority "p1"
228
- ```
229
- ```
230
-
231
- ### Pattern 5: Contract Validation Loop
232
-
233
- **Goal**: API contracts aligned
234
-
235
- ```markdown
236
- ## QE Contract Loop
237
-
238
- ### Success Criteria
239
- - Provider implements all consumer contracts
240
- - No breaking changes detected
241
- - Schema validation passes
242
-
243
- ### Iteration Steps
244
- 1. Run contract tests: `npm run test:contracts`
245
- 2. Parse contract violations
246
- 3. For each violation:
247
- - Determine if provider or consumer needs update
248
- - Update appropriate side
249
- - Re-run contract tests
250
- 4. When all contracts valid -> output <promise>CONTRACTS_VALID</promise>
251
-
252
- ### AQE v3 Integration
253
- ```bash
254
- # Validate contracts
255
- mcp__agentic-qe-v3__contract_validate --contractPath "./contracts"
256
-
257
- # Or use specialized agent
258
- Task("Validate API contracts", "Check consumer-provider alignment", "qe-contract-validator")
259
- ```
260
- ```
261
-
262
- ---
263
-
264
- ## AQE v3 Fleet Integration
265
-
266
- ### Spawning QE Iteration Agents
267
-
268
- ```bash
269
- # Initialize swarm for QE iteration
270
- npx @claude-flow/cli@latest swarm init --topology hierarchical --max-agents 8
271
-
272
- # Spawn specialized QE iterators
273
- Task("Fix failing tests", "Iterate until all tests pass", "qe-tdd-green", {run_in_background: true})
274
- Task("Improve coverage", "Iterate until 80% coverage", "qe-coverage-analyzer", {run_in_background: true})
275
- Task("Fix security issues", "Iterate until security scan passes", "qe-security-scanner", {run_in_background: true})
276
- Task("Stabilize flaky tests", "Iterate until tests stable", "qe-flaky-hunter", {run_in_background: true})
277
- ```
278
-
279
- ### Memory-Enhanced QE Iteration
280
-
281
- ```bash
282
- # Store iteration patterns for learning
283
- npx @claude-flow/cli@latest memory store \
284
- --key "qe-iteration-test-fix" \
285
- --value '{"approach": "mock external deps", "success_rate": 0.85}' \
286
- --namespace qe-patterns
287
-
288
- # Search for relevant QE patterns
289
- npx @claude-flow/cli@latest memory search \
290
- --query "test fix iteration patterns" \
291
- --namespace qe-patterns
292
-
293
- # Record successful iteration completion
294
- npx @claude-flow/cli@latest hooks post-task \
295
- --taskId "test-fix-iteration" \
296
- --success true \
297
- --quality 0.95
298
- ```
299
-
300
- ### QE-Specific Agent Routing
301
-
302
- | QE Task | Recommended Agent | Iteration Goal |
303
- |---------|-------------------|----------------|
304
- | Test fixes | `qe-tdd-green` | All tests pass |
305
- | Coverage gaps | `qe-coverage-analyzer` | Target coverage met |
306
- | Quality gates | `qe-quality-gate` | All gates pass |
307
- | Flaky tests | `qe-flaky-hunter` | Tests stable |
308
- | Contract validation | `qe-contract-validator` | Contracts aligned |
309
- | Security fixes | `qe-security-scanner` | No vulnerabilities |
310
- | Performance | `qe-performance-validator` | Benchmarks pass |
311
-
312
- ---
313
-
314
- ## Completion Promises for QE
315
-
316
- ### Standard QE Promises
317
-
318
- ```markdown
319
- # Test-related
320
- <promise>TESTS_GREEN</promise> # All tests pass
321
- <promise>TESTS_STABLE</promise> # Flaky tests fixed
322
- <promise>TDD_COMPLETE</promise> # TDD cycle done
323
-
324
- # Coverage-related
325
- <promise>COVERAGE_MET</promise> # Target coverage achieved
326
- <promise>GAPS_FILLED</promise> # Coverage gaps addressed
327
-
328
- # Quality gates
329
- <promise>QUALITY_GATES_PASSED</promise> # All gates pass
330
- <promise>DEPLOYMENT_READY</promise> # Ready for deploy
331
-
332
- # Contract/API
333
- <promise>CONTRACTS_VALID</promise> # Contracts aligned
334
- <promise>API_COMPLIANT</promise> # API matches spec
335
-
336
- # Security
337
- <promise>SECURITY_CLEARED</promise> # No vulnerabilities
338
- <promise>COMPLIANCE_MET</promise> # Compliance requirements met
339
-
340
- # Performance
341
- <promise>PERF_TARGET_MET</promise> # Benchmarks satisfied
342
- ```
343
-
344
- ---
345
-
346
- ## Example: Full QE Iteration Workflow
347
-
348
- ```markdown
349
- ## Complete QE Iteration Task
350
-
351
- ### Objective
352
- Achieve deployment readiness through iterative quality improvement
353
-
354
- ### Phase 1: Test Health (Priority)
355
- 1. Run `npm test`
356
- 2. Fix failing tests iteratively
357
- 3. Success: <promise>TESTS_GREEN</promise>
358
-
359
- ### Phase 2: Coverage (After Phase 1)
360
- 1. Run `npm test -- --coverage`
361
- 2. Write tests for uncovered critical paths
362
- 3. Success: Coverage >= 80% -> <promise>COVERAGE_MET</promise>
363
-
364
- ### Phase 3: Quality Gates (After Phase 2)
365
- 1. Run lint: `npm run lint`
366
- 2. Run typecheck: `npx tsc --noEmit`
367
- 3. Fix any violations
368
- 4. Success: <promise>LINT_PASS</promise> + <promise>TYPES_PASS</promise>
369
-
370
- ### Phase 4: Security (Parallel with Phase 3)
371
- 1. Run `npm audit`
372
- 2. Fix critical/high vulnerabilities
373
- 3. Success: <promise>SECURITY_CLEARED</promise>
374
-
375
- ### Phase 5: Integration
376
- 1. Run `npm run test:integration`
377
- 2. Fix any integration failures
378
- 3. Success: <promise>INTEGRATION_PASS</promise>
379
-
380
- ### Final Gate
381
- When ALL phases complete -> <promise>DEPLOYMENT_READY</promise>
382
-
383
- ### Safety Limits
384
- - Max iterations per phase: 15
385
- - Total max iterations: 50
386
- - Stuck detection: 5 iterations without progress triggers escalation
387
- ```
388
-
389
- ---
390
-
391
- ## Troubleshooting
392
-
393
- ### Issue: Tests Keep Failing Same Assertion
394
-
395
- **Cause**: Likely a design issue, not implementation bug
396
-
397
- **Solution**:
398
- 1. Stop iteration after 5 attempts on same test
399
- 2. Analyze if test expectation is correct
400
- 3. Review if production behavior is as designed
401
- 4. Escalate to human review if unclear
402
-
403
- ### Issue: Coverage Plateau
404
-
405
- **Cause**: Remaining uncovered code is complex/conditional
406
-
407
- **Solution**:
408
- 1. Identify uncovered branches (not just lines)
409
- 2. Generate edge case tests
410
- 3. Consider if uncovered code is dead code
411
- 4. Accept lower target for genuinely untestable code
412
-
413
- ### Issue: Flaky Tests Won't Stabilize
414
-
415
- **Cause**: Deep timing or state issues
416
-
417
- **Solution**:
418
- 1. Add explicit waits/retries
419
- 2. Mock time-dependent behavior
420
- 3. Isolate test environment
421
- 4. Consider marking as skip with explanation
422
-
423
- ---
424
-
425
- ## Related Skills
426
-
427
- - [iterative-loop](../iterative-loop/) - General iteration technique
428
- - [qe-test-generation](../qe-test-generation/) - AI-powered test creation
429
- - [qe-coverage-analysis](../qe-coverage-analysis/) - Coverage gap detection
430
- - [qe-quality-assessment](../qe-quality-assessment/) - Quality gate management
431
- - [qe-chaos-resilience](../qe-chaos-resilience/) - Resilience iteration testing
432
-
433
- ## Resources
434
-
435
- - [AQE v3 Documentation](../../v3/README.md) - Full v3 reference
436
- - [Ralph Wiggum Technique](https://ghuntley.com/ralph/) - Original methodology
437
- - [Claude Flow CLI](https://github.com/ruvnet/claude-flow) - CLI documentation
438
-
439
- ---
440
-
441
- **Origin**: Adapted from Ralph Wiggum plugin (anthropics/claude-code)
442
- **Specialized for**: Agentic QE v3 Fleet with 59 QE agents
443
- **Domains**: test-generation, test-execution, coverage-analysis, quality-assessment
1
+ ---
2
+ name: "QE Iterative Loop"
3
+ description: "Quality Engineering iteration loops for autonomous test improvement, coverage achievement, and quality gate compliance. Use when tests need to pass, coverage targets must be met, quality gates require compliance, or flaky tests need stabilization. Integrates with AQE v3 fleet agents for coordinated quality iteration."
4
+ trust_tier: 2
5
+ validation:
6
+ schema_path: schemas/output.json
7
+ validator_path: scripts/validate.sh
8
+
9
+ ---
10
+
11
+ # QE Iterative Loop
12
+
13
+ ## Overview
14
+
15
+ QE Iterative Loop is a specialized adaptation of the Ralph Wiggum technique for **Quality Engineering workflows**. It enables autonomous, self-correcting quality cycles where AI agents iterate until quality objectives are achieved - tests pass, coverage targets met, quality gates satisfied, or flaky tests stabilized.
16
+
17
+ ## Why QE Benefits from Iteration
18
+
19
+ Quality Engineering has **objective, measurable success criteria**:
20
+ - Tests either pass or fail (exit code 0 vs non-zero)
21
+ - Coverage is quantifiable (78.5% vs 80% target)
22
+ - Quality gates have binary outcomes (pass/fail)
23
+ - Contract validation has clear schemas
24
+
25
+ This makes QE ideal for iterative loops - we know exactly when we're done.
26
+
27
+ ## Prerequisites
28
+
29
+ - AQE v3 fleet initialized
30
+ - Test framework configured (Jest, Vitest, Pytest, etc.)
31
+ - Coverage tooling (c8, istanbul, coverage.py)
32
+ - Quality gate definitions
33
+
34
+ ---
35
+
36
+ ## Quick Start
37
+
38
+ ### Pattern 1: Test Fix Iteration
39
+
40
+ ```bash
41
+ # Task: Fix all failing tests
42
+ /qe-loop "Run npm test and fix all failing tests.
43
+ Success: npm test exits with code 0
44
+ Output <promise>TESTS_GREEN</promise> when all tests pass."
45
+ ```
46
+
47
+ ### Pattern 2: Coverage Target Iteration
48
+
49
+ ```bash
50
+ # Task: Achieve 80% coverage
51
+ /qe-loop "Increase test coverage to 80%.
52
+ Success: Coverage report shows >= 80%
53
+ Output <promise>COVERAGE_MET</promise> when target achieved."
54
+ ```
55
+
56
+ ### Pattern 3: Quality Gate Iteration
57
+
58
+ ```bash
59
+ # Task: Pass all quality gates
60
+ /qe-loop "Pass all quality gates for deployment.
61
+ Gates:
62
+ - Unit tests: pass
63
+ - Integration tests: pass
64
+ - Coverage: >= 80%
65
+ - No critical vulnerabilities
66
+ - Performance < 200ms P95
67
+ Output <promise>QUALITY_GATES_PASSED</promise> when all pass."
68
+ ```
69
+
70
+ ---
71
+
72
+ ## QE Iteration Patterns
73
+
74
+ ### Pattern 1: Test-Fix Iteration Loop
75
+
76
+ **Goal**: All tests pass
77
+
78
+ ```markdown
79
+ ## QE Test-Fix Loop
80
+
81
+ ### Success Criteria
82
+ - `npm test` (or test command) returns exit code 0
83
+ - No skipped tests (unless explicitly allowed)
84
+ - No pending tests
85
+
86
+ ### Iteration Steps
87
+ 1. Run full test suite
88
+ 2. Parse output for failures
89
+ 3. Analyze first failure:
90
+ - Identify failing test file
91
+ - Understand assertion that failed
92
+ - Check if production code or test is wrong
93
+ 4. Fix the issue
94
+ 5. Re-run failed test file only (faster feedback)
95
+ 6. If file passes, run full suite
96
+ 7. If all pass -> output <promise>TESTS_GREEN</promise>
97
+ 8. If failures remain -> continue to next failure
98
+
99
+ ### Safety
100
+ - Max iterations: 30
101
+ - After 10 iterations: report remaining failures
102
+ - Stop if same test fails 5 times (possible design issue)
103
+ ```
104
+
105
+ ### Pattern 2: Coverage Improvement Loop
106
+
107
+ **Goal**: Achieve coverage target
108
+
109
+ ```markdown
110
+ ## QE Coverage Loop
111
+
112
+ ### Success Criteria
113
+ - Line coverage >= {target}%
114
+ - Branch coverage >= {target - 5}% (typically lower target)
115
+ - No critical paths uncovered
116
+
117
+ ### Iteration Steps
118
+ 1. Run tests with coverage: `npm test -- --coverage`
119
+ 2. Parse coverage report
120
+ 3. If target met -> output <promise>COVERAGE_MET</promise>
121
+ 4. Identify uncovered files, sorted by:
122
+ - Critical business logic (highest priority)
123
+ - Lines uncovered (most impact)
124
+ - Complexity (McCabe score)
125
+ 5. Generate test for highest-impact uncovered code
126
+ 6. Run tests to verify new test passes
127
+ 7. Check coverage improvement
128
+ 8. Continue until target met
129
+
130
+ ### Intelligence Integration
131
+ - Store successful test patterns in memory
132
+ - Learn from coverage achievements
133
+ - Predict best coverage strategies
134
+
135
+ ### Commands
136
+ ```bash
137
+ # Check coverage status (via AQE MCP)
138
+ mcp__agentic-qe__memory_retrieve --key "coverage-status" --namespace "coverage"
139
+
140
+ # Store coverage achievement pattern (via AQE MCP)
141
+ mcp__agentic-qe__memory_store \
142
+ --key "coverage-pattern-auth" \
143
+ --value '{"approach": "mock external deps", "improvement": "12%"}' \
144
+ --namespace "coverage-patterns"
145
+ ```
146
+ ```
147
+
148
+ ### Pattern 3: Quality Gate Compliance Loop
149
+
150
+ **Goal**: Pass all quality gates
151
+
152
+ ```markdown
153
+ ## QE Quality Gate Loop
154
+
155
+ ### Gate Definitions
156
+ | Gate | Criteria | Priority |
157
+ |------|----------|----------|
158
+ | unit-tests | All pass | P0 |
159
+ | integration-tests | All pass | P0 |
160
+ | coverage | >= 80% | P1 |
161
+ | lint | No errors | P1 |
162
+ | typecheck | No errors | P1 |
163
+ | security | No critical/high CVEs | P0 |
164
+ | performance | P95 < 200ms | P2 |
165
+
166
+ ### Iteration Strategy
167
+ 1. Run all gate checks
168
+ 2. Identify failing gates (sorted by priority)
169
+ 3. Fix highest-priority failing gate
170
+ 4. Re-run that gate to verify
171
+ 5. When gate passes, move to next failing gate
172
+ 6. When all pass -> output <promise>QUALITY_GATES_PASSED</promise>
173
+
174
+ ### Gate Check Commands
175
+ ```bash
176
+ # Check all gates
177
+ npm test && npm run lint && npm run typecheck && npm run coverage && npm audit
178
+
179
+ # Individual gate checks
180
+ npm test # unit-tests
181
+ npm run test:integration # integration-tests
182
+ npm run coverage # coverage
183
+ npm run lint # lint
184
+ npx tsc --noEmit # typecheck
185
+ npm audit --audit-level=high # security
186
+ npm run benchmark # performance
187
+ ```
188
+
189
+ ### Integration with AQE v3
190
+ ```bash
191
+ # Submit quality gate assessment task
192
+ mcp__agentic-qe-v3__quality_assess --runGate true
193
+
194
+ # Task orchestration for gate compliance
195
+ mcp__agentic-qe-v3__task_orchestrate --task "Pass all quality gates" --strategy adaptive
196
+ ```
197
+ ```
198
+
199
+ ### Pattern 4: Flaky Test Stabilization Loop
200
+
201
+ **Goal**: Eliminate test flakiness
202
+
203
+ ```markdown
204
+ ## QE Flaky Test Loop
205
+
206
+ ### Flakiness Detection
207
+ 1. Run test suite N times (e.g., 5 runs)
208
+ 2. Identify tests that pass/fail inconsistently
209
+ 3. Calculate flakiness score: (inconsistent runs / total runs)
210
+
211
+ ### Iteration Steps
212
+ 1. Run: `for i in {1..5}; do npm test; done`
213
+ 2. Aggregate results per test
214
+ 3. Identify flaky tests (passed some, failed some)
215
+ 4. For each flaky test:
216
+ - Analyze failure modes
217
+ - Common causes:
218
+ - Timing issues (add retries/waits)
219
+ - Shared state (isolate test data)
220
+ - Network calls (mock external services)
221
+ - Random data (use deterministic seeds)
222
+ - Apply appropriate fix
223
+ - Re-run 5 times to verify stability
224
+ 5. When all tests stable -> output <promise>TESTS_STABLE</promise>
225
+
226
+ ### AQE v3 Flaky Detection
227
+ ```bash
228
+ # Use qe-flaky-hunter agent
229
+ Task("Hunt flaky tests", "Detect and stabilize flaky tests", "qe-flaky-hunter")
230
+
231
+ # Or submit flaky detection task
232
+ mcp__agentic-qe-v3__task_submit --type "flaky-detection" --priority "p1"
233
+ ```
234
+ ```
235
+
236
+ ### Pattern 5: Contract Validation Loop
237
+
238
+ **Goal**: API contracts aligned
239
+
240
+ ```markdown
241
+ ## QE Contract Loop
242
+
243
+ ### Success Criteria
244
+ - Provider implements all consumer contracts
245
+ - No breaking changes detected
246
+ - Schema validation passes
247
+
248
+ ### Iteration Steps
249
+ 1. Run contract tests: `npm run test:contracts`
250
+ 2. Parse contract violations
251
+ 3. For each violation:
252
+ - Determine if provider or consumer needs update
253
+ - Update appropriate side
254
+ - Re-run contract tests
255
+ 4. When all contracts valid -> output <promise>CONTRACTS_VALID</promise>
256
+
257
+ ### AQE v3 Integration
258
+ ```bash
259
+ # Validate contracts
260
+ mcp__agentic-qe-v3__contract_validate --contractPath "./contracts"
261
+
262
+ # Or use specialized agent
263
+ Task("Validate API contracts", "Check consumer-provider alignment", "qe-contract-validator")
264
+ ```
265
+ ```
266
+
267
+ ---
268
+
269
+ ## AQE v3 Fleet Integration
270
+
271
+ ### Spawning QE Iteration Agents
272
+
273
+ ```bash
274
+ # Initialize AQE fleet for QE iteration
275
+ mcp__agentic-qe__fleet_init --topology "hierarchical" --maxAgents 8
276
+
277
+ # Spawn specialized QE iterators using Task tool
278
+ Task("Fix failing tests", "Iterate until all tests pass", "qe-tdd-green", {run_in_background: true})
279
+ Task("Improve coverage", "Iterate until 80% coverage", "qe-coverage-analyzer", {run_in_background: true})
280
+ Task("Fix security issues", "Iterate until security scan passes", "qe-security-scanner", {run_in_background: true})
281
+ Task("Stabilize flaky tests", "Iterate until tests stable", "qe-flaky-hunter", {run_in_background: true})
282
+ ```
283
+
284
+ ### Memory-Enhanced QE Iteration
285
+
286
+ ```bash
287
+ # Store iteration patterns for learning (via AQE MCP)
288
+ mcp__agentic-qe__memory_store \
289
+ --key "qe-iteration-test-fix" \
290
+ --value '{"approach": "mock external deps", "success_rate": 0.85}' \
291
+ --namespace "qe-patterns"
292
+
293
+ # Search for relevant QE patterns (via AQE MCP)
294
+ mcp__agentic-qe__memory_query \
295
+ --pattern "test-fix-*" \
296
+ --namespace "qe-patterns"
297
+
298
+ # Record successful iteration completion (via AQE task tracking)
299
+ mcp__agentic-qe__task_status --taskId "test-fix-iteration"
300
+ ```
301
+
302
+ ### QE-Specific Agent Routing
303
+
304
+ | QE Task | Recommended Agent | Iteration Goal |
305
+ |---------|-------------------|----------------|
306
+ | Test fixes | `qe-tdd-green` | All tests pass |
307
+ | Coverage gaps | `qe-coverage-analyzer` | Target coverage met |
308
+ | Quality gates | `qe-quality-gate` | All gates pass |
309
+ | Flaky tests | `qe-flaky-hunter` | Tests stable |
310
+ | Contract validation | `qe-contract-validator` | Contracts aligned |
311
+ | Security fixes | `qe-security-scanner` | No vulnerabilities |
312
+ | Performance | `qe-performance-validator` | Benchmarks pass |
313
+
314
+ ---
315
+
316
+ ## Completion Promises for QE
317
+
318
+ ### Standard QE Promises
319
+
320
+ ```markdown
321
+ # Test-related
322
+ <promise>TESTS_GREEN</promise> # All tests pass
323
+ <promise>TESTS_STABLE</promise> # Flaky tests fixed
324
+ <promise>TDD_COMPLETE</promise> # TDD cycle done
325
+
326
+ # Coverage-related
327
+ <promise>COVERAGE_MET</promise> # Target coverage achieved
328
+ <promise>GAPS_FILLED</promise> # Coverage gaps addressed
329
+
330
+ # Quality gates
331
+ <promise>QUALITY_GATES_PASSED</promise> # All gates pass
332
+ <promise>DEPLOYMENT_READY</promise> # Ready for deploy
333
+
334
+ # Contract/API
335
+ <promise>CONTRACTS_VALID</promise> # Contracts aligned
336
+ <promise>API_COMPLIANT</promise> # API matches spec
337
+
338
+ # Security
339
+ <promise>SECURITY_CLEARED</promise> # No vulnerabilities
340
+ <promise>COMPLIANCE_MET</promise> # Compliance requirements met
341
+
342
+ # Performance
343
+ <promise>PERF_TARGET_MET</promise> # Benchmarks satisfied
344
+ ```
345
+
346
+ ---
347
+
348
+ ## Example: Full QE Iteration Workflow
349
+
350
+ ```markdown
351
+ ## Complete QE Iteration Task
352
+
353
+ ### Objective
354
+ Achieve deployment readiness through iterative quality improvement
355
+
356
+ ### Phase 1: Test Health (Priority)
357
+ 1. Run `npm test`
358
+ 2. Fix failing tests iteratively
359
+ 3. Success: <promise>TESTS_GREEN</promise>
360
+
361
+ ### Phase 2: Coverage (After Phase 1)
362
+ 1. Run `npm test -- --coverage`
363
+ 2. Write tests for uncovered critical paths
364
+ 3. Success: Coverage >= 80% -> <promise>COVERAGE_MET</promise>
365
+
366
+ ### Phase 3: Quality Gates (After Phase 2)
367
+ 1. Run lint: `npm run lint`
368
+ 2. Run typecheck: `npx tsc --noEmit`
369
+ 3. Fix any violations
370
+ 4. Success: <promise>LINT_PASS</promise> + <promise>TYPES_PASS</promise>
371
+
372
+ ### Phase 4: Security (Parallel with Phase 3)
373
+ 1. Run `npm audit`
374
+ 2. Fix critical/high vulnerabilities
375
+ 3. Success: <promise>SECURITY_CLEARED</promise>
376
+
377
+ ### Phase 5: Integration
378
+ 1. Run `npm run test:integration`
379
+ 2. Fix any integration failures
380
+ 3. Success: <promise>INTEGRATION_PASS</promise>
381
+
382
+ ### Final Gate
383
+ When ALL phases complete -> <promise>DEPLOYMENT_READY</promise>
384
+
385
+ ### Safety Limits
386
+ - Max iterations per phase: 15
387
+ - Total max iterations: 50
388
+ - Stuck detection: 5 iterations without progress triggers escalation
389
+ ```
390
+
391
+ ---
392
+
393
+ ## Troubleshooting
394
+
395
+ ### Issue: Tests Keep Failing Same Assertion
396
+
397
+ **Cause**: Likely a design issue, not implementation bug
398
+
399
+ **Solution**:
400
+ 1. Stop iteration after 5 attempts on same test
401
+ 2. Analyze if test expectation is correct
402
+ 3. Review if production behavior is as designed
403
+ 4. Escalate to human review if unclear
404
+
405
+ ### Issue: Coverage Plateau
406
+
407
+ **Cause**: Remaining uncovered code is complex/conditional
408
+
409
+ **Solution**:
410
+ 1. Identify uncovered branches (not just lines)
411
+ 2. Generate edge case tests
412
+ 3. Consider if uncovered code is dead code
413
+ 4. Accept lower target for genuinely untestable code
414
+
415
+ ### Issue: Flaky Tests Won't Stabilize
416
+
417
+ **Cause**: Deep timing or state issues
418
+
419
+ **Solution**:
420
+ 1. Add explicit waits/retries
421
+ 2. Mock time-dependent behavior
422
+ 3. Isolate test environment
423
+ 4. Consider marking as skip with explanation
424
+
425
+ ---
426
+
427
+ ## Related Skills
428
+
429
+ - [iterative-loop](../iterative-loop/) - General iteration technique
430
+ - [qe-test-generation](../qe-test-generation/) - AI-powered test creation
431
+ - [qe-coverage-analysis](../qe-coverage-analysis/) - Coverage gap detection
432
+ - [qe-quality-assessment](../qe-quality-assessment/) - Quality gate management
433
+ - [qe-chaos-resilience](../qe-chaos-resilience/) - Resilience iteration testing
434
+
435
+ ## Resources
436
+
437
+ - [AQE v3 Documentation](../../v3/README.md) - Full v3 reference
438
+ - [Ralph Wiggum Technique](https://ghuntley.com/ralph/) - Original methodology
439
+ - [Agentic QE MCP Tools](https://github.com/proffesor-for-testing/agentic-qe) - MCP tool reference
440
+
441
+ ---
442
+
443
+ **Origin**: Adapted from Ralph Wiggum plugin (anthropics/claude-code)
444
+ **Specialized for**: Agentic QE v3 Fleet with 59 QE agents
445
+ **Domains**: test-generation, test-execution, coverage-analysis, quality-assessment