ma-agents 3.12.3 → 3.13.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (254) hide show
  1. package/docs/architecture.md +18 -0
  2. package/lib/bmad-cache/bmb/.claude-plugin/marketplace.json +1 -1
  3. package/lib/bmad-cache/bmb/_git_preserved/hooks/commit-msg.sample +52 -2
  4. package/lib/bmad-cache/bmb/_git_preserved/hooks/fsmonitor-watchman.sample +2 -8
  5. package/lib/bmad-cache/bmb/_git_preserved/index +0 -0
  6. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-8f8b045fef5af6911495cf3b2a89f1ed75e120f7.idx +0 -0
  7. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-8f8b045fef5af6911495cf3b2a89f1ed75e120f7.pack +0 -0
  8. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-8f8b045fef5af6911495cf3b2a89f1ed75e120f7.rev +0 -0
  9. package/lib/bmad-cache/bmb/_git_preserved/packed-refs +1 -1
  10. package/lib/bmad-cache/bmb/_git_preserved/refs/heads/main +1 -1
  11. package/lib/bmad-cache/bmb/_git_preserved/shallow +1 -1
  12. package/lib/bmad-cache/bmb/package-lock.json +2 -2
  13. package/lib/bmad-cache/bmb/package.json +1 -1
  14. package/lib/bmad-cache/bmb/samples/bmad-agent-dream-weaver/assets/module-help.csv +1 -1
  15. package/lib/bmad-cache/bmb/samples/bmad-agent-dream-weaver/scripts/merge-config.py +33 -0
  16. package/lib/bmad-cache/bmb/samples/bmad-agent-dream-weaver/scripts/merge-help-csv.py +28 -0
  17. package/lib/bmad-cache/bmb/samples/sample-module-setup/assets/module-help.csv +1 -1
  18. package/lib/bmad-cache/bmb/samples/sample-module-setup/scripts/cleanup-legacy.py +28 -0
  19. package/lib/bmad-cache/bmb/samples/sample-module-setup/scripts/merge-config.py +33 -0
  20. package/lib/bmad-cache/bmb/samples/sample-module-setup/scripts/merge-help-csv.py +28 -0
  21. package/lib/bmad-cache/bmb/skills/bmad-bmb-setup/assets/module-help.csv +1 -1
  22. package/lib/bmad-cache/bmb/skills/bmad-bmb-setup/scripts/cleanup-legacy.py +28 -0
  23. package/lib/bmad-cache/bmb/skills/bmad-bmb-setup/scripts/merge-config.py +33 -0
  24. package/lib/bmad-cache/bmb/skills/bmad-bmb-setup/scripts/merge-help-csv.py +28 -0
  25. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/assets/Dockerfile +29 -0
  26. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/docker_setup.py +115 -0
  27. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/generate_report.py +184 -0
  28. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/pty_runner.py +171 -0
  29. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/run_evals.py +492 -0
  30. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/run_triggers.py +366 -0
  31. package/lib/bmad-cache/bmb/skills/bmad-eval-runner/scripts/utils.py +260 -0
  32. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/setup-skill-template/assets/module-help.csv +1 -1
  33. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/setup-skill-template/scripts/cleanup-legacy.py +28 -0
  34. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/setup-skill-template/scripts/merge-config.py +33 -0
  35. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/setup-skill-template/scripts/merge-help-csv.py +28 -0
  36. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/standalone-module-template/merge-config.py +33 -0
  37. package/lib/bmad-cache/bmb/skills/bmad-module-builder/assets/standalone-module-template/merge-help-csv.py +28 -0
  38. package/lib/bmad-cache/bmb/skills/bmad-module-builder/scripts/tests/test-validate-module.py +74 -1
  39. package/lib/bmad-cache/bmb/skills/bmad-module-builder/scripts/validate-module.py +24 -13
  40. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/assets/sample-customize-product-brief.toml +48 -33
  41. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/scripts/extract-report-json.py +287 -0
  42. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/scripts/generate-html-report.py +57 -8
  43. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/scripts/prepass-prompt-metrics.py +7 -7
  44. package/lib/bmad-cache/bmb/skills/module-help.csv +1 -1
  45. package/lib/bmad-cache/bmb/website/public/img/eval-test-types.png +0 -0
  46. package/lib/bmad-cache/cache-manifest.json +17 -18
  47. package/lib/bmad-cache/cis/_git_preserved/hooks/commit-msg.sample +52 -2
  48. package/lib/bmad-cache/cis/_git_preserved/hooks/fsmonitor-watchman.sample +2 -8
  49. package/lib/bmad-cache/cis/_git_preserved/index +0 -0
  50. package/lib/bmad-cache/cis/_git_preserved/objects/pack/pack-18c8290560a98bcb7bf0676e6cc9b2ac5ca2823e.idx +0 -0
  51. package/lib/bmad-cache/cis/_git_preserved/objects/pack/{pack-42ffc048f54e58ce94c6331bc6be97ebbb7936f2.pack → pack-18c8290560a98bcb7bf0676e6cc9b2ac5ca2823e.pack} +0 -0
  52. package/lib/bmad-cache/cis/_git_preserved/objects/pack/pack-18c8290560a98bcb7bf0676e6cc9b2ac5ca2823e.rev +0 -0
  53. package/lib/bmad-cache/cis/_git_preserved/packed-refs +1 -1
  54. package/lib/bmad-cache/cis/_git_preserved/refs/heads/main +1 -1
  55. package/lib/bmad-cache/cis/_git_preserved/refs/tags/v0.2.1 +1 -0
  56. package/lib/bmad-cache/cis/_git_preserved/shallow +1 -1
  57. package/lib/bmad-cache/cis/package-lock.json +2 -2
  58. package/lib/bmad-cache/cis/package.json +1 -1
  59. package/lib/bmad-cache/cis/src/module-help.csv +1 -1
  60. package/lib/bmad-cache/gds/.claude-plugin/marketplace.json +4 -7
  61. package/lib/bmad-cache/gds/README.md +3 -1
  62. package/lib/bmad-cache/gds/_git_preserved/hooks/commit-msg.sample +52 -2
  63. package/lib/bmad-cache/gds/_git_preserved/hooks/fsmonitor-watchman.sample +2 -8
  64. package/lib/bmad-cache/gds/_git_preserved/index +0 -0
  65. package/lib/bmad-cache/gds/_git_preserved/objects/pack/pack-dcb7c556d9bb6b6b70d2301e094eaac6d7300552.idx +0 -0
  66. package/lib/bmad-cache/gds/_git_preserved/objects/pack/{pack-9427a146a90c00bb542cba038874bf9671ba4dc0.pack → pack-dcb7c556d9bb6b6b70d2301e094eaac6d7300552.pack} +0 -0
  67. package/lib/bmad-cache/gds/_git_preserved/objects/pack/pack-dcb7c556d9bb6b6b70d2301e094eaac6d7300552.rev +0 -0
  68. package/lib/bmad-cache/gds/_git_preserved/packed-refs +1 -1
  69. package/lib/bmad-cache/gds/_git_preserved/refs/heads/main +1 -1
  70. package/lib/bmad-cache/gds/_git_preserved/shallow +1 -1
  71. package/lib/bmad-cache/gds/package.json +1 -1
  72. package/lib/bmad-cache/gds/src/agents/gds-agent-game-designer/customize.toml +5 -5
  73. package/lib/bmad-cache/gds/src/agents/gds-agent-game-dev/customize.toml +5 -5
  74. package/lib/bmad-cache/gds/src/agents/gds-agent-game-solo-dev/customize.toml +0 -5
  75. package/lib/bmad-cache/gds/src/module-help.csv +6 -12
  76. package/lib/bmad-cache/gds/src/module.yaml +1 -1
  77. package/lib/bmad-cache/gds/src/workflows/1-preproduction/gds-create-game-brief/customize.toml +97 -22
  78. package/lib/bmad-cache/gds/src/workflows/2-design/gds-gdd/assets/validation-report-template.html +190 -0
  79. package/lib/bmad-cache/gds/src/workflows/2-design/gds-gdd/customize.toml +99 -0
  80. package/lib/bmad-cache/gds/src/workflows/2-design/gds-gdd/scripts/render-validation-html.py +290 -0
  81. package/lib/bmad-cache/gds/src/workflows/2-design/gds-prd/assets/validation-report-template.html +190 -0
  82. package/lib/bmad-cache/gds/src/workflows/2-design/gds-prd/customize.toml +84 -0
  83. package/lib/bmad-cache/gds/src/workflows/2-design/gds-ux/assets/validation-report-template.html +319 -0
  84. package/lib/bmad-cache/gds/src/workflows/2-design/gds-ux/customize.toml +101 -0
  85. package/lib/bmad-cache/gds/src/workflows/3-technical/gds-game-architecture/architecture-patterns.yaml +1 -0
  86. package/lib/bmad-cache/gds/src/workflows/3-technical/gds-game-architecture/decision-catalog.yaml +88 -0
  87. package/lib/bmad-cache/gds/src/workflows/3-technical/gds-game-architecture/engine-mcps.yaml +124 -2
  88. package/lib/bmad-cache/gds/src/workflows/4-production/gds-investigate/customize.toml +62 -0
  89. package/lib/bmad-cache/tea/.claude-plugin/marketplace.json +1 -1
  90. package/lib/bmad-cache/tea/.github/workflows/docs.yaml +3 -3
  91. package/lib/bmad-cache/tea/.github/workflows/quality.yaml +10 -10
  92. package/lib/bmad-cache/tea/AGENTS.md +31 -0
  93. package/lib/bmad-cache/tea/CHANGELOG.md +42 -1
  94. package/lib/bmad-cache/tea/README.md +8 -5
  95. package/lib/bmad-cache/tea/_git_preserved/hooks/commit-msg.sample +52 -2
  96. package/lib/bmad-cache/tea/_git_preserved/hooks/fsmonitor-watchman.sample +2 -8
  97. package/lib/bmad-cache/tea/_git_preserved/index +0 -0
  98. package/lib/bmad-cache/tea/_git_preserved/objects/pack/pack-9e4197e37df7763dd7a05c2965ee921dfd2eb617.idx +0 -0
  99. package/lib/bmad-cache/tea/_git_preserved/objects/pack/{pack-f0df537f2649464ff6c5aee241165eb9c8664227.pack → pack-9e4197e37df7763dd7a05c2965ee921dfd2eb617.pack} +0 -0
  100. package/lib/bmad-cache/tea/_git_preserved/objects/pack/pack-9e4197e37df7763dd7a05c2965ee921dfd2eb617.rev +0 -0
  101. package/lib/bmad-cache/tea/_git_preserved/packed-refs +1 -1
  102. package/lib/bmad-cache/tea/_git_preserved/refs/heads/main +1 -1
  103. package/lib/bmad-cache/tea/_git_preserved/refs/tags/v1.19.0 +1 -0
  104. package/lib/bmad-cache/tea/_git_preserved/shallow +1 -1
  105. package/lib/bmad-cache/tea/docs/explanation/engagement-models.md +15 -16
  106. package/lib/bmad-cache/tea/docs/explanation/knowledge-base-system.md +2 -0
  107. package/lib/bmad-cache/tea/docs/explanation/risk-based-testing.md +1 -1
  108. package/lib/bmad-cache/tea/docs/explanation/tea-overview.md +88 -52
  109. package/lib/bmad-cache/tea/docs/explanation/testing-as-engineering.md +13 -12
  110. package/lib/bmad-cache/tea/docs/glossary/index.md +2 -2
  111. package/lib/bmad-cache/tea/docs/how-to/brownfield/use-tea-for-enterprise.md +19 -18
  112. package/lib/bmad-cache/tea/docs/how-to/brownfield/use-tea-with-existing-tests.md +1 -1
  113. package/lib/bmad-cache/tea/docs/how-to/workflows/run-nfr-assess.md +32 -26
  114. package/lib/bmad-cache/tea/docs/how-to/workflows/run-test-design.md +20 -14
  115. package/lib/bmad-cache/tea/docs/how-to/workflows/run-trace.md +3 -3
  116. package/lib/bmad-cache/tea/docs/index.md +13 -11
  117. package/lib/bmad-cache/tea/docs/reference/commands.md +37 -13
  118. package/lib/bmad-cache/tea/docs/reference/knowledge-base.md +2 -2
  119. package/lib/bmad-cache/tea/package-lock.json +2 -2
  120. package/lib/bmad-cache/tea/package.json +1 -1
  121. package/lib/bmad-cache/tea/src/agents/bmad-tea/customize.toml +20 -15
  122. package/lib/bmad-cache/tea/src/agents/bmad-tea/resources/knowledge/confidence-gate.md +73 -0
  123. package/lib/bmad-cache/tea/src/agents/bmad-tea/resources/knowledge/test-quality.md +1 -0
  124. package/lib/bmad-cache/tea/src/agents/bmad-tea/resources/tea-index.csv +2 -1
  125. package/lib/bmad-cache/tea/src/module-help.csv +2 -2
  126. package/lib/bmad-cache/tea/src/workflows/testarch/README.md +5 -4
  127. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-teach-me-testing/data/role-paths.yaml +1 -1
  128. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-teach-me-testing/data/tea-resources-index.yaml +1 -1
  129. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-teach-me-testing/steps-c/step-04-session-01.md +2 -2
  130. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-teach-me-testing/steps-c/step-04-session-07.md +1 -1
  131. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-teach-me-testing/templates/certificate-template.md +1 -1
  132. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-atdd/resources/tea-index.csv +1 -1
  133. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-automate/resources/tea-index.csv +1 -1
  134. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-ci/resources/tea-index.csv +1 -1
  135. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-framework/resources/tea-index.csv +1 -1
  136. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/SKILL.md +3 -3
  137. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/checklist.md +11 -11
  138. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/instructions.md +4 -2
  139. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/nfr-report-template.md +5 -5
  140. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/resources/tea-index.csv +1 -1
  141. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-01-load-context.md +1 -1
  142. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-01b-resume.md +1 -1
  143. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-02-define-thresholds.md +14 -3
  144. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04-evaluate-and-score.md +7 -7
  145. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04a-subagent-security.md +4 -4
  146. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04b-subagent-performance.md +4 -4
  147. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04c-subagent-reliability.md +4 -4
  148. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04d-subagent-scalability.md +4 -4
  149. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-04e-aggregate-nfr.md +4 -4
  150. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/steps-c/step-05-generate-report.md +1 -1
  151. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/workflow-plan.md +1 -1
  152. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-nfr/workflow.yaml +3 -3
  153. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/checklist.md +23 -3
  154. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/resources/tea-index.csv +1 -1
  155. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/steps-c/step-02-load-context.md +7 -0
  156. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/steps-c/step-03-risk-and-testability.md +16 -2
  157. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/steps-c/step-04-coverage-plan.md +20 -4
  158. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/steps-c/step-05-generate-output.md +2 -0
  159. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/test-design-architecture-template.md +17 -0
  160. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/test-design-qa-template.md +15 -0
  161. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-design/test-design-template.md +16 -0
  162. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-test-review/resources/tea-index.csv +1 -1
  163. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-trace/checklist.md +1 -1
  164. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-trace/resources/tea-index.csv +1 -1
  165. package/lib/bmad-cache/tea/src/workflows/testarch/bmad-testarch-trace/trace-template.md +1 -1
  166. package/lib/bmad-cache/tea/test/test-installation-components.js +49 -0
  167. package/lib/bmad-cache/tea/website/astro.config.mjs +2 -2
  168. package/lib/bmad-cache/wds/README.md +1 -1
  169. package/lib/bmad-cache/wds/_git_preserved/hooks/commit-msg.sample +52 -2
  170. package/lib/bmad-cache/wds/_git_preserved/hooks/fsmonitor-watchman.sample +2 -8
  171. package/lib/bmad-cache/wds/_git_preserved/index +0 -0
  172. package/lib/bmad-cache/wds/_git_preserved/objects/pack/pack-656c3d8d5426e73043b6a7f45eedaab74e3c419e.idx +0 -0
  173. package/lib/bmad-cache/wds/_git_preserved/objects/pack/{pack-96877c1c09123cccb1f91c1412184b11d2b492ad.pack → pack-656c3d8d5426e73043b6a7f45eedaab74e3c419e.pack} +0 -0
  174. package/lib/bmad-cache/wds/_git_preserved/objects/pack/pack-656c3d8d5426e73043b6a7f45eedaab74e3c419e.rev +0 -0
  175. package/lib/bmad-cache/wds/_git_preserved/packed-refs +1 -1
  176. package/lib/bmad-cache/wds/_git_preserved/refs/heads/main +1 -1
  177. package/lib/bmad-cache/wds/_git_preserved/refs/tags/v0.4.3 +1 -0
  178. package/lib/bmad-cache/wds/_git_preserved/shallow +1 -1
  179. package/lib/bmad-cache/wds/eslint.config.mjs +1 -1
  180. package/lib/bmad-cache/wds/package.json +1 -1
  181. package/lib/bmad-cache/wds/src/agents/wds-agent-freya-ux/customize.toml +80 -0
  182. package/lib/bmad-cache/wds/src/agents/wds-agent-mimir-builder/customize.toml +52 -0
  183. package/lib/bmad-cache/wds/src/agents/wds-agent-saga-analyst/customize.toml +70 -0
  184. package/lib/bmad-cache/wds/src/module-help.csv +19 -19
  185. package/lib/bmad-cache/wds/src/module.yaml +28 -0
  186. package/lib/bmad-cache/wds/src/scripts/README.md +155 -0
  187. package/lib/bmad-cache/wds/src/scripts/wds-add-object.js +202 -0
  188. package/lib/bmad-cache/wds/src/scripts/wds-add-spacing.js +158 -0
  189. package/lib/bmad-cache/wds/src/scripts/wds-init-page.js +229 -0
  190. package/lib/bmad-cache/wds/src/scripts/wds-init-scenario.js +120 -0
  191. package/lib/bmad-cache/wds/src/scripts/wds-nav.js +201 -0
  192. package/lib/bmad-cache/wds/src/scripts/wds-validate.js +301 -0
  193. package/lib/bmad-cache/wds/src/workflows/wds-3-scenarios/workflow.xml +450 -0
  194. package/lib/bmad-cache/wds/src/workflows/wds-4-ux-design/workflow-specify.xml +387 -0
  195. package/lib/bmad-extension/.claude-plugin/marketplace.json.template +1 -1
  196. package/lib/bmad-extension-plugin/.claude-plugin/marketplace.json +2 -2
  197. package/lib/bmad.js +91 -7
  198. package/lib/installer.js +28 -6
  199. package/lib/mil498-templates/OCD.md +169 -169
  200. package/lib/mil498-templates/README.md +4 -4
  201. package/lib/mil498-templates/SDD.md +163 -163
  202. package/lib/mil498-templates/SDP.md +307 -307
  203. package/lib/mil498-templates/SRS.md +219 -219
  204. package/lib/mil498-templates/SSDD.md +154 -154
  205. package/lib/mil498-templates/SSS.md +225 -225
  206. package/lib/mil498-templates/STD.md +188 -188
  207. package/lib/templates/instruction-block-git.template.md +25 -0
  208. package/package.json +5 -4
  209. package/scripts/build-bmad-cache.js +143 -42
  210. package/skills/git-workflow-skill/skill.json +21 -21
  211. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-6ecd9fc6445b1281449c5ec49a6c5794708e662e.idx +0 -0
  212. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-6ecd9fc6445b1281449c5ec49a6c5794708e662e.pack +0 -0
  213. package/lib/bmad-cache/bmb/_git_preserved/objects/pack/pack-6ecd9fc6445b1281449c5ec49a6c5794708e662e.rev +0 -0
  214. package/lib/bmad-cache/bmb/_git_preserved/refs/remotes/origin/HEAD +0 -1
  215. package/lib/bmad-cache/bmb/_git_preserved/refs/tags/v1.7.0 +0 -1
  216. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/scripts/generate-convert-report.py +0 -406
  217. package/lib/bmad-cache/bmb/skills/bmad-workflow-builder/scripts/tests/test_generate_convert_report.py +0 -243
  218. package/lib/bmad-cache/cis/_git_preserved/objects/pack/pack-42ffc048f54e58ce94c6331bc6be97ebbb7936f2.idx +0 -0
  219. package/lib/bmad-cache/cis/_git_preserved/objects/pack/pack-42ffc048f54e58ce94c6331bc6be97ebbb7936f2.rev +0 -0
  220. package/lib/bmad-cache/cis/_git_preserved/refs/remotes/origin/HEAD +0 -1
  221. package/lib/bmad-cache/gds/_git_preserved/objects/pack/pack-9427a146a90c00bb542cba038874bf9671ba4dc0.idx +0 -0
  222. package/lib/bmad-cache/gds/_git_preserved/objects/pack/pack-9427a146a90c00bb542cba038874bf9671ba4dc0.rev +0 -0
  223. package/lib/bmad-cache/gds/_git_preserved/refs/remotes/origin/HEAD +0 -1
  224. package/lib/bmad-cache/gds/src/workflows/2-design/gds-create-gdd/customize.toml +0 -41
  225. package/lib/bmad-cache/gds/src/workflows/2-design/gds-create-prd/customize.toml +0 -41
  226. package/lib/bmad-cache/gds/src/workflows/2-design/gds-create-prd/data/domain-complexity.csv +0 -15
  227. package/lib/bmad-cache/gds/src/workflows/2-design/gds-create-prd/data/project-types.csv +0 -11
  228. package/lib/bmad-cache/gds/src/workflows/2-design/gds-create-ux-design/customize.toml +0 -41
  229. package/lib/bmad-cache/gds/src/workflows/2-design/gds-edit-gdd/customize.toml +0 -41
  230. package/lib/bmad-cache/gds/src/workflows/2-design/gds-edit-prd/customize.toml +0 -41
  231. package/lib/bmad-cache/gds/src/workflows/2-design/gds-validate-gdd/customize.toml +0 -41
  232. package/lib/bmad-cache/gds/src/workflows/2-design/gds-validate-prd/customize.toml +0 -41
  233. package/lib/bmad-cache/gds/src/workflows/2-design/gds-validate-prd/data/domain-complexity.csv +0 -15
  234. package/lib/bmad-cache/gds/src/workflows/2-design/gds-validate-prd/data/project-types.csv +0 -11
  235. package/lib/bmad-cache/tea/_git_preserved/objects/pack/pack-f0df537f2649464ff6c5aee241165eb9c8664227.idx +0 -0
  236. package/lib/bmad-cache/tea/_git_preserved/objects/pack/pack-f0df537f2649464ff6c5aee241165eb9c8664227.rev +0 -0
  237. package/lib/bmad-cache/tea/_git_preserved/refs/remotes/origin/HEAD +0 -1
  238. package/lib/bmad-cache/wds/_git_preserved/objects/pack/pack-96877c1c09123cccb1f91c1412184b11d2b492ad.idx +0 -0
  239. package/lib/bmad-cache/wds/_git_preserved/objects/pack/pack-96877c1c09123cccb1f91c1412184b11d2b492ad.rev +0 -0
  240. package/lib/bmad-cache/wds/_git_preserved/refs/remotes/origin/HEAD +0 -1
  241. package/lib/bmad-cache/wds/src/agents/wds-agent-freya-ux/bmad-skill-manifest.yaml +0 -12
  242. package/lib/bmad-cache/wds/src/agents/wds-agent-saga-analyst/bmad-skill-manifest.yaml +0 -12
  243. package/lib/bmad-cache/wds/src/workflows/wds-0-alignment-signoff/bmad-skill-manifest.yaml +0 -1
  244. package/lib/bmad-cache/wds/src/workflows/wds-0-project-setup/bmad-skill-manifest.yaml +0 -1
  245. package/lib/bmad-cache/wds/src/workflows/wds-1-project-brief/bmad-skill-manifest.yaml +0 -1
  246. package/lib/bmad-cache/wds/src/workflows/wds-2-trigger-mapping/bmad-skill-manifest.yaml +0 -1
  247. package/lib/bmad-cache/wds/src/workflows/wds-3-scenarios/bmad-skill-manifest.yaml +0 -1
  248. package/lib/bmad-cache/wds/src/workflows/wds-4-ux-design/bmad-skill-manifest.yaml +0 -1
  249. package/lib/bmad-cache/wds/src/workflows/wds-5-agentic-development/bmad-skill-manifest.yaml +0 -1
  250. package/lib/bmad-cache/wds/src/workflows/wds-6-asset-generation/bmad-skill-manifest.yaml +0 -1
  251. package/lib/bmad-cache/wds/src/workflows/wds-7-design-system/bmad-skill-manifest.yaml +0 -1
  252. package/lib/bmad-cache/wds/src/workflows/wds-8-product-evolution/bmad-skill-manifest.yaml +0 -1
  253. /package/lib/bmad-cache/gds/src/workflows/2-design/{gds-create-gdd → gds-gdd/assets}/game-types.csv +0 -0
  254. /package/lib/bmad-cache/gds/src/workflows/2-design/{gds-validate-gdd/data → gds-gdd/assets}/genre-complexity.csv +0 -0
@@ -3,7 +3,7 @@ title: 'How to Run Test Design with TEA'
3
3
  description: How to create comprehensive test plans using TEA's test-design workflow
4
4
  ---
5
5
 
6
- Use TEA's `test-design` workflow to create comprehensive test plans with risk assessment and coverage strategies.
6
+ Use TEA's `test-design` workflow to create comprehensive test plans with risk assessment, NFR planning, and coverage strategies.
7
7
 
8
8
  ## When to Use This
9
9
 
@@ -12,12 +12,14 @@ Use TEA's `test-design` workflow to create comprehensive test plans with risk as
12
12
  - After architecture is complete
13
13
  - Before implementation-readiness gate
14
14
  - To validate architecture testability
15
+ - To define NFR thresholds, unknowns, and planned evidence before implementation
15
16
 
16
17
  **Epic-level (Phase 4):**
17
18
 
18
19
  - At the start of each epic
19
20
  - Before implementing stories in the epic
20
21
  - To identify epic-specific testing needs
22
+ - To refine NFR validation when the epic has security, performance, reliability, scalability, compliance, or maintainability requirements
21
23
 
22
24
  :::note[Prerequisites]
23
25
 
@@ -43,8 +45,8 @@ test-design
43
45
 
44
46
  TEA will ask if you want:
45
47
 
46
- - **System-level** — For architecture testability review (Phase 3)
47
- - **Epic-level** — For epic-specific test planning (Phase 4)
48
+ - **System-level** — For architecture testability review and NFR planning (Phase 3)
49
+ - **Epic-level** — For epic-specific test and NFR planning (Phase 4)
48
50
 
49
51
  ### 4. Provide Context
50
52
 
@@ -52,11 +54,13 @@ For system-level:
52
54
 
53
55
  - Point to your architecture document
54
56
  - Reference any ADRs (Architecture Decision Records)
57
+ - Include PRD NFRs, SLO/SLA targets, compliance requirements, and known monitoring needs
55
58
 
56
59
  For epic-level:
57
60
 
58
61
  - Specify which epic you're planning
59
62
  - Reference the epic file with stories
63
+ - Mention any NFR-heavy scenarios or inherited system-level NFR plans
60
64
 
61
65
  ### 5. Review the Output
62
66
 
@@ -72,20 +76,18 @@ TEA produces two focused documents for system-level mode:
72
76
  - Purpose: Architectural concerns, testability gaps, NFR requirements
73
77
  - Quick Guide with 🚨 BLOCKERS / ⚠️ HIGH PRIORITY / 📋 INFO ONLY
74
78
  - Risk assessment (high/medium/low-priority with scoring)
79
+ - NFR testability requirements: thresholds, unknowns, architecture gaps, planned evidence
75
80
  - Testability concerns and architectural gaps
76
81
  - Risk mitigation plans for high-priority risks (≥6)
77
82
  - Assumptions and dependencies
78
83
 
79
84
  2. **`test-design-qa.md`** (for QA team)
80
85
  - Purpose: Test execution recipe, coverage plan, Sprint 0 setup
81
- - Quick Reference for QA (Before You Start, Execution Order, Need Help)
82
- - System architecture summary
83
- - Test environment requirements (moved up - early in doc)
84
- - Testability assessment (prerequisites checklist)
85
- - Test levels strategy (unit/integration/E2E split)
86
86
  - Test coverage plan (P0/P1/P2/P3 with detailed scenarios + checkboxes)
87
+ - NFR test coverage plan with planned validation tools and evidence artifacts
87
88
  - Sprint 0 setup requirements (blockers, infrastructure, environments)
88
- - NFR readiness summary
89
+
90
+ `test-design` does **not** make final NFR PASS/CONCERNS/FAIL decisions. It defines the thresholds and evidence that `nfr-assess` audits later.
89
91
 
90
92
  **Why Two Documents?**
91
93
 
@@ -101,17 +103,18 @@ TEA produces two focused documents for system-level mode:
101
103
  - Risk assessment for the epic
102
104
  - Test priorities (P0-P3)
103
105
  - Coverage plan
106
+ - NFR planning when NFRs are in scope
104
107
  - Regression hotspots (for brownfield)
105
108
  - Integration risks
106
109
  - Mitigation strategies
107
110
 
108
111
  ## Test Design for Different Tracks
109
112
 
110
- | Track | Phase 3 Focus | Phase 4 Focus |
111
- | -------------- | ------------------------------------- | -------------------------------------- |
112
- | **Greenfield** | System-level testability review | Per-epic risk assessment and test plan |
113
- | **Brownfield** | System-level + existing test baseline | Regression hotspots, integration risks |
114
- | **Enterprise** | Compliance-aware testability | Security/performance/compliance focus |
113
+ | Track | Phase 3 Focus | Phase 4 Focus |
114
+ | -------------- | ------------------------------------------------ | ------------------------------------------ |
115
+ | **Greenfield** | System-level testability + NFR planning | Per-epic risk assessment and test plan |
116
+ | **Brownfield** | System-level + existing test baseline | Regression hotspots, integration/NFR risks |
117
+ | **Enterprise** | Compliance-aware testability + NFR evidence plan | Security/performance/compliance focus |
115
118
 
116
119
  ## Examples
117
120
 
@@ -129,9 +132,11 @@ TEA produces two focused documents for system-level mode:
129
132
  ## Tips
130
133
 
131
134
  - **Run system-level right after architecture** — Early testability review
135
+ - **Shift NFRs left** — Define thresholds and planned evidence before implementation
132
136
  - **Run epic-level at the start of each epic** — Targeted test planning
133
137
  - **Update if ADRs change** — Keep test design aligned
134
138
  - **Use output to guide other workflows** — Feeds into `atdd` and `automate`
139
+ - **Use `nfr-assess` later** — Audit evidence after tests, scans, metrics, or logs exist
135
140
  - **Architecture teams review Architecture doc** — Focus on blockers and mitigation plans
136
141
  - **QA teams use QA doc as implementation guide** — Follow test scenarios and Sprint 0 checklist
137
142
 
@@ -142,3 +147,4 @@ After test design:
142
147
  1. **Setup Test Framework** — If not already configured
143
148
  2. **Implementation Readiness** — System-level feeds into gate check
144
149
  3. **Story Implementation** — Epic-level guides testing during dev
150
+ 4. **NFR Evidence Audit** — Run `nfr-assess` after implementation evidence exists
@@ -444,7 +444,7 @@ test-review.md (from test-review)
444
444
 
445
445
  ```
446
446
 
447
- **NFR Assessment (Optional):**
447
+ **NFR Evidence Audit (Optional):**
448
448
  ```
449
449
 
450
450
  nfr-assessment.md (from nfr-assess)
@@ -476,7 +476,7 @@ TEA makes evidence-based gate decision and writes to separate file.
476
476
  - P1 coverage: 100% (6/6 requirements)
477
477
  - P2 coverage: 33% (1/3 requirements) - acceptable
478
478
  - Test quality score: 84/100
479
- - NFR assessment: PASS
479
+ - NFR evidence audit: PASS
480
480
 
481
481
  ## Coverage Analysis
482
482
 
@@ -949,7 +949,7 @@ Result: PARTIAL coverage (3/4 criteria)
949
949
 
950
950
  - [How to Run Test Design](/docs/how-to/workflows/run-test-design.md) - Provides requirements for traceability
951
951
  - [How to Run Test Review](/docs/how-to/workflows/run-test-review.md) - Quality scores feed gate
952
- - [How to Run NFR Assessment](/docs/how-to/workflows/run-nfr-assess.md) - NFR status feeds gate
952
+ - [How to Run NFR Evidence Audit](/docs/how-to/workflows/run-nfr-assess.md) - NFR status feeds gate
953
953
 
954
954
  ## Understanding the Concepts
955
955
 
@@ -40,17 +40,19 @@ Pick a path:
40
40
 
41
41
  ## Core Workflows
42
42
 
43
- | Workflow | Trigger | Purpose |
44
- | --------------------------------------------------------- | ------- | -------------------------------------- |
45
- | [Teach Me Testing](/how-to/workflows/teach-me-testing) | TMT | Learn testing (7 sessions, 1-2 weeks) |
46
- | [Framework Setup](/how-to/workflows/setup-test-framework) | TF | Scaffold test framework |
47
- | [CI/CD Integration](/how-to/workflows/setup-ci) | CI | Set up quality pipeline |
48
- | [Test Design](/how-to/workflows/run-test-design) | TD | Risk-based test planning |
49
- | [ATDD](/how-to/workflows/run-atdd) | AT | Failing acceptance tests (TDD) |
50
- | [Test Automation](/how-to/workflows/run-automate) | TA | Expand automation coverage |
51
- | [Test Review](/how-to/workflows/run-test-review) | RV | Quality audit with scoring |
52
- | [Requirements Tracing](/how-to/workflows/run-trace) | TR | Coverage mapping + gate decision |
53
- | [NFR Assessment](/how-to/workflows/run-nfr-assess) | NR | Non-functional requirements evaluation |
43
+ | Workflow | Trigger | Purpose |
44
+ | --------------------------------------------------------- | ------- | ------------------------------------- |
45
+ | [Teach Me Testing](/how-to/workflows/teach-me-testing) | TMT | Learn testing (7 sessions, 1-2 weeks) |
46
+ | [Test Design](/how-to/workflows/run-test-design) | TD | Risk-based planning + NFR planning |
47
+ | [Framework Setup](/how-to/workflows/setup-test-framework) | TF | Scaffold test framework |
48
+ | [CI/CD Integration](/how-to/workflows/setup-ci) | CI | Set up quality pipeline |
49
+ | [ATDD](/how-to/workflows/run-atdd) | AT | Failing acceptance tests (TDD) |
50
+ | [Test Automation](/how-to/workflows/run-automate) | TA | Expand automation coverage |
51
+ | [Test Review](/how-to/workflows/run-test-review) | RV | Quality audit with scoring |
52
+ | [NFR Evidence Audit](/how-to/workflows/run-nfr-assess) | NR | Non-functional evidence evaluation |
53
+ | [Requirements Tracing](/how-to/workflows/run-trace) | TR | Coverage mapping + gate decision |
54
+
55
+ > **Agent menu shortcut:** The TEA agent menu also provides a `GATE` intent (trigger: `GATE` in chat after loading `bmad-tea`). It is a routing helper — not a standalone workflow — that guides you through the release gate sequence: optional test-review → optional nfr-assess → trace Phase 2 gate decision. It produces no artifact of its own.
54
56
 
55
57
  ## Documentation Structure
56
58
 
@@ -18,14 +18,15 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
18
18
  ## Quick Index
19
19
 
20
20
  - [`teach-me-testing`](#teach-me-testing) - Learn testing (TEA Academy)
21
+ - [`test-design`](#test-design) - Risk-based test planning
21
22
  - [`framework`](#framework) - Scaffold test framework
22
23
  - [`ci`](#ci) - Setup CI/CD pipeline
23
- - [`test-design`](#test-design) - Risk-based test planning
24
24
  - [`atdd`](#atdd) - Acceptance TDD
25
25
  - [`automate`](#automate) - Test automation
26
26
  - [`test-review`](#test-review) - Quality audit
27
- - [`nfr-assess`](#nfr-assess) - NFR assessment
27
+ - [`nfr-assess`](#nfr-assess) - NFR Evidence Audit
28
28
  - [`trace`](#trace) - Coverage traceability
29
+ - [`GATE`](#gate-agent-menu-shortcut) - Release gate routing helper (agent menu only)
29
30
 
30
31
  ---
31
32
 
@@ -123,7 +124,7 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
123
124
 
124
125
  ## test-design
125
126
 
126
- **Purpose:** Risk-based test planning with coverage strategy
127
+ **Purpose:** Risk-based test planning with coverage strategy and NFR planning
127
128
 
128
129
  **Phase:** Phase 3 (system-level), Phase 4 (epic-level)
129
130
 
@@ -131,8 +132,8 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
131
132
 
132
133
  **Modes:**
133
134
 
134
- - **System-level:** Architecture testability review (TWO documents)
135
- - **Epic-level:** Per-epic risk assessment (ONE document)
135
+ - **System-level:** Architecture testability review and NFR planning (TWO documents)
136
+ - **Epic-level:** Per-epic risk and NFR planning (ONE document)
136
137
 
137
138
  **Key Inputs:**
138
139
 
@@ -147,12 +148,13 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
147
148
  - Quick Guide (🚨 BLOCKERS / ⚠️ HIGH PRIORITY / 📋 INFO ONLY)
148
149
  - Risk assessment with scoring
149
150
  - Testability concerns and gaps
151
+ - NFR thresholds, unknowns, and planned evidence
150
152
  - Mitigation plans
151
153
  - `test-design-qa.md` - For QA team
152
154
  - Test execution recipe
153
155
  - Coverage plan (P0/P1/P2/P3 with checkboxes)
154
156
  - Sprint 0 setup requirements
155
- - NFR readiness summary
157
+ - NFR test coverage and evidence plan
156
158
 
157
159
  **Epic-Level (ONE Document):**
158
160
 
@@ -160,6 +162,7 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
160
162
  - Risk assessment (probability × impact scores)
161
163
  - Test priorities (P0-P3)
162
164
  - Coverage strategy
165
+ - NFR planning when NFRs are in scope
163
166
  - Mitigation plans
164
167
 
165
168
  **Why Two Documents for System-Level?**
@@ -256,16 +259,17 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
256
259
 
257
260
  ## nfr-assess
258
261
 
259
- **Purpose:** Validate non-functional requirements with evidence
262
+ **Purpose:** Audit implemented NFR evidence against defined thresholds
260
263
 
261
- **Phase:** Phase 2 (enterprise), Release Gate
264
+ **Phase:** Release Gate; optional earlier evidence audit when implementation evidence exists
262
265
 
263
266
  **Frequency:** Per release (enterprise projects)
264
267
 
265
268
  **Key Inputs:**
266
269
 
267
270
  - NFR categories (Security, Performance, Reliability, Maintainability)
268
- - Thresholds, evidence location
271
+ - Thresholds from PRD, architecture, or `test-design`
272
+ - Evidence locations (test reports, scans, metrics, logs, monitoring, CI results)
269
273
 
270
274
  **Key Outputs:**
271
275
 
@@ -274,7 +278,9 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
274
278
  - Mitigation plans
275
279
  - Gate decision inputs
276
280
 
277
- **How-To Guide:** [Run NFR Assessment](/docs/how-to/workflows/run-nfr-assess.md)
281
+ **Boundary:** Use `test-design` to plan NFR thresholds and evidence before implementation. Use `nfr-assess` after evidence exists to audit the evidence.
282
+
283
+ **How-To Guide:** [Run NFR Evidence Audit](/docs/how-to/workflows/run-nfr-assess.md)
278
284
 
279
285
  ---
280
286
 
@@ -311,18 +317,36 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
311
317
 
312
318
  ---
313
319
 
320
+ ## GATE (Agent Menu Shortcut)
321
+
322
+ **Purpose:** Release gate routing helper — not a standalone workflow; produces no artifact of its own.
323
+
324
+ **Trigger:** Type `GATE` in chat after loading the TEA agent (`bmad-tea`).
325
+
326
+ **What it does:** Determines which release gate evidence exists and guides you through the correct sequence:
327
+
328
+ 1. (Optional) `test-review` — final test quality audit
329
+ 2. (Optional) `nfr-assess` — NFR Evidence Audit
330
+ 3. `trace` Phase 2 — PASS/CONCERNS/FAIL/WAIVED gate decision
331
+
332
+ The agent asks which evidence is available and routes to the right workflow. It does not merge these workflows; each workflow is invoked separately in sequence.
333
+
334
+ **When to use:** When you are approaching a release and want a single starting point that covers all release gate checks without needing to know which workflow to invoke first.
335
+
336
+ ---
337
+
314
338
  ## Summary Table
315
339
 
316
340
  | Command | Phase | Frequency | Primary Output |
317
341
  | ------------------ | ---------- | ------------------------- | -------------------------- |
318
342
  | `teach-me-testing` | Learning | Once per learner | Progress + notes + cert |
343
+ | `test-design` | 3, 4 | System + per epic | Test design + NFR plan |
319
344
  | `framework` | 3 | Once | Test infrastructure |
320
345
  | `ci` | 3 | Once | CI/CD pipeline |
321
- | `test-design` | 3, 4 | System + per epic | Test design doc |
322
346
  | `atdd` | 4 | Per story (optional) | Failing tests |
323
347
  | `automate` | 4 | Per story | Passing tests |
324
348
  | `test-review` | 4, Gate | Per epic/release | Quality report |
325
- | `nfr-assess` | 2, Gate | Per release | NFR assessment |
349
+ | `nfr-assess` | Gate | Per release | NFR evidence audit |
326
350
  | `trace` | 2, 4, Gate | Baseline + refresh + gate | Coverage matrix + decision |
327
351
 
328
352
  ---
@@ -338,7 +362,7 @@ All workflows listed here are current and supported in TEA, including `nfr-asses
338
362
  - [Run ATDD](/docs/how-to/workflows/run-atdd.md)
339
363
  - [Run Automate](/docs/how-to/workflows/run-automate.md)
340
364
  - [Run Test Review](/docs/how-to/workflows/run-test-review.md)
341
- - [Run NFR Assessment](/docs/how-to/workflows/run-nfr-assess.md)
365
+ - [Run NFR Evidence Audit](/docs/how-to/workflows/run-nfr-assess.md)
342
366
  - [Run Trace](/docs/how-to/workflows/run-trace.md)
343
367
 
344
368
  **Explanation:**
@@ -377,7 +377,7 @@ Each TEA workflow loads specific fragments:
377
377
  - risk-governance.md
378
378
  - probability-impact.md
379
379
 
380
- **Purpose:** NFR assessment frameworks and decision rules
380
+ **Purpose:** NFR Evidence Audit frameworks and decision rules
381
381
 
382
382
  ---
383
383
 
@@ -391,7 +391,7 @@ Each TEA workflow loads specific fragments:
391
391
 
392
392
  **Purpose:** Traceability and gate decision standards
393
393
 
394
- **Note:** Loads nfr-criteria.md if NFR assessment is part of gate decision.
394
+ **Note:** Loads nfr-criteria.md if NFR evidence audit status is part of the gate decision.
395
395
 
396
396
  ---
397
397
 
@@ -1,12 +1,12 @@
1
1
  {
2
2
  "name": "bmad-method-test-architecture-enterprise",
3
- "version": "1.15.1",
3
+ "version": "1.19.0",
4
4
  "lockfileVersion": 3,
5
5
  "requires": true,
6
6
  "packages": {
7
7
  "": {
8
8
  "name": "bmad-method-test-architecture-enterprise",
9
- "version": "1.15.1",
9
+ "version": "1.19.0",
10
10
  "license": "MIT",
11
11
  "dependencies": {
12
12
  "@clack/prompts": "^0.11.0",
@@ -1,7 +1,7 @@
1
1
  {
2
2
  "$schema": "https://json.schemastore.org/package.json",
3
3
  "name": "bmad-method-test-architecture-enterprise",
4
- "version": "1.15.1",
4
+ "version": "1.19.0",
5
5
  "description": "Master Test Architect for quality strategy, test automation, and release gates",
6
6
  "keywords": [
7
7
  "bmad",
@@ -63,11 +63,21 @@ code = "TMT"
63
63
  description = "Teach Me Testing — interactive learning companion with 7 progressive sessions from fundamentals to advanced practices"
64
64
  skill = "bmad-teach-me-testing"
65
65
 
66
+ [[agent.menu]]
67
+ code = "TD"
68
+ description = "Test Design — risk assessment, NFR planning, and coverage strategy for system or epic scope"
69
+ skill = "bmad-testarch-test-design"
70
+
66
71
  [[agent.menu]]
67
72
  code = "TF"
68
73
  description = "Test Framework — initialize production-ready test framework architecture"
69
74
  skill = "bmad-testarch-framework"
70
75
 
76
+ [[agent.menu]]
77
+ code = "CI"
78
+ description = "Continuous Integration — recommend and scaffold CI/CD quality pipeline"
79
+ skill = "bmad-testarch-ci"
80
+
71
81
  [[agent.menu]]
72
82
  code = "AT"
73
83
  description = "ATDD — generate failing acceptance tests plus an implementation checklist before development"
@@ -79,26 +89,21 @@ description = "Test Automation — generate prioritized API/E2E tests, fixtures,
79
89
  skill = "bmad-testarch-automate"
80
90
 
81
91
  [[agent.menu]]
82
- code = "TD"
83
- description = "Test Designrisk assessment plus coverage strategy for system or epic scope"
84
- skill = "bmad-testarch-test-design"
92
+ code = "GATE"
93
+ description = "Release Gateroute final audit, NFR evidence audit, and trace gate decision"
94
+ prompt = "Help the user run the release gate path. First determine which evidence exists, then recommend the correct sequence: optional test-review for final test quality audit, optional nfr-assess for NFR Evidence Audit, then trace Phase 2 for PASS/CONCERNS/FAIL/WAIVED gate decision. Do not merge these workflows; route to the right one based on available evidence."
85
95
 
86
96
  [[agent.menu]]
87
- code = "TR"
88
- description = "Trace Coveragemap requirements, specs, or inferred journeys to tests (Phase 1) and make quality gate decision (Phase 2)"
89
- skill = "bmad-testarch-trace"
97
+ code = "RV"
98
+ description = "Review Testsperform a quality check against written tests using comprehensive knowledge base and best practices"
99
+ skill = "bmad-testarch-test-review"
90
100
 
91
101
  [[agent.menu]]
92
102
  code = "NR"
93
- description = "Non-Functional Requirements — assess NFRs and recommend actions"
103
+ description = "NFR Evidence Audit — assess implemented NFR evidence and recommend actions"
94
104
  skill = "bmad-testarch-nfr"
95
105
 
96
106
  [[agent.menu]]
97
- code = "CI"
98
- description = "Continuous Integrationrecommend and scaffold CI/CD quality pipeline"
99
- skill = "bmad-testarch-ci"
100
-
101
- [[agent.menu]]
102
- code = "RV"
103
- description = "Review Tests — perform a quality check against written tests using comprehensive knowledge base and best practices"
104
- skill = "bmad-testarch-test-review"
107
+ code = "TR"
108
+ description = "Trace Coveragemap requirements to tests (Phase 1) and make quality gate decision (Phase 2)"
109
+ skill = "bmad-testarch-trace"
@@ -0,0 +1,73 @@
1
+ # Confidence Gate
2
+
3
+ ## Principle
4
+
5
+ When generating tests, scaffolding fixtures, classifying risk, or proposing any non-trivial test artifact, emit a confidence assessment before writing code. If confidence is below the threshold, stop and ask the user instead of generating plausible-looking output built on guesses.
6
+
7
+ ## Rationale
8
+
9
+ The failure mode of LLM-generated tests is rarely "refused to try" — it is "generated something plausible that passes locally and breaks silently in CI." Hallucinated selectors, invented endpoint paths, fabricated risk scores, and reverse-engineered schemas all produce code that looks correct and tests nothing real. A confidence gate makes that failure mode loud by forcing the agent to declare its evidence and its unknowns before any artifact is committed.
10
+
11
+ ## Required output shape
12
+
13
+ Every non-trivial test artifact proposal must include:
14
+
15
+ ```
16
+ Confidence: <1-10>
17
+ Rationale: <one or two sentences citing concrete evidence from the repo or contract>
18
+ Unknowns: <bulleted list of things the agent does not know>
19
+ ```
20
+
21
+ The Rationale must cite a file path, a contract document, an existing pattern, or a captured observation. Vague rationale ("based on standard patterns", "looks similar to other tests") is not evidence and forces the score down.
22
+
23
+ ## Threshold rule
24
+
25
+ - **Confidence ≥ 7** — proceed with generation.
26
+ - **Confidence 5–6** — proceed but surface the assumptions to the user in the output so they can correct mid-flight.
27
+ - **Confidence < 5** — STOP. Do not generate. Ask the user to resolve the most-blocking Unknown first.
28
+
29
+ ## When to apply
30
+
31
+ Apply the gate when generating or proposing:
32
+
33
+ - **Selectors and page objects.** Must have explored the live application via `playwright-cli` or read existing page object patterns. Confidence < 5 if neither.
34
+ - **Endpoint paths and request shapes.** Must have read the OpenAPI / Swagger contract or existing endpoint enums. Confidence < 5 if the endpoint is being invented.
35
+ - **Risk classification (test-design, NFR).** Must cite probability and impact evidence. Confidence < 5 if scoring is vibes-based.
36
+ - **Fixture composition.** Must understand existing `mergeTests` patterns and fixture boundaries in the repo. Confidence < 5 if composing blindly.
37
+ - **Schema authoring (Zod, Ajv, JSON Schema).** Must have a documented contract source (OpenAPI, JSON schema, existing schema file). Confidence < 5 if reverse-engineering from a single sample response.
38
+ - **Data factories.** Must understand the production data shape and constraints. Confidence < 5 if guessing field validity rules.
39
+
40
+ ## When NOT to apply
41
+
42
+ - Mechanical refactors with clear scope (rename a variable, add a tag, update an import).
43
+ - Reading or summarizing existing artifacts.
44
+ - Producing reports from already-gathered data.
45
+ - Trivial test additions that copy an existing pattern exactly.
46
+
47
+ The gate exists to prevent fabrication, not to bureaucratize obvious work.
48
+
49
+ ## Anti-patterns
50
+
51
+ ❌ **Vanity scores.** `Confidence: 9` with no Rationale, or Rationale that does not cite evidence. Score the evidence, not the optimism.
52
+
53
+ ❌ **Listing then ignoring Unknowns.** Listing unknowns and then proceeding anyway when Confidence is below threshold. If the gate is below threshold, the only valid next action is to ask the user.
54
+
55
+ ❌ **Asking generically.** Asking "should I proceed?" instead of resolving the most-blocking Unknown with a concrete one-sentence question.
56
+
57
+ ❌ **Inflating to clear the bar.** Adjusting Confidence upward to avoid the stop rule. If the evidence is weak, the score is weak; resolve the evidence, not the number.
58
+
59
+ ## Patterns that work
60
+
61
+ ✅ **Cite the source.** "Confidence: 8 — Rationale: read `src/openapi/users.yaml` line 142-167 and existing schema at `tests/api/users.schema.ts`."
62
+
63
+ ✅ **One concrete Unknown.** When below threshold, ask one specific question: "Is `POST /users/{id}/role` documented anywhere? I can't find it in the OpenAPI spec and there are no existing tests for it."
64
+
65
+ ✅ **Promote evidence.** When the user answers the Unknown, the Rationale gets stronger and Confidence rises legitimately. The gate is a feedback loop, not a checkpoint.
66
+
67
+ ## Related fragments
68
+
69
+ - `test-quality.md` — Definition of Done for tests; the gate protects DoD compliance.
70
+ - `risk-governance.md` — risk scoring discipline that informs Rationale for risk-related gates.
71
+ - `probability-impact.md` — scoring scales used in risk-related Rationale.
72
+ - `selector-resilience.md` — selector confidence specifically.
73
+ - `playwright-cli.md` — the sanctioned exploration tool that promotes selector Confidence.
@@ -647,6 +647,7 @@ test('admin action', async ({ page }) => {
647
647
  - `data-factories.md` - Isolated, parallel-safe data patterns
648
648
  - `fixture-architecture.md` - Setup extraction and cleanup
649
649
  - `test-levels-framework.md` - Choosing appropriate test granularity for speed
650
+ - `confidence-gate.md` - Agent reliability gate that protects DoD compliance during LLM-assisted test generation
650
651
 
651
652
  ## Core Quality Checklist
652
653
 
@@ -40,7 +40,7 @@ pactjs-utils-request-filter,Pact.js Utils Request Filter,"createRequestFilter, n
40
40
  pact-mcp,Pact MCP Server,"SmartBear MCP for PactFlow: generate tests, review, can-i-deploy, provider states","pact,mcp,pactflow,contract-testing,broker",specialized,knowledge/pact-mcp.md
41
41
  pact-consumer-framework-setup,Pact Consumer CDC Framework Setup,"Directory structure, vitest config with fileParallelism:false + pool:forks + singleFork:true (FFI safety), one-file-per-consumer+provider-pair rule (FFI handle collision prevention), jq-normalized publishing, 1:1 local/CI parity, PactV4 patterns","pactjs-utils,consumer,contract-testing,pact,ci,framework,setup,vitest,shell-scripts,jq,pactv4,ffi,file-organization,one-file-per-pair",specialized,knowledge/pact-consumer-framework-setup.md
42
42
  pact-broker-webhooks,Pact Broker Webhooks,"PactFlow → GitHub repository_dispatch auth via dedicated machine user + classic PAT (repo scope, no expiration) + PactFlow secret; staleness monitoring and PAT rotation runbook","pact,pactflow,broker,webhooks,github,auth,pat,ci,operations,security",specialized,knowledge/pact-broker-webhooks.md
43
- adr-quality-readiness-checklist,ADR Quality Readiness Checklist,"8-category 29-criteria framework for ADR testability and NFR assessment","nfr,testability,adr,quality,assessment,checklist",extended,knowledge/adr-quality-readiness-checklist.md
43
+ adr-quality-readiness-checklist,ADR Quality Readiness Checklist,"8-category 29-criteria framework for ADR testability and NFR evidence audit","nfr,testability,adr,quality,assessment,checklist",extended,knowledge/adr-quality-readiness-checklist.md
44
44
  playwright-cli,Playwright CLI,"Token-efficient CLI for AI coding agents: element refs, sessions, snapshots, trace analysis, debug=cli autonomous investigation","cli,browser,agent,automation,snapshot,trace,debug",core,knowledge/playwright-cli.md
45
45
  pact-consumer-di,Pact Consumer DI Pattern,"Dependency injection pattern for Pact consumer tests — call actual source code instead of raw fetch by injecting mock server URL via optional baseUrl in context type","contract-testing,pact,consumer,dependency-injection,api,backend,architecture",extended,knowledge/pact-consumer-di.md
46
46
  webhook-fundamentals,Webhook Testing Fundamentals,"Why webhook delivery is hard: async, parallel pollution, opaque timeouts, cleanup drift. playwright-utils approach with polling, typed matchers, rich errors, startedAt isolation","webhook,async,playwright-utils,event-driven,eventually-consistent",core,knowledge/webhook-testing-fundamentals.md
@@ -50,3 +50,4 @@ webhook-waiting,Webhook Waiting and Querying,"waitFor, waitForCount, getReceived
50
50
  webhook-timeout-error,WebhookTimeoutError Debugging,"templateName, timeoutMs, totalReceived, receivedWebhooks, matcherDetails, toJSON — inspect what arrived vs what was expected","webhook,debugging,errors,playwright-utils",extended,knowledge/webhook-timeout-error.md
51
51
  webhook-providers,Webhook Provider Patterns,"WireMock (deleteById supported), MockServer (deleteById no-op), Mockoon (deleteById no-op, 100-entry limit), custom WebhookProvider interface","webhook,providers,playwright-utils,wiremock,mockserver,mockoon",extended,knowledge/webhook-providers.md
52
52
  webhook-risk,Webhook Testing Risk Guidance,"When webhook tests are required, P2×I3 default risk score, complete test checklist, failure patterns and mitigations, TA assessment checklist","webhook,risk,assessment,event-driven,async,playwright-utils,governance",core,knowledge/webhook-risk-guidance.md
53
+ confidence-gate,Confidence Gate,"1-10 confidence scoring with stop-and-ask rule below threshold for selectors, endpoints, risk classification, fixtures, schemas, and data factories — prevents agent fabrication","reliability,agent-safety,generation,quality,governance",core,knowledge/confidence-gate.md
@@ -1,4 +1,4 @@
1
- module,skill,display-name,menu-code,description,action,args,phase,after,before,required,output-location,outputs
1
+ module,skill,display-name,menu-code,description,action,args,phase,preceded-by,followed-by,required,output-location,outputs
2
2
  Test Architecture Enterprise,_meta,,,,,,,,,false,https://bmad-code-org.github.io/bmad-method-test-architecture-enterprise/llms.txt,
3
3
  Test Architecture Enterprise,bmad-teach-me-testing,Teach Me Testing,TMT,Teach testing fundamentals through 7 sessions (TEA Academy).,,,0-learning,,,false,test_artifacts,progress file|session notes|certificate
4
4
  Test Architecture Enterprise,bmad-testarch-test-design,Test Design,TD,Risk-based test planning.,,,3-solutioning,,bmad-testarch-framework,false,test_artifacts,test design document
@@ -7,5 +7,5 @@ Test Architecture Enterprise,bmad-testarch-ci,CI Setup,CI,Configure CI/CD qualit
7
7
  Test Architecture Enterprise,bmad-testarch-atdd,ATDD,AT,Generate red-phase acceptance test scaffolds before implementation.,,,4-implementation,bmad-create-story:create,bmad-dev-story,false,test_artifacts,atdd-checklist|red-phase acceptance tests
8
8
  Test Architecture Enterprise,bmad-testarch-automate,Test Automation,TA,Expand test coverage.,,,4-implementation,bmad-testarch-atdd,,false,test_artifacts,test suite
9
9
  Test Architecture Enterprise,bmad-testarch-test-review,Test Review,RV,Quality audit (0-100 scoring).,,,4-implementation,bmad-testarch-automate,,false,test_artifacts,review report
10
- Test Architecture Enterprise,bmad-testarch-nfr,NFR Assessment,NR,Non-functional requirements assessment.,,,4-implementation,bmad-testarch-automate,,false,test_artifacts,nfr report
10
+ Test Architecture Enterprise,bmad-testarch-nfr,NFR Evidence Audit,NR,Audit non-functional requirement evidence.,,,4-implementation,bmad-testarch-automate,,false,test_artifacts,nfr report
11
11
  Test Architecture Enterprise,bmad-testarch-trace,Traceability,TR,Coverage traceability and gate.,,,4-implementation,bmad-testarch-test-review,,false,test_artifacts,traceability matrix|gate decision
@@ -59,14 +59,15 @@ This folder contains the Test Architect (TEA) workflows converted to skill-drive
59
59
 
60
60
  ## TEA Workflows
61
61
 
62
+ - teach-me-testing
62
63
  - test-design
63
- - automate
64
- - atdd
65
- - test-review
66
- - trace
67
64
  - framework
68
65
  - ci
66
+ - atdd
67
+ - automate
68
+ - test-review
69
69
  - nfr-assess
70
+ - trace
70
71
 
71
72
  ## Notes
72
73
 
@@ -107,7 +107,7 @@ roles:
107
107
  session-04-test-design: "Test design makes risk visible to stakeholders"
108
108
  session-05-atdd-automate: "ATDD reduces defect rates early"
109
109
  session-06-quality-trace: "Quality metrics: P0/P1 coverage, not vanity metrics"
110
- session-07-advanced: "Governance patterns, CI orchestration, NFR assessment"
110
+ session-07-advanced: "Governance patterns, CI orchestration, NFR evidence audit"
111
111
 
112
112
  # Role-Based Example Types
113
113
  example_types:
@@ -51,7 +51,7 @@ documentation:
51
51
  online: "/how-to/workflows/run-trace/"
52
52
  workflow: trace
53
53
 
54
- - name: "NFR Assessment"
54
+ - name: "NFR Evidence Audit"
55
55
  local: "/docs/how-to/workflows/run-nfr-assess.md"
56
56
  online: "/how-to/workflows/run-nfr-assess/"
57
57
  workflow: nfr-assess
@@ -95,7 +95,7 @@ Present this content (mostly autonomous, clear and educational):
95
95
 
96
96
  TEA is a comprehensive test architecture framework that provides:
97
97
 
98
- - **9 Workflows:** Teach Me Testing, Framework, Test Design, ATDD, Automate, Test Review, Trace, NFR Assessment, CI
98
+ - **9 Workflows:** Teach Me Testing, Test Design, Framework, CI, ATDD, Automate, Test Review, NFR Evidence Audit, Trace
99
99
  - **35 Knowledge Fragments:** Distilled expertise on patterns, best practices, Playwright Utils
100
100
  - **Quality Standards:** Definition of Done with execution limits (no flaky tests, no hard waits, etc.)
101
101
  - **Risk-Based Testing:** P0-P3 matrix for prioritizing test coverage
@@ -113,7 +113,7 @@ Testing knowledge doesn't scale through manual teaching. TEA makes testing exper
113
113
  1. **TEA Lite (30 min):** Quick start - run Automate workflow, generate tests
114
114
  2. **TEA Solo:** Use workflows individually as needed
115
115
  3. **TEA Integrated:** Full lifecycle - Framework → Test Design → ATDD/Automate → Review → Trace
116
- 4. **TEA Enterprise:** Add NFR Assessment + CI integration for compliance
116
+ 4. **TEA Enterprise:** Add NFR Evidence Audit + CI integration for compliance
117
117
  5. **TEA Brownfield:** Adapt TEA for existing test suites
118
118
 
119
119
  **Today we're experiencing TEA Lite!**"
@@ -118,7 +118,7 @@ Set session-07-advanced `status: 'in-progress'` (only first time).
118
118
  - test-levels-framework.md - Unit/Integration/E2E
119
119
  - test-priorities-matrix.md - P0-P3 coverage targets
120
120
  - probability-impact.md - Probability × impact scoring
121
- - nfr-criteria.md - NFR assessment definitions
121
+ - nfr-criteria.md - NFR evidence audit definitions
122
122
 
123
123
  **5. Authentication & Security (3 fragments)**
124
124
 
@@ -53,7 +53,7 @@ average_score: { { average_score } }
53
53
  - ✅ **Architecture Patterns:** Fixtures, network-first patterns, data factories
54
54
  - ✅ **Test Design:** Risk assessment, coverage planning, P0-P3 prioritization
55
55
  - ✅ **Test Development:** ATDD red-green approach, test automation
56
- - ✅ **Quality Assurance:** Test review, traceability, NFR assessment
56
+ - ✅ **Quality Assurance:** Test review, traceability, NFR evidence audit
57
57
  - ✅ **Advanced Techniques:** 42 knowledge fragments explored
58
58
 
59
59
  ---
@@ -40,7 +40,7 @@ pactjs-utils-request-filter,Pact.js Utils Request Filter,"createRequestFilter, n
40
40
  pact-mcp,Pact MCP Server,"SmartBear MCP for PactFlow: generate tests, review, can-i-deploy, provider states","pact,mcp,pactflow,contract-testing,broker",specialized,knowledge/pact-mcp.md
41
41
  pact-consumer-framework-setup,Pact Consumer CDC Framework Setup,"Directory structure, vitest config with fileParallelism:false + pool:forks + singleFork:true (FFI safety), determinism gate (check-pact-determinism.sh), jq-normalized publishing, 1:1 local/CI parity, PactV4 patterns","pactjs-utils,consumer,contract-testing,pact,ci,framework,setup,vitest,shell-scripts,determinism,jq,pactv4,ffi",specialized,knowledge/pact-consumer-framework-setup.md
42
42
  pact-broker-webhooks,Pact Broker Webhooks,"PactFlow → GitHub repository_dispatch auth via dedicated machine user + classic PAT (repo scope, no expiration) + PactFlow secret; staleness monitoring and PAT rotation runbook","pact,pactflow,broker,webhooks,github,auth,pat,ci,operations,security",specialized,knowledge/pact-broker-webhooks.md
43
- adr-quality-readiness-checklist,ADR Quality Readiness Checklist,"8-category 29-criteria framework for ADR testability and NFR assessment","nfr,testability,adr,quality,assessment,checklist",extended,knowledge/adr-quality-readiness-checklist.md
43
+ adr-quality-readiness-checklist,ADR Quality Readiness Checklist,"8-category 29-criteria framework for ADR testability and NFR evidence audit","nfr,testability,adr,quality,assessment,checklist",extended,knowledge/adr-quality-readiness-checklist.md
44
44
  playwright-cli,Playwright CLI,"Token-efficient CLI for AI coding agents: element refs, sessions, snapshots, trace analysis, debug=cli autonomous investigation","cli,browser,agent,automation,snapshot,trace,debug",core,knowledge/playwright-cli.md
45
45
  pact-consumer-di,Pact Consumer DI Pattern,"Dependency injection pattern for Pact consumer tests — call actual source code instead of raw fetch by injecting mock server URL via optional baseUrl in context type","contract-testing,pact,consumer,dependency-injection,api,backend,architecture",extended,knowledge/pact-consumer-di.md
46
46
  webhook-fundamentals,Webhook Testing Fundamentals,"Why webhook delivery is hard: async, parallel pollution, opaque timeouts, cleanup drift. playwright-utils approach with polling, typed matchers, rich errors, startedAt isolation","webhook,async,playwright-utils,event-driven,eventually-consistent",core,knowledge/webhook-testing-fundamentals.md