siesa-agents 2.1.40 → 2.1.41

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (552) hide show
  1. package/README.md +147 -147
  2. package/bin/install.js +534 -534
  3. package/bin/prepare-publish.js +26 -26
  4. package/bin/restore-folders.js +26 -26
  5. package/bmad/_config/agent-manifest.csv +20 -20
  6. package/bmad/_config/agents/bmb-agent-builder.customize.yaml +41 -41
  7. package/bmad/_config/agents/bmb-module-builder.customize.yaml +41 -41
  8. package/bmad/_config/agents/bmb-workflow-builder.customize.yaml +41 -41
  9. package/bmad/_config/files-manifest.csv +469 -469
  10. package/bmad/_config/ides/claude-code.yaml +6 -6
  11. package/bmad/_config/manifest.yaml +14 -14
  12. package/bmad/_config/task-manifest.csv +6 -6
  13. package/bmad/_config/tool-manifest.csv +1 -1
  14. package/bmad/_config/workflow-manifest.csv +45 -45
  15. package/bmad/_memory/config.yaml +11 -11
  16. package/bmad/bmb/README.md +25 -25
  17. package/bmad/bmb/agents/agent-builder.md +57 -57
  18. package/bmad/bmb/agents/module-builder.md +60 -60
  19. package/bmad/bmb/agents/workflow-builder.md +56 -56
  20. package/bmad/bmb/config.yaml +12 -12
  21. package/bmad/bmb/docs/workflows/architecture.md +220 -220
  22. package/bmad/bmb/docs/workflows/common-workflow-tools.csv +18 -18
  23. package/bmad/bmb/docs/workflows/csv-data-file-standards.md +206 -206
  24. package/bmad/bmb/docs/workflows/intent-vs-prescriptive-spectrum.md +220 -220
  25. package/bmad/bmb/docs/workflows/step-file-rules.md +469 -469
  26. package/bmad/bmb/docs/workflows/templates/step-01-init-continuable-template.md +241 -241
  27. package/bmad/bmb/docs/workflows/templates/step-1b-template.md +223 -223
  28. package/bmad/bmb/docs/workflows/templates/step-file.md +139 -139
  29. package/bmad/bmb/docs/workflows/templates/step-template.md +290 -290
  30. package/bmad/bmb/docs/workflows/templates/workflow-template.md +104 -104
  31. package/bmad/bmb/docs/workflows/templates/workflow.md +58 -58
  32. package/bmad/bmb/docs/workflows/terms.md +97 -97
  33. package/bmad/bmb/reference/agents/simple-examples/README.md +223 -223
  34. package/bmad/bmb/reference/readme.md +3 -3
  35. package/bmad/bmb/reference/workflows/meal-prep-nutrition/data/dietary-restrictions.csv +17 -17
  36. package/bmad/bmb/reference/workflows/meal-prep-nutrition/data/macro-calculator.csv +15 -15
  37. package/bmad/bmb/reference/workflows/meal-prep-nutrition/data/recipe-database.csv +27 -27
  38. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-01-init.md +177 -177
  39. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-01b-continue.md +121 -121
  40. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-02-profile.md +165 -165
  41. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-03-assessment.md +154 -154
  42. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-04-strategy.md +183 -183
  43. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-05-shopping.md +168 -168
  44. package/bmad/bmb/reference/workflows/meal-prep-nutrition/steps/step-06-prep-schedule.md +195 -195
  45. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/assessment-section.md +25 -25
  46. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/nutrition-plan.md +68 -68
  47. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/prep-schedule-section.md +29 -29
  48. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/profile-section.md +47 -47
  49. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/shopping-section.md +37 -37
  50. package/bmad/bmb/reference/workflows/meal-prep-nutrition/templates/strategy-section.md +18 -18
  51. package/bmad/bmb/reference/workflows/meal-prep-nutrition/workflow.md +59 -59
  52. package/bmad/bmb/workflows/agent/data/agent-compilation.md +273 -273
  53. package/bmad/bmb/workflows/agent/data/agent-menu-patterns.md +233 -233
  54. package/bmad/bmb/workflows/agent/data/agent-metadata.md +208 -208
  55. package/bmad/bmb/workflows/agent/data/brainstorm-context.md +146 -146
  56. package/bmad/bmb/workflows/agent/data/communication-presets.csv +61 -61
  57. package/bmad/bmb/workflows/agent/data/critical-actions.md +120 -120
  58. package/bmad/bmb/workflows/agent/data/expert-agent-architecture.md +236 -236
  59. package/bmad/bmb/workflows/agent/data/expert-agent-validation.md +173 -173
  60. package/bmad/bmb/workflows/agent/data/module-agent-validation.md +124 -124
  61. package/bmad/bmb/workflows/agent/data/persona-properties.md +266 -266
  62. package/bmad/bmb/workflows/agent/data/principles-crafting.md +292 -292
  63. package/bmad/bmb/workflows/agent/data/reference/expert-examples/journal-keeper/journal-keeper-sidecar/entries/yy-mm-dd-entry-template.md +16 -16
  64. package/bmad/bmb/workflows/agent/data/reference/module-examples/architect.md +68 -68
  65. package/bmad/bmb/workflows/agent/data/simple-agent-architecture.md +204 -204
  66. package/bmad/bmb/workflows/agent/data/simple-agent-validation.md +132 -132
  67. package/bmad/bmb/workflows/agent/data/understanding-agent-types.md +222 -222
  68. package/bmad/bmb/workflows/agent/steps-c/step-01-brainstorm.md +126 -126
  69. package/bmad/bmb/workflows/agent/steps-c/step-02-discovery.md +168 -168
  70. package/bmad/bmb/workflows/agent/steps-c/step-03-type-metadata.md +294 -294
  71. package/bmad/bmb/workflows/agent/steps-c/step-04-persona.md +210 -210
  72. package/bmad/bmb/workflows/agent/steps-c/step-05-commands-menu.md +176 -176
  73. package/bmad/bmb/workflows/agent/steps-c/step-06-activation.md +275 -275
  74. package/bmad/bmb/workflows/agent/steps-c/step-07a-build-simple.md +185 -185
  75. package/bmad/bmb/workflows/agent/steps-c/step-07b-build-expert.md +201 -201
  76. package/bmad/bmb/workflows/agent/steps-c/step-07c-build-module.md +258 -258
  77. package/bmad/bmb/workflows/agent/steps-c/step-08a-plan-traceability.md +203 -203
  78. package/bmad/bmb/workflows/agent/steps-c/step-08b-metadata-validation.md +135 -135
  79. package/bmad/bmb/workflows/agent/steps-c/step-08c-persona-validation.md +161 -161
  80. package/bmad/bmb/workflows/agent/steps-c/step-08d-menu-validation.md +158 -158
  81. package/bmad/bmb/workflows/agent/steps-c/step-08e-structure-validation.md +306 -306
  82. package/bmad/bmb/workflows/agent/steps-c/step-08f-sidecar-validation.md +462 -462
  83. package/bmad/bmb/workflows/agent/steps-c/step-09-celebrate.md +244 -244
  84. package/bmad/bmb/workflows/agent/steps-e/e-01-load-existing.md +214 -214
  85. package/bmad/bmb/workflows/agent/steps-e/e-02-discover-edits.md +191 -191
  86. package/bmad/bmb/workflows/agent/steps-e/e-03a-validate-metadata.md +78 -78
  87. package/bmad/bmb/workflows/agent/steps-e/e-03b-validate-persona.md +76 -76
  88. package/bmad/bmb/workflows/agent/steps-e/e-03c-validate-menu.md +75 -75
  89. package/bmad/bmb/workflows/agent/steps-e/e-03d-validate-structure.md +75 -75
  90. package/bmad/bmb/workflows/agent/steps-e/e-03e-validate-sidecar.md +78 -78
  91. package/bmad/bmb/workflows/agent/steps-e/e-03f-validation-summary.md +119 -119
  92. package/bmad/bmb/workflows/agent/steps-e/e-04-type-metadata.md +122 -122
  93. package/bmad/bmb/workflows/agent/steps-e/e-05-persona.md +132 -132
  94. package/bmad/bmb/workflows/agent/steps-e/e-06-commands-menu.md +120 -120
  95. package/bmad/bmb/workflows/agent/steps-e/e-07-activation.md +122 -122
  96. package/bmad/bmb/workflows/agent/steps-e/e-08a-edit-simple.md +134 -134
  97. package/bmad/bmb/workflows/agent/steps-e/e-08b-edit-expert.md +117 -117
  98. package/bmad/bmb/workflows/agent/steps-e/e-08c-edit-module.md +120 -120
  99. package/bmad/bmb/workflows/agent/steps-e/e-09a-validate-metadata.md +70 -70
  100. package/bmad/bmb/workflows/agent/steps-e/e-09b-validate-persona.md +70 -70
  101. package/bmad/bmb/workflows/agent/steps-e/e-09c-validate-menu.md +69 -69
  102. package/bmad/bmb/workflows/agent/steps-e/e-09d-validate-structure.md +69 -69
  103. package/bmad/bmb/workflows/agent/steps-e/e-09e-validate-sidecar.md +70 -70
  104. package/bmad/bmb/workflows/agent/steps-e/e-09f-validation-summary.md +111 -111
  105. package/bmad/bmb/workflows/agent/steps-e/e-10-celebrate.md +150 -150
  106. package/bmad/bmb/workflows/agent/steps-v/v-01-load-review.md +128 -128
  107. package/bmad/bmb/workflows/agent/steps-v/v-02a-validate-metadata.md +73 -73
  108. package/bmad/bmb/workflows/agent/steps-v/v-02b-validate-persona.md +72 -72
  109. package/bmad/bmb/workflows/agent/steps-v/v-02c-validate-menu.md +71 -71
  110. package/bmad/bmb/workflows/agent/steps-v/v-02d-validate-structure.md +71 -71
  111. package/bmad/bmb/workflows/agent/steps-v/v-02e-validate-sidecar.md +76 -76
  112. package/bmad/bmb/workflows/agent/steps-v/v-03-summary.md +100 -100
  113. package/bmad/bmb/workflows/agent/templates/agent-plan.template.md +5 -5
  114. package/bmad/bmb/workflows/agent/templates/expert-agent-template/expert-agent.template.md +76 -76
  115. package/bmad/bmb/workflows/agent/templates/simple-agent.template.md +71 -71
  116. package/bmad/bmb/workflows/agent/workflow.md +123 -123
  117. package/bmad/bmb/workflows/create-module/steps/step-01-init.md +156 -156
  118. package/bmad/bmb/workflows/create-module/steps/step-01b-continue.md +170 -170
  119. package/bmad/bmb/workflows/create-module/steps/step-02-concept.md +218 -218
  120. package/bmad/bmb/workflows/create-module/steps/step-03-components.md +268 -268
  121. package/bmad/bmb/workflows/create-module/steps/step-04-structure.md +229 -229
  122. package/bmad/bmb/workflows/create-module/steps/step-05-config.md +234 -234
  123. package/bmad/bmb/workflows/create-module/steps/step-06-agents.md +297 -297
  124. package/bmad/bmb/workflows/create-module/steps/step-07-workflows.md +229 -229
  125. package/bmad/bmb/workflows/create-module/steps/step-08-installer.md +187 -187
  126. package/bmad/bmb/workflows/create-module/steps/step-09-documentation.md +310 -310
  127. package/bmad/bmb/workflows/create-module/steps/step-10-roadmap.md +338 -338
  128. package/bmad/bmb/workflows/create-module/steps/step-11-validate.md +336 -336
  129. package/bmad/bmb/workflows/create-module/templates/agent.template.md +313 -313
  130. package/bmad/bmb/workflows/create-module/templates/installer.template.js +47 -47
  131. package/bmad/bmb/workflows/create-module/templates/module-plan.template.md +5 -5
  132. package/bmad/bmb/workflows/create-module/templates/module.template.yaml +53 -53
  133. package/bmad/bmb/workflows/create-module/templates/workflow-plan-template.md +23 -23
  134. package/bmad/bmb/workflows/create-module/validation.md +126 -126
  135. package/bmad/bmb/workflows/create-module/workflow.md +56 -56
  136. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/data/dietary-restrictions.csv +17 -17
  137. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/data/macro-calculator.csv +15 -15
  138. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/data/recipe-database.csv +27 -27
  139. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-01-init.md +177 -177
  140. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-01b-continue.md +150 -150
  141. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-02-profile.md +164 -164
  142. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-03-assessment.md +152 -152
  143. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-04-strategy.md +182 -182
  144. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-05-shopping.md +167 -167
  145. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/steps/step-06-prep-schedule.md +194 -194
  146. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/assessment-section.md +25 -25
  147. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/nutrition-plan.md +68 -68
  148. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/prep-schedule-section.md +29 -29
  149. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/profile-section.md +47 -47
  150. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/shopping-section.md +37 -37
  151. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/templates/strategy-section.md +18 -18
  152. package/bmad/bmb/workflows/create-workflow/data/examples/meal-prep-nutrition/workflow.md +58 -58
  153. package/bmad/bmb/workflows/create-workflow/steps/step-01-init.md +158 -158
  154. package/bmad/bmb/workflows/create-workflow/steps/step-02-gather.md +212 -212
  155. package/bmad/bmb/workflows/create-workflow/steps/step-03-tools-configuration.md +251 -251
  156. package/bmad/bmb/workflows/create-workflow/steps/step-04-plan-review.md +217 -217
  157. package/bmad/bmb/workflows/create-workflow/steps/step-05-output-format-design.md +290 -290
  158. package/bmad/bmb/workflows/create-workflow/steps/step-06-design.md +272 -272
  159. package/bmad/bmb/workflows/create-workflow/steps/step-07-build.md +323 -323
  160. package/bmad/bmb/workflows/create-workflow/steps/step-08-review.md +285 -285
  161. package/bmad/bmb/workflows/create-workflow/steps/step-09-complete.md +188 -188
  162. package/bmad/bmb/workflows/create-workflow/workflow.md +59 -59
  163. package/bmad/bmb/workflows/edit-workflow/steps/step-01-analyze.md +217 -217
  164. package/bmad/bmb/workflows/edit-workflow/steps/step-02-discover.md +254 -254
  165. package/bmad/bmb/workflows/edit-workflow/steps/step-03-improve.md +218 -218
  166. package/bmad/bmb/workflows/edit-workflow/steps/step-04-validate.md +194 -194
  167. package/bmad/bmb/workflows/edit-workflow/steps/step-05-compliance-check.md +246 -246
  168. package/bmad/bmb/workflows/edit-workflow/templates/completion-summary.md +75 -75
  169. package/bmad/bmb/workflows/edit-workflow/templates/improvement-goals.md +68 -68
  170. package/bmad/bmb/workflows/edit-workflow/templates/improvement-log.md +40 -40
  171. package/bmad/bmb/workflows/edit-workflow/templates/validation-results.md +51 -51
  172. package/bmad/bmb/workflows/edit-workflow/templates/workflow-analysis.md +56 -56
  173. package/bmad/bmb/workflows/edit-workflow/workflow.md +59 -59
  174. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-01-validate-goal.md +153 -153
  175. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-02-workflow-validation.md +244 -244
  176. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-03-step-validation.md +275 -275
  177. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-04-file-validation.md +296 -296
  178. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-05-intent-spectrum-validation.md +265 -265
  179. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-06-web-subprocess-validation.md +361 -361
  180. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-07-holistic-analysis.md +259 -259
  181. package/bmad/bmb/workflows/workflow-compliance-check/steps/step-08-generate-report.md +302 -302
  182. package/bmad/bmb/workflows/workflow-compliance-check/templates/compliance-report.md +140 -140
  183. package/bmad/bmb/workflows/workflow-compliance-check/workflow.md +59 -59
  184. package/bmad/bmb/workflows-legacy/edit-module/README.md +171 -171
  185. package/bmad/bmb/workflows-legacy/edit-module/checklist.md +163 -163
  186. package/bmad/bmb/workflows-legacy/edit-module/instructions.md +340 -340
  187. package/bmad/bmb/workflows-legacy/edit-module/workflow.yaml +32 -32
  188. package/bmad/bmb/workflows-legacy/module-brief/README.md +264 -264
  189. package/bmad/bmb/workflows-legacy/module-brief/checklist.md +116 -116
  190. package/bmad/bmb/workflows-legacy/module-brief/instructions.md +268 -268
  191. package/bmad/bmb/workflows-legacy/module-brief/template.md +275 -275
  192. package/bmad/bmb/workflows-legacy/module-brief/workflow.yaml +34 -34
  193. package/bmad/bmm/agents/analyst.md +76 -76
  194. package/bmad/bmm/agents/architect.md +68 -68
  195. package/bmad/bmm/agents/dev.md +70 -70
  196. package/bmad/bmm/agents/pm.md +70 -70
  197. package/bmad/bmm/agents/quick-flow-solo-dev.md +68 -68
  198. package/bmad/bmm/agents/sm.md +71 -71
  199. package/bmad/bmm/agents/tea.md +71 -71
  200. package/bmad/bmm/agents/tech-writer.md +72 -72
  201. package/bmad/bmm/agents/ux-designer.md +68 -68
  202. package/bmad/bmm/config.yaml +18 -18
  203. package/bmad/bmm/data/README.md +29 -29
  204. package/bmad/bmm/data/documentation-standards.md +262 -262
  205. package/bmad/bmm/data/project-context-template.md +40 -40
  206. package/bmad/bmm/teams/default-party.csv +21 -21
  207. package/bmad/bmm/teams/team-fullstack.yaml +12 -12
  208. package/bmad/bmm/testarch/knowledge/api-request.md +303 -303
  209. package/bmad/bmm/testarch/knowledge/auth-session.md +356 -356
  210. package/bmad/bmm/testarch/knowledge/burn-in.md +273 -273
  211. package/bmad/bmm/testarch/knowledge/ci-burn-in.md +675 -675
  212. package/bmad/bmm/testarch/knowledge/component-tdd.md +486 -486
  213. package/bmad/bmm/testarch/knowledge/contract-testing.md +957 -957
  214. package/bmad/bmm/testarch/knowledge/data-factories.md +500 -500
  215. package/bmad/bmm/testarch/knowledge/email-auth.md +721 -721
  216. package/bmad/bmm/testarch/knowledge/error-handling.md +725 -725
  217. package/bmad/bmm/testarch/knowledge/feature-flags.md +750 -750
  218. package/bmad/bmm/testarch/knowledge/file-utils.md +260 -260
  219. package/bmad/bmm/testarch/knowledge/fixture-architecture.md +401 -401
  220. package/bmad/bmm/testarch/knowledge/fixtures-composition.md +382 -382
  221. package/bmad/bmm/testarch/knowledge/intercept-network-call.md +280 -280
  222. package/bmad/bmm/testarch/knowledge/log.md +294 -294
  223. package/bmad/bmm/testarch/knowledge/network-error-monitor.md +272 -272
  224. package/bmad/bmm/testarch/knowledge/network-first.md +486 -486
  225. package/bmad/bmm/testarch/knowledge/network-recorder.md +265 -265
  226. package/bmad/bmm/testarch/knowledge/nfr-criteria.md +670 -670
  227. package/bmad/bmm/testarch/knowledge/overview.md +283 -283
  228. package/bmad/bmm/testarch/knowledge/playwright-config.md +730 -730
  229. package/bmad/bmm/testarch/knowledge/probability-impact.md +601 -601
  230. package/bmad/bmm/testarch/knowledge/recurse.md +296 -296
  231. package/bmad/bmm/testarch/knowledge/risk-governance.md +615 -615
  232. package/bmad/bmm/testarch/knowledge/selective-testing.md +732 -732
  233. package/bmad/bmm/testarch/knowledge/selector-resilience.md +527 -527
  234. package/bmad/bmm/testarch/knowledge/test-healing-patterns.md +644 -644
  235. package/bmad/bmm/testarch/knowledge/test-levels-framework.md +473 -473
  236. package/bmad/bmm/testarch/knowledge/test-priorities-matrix.md +373 -373
  237. package/bmad/bmm/testarch/knowledge/test-quality.md +664 -664
  238. package/bmad/bmm/testarch/knowledge/timing-debugging.md +372 -372
  239. package/bmad/bmm/testarch/knowledge/visual-debugging.md +524 -524
  240. package/bmad/bmm/testarch/tea-index.csv +33 -33
  241. package/bmad/bmm/workflows/1-analysis/create-product-brief/product-brief.template.md +10 -10
  242. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-01-init.md +182 -182
  243. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-01b-continue.md +166 -166
  244. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-02-vision.md +204 -204
  245. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-03-users.md +207 -207
  246. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-04-metrics.md +210 -210
  247. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-05-scope.md +224 -224
  248. package/bmad/bmm/workflows/1-analysis/create-product-brief/steps/step-06-complete.md +199 -199
  249. package/bmad/bmm/workflows/1-analysis/create-product-brief/workflow.md +58 -58
  250. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-01-init.md +137 -137
  251. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-02-domain-analysis.md +229 -229
  252. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-03-competitive-landscape.md +238 -238
  253. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-04-regulatory-focus.md +206 -206
  254. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-05-technical-trends.md +234 -234
  255. package/bmad/bmm/workflows/1-analysis/research/domain-steps/step-06-research-synthesis.md +443 -443
  256. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-01-init.md +182 -182
  257. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-02-customer-behavior.md +237 -237
  258. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-02-customer-insights.md +200 -200
  259. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-03-customer-pain-points.md +249 -249
  260. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-04-customer-decisions.md +259 -259
  261. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-05-competitive-analysis.md +177 -177
  262. package/bmad/bmm/workflows/1-analysis/research/market-steps/step-06-research-completion.md +475 -475
  263. package/bmad/bmm/workflows/1-analysis/research/research.template.md +29 -29
  264. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-01-init.md +137 -137
  265. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-02-technical-overview.md +239 -239
  266. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-03-integration-patterns.md +248 -248
  267. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-04-architectural-patterns.md +202 -202
  268. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-05-implementation-research.md +239 -239
  269. package/bmad/bmm/workflows/1-analysis/research/technical-steps/step-06-research-synthesis.md +486 -486
  270. package/bmad/bmm/workflows/1-analysis/research/workflow.md +173 -173
  271. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-01-init.md +135 -135
  272. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-01b-continue.md +127 -127
  273. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-02-discovery.md +190 -190
  274. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-03-core-experience.md +216 -216
  275. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-04-emotional-response.md +219 -219
  276. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-05-inspiration.md +234 -234
  277. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-06-design-system.md +252 -252
  278. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-07-defining-experience.md +254 -254
  279. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-08-visual-foundation.md +224 -224
  280. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-09-design-directions.md +224 -224
  281. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-10-user-journeys.md +241 -241
  282. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-11-component-strategy.md +248 -248
  283. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-12-ux-patterns.md +237 -237
  284. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-13-responsive-accessibility.md +264 -264
  285. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/steps/step-14-complete.md +228 -228
  286. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/ux-design-template.md +13 -13
  287. package/bmad/bmm/workflows/2-plan-workflows/create-ux-design/workflow.md +43 -43
  288. package/bmad/bmm/workflows/2-plan-workflows/prd/domain-complexity.csv +12 -12
  289. package/bmad/bmm/workflows/2-plan-workflows/prd/prd-template.md +11 -11
  290. package/bmad/bmm/workflows/2-plan-workflows/prd/project-types.csv +10 -10
  291. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-01-init.md +197 -197
  292. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-01b-continue.md +166 -166
  293. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-02-discovery.md +421 -421
  294. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-03-success.md +290 -290
  295. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-04-journeys.md +291 -291
  296. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-05-domain.md +271 -271
  297. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-06-innovation.md +262 -262
  298. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-07-project-type.md +258 -258
  299. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-08-scoping.md +299 -299
  300. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-09-functional.md +270 -270
  301. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-10-nonfunctional.md +294 -294
  302. package/bmad/bmm/workflows/2-plan-workflows/prd/steps/step-11-complete.md +186 -186
  303. package/bmad/bmm/workflows/2-plan-workflows/prd/workflow.md +63 -63
  304. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-01-document-discovery.md +190 -190
  305. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-02-prd-analysis.md +178 -178
  306. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-03-epic-coverage-validation.md +179 -179
  307. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-04-ux-alignment.md +139 -139
  308. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-05-epic-quality-review.md +252 -252
  309. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/steps/step-06-final-assessment.md +133 -133
  310. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/templates/readiness-report-template.md +4 -4
  311. package/bmad/bmm/workflows/3-solutioning/check-implementation-readiness/workflow.md +55 -55
  312. package/bmad/bmm/workflows/3-solutioning/create-architecture/architecture-decision-template.md +12 -12
  313. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/company-standards/architecture-patterns.md +415 -415
  314. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/company-standards/backend-standards.md +811 -811
  315. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/company-standards/frontend-standards.md +375 -375
  316. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/company-standards/technical-preferences-ux.md +422 -422
  317. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/company-standards/technology-stack.md +235 -235
  318. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/domain-complexity.csv +10 -10
  319. package/bmad/bmm/workflows/3-solutioning/create-architecture/data/project-types.csv +6 -6
  320. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-01-init.md +166 -166
  321. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-01b-continue.md +164 -164
  322. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-02-context.md +224 -224
  323. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-03-starter.md +342 -342
  324. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-04-decisions.md +328 -328
  325. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-05-patterns.md +368 -368
  326. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-06-structure.md +379 -379
  327. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-07-validation.md +366 -366
  328. package/bmad/bmm/workflows/3-solutioning/create-architecture/steps/step-08-complete.md +352 -352
  329. package/bmad/bmm/workflows/3-solutioning/create-architecture/workflow.md +51 -51
  330. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/steps/step-01-validate-prerequisites.md +259 -259
  331. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/steps/step-02-design-epics.md +233 -233
  332. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/steps/step-03-create-stories.md +272 -272
  333. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/steps/step-04-final-validation.md +145 -145
  334. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/templates/epics-template.md +57 -57
  335. package/bmad/bmm/workflows/3-solutioning/create-epics-and-stories/workflow.md +59 -59
  336. package/bmad/bmm/workflows/4-implementation/code-review/checklist.md +23 -23
  337. package/bmad/bmm/workflows/4-implementation/code-review/instructions.xml +224 -224
  338. package/bmad/bmm/workflows/4-implementation/code-review/workflow.yaml +49 -49
  339. package/bmad/bmm/workflows/4-implementation/correct-course/checklist.md +279 -279
  340. package/bmad/bmm/workflows/4-implementation/correct-course/instructions.md +206 -206
  341. package/bmad/bmm/workflows/4-implementation/correct-course/workflow.yaml +58 -58
  342. package/bmad/bmm/workflows/4-implementation/create-story/checklist.md +358 -358
  343. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-01-determine-story.md +85 -85
  344. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-02-analyze.md +67 -67
  345. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-03-architecture.md +71 -71
  346. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-04-web-research.md +58 -58
  347. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-05-create-file.md +76 -76
  348. package/bmad/bmm/workflows/4-implementation/create-story/steps/step-06-finalize.md +66 -66
  349. package/bmad/bmm/workflows/4-implementation/create-story/template.md +49 -49
  350. package/bmad/bmm/workflows/4-implementation/create-story/workflow.md +58 -58
  351. package/bmad/bmm/workflows/4-implementation/create-story/workflow.yaml.bak +63 -63
  352. package/bmad/bmm/workflows/4-implementation/dev-story/checklist.md +85 -85
  353. package/bmad/bmm/workflows/4-implementation/dev-story/instructions.xml +470 -470
  354. package/bmad/bmm/workflows/4-implementation/dev-story/workflow.yaml +25 -25
  355. package/bmad/bmm/workflows/4-implementation/retrospective/instructions.md +1443 -1443
  356. package/bmad/bmm/workflows/4-implementation/retrospective/workflow.yaml +56 -56
  357. package/bmad/bmm/workflows/4-implementation/sprint-planning/checklist.md +33 -33
  358. package/bmad/bmm/workflows/4-implementation/sprint-planning/instructions.md +225 -225
  359. package/bmad/bmm/workflows/4-implementation/sprint-planning/sprint-status-template.yaml +55 -55
  360. package/bmad/bmm/workflows/4-implementation/sprint-planning/workflow.yaml +52 -52
  361. package/bmad/bmm/workflows/4-implementation/sprint-status/instructions.md +229 -229
  362. package/bmad/bmm/workflows/4-implementation/sprint-status/workflow.yaml +34 -34
  363. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/steps/step-01-understand.md +189 -189
  364. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/steps/step-02-investigate.md +144 -144
  365. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/steps/step-03-generate.md +128 -128
  366. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/steps/step-04-review.md +173 -173
  367. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/tech-spec-template.md +74 -74
  368. package/bmad/bmm/workflows/bmad-quick-flow/create-tech-spec/workflow.md +79 -79
  369. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-01-mode-detection.md +156 -156
  370. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-02-context-gathering.md +120 -120
  371. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-03-execute.md +113 -113
  372. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-04-self-check.md +113 -113
  373. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-05-adversarial-review.md +106 -106
  374. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/steps/step-06-resolve-findings.md +140 -140
  375. package/bmad/bmm/workflows/bmad-quick-flow/quick-dev/workflow.md +52 -52
  376. package/bmad/bmm/workflows/document-project/checklist.md +245 -245
  377. package/bmad/bmm/workflows/document-project/documentation-requirements.csv +12 -12
  378. package/bmad/bmm/workflows/document-project/instructions.md +221 -221
  379. package/bmad/bmm/workflows/document-project/templates/deep-dive-template.md +345 -345
  380. package/bmad/bmm/workflows/document-project/templates/index-template.md +169 -169
  381. package/bmad/bmm/workflows/document-project/templates/project-overview-template.md +103 -103
  382. package/bmad/bmm/workflows/document-project/templates/project-scan-report-schema.json +160 -160
  383. package/bmad/bmm/workflows/document-project/templates/source-tree-template.md +135 -135
  384. package/bmad/bmm/workflows/document-project/workflow.yaml +28 -28
  385. package/bmad/bmm/workflows/document-project/workflows/deep-dive-instructions.md +298 -298
  386. package/bmad/bmm/workflows/document-project/workflows/deep-dive.yaml +31 -31
  387. package/bmad/bmm/workflows/document-project/workflows/full-scan-instructions.md +1106 -1106
  388. package/bmad/bmm/workflows/document-project/workflows/full-scan.yaml +31 -31
  389. package/bmad/bmm/workflows/excalidraw-diagrams/_shared/excalidraw-library.json +90 -90
  390. package/bmad/bmm/workflows/excalidraw-diagrams/_shared/excalidraw-templates.yaml +127 -127
  391. package/bmad/bmm/workflows/excalidraw-diagrams/create-dataflow/checklist.md +39 -39
  392. package/bmad/bmm/workflows/excalidraw-diagrams/create-dataflow/instructions.md +130 -130
  393. package/bmad/bmm/workflows/excalidraw-diagrams/create-dataflow/workflow.yaml +25 -25
  394. package/bmad/bmm/workflows/excalidraw-diagrams/create-diagram/checklist.md +43 -43
  395. package/bmad/bmm/workflows/excalidraw-diagrams/create-diagram/instructions.md +141 -141
  396. package/bmad/bmm/workflows/excalidraw-diagrams/create-diagram/workflow.yaml +25 -25
  397. package/bmad/bmm/workflows/excalidraw-diagrams/create-flowchart/checklist.md +49 -49
  398. package/bmad/bmm/workflows/excalidraw-diagrams/create-flowchart/instructions.md +241 -241
  399. package/bmad/bmm/workflows/excalidraw-diagrams/create-flowchart/workflow.yaml +25 -25
  400. package/bmad/bmm/workflows/excalidraw-diagrams/create-wireframe/checklist.md +38 -38
  401. package/bmad/bmm/workflows/excalidraw-diagrams/create-wireframe/instructions.md +133 -133
  402. package/bmad/bmm/workflows/excalidraw-diagrams/create-wireframe/workflow.yaml +25 -25
  403. package/bmad/bmm/workflows/generate-project-context/project-context-template.md +21 -21
  404. package/bmad/bmm/workflows/generate-project-context/steps/step-01-discover.md +218 -218
  405. package/bmad/bmm/workflows/generate-project-context/steps/step-02-generate.md +318 -318
  406. package/bmad/bmm/workflows/generate-project-context/steps/step-03-complete.md +278 -278
  407. package/bmad/bmm/workflows/generate-project-context/workflow.md +50 -50
  408. package/bmad/bmm/workflows/testarch/atdd/atdd-checklist-template.md +364 -364
  409. package/bmad/bmm/workflows/testarch/atdd/checklist.md +374 -374
  410. package/bmad/bmm/workflows/testarch/atdd/instructions.md +806 -806
  411. package/bmad/bmm/workflows/testarch/atdd/workflow.yaml +45 -45
  412. package/bmad/bmm/workflows/testarch/automate/checklist.md +582 -582
  413. package/bmad/bmm/workflows/testarch/automate/instructions.md +1324 -1324
  414. package/bmad/bmm/workflows/testarch/automate/workflow.yaml +52 -52
  415. package/bmad/bmm/workflows/testarch/ci/checklist.md +248 -248
  416. package/bmad/bmm/workflows/testarch/ci/github-actions-template.yaml +198 -198
  417. package/bmad/bmm/workflows/testarch/ci/gitlab-ci-template.yaml +149 -149
  418. package/bmad/bmm/workflows/testarch/ci/instructions.md +536 -536
  419. package/bmad/bmm/workflows/testarch/ci/workflow.yaml +45 -45
  420. package/bmad/bmm/workflows/testarch/framework/checklist.md +321 -321
  421. package/bmad/bmm/workflows/testarch/framework/instructions.md +481 -481
  422. package/bmad/bmm/workflows/testarch/framework/workflow.yaml +47 -47
  423. package/bmad/bmm/workflows/testarch/nfr-assess/checklist.md +407 -407
  424. package/bmad/bmm/workflows/testarch/nfr-assess/instructions.md +722 -722
  425. package/bmad/bmm/workflows/testarch/nfr-assess/nfr-report-template.md +445 -445
  426. package/bmad/bmm/workflows/testarch/nfr-assess/workflow.yaml +47 -47
  427. package/bmad/bmm/workflows/testarch/test-design/checklist.md +235 -235
  428. package/bmad/bmm/workflows/testarch/test-design/instructions.md +788 -788
  429. package/bmad/bmm/workflows/testarch/test-design/test-design-template.md +294 -294
  430. package/bmad/bmm/workflows/testarch/test-design/workflow.yaml +54 -54
  431. package/bmad/bmm/workflows/testarch/test-review/checklist.md +472 -472
  432. package/bmad/bmm/workflows/testarch/test-review/instructions.md +628 -628
  433. package/bmad/bmm/workflows/testarch/test-review/test-review-template.md +390 -390
  434. package/bmad/bmm/workflows/testarch/test-review/workflow.yaml +46 -46
  435. package/bmad/bmm/workflows/testarch/trace/checklist.md +655 -655
  436. package/bmad/bmm/workflows/testarch/trace/instructions.md +1047 -1047
  437. package/bmad/bmm/workflows/testarch/trace/trace-template.md +675 -675
  438. package/bmad/bmm/workflows/testarch/trace/workflow.yaml +55 -55
  439. package/bmad/bmm/workflows/workflow-status/init/instructions.md +346 -346
  440. package/bmad/bmm/workflows/workflow-status/init/workflow.yaml +28 -28
  441. package/bmad/bmm/workflows/workflow-status/instructions.md +395 -395
  442. package/bmad/bmm/workflows/workflow-status/paths/enterprise-brownfield.yaml +103 -103
  443. package/bmad/bmm/workflows/workflow-status/paths/enterprise-greenfield.yaml +100 -100
  444. package/bmad/bmm/workflows/workflow-status/paths/method-brownfield.yaml +103 -103
  445. package/bmad/bmm/workflows/workflow-status/paths/method-greenfield.yaml +100 -100
  446. package/bmad/bmm/workflows/workflow-status/project-levels.yaml +59 -59
  447. package/bmad/bmm/workflows/workflow-status/workflow-status-template.yaml +24 -24
  448. package/bmad/bmm/workflows/workflow-status/workflow.yaml +30 -30
  449. package/bmad/cis/agents/brainstorming-coach.md +60 -60
  450. package/bmad/cis/agents/creative-problem-solver.md +60 -60
  451. package/bmad/cis/agents/design-thinking-coach.md +60 -60
  452. package/bmad/cis/agents/innovation-strategist.md +60 -60
  453. package/bmad/cis/agents/presentation-master.md +66 -66
  454. package/bmad/cis/agents/storyteller/storyteller.md +57 -57
  455. package/bmad/cis/config.yaml +11 -11
  456. package/bmad/cis/teams/creative-squad.yaml +7 -7
  457. package/bmad/cis/teams/default-party.csv +12 -12
  458. package/bmad/cis/workflows/README.md +139 -139
  459. package/bmad/cis/workflows/design-thinking/README.md +56 -56
  460. package/bmad/cis/workflows/design-thinking/design-methods.csv +30 -30
  461. package/bmad/cis/workflows/design-thinking/instructions.md +202 -202
  462. package/bmad/cis/workflows/design-thinking/template.md +111 -111
  463. package/bmad/cis/workflows/design-thinking/workflow.yaml +27 -27
  464. package/bmad/cis/workflows/innovation-strategy/README.md +56 -56
  465. package/bmad/cis/workflows/innovation-strategy/innovation-frameworks.csv +30 -30
  466. package/bmad/cis/workflows/innovation-strategy/instructions.md +276 -276
  467. package/bmad/cis/workflows/innovation-strategy/template.md +189 -189
  468. package/bmad/cis/workflows/innovation-strategy/workflow.yaml +27 -27
  469. package/bmad/cis/workflows/problem-solving/README.md +56 -56
  470. package/bmad/cis/workflows/problem-solving/instructions.md +252 -252
  471. package/bmad/cis/workflows/problem-solving/solving-methods.csv +30 -30
  472. package/bmad/cis/workflows/problem-solving/template.md +165 -165
  473. package/bmad/cis/workflows/problem-solving/workflow.yaml +27 -27
  474. package/bmad/cis/workflows/storytelling/README.md +58 -58
  475. package/bmad/cis/workflows/storytelling/instructions.md +293 -293
  476. package/bmad/cis/workflows/storytelling/story-types.csv +25 -25
  477. package/bmad/cis/workflows/storytelling/template.md +113 -113
  478. package/bmad/cis/workflows/storytelling/workflow.yaml +27 -27
  479. package/bmad/core/agents/bmad-master.md +57 -57
  480. package/bmad/core/config.yaml +9 -9
  481. package/bmad/core/resources/excalidraw/README.md +160 -160
  482. package/bmad/core/resources/excalidraw/excalidraw-helpers.md +127 -127
  483. package/bmad/core/resources/excalidraw/library-loader.md +50 -50
  484. package/bmad/core/resources/excalidraw/validate-json-instructions.md +79 -79
  485. package/bmad/core/tasks/index-docs.xml +64 -64
  486. package/bmad/core/tasks/review-adversarial-general.xml +41 -41
  487. package/bmad/core/tasks/shard-doc.xml +108 -108
  488. package/bmad/core/tasks/validate-workflow.xml +88 -88
  489. package/bmad/core/tasks/workflow.xml +234 -234
  490. package/bmad/core/workflows/advanced-elicitation/methods.csv +51 -51
  491. package/bmad/core/workflows/advanced-elicitation/workflow.xml +116 -116
  492. package/bmad/core/workflows/brainstorming/brain-methods.csv +61 -61
  493. package/bmad/core/workflows/brainstorming/steps/step-01-session-setup.md +197 -197
  494. package/bmad/core/workflows/brainstorming/steps/step-01b-continue.md +122 -122
  495. package/bmad/core/workflows/brainstorming/steps/step-02a-user-selected.md +225 -225
  496. package/bmad/core/workflows/brainstorming/steps/step-02b-ai-recommended.md +237 -237
  497. package/bmad/core/workflows/brainstorming/steps/step-02c-random-selection.md +209 -209
  498. package/bmad/core/workflows/brainstorming/steps/step-02d-progressive-flow.md +264 -264
  499. package/bmad/core/workflows/brainstorming/steps/step-03-technique-execution.md +340 -340
  500. package/bmad/core/workflows/brainstorming/steps/step-04-idea-organization.md +303 -303
  501. package/bmad/core/workflows/brainstorming/template.md +15 -15
  502. package/bmad/core/workflows/brainstorming/workflow.md +51 -51
  503. package/bmad/core/workflows/party-mode/steps/step-01-agent-loading.md +139 -139
  504. package/bmad/core/workflows/party-mode/steps/step-02-discussion-orchestration.md +204 -204
  505. package/bmad/core/workflows/party-mode/steps/step-03-graceful-exit.md +159 -159
  506. package/bmad/core/workflows/party-mode/workflow.md +206 -206
  507. package/claude/hooks/file-restriction-hook.py +51 -51
  508. package/claude/hooks/track-agent.py +67 -67
  509. package/claude/settings.local.json +76 -76
  510. package/gemini/commands/BMad/agents/analyst.toml +6 -0
  511. package/gemini/commands/BMad/agents/architect.toml +6 -0
  512. package/gemini/commands/BMad/agents/bmad-master.toml +6 -0
  513. package/gemini/commands/BMad/agents/bmad-orchestrator.toml +6 -0
  514. package/gemini/commands/BMad/agents/dev.toml +6 -0
  515. package/gemini/commands/BMad/agents/pm.toml +6 -0
  516. package/gemini/commands/BMad/agents/po.toml +6 -0
  517. package/gemini/commands/BMad/agents/qa.toml +6 -0
  518. package/gemini/commands/BMad/agents/sm.toml +6 -0
  519. package/gemini/commands/BMad/agents/ux-expert.toml +6 -0
  520. package/gemini/commands/BMad/tasks/advanced-elicitation.toml +6 -0
  521. package/gemini/commands/BMad/tasks/apply-qa-fixes.toml +6 -0
  522. package/gemini/commands/BMad/tasks/brownfield-create-epic.toml +6 -0
  523. package/gemini/commands/BMad/tasks/brownfield-create-story.toml +6 -0
  524. package/gemini/commands/BMad/tasks/correct-course.toml +6 -0
  525. package/gemini/commands/BMad/tasks/create-brownfield-story.toml +6 -0
  526. package/gemini/commands/BMad/tasks/create-deep-research-prompt.toml +6 -0
  527. package/gemini/commands/BMad/tasks/create-doc.toml +6 -0
  528. package/gemini/commands/BMad/tasks/create-next-story.toml +6 -0
  529. package/gemini/commands/BMad/tasks/document-project.toml +6 -0
  530. package/gemini/commands/BMad/tasks/execute-checklist.toml +6 -0
  531. package/gemini/commands/BMad/tasks/facilitate-brainstorming-session.toml +6 -0
  532. package/gemini/commands/BMad/tasks/generate-ai-frontend-prompt.toml +6 -0
  533. package/gemini/commands/BMad/tasks/index-docs.toml +6 -0
  534. package/gemini/commands/BMad/tasks/kb-mode-interaction.toml +6 -0
  535. package/gemini/commands/BMad/tasks/nfr-assess.toml +6 -0
  536. package/gemini/commands/BMad/tasks/qa-gate.toml +6 -0
  537. package/gemini/commands/BMad/tasks/review-story.toml +6 -0
  538. package/gemini/commands/BMad/tasks/risk-profile.toml +6 -0
  539. package/gemini/commands/BMad/tasks/shard-doc.toml +6 -0
  540. package/gemini/commands/BMad/tasks/test-design.toml +6 -0
  541. package/gemini/commands/BMad/tasks/trace-requirements.toml +6 -0
  542. package/gemini/commands/BMad/tasks/validate-next-story.toml +6 -0
  543. package/github/workflows/publish.yml +150 -150
  544. package/index.js +9 -9
  545. package/mcp.json +14 -14
  546. package/package.json +41 -40
  547. package/resources/images/Siesa_Logosimbolo_Azul.svg +24 -24
  548. package/resources/images/Siesa_Logosimbolo_Blanco.svg +24 -24
  549. package/resources/images/Siesa_Simbolo_Azul.svg +14 -14
  550. package/resources/images/Siesa_Simbolo_Blanco.svg +14 -14
  551. package/vscode/mcp.json +15 -15
  552. package/vscode/settings.json +12 -12
@@ -1,670 +1,670 @@
1
- # Non-Functional Requirements (NFR) Criteria
2
-
3
- ## Principle
4
-
5
- Non-functional requirements (security, performance, reliability, maintainability) are **validated through automated tests**, not checklists. NFR assessment uses objective pass/fail criteria tied to measurable thresholds. Ambiguous requirements default to CONCERNS until clarified.
6
-
7
- ## Rationale
8
-
9
- **The Problem**: Teams ship features that "work" functionally but fail under load, expose security vulnerabilities, or lack error recovery. NFRs are treated as optional "nice-to-haves" instead of release blockers.
10
-
11
- **The Solution**: Define explicit NFR criteria with automated validation. Security tests verify auth/authz and secret handling. Performance tests enforce SLO/SLA thresholds with profiling evidence. Reliability tests validate error handling, retries, and health checks. Maintainability is measured by test coverage, code duplication, and observability.
12
-
13
- **Why This Matters**:
14
-
15
- - Prevents production incidents (security breaches, performance degradation, cascading failures)
16
- - Provides objective release criteria (no subjective "feels fast enough")
17
- - Automates compliance validation (audit trail for regulated environments)
18
- - Forces clarity on ambiguous requirements (default to CONCERNS)
19
-
20
- ## Pattern Examples
21
-
22
- ### Example 1: Security NFR Validation (Auth, Secrets, OWASP)
23
-
24
- **Context**: Automated security tests enforcing authentication, authorization, and secret handling
25
-
26
- **Implementation**:
27
-
28
- ```typescript
29
- // tests/nfr/security.spec.ts
30
- import { test, expect } from '@playwright/test';
31
-
32
- test.describe('Security NFR: Authentication & Authorization', () => {
33
- test('unauthenticated users cannot access protected routes', async ({ page }) => {
34
- // Attempt to access dashboard without auth
35
- await page.goto('/dashboard');
36
-
37
- // Should redirect to login (not expose data)
38
- await expect(page).toHaveURL(/\/login/);
39
- await expect(page.getByText('Please sign in')).toBeVisible();
40
-
41
- // Verify no sensitive data leaked in response
42
- const pageContent = await page.content();
43
- expect(pageContent).not.toContain('user_id');
44
- expect(pageContent).not.toContain('api_key');
45
- });
46
-
47
- test('JWT tokens expire after 15 minutes', async ({ page, request }) => {
48
- // Login and capture token
49
- await page.goto('/login');
50
- await page.getByLabel('Email').fill('test@example.com');
51
- await page.getByLabel('Password').fill('ValidPass123!');
52
- await page.getByRole('button', { name: 'Sign In' }).click();
53
-
54
- const token = await page.evaluate(() => localStorage.getItem('auth_token'));
55
- expect(token).toBeTruthy();
56
-
57
- // Wait 16 minutes (use mock clock in real tests)
58
- await page.clock.fastForward('00:16:00');
59
-
60
- // Token should be expired, API call should fail
61
- const response = await request.get('/api/user/profile', {
62
- headers: { Authorization: `Bearer ${token}` },
63
- });
64
-
65
- expect(response.status()).toBe(401);
66
- const body = await response.json();
67
- expect(body.error).toContain('expired');
68
- });
69
-
70
- test('passwords are never logged or exposed in errors', async ({ page }) => {
71
- // Trigger login error
72
- await page.goto('/login');
73
- await page.getByLabel('Email').fill('test@example.com');
74
- await page.getByLabel('Password').fill('WrongPassword123!');
75
-
76
- // Monitor console for password leaks
77
- const consoleLogs: string[] = [];
78
- page.on('console', (msg) => consoleLogs.push(msg.text()));
79
-
80
- await page.getByRole('button', { name: 'Sign In' }).click();
81
-
82
- // Error shown to user (generic message)
83
- await expect(page.getByText('Invalid credentials')).toBeVisible();
84
-
85
- // Verify password NEVER appears in console, DOM, or network
86
- const pageContent = await page.content();
87
- expect(pageContent).not.toContain('WrongPassword123!');
88
- expect(consoleLogs.join('\n')).not.toContain('WrongPassword123!');
89
- });
90
-
91
- test('RBAC: users can only access resources they own', async ({ page, request }) => {
92
- // Login as User A
93
- const userAToken = await login(request, 'userA@example.com', 'password');
94
-
95
- // Try to access User B's order
96
- const response = await request.get('/api/orders/user-b-order-id', {
97
- headers: { Authorization: `Bearer ${userAToken}` },
98
- });
99
-
100
- expect(response.status()).toBe(403); // Forbidden
101
- const body = await response.json();
102
- expect(body.error).toContain('insufficient permissions');
103
- });
104
-
105
- test('SQL injection attempts are blocked', async ({ page }) => {
106
- await page.goto('/search');
107
-
108
- // Attempt SQL injection
109
- await page.getByPlaceholder('Search products').fill("'; DROP TABLE users; --");
110
- await page.getByRole('button', { name: 'Search' }).click();
111
-
112
- // Should return empty results, NOT crash or expose error
113
- await expect(page.getByText('No results found')).toBeVisible();
114
-
115
- // Verify app still works (table not dropped)
116
- await page.goto('/dashboard');
117
- await expect(page.getByText('Welcome')).toBeVisible();
118
- });
119
-
120
- test('XSS attempts are sanitized', async ({ page }) => {
121
- await page.goto('/profile/edit');
122
-
123
- // Attempt XSS injection
124
- const xssPayload = '<script>alert("XSS")</script>';
125
- await page.getByLabel('Bio').fill(xssPayload);
126
- await page.getByRole('button', { name: 'Save' }).click();
127
-
128
- // Reload and verify XSS is escaped (not executed)
129
- await page.reload();
130
- const bio = await page.getByTestId('user-bio').textContent();
131
-
132
- // Text should be escaped, script should NOT execute
133
- expect(bio).toContain('&lt;script&gt;');
134
- expect(bio).not.toContain('<script>');
135
- });
136
- });
137
-
138
- // Helper
139
- async function login(request: any, email: string, password: string): Promise<string> {
140
- const response = await request.post('/api/auth/login', {
141
- data: { email, password },
142
- });
143
- const body = await response.json();
144
- return body.token;
145
- }
146
- ```
147
-
148
- **Key Points**:
149
-
150
- - Authentication: Unauthenticated access redirected (not exposed)
151
- - Authorization: RBAC enforced (403 for insufficient permissions)
152
- - Token expiry: JWT expires after 15 minutes (automated validation)
153
- - Secret handling: Passwords never logged or exposed in errors
154
- - OWASP Top 10: SQL injection and XSS blocked (input sanitization)
155
-
156
- **Security NFR Criteria**:
157
-
158
- - ✅ PASS: All 6 tests green (auth, authz, token expiry, secret handling, SQL injection, XSS)
159
- - ⚠️ CONCERNS: 1-2 tests failing with mitigation plan and owner assigned
160
- - ❌ FAIL: Critical exposure (unauthenticated access, password leak, SQL injection succeeds)
161
-
162
- ---
163
-
164
- ### Example 2: Performance NFR Validation (k6 Load Testing for SLO/SLA)
165
-
166
- **Context**: Use k6 for load testing, stress testing, and SLO/SLA enforcement (NOT Playwright)
167
-
168
- **Implementation**:
169
-
170
- ```javascript
171
- // tests/nfr/performance.k6.js
172
- import http from 'k6/http';
173
- import { check, sleep } from 'k6';
174
- import { Rate, Trend } from 'k6/metrics';
175
-
176
- // Custom metrics
177
- const errorRate = new Rate('errors');
178
- const apiDuration = new Trend('api_duration');
179
-
180
- // Performance thresholds (SLO/SLA)
181
- export const options = {
182
- stages: [
183
- { duration: '1m', target: 50 }, // Ramp up to 50 users
184
- { duration: '3m', target: 50 }, // Stay at 50 users for 3 minutes
185
- { duration: '1m', target: 100 }, // Spike to 100 users
186
- { duration: '3m', target: 100 }, // Stay at 100 users
187
- { duration: '1m', target: 0 }, // Ramp down
188
- ],
189
- thresholds: {
190
- // SLO: 95% of requests must complete in <500ms
191
- http_req_duration: ['p(95)<500'],
192
- // SLO: Error rate must be <1%
193
- errors: ['rate<0.01'],
194
- // SLA: API endpoints must respond in <1s (99th percentile)
195
- api_duration: ['p(99)<1000'],
196
- },
197
- };
198
-
199
- export default function () {
200
- // Test 1: Homepage load performance
201
- const homepageResponse = http.get(`${__ENV.BASE_URL}/`);
202
- check(homepageResponse, {
203
- 'homepage status is 200': (r) => r.status === 200,
204
- 'homepage loads in <2s': (r) => r.timings.duration < 2000,
205
- });
206
- errorRate.add(homepageResponse.status !== 200);
207
-
208
- // Test 2: API endpoint performance
209
- const apiResponse = http.get(`${__ENV.BASE_URL}/api/products?limit=10`, {
210
- headers: { Authorization: `Bearer ${__ENV.API_TOKEN}` },
211
- });
212
- check(apiResponse, {
213
- 'API status is 200': (r) => r.status === 200,
214
- 'API responds in <500ms': (r) => r.timings.duration < 500,
215
- });
216
- apiDuration.add(apiResponse.timings.duration);
217
- errorRate.add(apiResponse.status !== 200);
218
-
219
- // Test 3: Search endpoint under load
220
- const searchResponse = http.get(`${__ENV.BASE_URL}/api/search?q=laptop&limit=100`);
221
- check(searchResponse, {
222
- 'search status is 200': (r) => r.status === 200,
223
- 'search responds in <1s': (r) => r.timings.duration < 1000,
224
- 'search returns results': (r) => JSON.parse(r.body).results.length > 0,
225
- });
226
- errorRate.add(searchResponse.status !== 200);
227
-
228
- sleep(1); // Realistic user think time
229
- }
230
-
231
- // Threshold validation (run after test)
232
- export function handleSummary(data) {
233
- const p95Duration = data.metrics.http_req_duration.values['p(95)'];
234
- const p99ApiDuration = data.metrics.api_duration.values['p(99)'];
235
- const errorRateValue = data.metrics.errors.values.rate;
236
-
237
- console.log(`P95 request duration: ${p95Duration.toFixed(2)}ms`);
238
- console.log(`P99 API duration: ${p99ApiDuration.toFixed(2)}ms`);
239
- console.log(`Error rate: ${(errorRateValue * 100).toFixed(2)}%`);
240
-
241
- return {
242
- 'summary.json': JSON.stringify(data),
243
- stdout: `
244
- Performance NFR Results:
245
- - P95 request duration: ${p95Duration < 500 ? '✅ PASS' : '❌ FAIL'} (${p95Duration.toFixed(2)}ms / 500ms threshold)
246
- - P99 API duration: ${p99ApiDuration < 1000 ? '✅ PASS' : '❌ FAIL'} (${p99ApiDuration.toFixed(2)}ms / 1000ms threshold)
247
- - Error rate: ${errorRateValue < 0.01 ? '✅ PASS' : '❌ FAIL'} (${(errorRateValue * 100).toFixed(2)}% / 1% threshold)
248
- `,
249
- };
250
- }
251
- ```
252
-
253
- **Run k6 tests:**
254
-
255
- ```bash
256
- # Local smoke test (10 VUs, 30s)
257
- k6 run --vus 10 --duration 30s tests/nfr/performance.k6.js
258
-
259
- # Full load test (stages defined in script)
260
- k6 run tests/nfr/performance.k6.js
261
-
262
- # CI integration with thresholds
263
- k6 run --out json=performance-results.json tests/nfr/performance.k6.js
264
- ```
265
-
266
- **Key Points**:
267
-
268
- - **k6 is the right tool** for load testing (NOT Playwright)
269
- - SLO/SLA thresholds enforced automatically (`p(95)<500`, `rate<0.01`)
270
- - Realistic load simulation (ramp up, sustained load, spike testing)
271
- - Comprehensive metrics (p50, p95, p99, error rate, throughput)
272
- - CI-friendly (JSON output, exit codes based on thresholds)
273
-
274
- **Performance NFR Criteria**:
275
-
276
- - ✅ PASS: All SLO/SLA targets met with k6 profiling evidence (p95 < 500ms, error rate < 1%)
277
- - ⚠️ CONCERNS: Trending toward limits (e.g., p95 = 480ms approaching 500ms) or missing baselines
278
- - ❌ FAIL: SLO/SLA breached (e.g., p95 > 500ms) or error rate > 1%
279
-
280
- **Performance Testing Levels (from Test Architect course):**
281
-
282
- - **Load testing**: System behavior under expected load
283
- - **Stress testing**: System behavior under extreme load (breaking point)
284
- - **Spike testing**: Sudden load increases (traffic spikes)
285
- - **Endurance/Soak testing**: System behavior under sustained load (memory leaks, resource exhaustion)
286
- - **Benchmarking**: Baseline measurements for comparison
287
-
288
- **Note**: Playwright can validate **perceived performance** (Core Web Vitals via Lighthouse), but k6 validates **system performance** (throughput, latency, resource limits under load)
289
-
290
- ---
291
-
292
- ### Example 3: Reliability NFR Validation (Playwright for UI Resilience)
293
-
294
- **Context**: Automated reliability tests validating graceful degradation and recovery paths
295
-
296
- **Implementation**:
297
-
298
- ```typescript
299
- // tests/nfr/reliability.spec.ts
300
- import { test, expect } from '@playwright/test';
301
-
302
- test.describe('Reliability NFR: Error Handling & Recovery', () => {
303
- test('app remains functional when API returns 500 error', async ({ page, context }) => {
304
- // Mock API failure
305
- await context.route('**/api/products', (route) => {
306
- route.fulfill({ status: 500, body: JSON.stringify({ error: 'Internal Server Error' }) });
307
- });
308
-
309
- await page.goto('/products');
310
-
311
- // User sees error message (not blank page or crash)
312
- await expect(page.getByText('Unable to load products. Please try again.')).toBeVisible();
313
- await expect(page.getByRole('button', { name: 'Retry' })).toBeVisible();
314
-
315
- // App navigation still works (graceful degradation)
316
- await page.getByRole('link', { name: 'Home' }).click();
317
- await expect(page).toHaveURL('/');
318
- });
319
-
320
- test('API client retries on transient failures (3 attempts)', async ({ page, context }) => {
321
- let attemptCount = 0;
322
-
323
- await context.route('**/api/checkout', (route) => {
324
- attemptCount++;
325
-
326
- // Fail first 2 attempts, succeed on 3rd
327
- if (attemptCount < 3) {
328
- route.fulfill({ status: 503, body: JSON.stringify({ error: 'Service Unavailable' }) });
329
- } else {
330
- route.fulfill({ status: 200, body: JSON.stringify({ orderId: '12345' }) });
331
- }
332
- });
333
-
334
- await page.goto('/checkout');
335
- await page.getByRole('button', { name: 'Place Order' }).click();
336
-
337
- // Should succeed after 3 attempts
338
- await expect(page.getByText('Order placed successfully')).toBeVisible();
339
- expect(attemptCount).toBe(3);
340
- });
341
-
342
- test('app handles network disconnection gracefully', async ({ page, context }) => {
343
- await page.goto('/dashboard');
344
-
345
- // Simulate offline mode
346
- await context.setOffline(true);
347
-
348
- // Trigger action requiring network
349
- await page.getByRole('button', { name: 'Refresh Data' }).click();
350
-
351
- // User sees offline indicator (not crash)
352
- await expect(page.getByText('You are offline. Changes will sync when reconnected.')).toBeVisible();
353
-
354
- // Reconnect
355
- await context.setOffline(false);
356
- await page.getByRole('button', { name: 'Refresh Data' }).click();
357
-
358
- // Data loads successfully
359
- await expect(page.getByText('Data updated')).toBeVisible();
360
- });
361
-
362
- test('health check endpoint returns service status', async ({ request }) => {
363
- const response = await request.get('/api/health');
364
-
365
- expect(response.status()).toBe(200);
366
-
367
- const health = await response.json();
368
- expect(health).toHaveProperty('status', 'healthy');
369
- expect(health).toHaveProperty('timestamp');
370
- expect(health).toHaveProperty('services');
371
-
372
- // Verify critical services are monitored
373
- expect(health.services).toHaveProperty('database');
374
- expect(health.services).toHaveProperty('cache');
375
- expect(health.services).toHaveProperty('queue');
376
-
377
- // All services should be UP
378
- expect(health.services.database.status).toBe('UP');
379
- expect(health.services.cache.status).toBe('UP');
380
- expect(health.services.queue.status).toBe('UP');
381
- });
382
-
383
- test('circuit breaker opens after 5 consecutive failures', async ({ page, context }) => {
384
- let failureCount = 0;
385
-
386
- await context.route('**/api/recommendations', (route) => {
387
- failureCount++;
388
- route.fulfill({ status: 500, body: JSON.stringify({ error: 'Service Error' }) });
389
- });
390
-
391
- await page.goto('/product/123');
392
-
393
- // Wait for circuit breaker to open (fallback UI appears)
394
- await expect(page.getByText('Recommendations temporarily unavailable')).toBeVisible({ timeout: 10000 });
395
-
396
- // Verify circuit breaker stopped making requests after threshold (should be ≤5)
397
- expect(failureCount).toBeLessThanOrEqual(5);
398
- });
399
-
400
- test('rate limiting gracefully handles 429 responses', async ({ page, context }) => {
401
- let requestCount = 0;
402
-
403
- await context.route('**/api/search', (route) => {
404
- requestCount++;
405
-
406
- if (requestCount > 10) {
407
- // Rate limit exceeded
408
- route.fulfill({
409
- status: 429,
410
- headers: { 'Retry-After': '5' },
411
- body: JSON.stringify({ error: 'Rate limit exceeded' }),
412
- });
413
- } else {
414
- route.fulfill({ status: 200, body: JSON.stringify({ results: [] }) });
415
- }
416
- });
417
-
418
- await page.goto('/search');
419
-
420
- // Make 15 search requests rapidly
421
- for (let i = 0; i < 15; i++) {
422
- await page.getByPlaceholder('Search').fill(`query-${i}`);
423
- await page.getByRole('button', { name: 'Search' }).click();
424
- }
425
-
426
- // User sees rate limit message (not crash)
427
- await expect(page.getByText('Too many requests. Please wait a moment.')).toBeVisible();
428
- });
429
- });
430
- ```
431
-
432
- **Key Points**:
433
-
434
- - Error handling: Graceful degradation (500 error → user-friendly message + retry button)
435
- - Retries: 3 attempts on transient failures (503 → eventual success)
436
- - Offline handling: Network disconnection detected (sync when reconnected)
437
- - Health checks: `/api/health` monitors database, cache, queue
438
- - Circuit breaker: Opens after 5 failures (fallback UI, stop retries)
439
- - Rate limiting: 429 response handled (Retry-After header respected)
440
-
441
- **Reliability NFR Criteria**:
442
-
443
- - ✅ PASS: Error handling, retries, health checks verified (all 6 tests green)
444
- - ⚠️ CONCERNS: Partial coverage (e.g., missing circuit breaker) or no telemetry
445
- - ❌ FAIL: No recovery path (500 error crashes app) or unresolved crash scenarios
446
-
447
- ---
448
-
449
- ### Example 4: Maintainability NFR Validation (CI Tools, Not Playwright)
450
-
451
- **Context**: Use proper CI tools for code quality validation (coverage, duplication, vulnerabilities)
452
-
453
- **Implementation**:
454
-
455
- ```yaml
456
- # .github/workflows/nfr-maintainability.yml
457
- name: NFR - Maintainability
458
-
459
- on: [push, pull_request]
460
-
461
- jobs:
462
- test-coverage:
463
- runs-on: ubuntu-latest
464
- steps:
465
- - uses: actions/checkout@v4
466
- - uses: actions/setup-node@v4
467
-
468
- - name: Install dependencies
469
- run: npm ci
470
-
471
- - name: Run tests with coverage
472
- run: npm run test:coverage
473
-
474
- - name: Check coverage threshold (80% minimum)
475
- run: |
476
- COVERAGE=$(jq '.total.lines.pct' coverage/coverage-summary.json)
477
- echo "Coverage: $COVERAGE%"
478
- if (( $(echo "$COVERAGE < 80" | bc -l) )); then
479
- echo "❌ FAIL: Coverage $COVERAGE% below 80% threshold"
480
- exit 1
481
- else
482
- echo "✅ PASS: Coverage $COVERAGE% meets 80% threshold"
483
- fi
484
-
485
- code-duplication:
486
- runs-on: ubuntu-latest
487
- steps:
488
- - uses: actions/checkout@v4
489
- - uses: actions/setup-node@v4
490
-
491
- - name: Check code duplication (<5% allowed)
492
- run: |
493
- npx jscpd src/ --threshold 5 --format json --output duplication.json
494
- DUPLICATION=$(jq '.statistics.total.percentage' duplication.json)
495
- echo "Duplication: $DUPLICATION%"
496
- if (( $(echo "$DUPLICATION >= 5" | bc -l) )); then
497
- echo "❌ FAIL: Duplication $DUPLICATION% exceeds 5% threshold"
498
- exit 1
499
- else
500
- echo "✅ PASS: Duplication $DUPLICATION% below 5% threshold"
501
- fi
502
-
503
- vulnerability-scan:
504
- runs-on: ubuntu-latest
505
- steps:
506
- - uses: actions/checkout@v4
507
- - uses: actions/setup-node@v4
508
-
509
- - name: Install dependencies
510
- run: npm ci
511
-
512
- - name: Run npm audit (no critical/high vulnerabilities)
513
- run: |
514
- npm audit --json > audit.json || true
515
- CRITICAL=$(jq '.metadata.vulnerabilities.critical' audit.json)
516
- HIGH=$(jq '.metadata.vulnerabilities.high' audit.json)
517
- echo "Critical: $CRITICAL, High: $HIGH"
518
- if [ "$CRITICAL" -gt 0 ] || [ "$HIGH" -gt 0 ]; then
519
- echo "❌ FAIL: Found $CRITICAL critical and $HIGH high vulnerabilities"
520
- npm audit
521
- exit 1
522
- else
523
- echo "✅ PASS: No critical/high vulnerabilities"
524
- fi
525
- ```
526
-
527
- **Playwright Tests for Observability (E2E Validation):**
528
-
529
- ```typescript
530
- // tests/nfr/observability.spec.ts
531
- import { test, expect } from '@playwright/test';
532
-
533
- test.describe('Maintainability NFR: Observability Validation', () => {
534
- test('critical errors are reported to monitoring service', async ({ page, context }) => {
535
- const sentryEvents: any[] = [];
536
-
537
- // Mock Sentry SDK to verify error tracking
538
- await context.addInitScript(() => {
539
- (window as any).Sentry = {
540
- captureException: (error: Error) => {
541
- console.log('SENTRY_CAPTURE:', JSON.stringify({ message: error.message, stack: error.stack }));
542
- },
543
- };
544
- });
545
-
546
- page.on('console', (msg) => {
547
- if (msg.text().includes('SENTRY_CAPTURE:')) {
548
- sentryEvents.push(JSON.parse(msg.text().replace('SENTRY_CAPTURE:', '')));
549
- }
550
- });
551
-
552
- // Trigger error by mocking API failure
553
- await context.route('**/api/products', (route) => {
554
- route.fulfill({ status: 500, body: JSON.stringify({ error: 'Database Error' }) });
555
- });
556
-
557
- await page.goto('/products');
558
-
559
- // Wait for error UI and Sentry capture
560
- await expect(page.getByText('Unable to load products')).toBeVisible();
561
-
562
- // Verify error was captured by monitoring
563
- expect(sentryEvents.length).toBeGreaterThan(0);
564
- expect(sentryEvents[0]).toHaveProperty('message');
565
- expect(sentryEvents[0]).toHaveProperty('stack');
566
- });
567
-
568
- test('API response times are tracked in telemetry', async ({ request }) => {
569
- const response = await request.get('/api/products?limit=10');
570
-
571
- expect(response.ok()).toBeTruthy();
572
-
573
- // Verify Server-Timing header for APM (Application Performance Monitoring)
574
- const serverTiming = response.headers()['server-timing'];
575
-
576
- expect(serverTiming).toBeTruthy();
577
- expect(serverTiming).toContain('db'); // Database query time
578
- expect(serverTiming).toContain('total'); // Total processing time
579
- });
580
-
581
- test('structured logging present in application', async ({ request }) => {
582
- // Make API call that generates logs
583
- const response = await request.post('/api/orders', {
584
- data: { productId: '123', quantity: 2 },
585
- });
586
-
587
- expect(response.ok()).toBeTruthy();
588
-
589
- // Note: In real scenarios, validate logs in monitoring system (Datadog, CloudWatch)
590
- // This test validates the logging contract exists (Server-Timing, trace IDs in headers)
591
- const traceId = response.headers()['x-trace-id'];
592
- expect(traceId).toBeTruthy(); // Confirms structured logging with correlation IDs
593
- });
594
- });
595
- ```
596
-
597
- **Key Points**:
598
-
599
- - **Coverage/duplication**: CI jobs (GitHub Actions), not Playwright tests
600
- - **Vulnerability scanning**: npm audit in CI, not Playwright tests
601
- - **Observability**: Playwright validates error tracking (Sentry) and telemetry headers
602
- - **Structured logging**: Validate logging contract (trace IDs, Server-Timing headers)
603
- - **Separation of concerns**: Build-time checks (coverage, audit) vs runtime checks (error tracking, telemetry)
604
-
605
- **Maintainability NFR Criteria**:
606
-
607
- - ✅ PASS: Clean code (80%+ coverage from CI, <5% duplication from CI), observability validated in E2E, no critical vulnerabilities from npm audit
608
- - ⚠️ CONCERNS: Duplication >5%, coverage 60-79%, or unclear ownership
609
- - ❌ FAIL: Absent tests (<60%), tangled implementations (>10% duplication), or no observability
610
-
611
- ---
612
-
613
- ## NFR Assessment Checklist
614
-
615
- Before release gate:
616
-
617
- - [ ] **Security** (Playwright E2E + Security Tools):
618
- - [ ] Auth/authz tests green (unauthenticated redirect, RBAC enforced)
619
- - [ ] Secrets never logged or exposed in errors
620
- - [ ] OWASP Top 10 validated (SQL injection blocked, XSS sanitized)
621
- - [ ] Security audit completed (vulnerability scan, penetration test if applicable)
622
-
623
- - [ ] **Performance** (k6 Load Testing):
624
- - [ ] SLO/SLA targets met with k6 evidence (p95 <500ms, error rate <1%)
625
- - [ ] Load testing completed (expected load)
626
- - [ ] Stress testing completed (breaking point identified)
627
- - [ ] Spike testing completed (handles traffic spikes)
628
- - [ ] Endurance testing completed (no memory leaks under sustained load)
629
-
630
- - [ ] **Reliability** (Playwright E2E + API Tests):
631
- - [ ] Error handling graceful (500 → user-friendly message + retry)
632
- - [ ] Retries implemented (3 attempts on transient failures)
633
- - [ ] Health checks monitored (/api/health endpoint)
634
- - [ ] Circuit breaker tested (opens after failure threshold)
635
- - [ ] Offline handling validated (network disconnection graceful)
636
-
637
- - [ ] **Maintainability** (CI Tools):
638
- - [ ] Test coverage ≥80% (from CI coverage report)
639
- - [ ] Code duplication <5% (from jscpd CI job)
640
- - [ ] No critical/high vulnerabilities (from npm audit CI job)
641
- - [ ] Structured logging validated (Playwright validates telemetry headers)
642
- - [ ] Error tracking configured (Sentry/monitoring integration validated)
643
-
644
- - [ ] **Ambiguous requirements**: Default to CONCERNS (force team to clarify thresholds and evidence)
645
- - [ ] **NFR criteria documented**: Measurable thresholds defined (not subjective "fast enough")
646
- - [ ] **Automated validation**: NFR tests run in CI pipeline (not manual checklists)
647
- - [ ] **Tool selection**: Right tool for each NFR (k6 for performance, Playwright for security/reliability E2E, CI tools for maintainability)
648
-
649
- ## NFR Gate Decision Matrix
650
-
651
- | Category | PASS Criteria | CONCERNS Criteria | FAIL Criteria |
652
- | ------------------- | -------------------------------------------- | -------------------------------------------- | ---------------------------------------------- |
653
- | **Security** | Auth/authz, secret handling, OWASP verified | Minor gaps with clear owners | Critical exposure or missing controls |
654
- | **Performance** | Metrics meet SLO/SLA with profiling evidence | Trending toward limits or missing baselines | SLO/SLA breached or resource leaks detected |
655
- | **Reliability** | Error handling, retries, health checks OK | Partial coverage or missing telemetry | No recovery path or unresolved crash scenarios |
656
- | **Maintainability** | Clean code, tests, docs shipped together | Duplication, low coverage, unclear ownership | Absent tests, tangled code, no observability |
657
-
658
- **Default**: If targets or evidence are undefined → **CONCERNS** (force team to clarify before sign-off)
659
-
660
- ## Integration Points
661
-
662
- - **Used in workflows**: `*nfr-assess` (automated NFR validation), `*trace` (gate decision Phase 2), `*test-design` (NFR risk assessment via Utility Tree)
663
- - **Related fragments**: `risk-governance.md` (NFR risk scoring), `probability-impact.md` (NFR impact assessment), `test-quality.md` (maintainability standards), `test-levels-framework.md` (system-level testing for NFRs)
664
- - **Tools by NFR Category**:
665
- - **Security**: Playwright (E2E auth/authz), OWASP ZAP, Burp Suite, npm audit, Snyk
666
- - **Performance**: k6 (load/stress/spike/endurance), Lighthouse (Core Web Vitals), Artillery
667
- - **Reliability**: Playwright (E2E error handling), API tests (retries, health checks), Chaos Engineering tools
668
- - **Maintainability**: GitHub Actions (coverage, duplication, audit), jscpd, Playwright (observability validation)
669
-
670
- _Source: Test Architect course (NFR testing approaches, Utility Tree, Quality Scenarios), ISO/IEC 25010 Software Quality Characteristics, OWASP Top 10, k6 documentation, SRE practices_
1
+ # Non-Functional Requirements (NFR) Criteria
2
+
3
+ ## Principle
4
+
5
+ Non-functional requirements (security, performance, reliability, maintainability) are **validated through automated tests**, not checklists. NFR assessment uses objective pass/fail criteria tied to measurable thresholds. Ambiguous requirements default to CONCERNS until clarified.
6
+
7
+ ## Rationale
8
+
9
+ **The Problem**: Teams ship features that "work" functionally but fail under load, expose security vulnerabilities, or lack error recovery. NFRs are treated as optional "nice-to-haves" instead of release blockers.
10
+
11
+ **The Solution**: Define explicit NFR criteria with automated validation. Security tests verify auth/authz and secret handling. Performance tests enforce SLO/SLA thresholds with profiling evidence. Reliability tests validate error handling, retries, and health checks. Maintainability is measured by test coverage, code duplication, and observability.
12
+
13
+ **Why This Matters**:
14
+
15
+ - Prevents production incidents (security breaches, performance degradation, cascading failures)
16
+ - Provides objective release criteria (no subjective "feels fast enough")
17
+ - Automates compliance validation (audit trail for regulated environments)
18
+ - Forces clarity on ambiguous requirements (default to CONCERNS)
19
+
20
+ ## Pattern Examples
21
+
22
+ ### Example 1: Security NFR Validation (Auth, Secrets, OWASP)
23
+
24
+ **Context**: Automated security tests enforcing authentication, authorization, and secret handling
25
+
26
+ **Implementation**:
27
+
28
+ ```typescript
29
+ // tests/nfr/security.spec.ts
30
+ import { test, expect } from '@playwright/test';
31
+
32
+ test.describe('Security NFR: Authentication & Authorization', () => {
33
+ test('unauthenticated users cannot access protected routes', async ({ page }) => {
34
+ // Attempt to access dashboard without auth
35
+ await page.goto('/dashboard');
36
+
37
+ // Should redirect to login (not expose data)
38
+ await expect(page).toHaveURL(/\/login/);
39
+ await expect(page.getByText('Please sign in')).toBeVisible();
40
+
41
+ // Verify no sensitive data leaked in response
42
+ const pageContent = await page.content();
43
+ expect(pageContent).not.toContain('user_id');
44
+ expect(pageContent).not.toContain('api_key');
45
+ });
46
+
47
+ test('JWT tokens expire after 15 minutes', async ({ page, request }) => {
48
+ // Login and capture token
49
+ await page.goto('/login');
50
+ await page.getByLabel('Email').fill('test@example.com');
51
+ await page.getByLabel('Password').fill('ValidPass123!');
52
+ await page.getByRole('button', { name: 'Sign In' }).click();
53
+
54
+ const token = await page.evaluate(() => localStorage.getItem('auth_token'));
55
+ expect(token).toBeTruthy();
56
+
57
+ // Wait 16 minutes (use mock clock in real tests)
58
+ await page.clock.fastForward('00:16:00');
59
+
60
+ // Token should be expired, API call should fail
61
+ const response = await request.get('/api/user/profile', {
62
+ headers: { Authorization: `Bearer ${token}` },
63
+ });
64
+
65
+ expect(response.status()).toBe(401);
66
+ const body = await response.json();
67
+ expect(body.error).toContain('expired');
68
+ });
69
+
70
+ test('passwords are never logged or exposed in errors', async ({ page }) => {
71
+ // Trigger login error
72
+ await page.goto('/login');
73
+ await page.getByLabel('Email').fill('test@example.com');
74
+ await page.getByLabel('Password').fill('WrongPassword123!');
75
+
76
+ // Monitor console for password leaks
77
+ const consoleLogs: string[] = [];
78
+ page.on('console', (msg) => consoleLogs.push(msg.text()));
79
+
80
+ await page.getByRole('button', { name: 'Sign In' }).click();
81
+
82
+ // Error shown to user (generic message)
83
+ await expect(page.getByText('Invalid credentials')).toBeVisible();
84
+
85
+ // Verify password NEVER appears in console, DOM, or network
86
+ const pageContent = await page.content();
87
+ expect(pageContent).not.toContain('WrongPassword123!');
88
+ expect(consoleLogs.join('\n')).not.toContain('WrongPassword123!');
89
+ });
90
+
91
+ test('RBAC: users can only access resources they own', async ({ page, request }) => {
92
+ // Login as User A
93
+ const userAToken = await login(request, 'userA@example.com', 'password');
94
+
95
+ // Try to access User B's order
96
+ const response = await request.get('/api/orders/user-b-order-id', {
97
+ headers: { Authorization: `Bearer ${userAToken}` },
98
+ });
99
+
100
+ expect(response.status()).toBe(403); // Forbidden
101
+ const body = await response.json();
102
+ expect(body.error).toContain('insufficient permissions');
103
+ });
104
+
105
+ test('SQL injection attempts are blocked', async ({ page }) => {
106
+ await page.goto('/search');
107
+
108
+ // Attempt SQL injection
109
+ await page.getByPlaceholder('Search products').fill("'; DROP TABLE users; --");
110
+ await page.getByRole('button', { name: 'Search' }).click();
111
+
112
+ // Should return empty results, NOT crash or expose error
113
+ await expect(page.getByText('No results found')).toBeVisible();
114
+
115
+ // Verify app still works (table not dropped)
116
+ await page.goto('/dashboard');
117
+ await expect(page.getByText('Welcome')).toBeVisible();
118
+ });
119
+
120
+ test('XSS attempts are sanitized', async ({ page }) => {
121
+ await page.goto('/profile/edit');
122
+
123
+ // Attempt XSS injection
124
+ const xssPayload = '<script>alert("XSS")</script>';
125
+ await page.getByLabel('Bio').fill(xssPayload);
126
+ await page.getByRole('button', { name: 'Save' }).click();
127
+
128
+ // Reload and verify XSS is escaped (not executed)
129
+ await page.reload();
130
+ const bio = await page.getByTestId('user-bio').textContent();
131
+
132
+ // Text should be escaped, script should NOT execute
133
+ expect(bio).toContain('&lt;script&gt;');
134
+ expect(bio).not.toContain('<script>');
135
+ });
136
+ });
137
+
138
+ // Helper
139
+ async function login(request: any, email: string, password: string): Promise<string> {
140
+ const response = await request.post('/api/auth/login', {
141
+ data: { email, password },
142
+ });
143
+ const body = await response.json();
144
+ return body.token;
145
+ }
146
+ ```
147
+
148
+ **Key Points**:
149
+
150
+ - Authentication: Unauthenticated access redirected (not exposed)
151
+ - Authorization: RBAC enforced (403 for insufficient permissions)
152
+ - Token expiry: JWT expires after 15 minutes (automated validation)
153
+ - Secret handling: Passwords never logged or exposed in errors
154
+ - OWASP Top 10: SQL injection and XSS blocked (input sanitization)
155
+
156
+ **Security NFR Criteria**:
157
+
158
+ - ✅ PASS: All 6 tests green (auth, authz, token expiry, secret handling, SQL injection, XSS)
159
+ - ⚠️ CONCERNS: 1-2 tests failing with mitigation plan and owner assigned
160
+ - ❌ FAIL: Critical exposure (unauthenticated access, password leak, SQL injection succeeds)
161
+
162
+ ---
163
+
164
+ ### Example 2: Performance NFR Validation (k6 Load Testing for SLO/SLA)
165
+
166
+ **Context**: Use k6 for load testing, stress testing, and SLO/SLA enforcement (NOT Playwright)
167
+
168
+ **Implementation**:
169
+
170
+ ```javascript
171
+ // tests/nfr/performance.k6.js
172
+ import http from 'k6/http';
173
+ import { check, sleep } from 'k6';
174
+ import { Rate, Trend } from 'k6/metrics';
175
+
176
+ // Custom metrics
177
+ const errorRate = new Rate('errors');
178
+ const apiDuration = new Trend('api_duration');
179
+
180
+ // Performance thresholds (SLO/SLA)
181
+ export const options = {
182
+ stages: [
183
+ { duration: '1m', target: 50 }, // Ramp up to 50 users
184
+ { duration: '3m', target: 50 }, // Stay at 50 users for 3 minutes
185
+ { duration: '1m', target: 100 }, // Spike to 100 users
186
+ { duration: '3m', target: 100 }, // Stay at 100 users
187
+ { duration: '1m', target: 0 }, // Ramp down
188
+ ],
189
+ thresholds: {
190
+ // SLO: 95% of requests must complete in <500ms
191
+ http_req_duration: ['p(95)<500'],
192
+ // SLO: Error rate must be <1%
193
+ errors: ['rate<0.01'],
194
+ // SLA: API endpoints must respond in <1s (99th percentile)
195
+ api_duration: ['p(99)<1000'],
196
+ },
197
+ };
198
+
199
+ export default function () {
200
+ // Test 1: Homepage load performance
201
+ const homepageResponse = http.get(`${__ENV.BASE_URL}/`);
202
+ check(homepageResponse, {
203
+ 'homepage status is 200': (r) => r.status === 200,
204
+ 'homepage loads in <2s': (r) => r.timings.duration < 2000,
205
+ });
206
+ errorRate.add(homepageResponse.status !== 200);
207
+
208
+ // Test 2: API endpoint performance
209
+ const apiResponse = http.get(`${__ENV.BASE_URL}/api/products?limit=10`, {
210
+ headers: { Authorization: `Bearer ${__ENV.API_TOKEN}` },
211
+ });
212
+ check(apiResponse, {
213
+ 'API status is 200': (r) => r.status === 200,
214
+ 'API responds in <500ms': (r) => r.timings.duration < 500,
215
+ });
216
+ apiDuration.add(apiResponse.timings.duration);
217
+ errorRate.add(apiResponse.status !== 200);
218
+
219
+ // Test 3: Search endpoint under load
220
+ const searchResponse = http.get(`${__ENV.BASE_URL}/api/search?q=laptop&limit=100`);
221
+ check(searchResponse, {
222
+ 'search status is 200': (r) => r.status === 200,
223
+ 'search responds in <1s': (r) => r.timings.duration < 1000,
224
+ 'search returns results': (r) => JSON.parse(r.body).results.length > 0,
225
+ });
226
+ errorRate.add(searchResponse.status !== 200);
227
+
228
+ sleep(1); // Realistic user think time
229
+ }
230
+
231
+ // Threshold validation (run after test)
232
+ export function handleSummary(data) {
233
+ const p95Duration = data.metrics.http_req_duration.values['p(95)'];
234
+ const p99ApiDuration = data.metrics.api_duration.values['p(99)'];
235
+ const errorRateValue = data.metrics.errors.values.rate;
236
+
237
+ console.log(`P95 request duration: ${p95Duration.toFixed(2)}ms`);
238
+ console.log(`P99 API duration: ${p99ApiDuration.toFixed(2)}ms`);
239
+ console.log(`Error rate: ${(errorRateValue * 100).toFixed(2)}%`);
240
+
241
+ return {
242
+ 'summary.json': JSON.stringify(data),
243
+ stdout: `
244
+ Performance NFR Results:
245
+ - P95 request duration: ${p95Duration < 500 ? '✅ PASS' : '❌ FAIL'} (${p95Duration.toFixed(2)}ms / 500ms threshold)
246
+ - P99 API duration: ${p99ApiDuration < 1000 ? '✅ PASS' : '❌ FAIL'} (${p99ApiDuration.toFixed(2)}ms / 1000ms threshold)
247
+ - Error rate: ${errorRateValue < 0.01 ? '✅ PASS' : '❌ FAIL'} (${(errorRateValue * 100).toFixed(2)}% / 1% threshold)
248
+ `,
249
+ };
250
+ }
251
+ ```
252
+
253
+ **Run k6 tests:**
254
+
255
+ ```bash
256
+ # Local smoke test (10 VUs, 30s)
257
+ k6 run --vus 10 --duration 30s tests/nfr/performance.k6.js
258
+
259
+ # Full load test (stages defined in script)
260
+ k6 run tests/nfr/performance.k6.js
261
+
262
+ # CI integration with thresholds
263
+ k6 run --out json=performance-results.json tests/nfr/performance.k6.js
264
+ ```
265
+
266
+ **Key Points**:
267
+
268
+ - **k6 is the right tool** for load testing (NOT Playwright)
269
+ - SLO/SLA thresholds enforced automatically (`p(95)<500`, `rate<0.01`)
270
+ - Realistic load simulation (ramp up, sustained load, spike testing)
271
+ - Comprehensive metrics (p50, p95, p99, error rate, throughput)
272
+ - CI-friendly (JSON output, exit codes based on thresholds)
273
+
274
+ **Performance NFR Criteria**:
275
+
276
+ - ✅ PASS: All SLO/SLA targets met with k6 profiling evidence (p95 < 500ms, error rate < 1%)
277
+ - ⚠️ CONCERNS: Trending toward limits (e.g., p95 = 480ms approaching 500ms) or missing baselines
278
+ - ❌ FAIL: SLO/SLA breached (e.g., p95 > 500ms) or error rate > 1%
279
+
280
+ **Performance Testing Levels (from Test Architect course):**
281
+
282
+ - **Load testing**: System behavior under expected load
283
+ - **Stress testing**: System behavior under extreme load (breaking point)
284
+ - **Spike testing**: Sudden load increases (traffic spikes)
285
+ - **Endurance/Soak testing**: System behavior under sustained load (memory leaks, resource exhaustion)
286
+ - **Benchmarking**: Baseline measurements for comparison
287
+
288
+ **Note**: Playwright can validate **perceived performance** (Core Web Vitals via Lighthouse), but k6 validates **system performance** (throughput, latency, resource limits under load)
289
+
290
+ ---
291
+
292
+ ### Example 3: Reliability NFR Validation (Playwright for UI Resilience)
293
+
294
+ **Context**: Automated reliability tests validating graceful degradation and recovery paths
295
+
296
+ **Implementation**:
297
+
298
+ ```typescript
299
+ // tests/nfr/reliability.spec.ts
300
+ import { test, expect } from '@playwright/test';
301
+
302
+ test.describe('Reliability NFR: Error Handling & Recovery', () => {
303
+ test('app remains functional when API returns 500 error', async ({ page, context }) => {
304
+ // Mock API failure
305
+ await context.route('**/api/products', (route) => {
306
+ route.fulfill({ status: 500, body: JSON.stringify({ error: 'Internal Server Error' }) });
307
+ });
308
+
309
+ await page.goto('/products');
310
+
311
+ // User sees error message (not blank page or crash)
312
+ await expect(page.getByText('Unable to load products. Please try again.')).toBeVisible();
313
+ await expect(page.getByRole('button', { name: 'Retry' })).toBeVisible();
314
+
315
+ // App navigation still works (graceful degradation)
316
+ await page.getByRole('link', { name: 'Home' }).click();
317
+ await expect(page).toHaveURL('/');
318
+ });
319
+
320
+ test('API client retries on transient failures (3 attempts)', async ({ page, context }) => {
321
+ let attemptCount = 0;
322
+
323
+ await context.route('**/api/checkout', (route) => {
324
+ attemptCount++;
325
+
326
+ // Fail first 2 attempts, succeed on 3rd
327
+ if (attemptCount < 3) {
328
+ route.fulfill({ status: 503, body: JSON.stringify({ error: 'Service Unavailable' }) });
329
+ } else {
330
+ route.fulfill({ status: 200, body: JSON.stringify({ orderId: '12345' }) });
331
+ }
332
+ });
333
+
334
+ await page.goto('/checkout');
335
+ await page.getByRole('button', { name: 'Place Order' }).click();
336
+
337
+ // Should succeed after 3 attempts
338
+ await expect(page.getByText('Order placed successfully')).toBeVisible();
339
+ expect(attemptCount).toBe(3);
340
+ });
341
+
342
+ test('app handles network disconnection gracefully', async ({ page, context }) => {
343
+ await page.goto('/dashboard');
344
+
345
+ // Simulate offline mode
346
+ await context.setOffline(true);
347
+
348
+ // Trigger action requiring network
349
+ await page.getByRole('button', { name: 'Refresh Data' }).click();
350
+
351
+ // User sees offline indicator (not crash)
352
+ await expect(page.getByText('You are offline. Changes will sync when reconnected.')).toBeVisible();
353
+
354
+ // Reconnect
355
+ await context.setOffline(false);
356
+ await page.getByRole('button', { name: 'Refresh Data' }).click();
357
+
358
+ // Data loads successfully
359
+ await expect(page.getByText('Data updated')).toBeVisible();
360
+ });
361
+
362
+ test('health check endpoint returns service status', async ({ request }) => {
363
+ const response = await request.get('/api/health');
364
+
365
+ expect(response.status()).toBe(200);
366
+
367
+ const health = await response.json();
368
+ expect(health).toHaveProperty('status', 'healthy');
369
+ expect(health).toHaveProperty('timestamp');
370
+ expect(health).toHaveProperty('services');
371
+
372
+ // Verify critical services are monitored
373
+ expect(health.services).toHaveProperty('database');
374
+ expect(health.services).toHaveProperty('cache');
375
+ expect(health.services).toHaveProperty('queue');
376
+
377
+ // All services should be UP
378
+ expect(health.services.database.status).toBe('UP');
379
+ expect(health.services.cache.status).toBe('UP');
380
+ expect(health.services.queue.status).toBe('UP');
381
+ });
382
+
383
+ test('circuit breaker opens after 5 consecutive failures', async ({ page, context }) => {
384
+ let failureCount = 0;
385
+
386
+ await context.route('**/api/recommendations', (route) => {
387
+ failureCount++;
388
+ route.fulfill({ status: 500, body: JSON.stringify({ error: 'Service Error' }) });
389
+ });
390
+
391
+ await page.goto('/product/123');
392
+
393
+ // Wait for circuit breaker to open (fallback UI appears)
394
+ await expect(page.getByText('Recommendations temporarily unavailable')).toBeVisible({ timeout: 10000 });
395
+
396
+ // Verify circuit breaker stopped making requests after threshold (should be ≤5)
397
+ expect(failureCount).toBeLessThanOrEqual(5);
398
+ });
399
+
400
+ test('rate limiting gracefully handles 429 responses', async ({ page, context }) => {
401
+ let requestCount = 0;
402
+
403
+ await context.route('**/api/search', (route) => {
404
+ requestCount++;
405
+
406
+ if (requestCount > 10) {
407
+ // Rate limit exceeded
408
+ route.fulfill({
409
+ status: 429,
410
+ headers: { 'Retry-After': '5' },
411
+ body: JSON.stringify({ error: 'Rate limit exceeded' }),
412
+ });
413
+ } else {
414
+ route.fulfill({ status: 200, body: JSON.stringify({ results: [] }) });
415
+ }
416
+ });
417
+
418
+ await page.goto('/search');
419
+
420
+ // Make 15 search requests rapidly
421
+ for (let i = 0; i < 15; i++) {
422
+ await page.getByPlaceholder('Search').fill(`query-${i}`);
423
+ await page.getByRole('button', { name: 'Search' }).click();
424
+ }
425
+
426
+ // User sees rate limit message (not crash)
427
+ await expect(page.getByText('Too many requests. Please wait a moment.')).toBeVisible();
428
+ });
429
+ });
430
+ ```
431
+
432
+ **Key Points**:
433
+
434
+ - Error handling: Graceful degradation (500 error → user-friendly message + retry button)
435
+ - Retries: 3 attempts on transient failures (503 → eventual success)
436
+ - Offline handling: Network disconnection detected (sync when reconnected)
437
+ - Health checks: `/api/health` monitors database, cache, queue
438
+ - Circuit breaker: Opens after 5 failures (fallback UI, stop retries)
439
+ - Rate limiting: 429 response handled (Retry-After header respected)
440
+
441
+ **Reliability NFR Criteria**:
442
+
443
+ - ✅ PASS: Error handling, retries, health checks verified (all 6 tests green)
444
+ - ⚠️ CONCERNS: Partial coverage (e.g., missing circuit breaker) or no telemetry
445
+ - ❌ FAIL: No recovery path (500 error crashes app) or unresolved crash scenarios
446
+
447
+ ---
448
+
449
+ ### Example 4: Maintainability NFR Validation (CI Tools, Not Playwright)
450
+
451
+ **Context**: Use proper CI tools for code quality validation (coverage, duplication, vulnerabilities)
452
+
453
+ **Implementation**:
454
+
455
+ ```yaml
456
+ # .github/workflows/nfr-maintainability.yml
457
+ name: NFR - Maintainability
458
+
459
+ on: [push, pull_request]
460
+
461
+ jobs:
462
+ test-coverage:
463
+ runs-on: ubuntu-latest
464
+ steps:
465
+ - uses: actions/checkout@v4
466
+ - uses: actions/setup-node@v4
467
+
468
+ - name: Install dependencies
469
+ run: npm ci
470
+
471
+ - name: Run tests with coverage
472
+ run: npm run test:coverage
473
+
474
+ - name: Check coverage threshold (80% minimum)
475
+ run: |
476
+ COVERAGE=$(jq '.total.lines.pct' coverage/coverage-summary.json)
477
+ echo "Coverage: $COVERAGE%"
478
+ if (( $(echo "$COVERAGE < 80" | bc -l) )); then
479
+ echo "❌ FAIL: Coverage $COVERAGE% below 80% threshold"
480
+ exit 1
481
+ else
482
+ echo "✅ PASS: Coverage $COVERAGE% meets 80% threshold"
483
+ fi
484
+
485
+ code-duplication:
486
+ runs-on: ubuntu-latest
487
+ steps:
488
+ - uses: actions/checkout@v4
489
+ - uses: actions/setup-node@v4
490
+
491
+ - name: Check code duplication (<5% allowed)
492
+ run: |
493
+ npx jscpd src/ --threshold 5 --format json --output duplication.json
494
+ DUPLICATION=$(jq '.statistics.total.percentage' duplication.json)
495
+ echo "Duplication: $DUPLICATION%"
496
+ if (( $(echo "$DUPLICATION >= 5" | bc -l) )); then
497
+ echo "❌ FAIL: Duplication $DUPLICATION% exceeds 5% threshold"
498
+ exit 1
499
+ else
500
+ echo "✅ PASS: Duplication $DUPLICATION% below 5% threshold"
501
+ fi
502
+
503
+ vulnerability-scan:
504
+ runs-on: ubuntu-latest
505
+ steps:
506
+ - uses: actions/checkout@v4
507
+ - uses: actions/setup-node@v4
508
+
509
+ - name: Install dependencies
510
+ run: npm ci
511
+
512
+ - name: Run npm audit (no critical/high vulnerabilities)
513
+ run: |
514
+ npm audit --json > audit.json || true
515
+ CRITICAL=$(jq '.metadata.vulnerabilities.critical' audit.json)
516
+ HIGH=$(jq '.metadata.vulnerabilities.high' audit.json)
517
+ echo "Critical: $CRITICAL, High: $HIGH"
518
+ if [ "$CRITICAL" -gt 0 ] || [ "$HIGH" -gt 0 ]; then
519
+ echo "❌ FAIL: Found $CRITICAL critical and $HIGH high vulnerabilities"
520
+ npm audit
521
+ exit 1
522
+ else
523
+ echo "✅ PASS: No critical/high vulnerabilities"
524
+ fi
525
+ ```
526
+
527
+ **Playwright Tests for Observability (E2E Validation):**
528
+
529
+ ```typescript
530
+ // tests/nfr/observability.spec.ts
531
+ import { test, expect } from '@playwright/test';
532
+
533
+ test.describe('Maintainability NFR: Observability Validation', () => {
534
+ test('critical errors are reported to monitoring service', async ({ page, context }) => {
535
+ const sentryEvents: any[] = [];
536
+
537
+ // Mock Sentry SDK to verify error tracking
538
+ await context.addInitScript(() => {
539
+ (window as any).Sentry = {
540
+ captureException: (error: Error) => {
541
+ console.log('SENTRY_CAPTURE:', JSON.stringify({ message: error.message, stack: error.stack }));
542
+ },
543
+ };
544
+ });
545
+
546
+ page.on('console', (msg) => {
547
+ if (msg.text().includes('SENTRY_CAPTURE:')) {
548
+ sentryEvents.push(JSON.parse(msg.text().replace('SENTRY_CAPTURE:', '')));
549
+ }
550
+ });
551
+
552
+ // Trigger error by mocking API failure
553
+ await context.route('**/api/products', (route) => {
554
+ route.fulfill({ status: 500, body: JSON.stringify({ error: 'Database Error' }) });
555
+ });
556
+
557
+ await page.goto('/products');
558
+
559
+ // Wait for error UI and Sentry capture
560
+ await expect(page.getByText('Unable to load products')).toBeVisible();
561
+
562
+ // Verify error was captured by monitoring
563
+ expect(sentryEvents.length).toBeGreaterThan(0);
564
+ expect(sentryEvents[0]).toHaveProperty('message');
565
+ expect(sentryEvents[0]).toHaveProperty('stack');
566
+ });
567
+
568
+ test('API response times are tracked in telemetry', async ({ request }) => {
569
+ const response = await request.get('/api/products?limit=10');
570
+
571
+ expect(response.ok()).toBeTruthy();
572
+
573
+ // Verify Server-Timing header for APM (Application Performance Monitoring)
574
+ const serverTiming = response.headers()['server-timing'];
575
+
576
+ expect(serverTiming).toBeTruthy();
577
+ expect(serverTiming).toContain('db'); // Database query time
578
+ expect(serverTiming).toContain('total'); // Total processing time
579
+ });
580
+
581
+ test('structured logging present in application', async ({ request }) => {
582
+ // Make API call that generates logs
583
+ const response = await request.post('/api/orders', {
584
+ data: { productId: '123', quantity: 2 },
585
+ });
586
+
587
+ expect(response.ok()).toBeTruthy();
588
+
589
+ // Note: In real scenarios, validate logs in monitoring system (Datadog, CloudWatch)
590
+ // This test validates the logging contract exists (Server-Timing, trace IDs in headers)
591
+ const traceId = response.headers()['x-trace-id'];
592
+ expect(traceId).toBeTruthy(); // Confirms structured logging with correlation IDs
593
+ });
594
+ });
595
+ ```
596
+
597
+ **Key Points**:
598
+
599
+ - **Coverage/duplication**: CI jobs (GitHub Actions), not Playwright tests
600
+ - **Vulnerability scanning**: npm audit in CI, not Playwright tests
601
+ - **Observability**: Playwright validates error tracking (Sentry) and telemetry headers
602
+ - **Structured logging**: Validate logging contract (trace IDs, Server-Timing headers)
603
+ - **Separation of concerns**: Build-time checks (coverage, audit) vs runtime checks (error tracking, telemetry)
604
+
605
+ **Maintainability NFR Criteria**:
606
+
607
+ - ✅ PASS: Clean code (80%+ coverage from CI, <5% duplication from CI), observability validated in E2E, no critical vulnerabilities from npm audit
608
+ - ⚠️ CONCERNS: Duplication >5%, coverage 60-79%, or unclear ownership
609
+ - ❌ FAIL: Absent tests (<60%), tangled implementations (>10% duplication), or no observability
610
+
611
+ ---
612
+
613
+ ## NFR Assessment Checklist
614
+
615
+ Before release gate:
616
+
617
+ - [ ] **Security** (Playwright E2E + Security Tools):
618
+ - [ ] Auth/authz tests green (unauthenticated redirect, RBAC enforced)
619
+ - [ ] Secrets never logged or exposed in errors
620
+ - [ ] OWASP Top 10 validated (SQL injection blocked, XSS sanitized)
621
+ - [ ] Security audit completed (vulnerability scan, penetration test if applicable)
622
+
623
+ - [ ] **Performance** (k6 Load Testing):
624
+ - [ ] SLO/SLA targets met with k6 evidence (p95 <500ms, error rate <1%)
625
+ - [ ] Load testing completed (expected load)
626
+ - [ ] Stress testing completed (breaking point identified)
627
+ - [ ] Spike testing completed (handles traffic spikes)
628
+ - [ ] Endurance testing completed (no memory leaks under sustained load)
629
+
630
+ - [ ] **Reliability** (Playwright E2E + API Tests):
631
+ - [ ] Error handling graceful (500 → user-friendly message + retry)
632
+ - [ ] Retries implemented (3 attempts on transient failures)
633
+ - [ ] Health checks monitored (/api/health endpoint)
634
+ - [ ] Circuit breaker tested (opens after failure threshold)
635
+ - [ ] Offline handling validated (network disconnection graceful)
636
+
637
+ - [ ] **Maintainability** (CI Tools):
638
+ - [ ] Test coverage ≥80% (from CI coverage report)
639
+ - [ ] Code duplication <5% (from jscpd CI job)
640
+ - [ ] No critical/high vulnerabilities (from npm audit CI job)
641
+ - [ ] Structured logging validated (Playwright validates telemetry headers)
642
+ - [ ] Error tracking configured (Sentry/monitoring integration validated)
643
+
644
+ - [ ] **Ambiguous requirements**: Default to CONCERNS (force team to clarify thresholds and evidence)
645
+ - [ ] **NFR criteria documented**: Measurable thresholds defined (not subjective "fast enough")
646
+ - [ ] **Automated validation**: NFR tests run in CI pipeline (not manual checklists)
647
+ - [ ] **Tool selection**: Right tool for each NFR (k6 for performance, Playwright for security/reliability E2E, CI tools for maintainability)
648
+
649
+ ## NFR Gate Decision Matrix
650
+
651
+ | Category | PASS Criteria | CONCERNS Criteria | FAIL Criteria |
652
+ | ------------------- | -------------------------------------------- | -------------------------------------------- | ---------------------------------------------- |
653
+ | **Security** | Auth/authz, secret handling, OWASP verified | Minor gaps with clear owners | Critical exposure or missing controls |
654
+ | **Performance** | Metrics meet SLO/SLA with profiling evidence | Trending toward limits or missing baselines | SLO/SLA breached or resource leaks detected |
655
+ | **Reliability** | Error handling, retries, health checks OK | Partial coverage or missing telemetry | No recovery path or unresolved crash scenarios |
656
+ | **Maintainability** | Clean code, tests, docs shipped together | Duplication, low coverage, unclear ownership | Absent tests, tangled code, no observability |
657
+
658
+ **Default**: If targets or evidence are undefined → **CONCERNS** (force team to clarify before sign-off)
659
+
660
+ ## Integration Points
661
+
662
+ - **Used in workflows**: `*nfr-assess` (automated NFR validation), `*trace` (gate decision Phase 2), `*test-design` (NFR risk assessment via Utility Tree)
663
+ - **Related fragments**: `risk-governance.md` (NFR risk scoring), `probability-impact.md` (NFR impact assessment), `test-quality.md` (maintainability standards), `test-levels-framework.md` (system-level testing for NFRs)
664
+ - **Tools by NFR Category**:
665
+ - **Security**: Playwright (E2E auth/authz), OWASP ZAP, Burp Suite, npm audit, Snyk
666
+ - **Performance**: k6 (load/stress/spike/endurance), Lighthouse (Core Web Vitals), Artillery
667
+ - **Reliability**: Playwright (E2E error handling), API tests (retries, health checks), Chaos Engineering tools
668
+ - **Maintainability**: GitHub Actions (coverage, duplication, audit), jscpd, Playwright (observability validation)
669
+
670
+ _Source: Test Architect course (NFR testing approaches, Utility Tree, Quality Scenarios), ISO/IEC 25010 Software Quality Characteristics, OWASP Top 10, k6 documentation, SRE practices_