bmad-method-test-architecture-enterprise 2.0.2 → 2.0.3-next.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +1 -3
- package/README.md +3 -3
- package/cli/evaluate.js +25 -2
- package/cli/lib/evaluate/preflight.js +77 -1
- package/cli/lib/evaluate/run.js +43 -4
- package/cli/lib/evaluate/status.js +184 -0
- package/package.json +3 -2
- package/skills/bmad-tea/SKILL.md +2 -2
- package/skills/bmad-tea/customize.toml +4 -4
- package/skills/bmad-teach-me-testing/steps-c/step-04-session-01.md +2 -2
- package/skills/bmad-teach-me-testing/steps-c/step-04-session-03.md +1 -1
- package/skills/bmad-teach-me-testing/steps-c/step-04-session-05.md +2 -2
- package/skills/bmad-testarch-automate/red/instructions.md +1 -2
- package/skills/bmad-testarch-automate/resources/test-generation-routing.md +17 -21
- package/skills/bmad-testarch-evaluate/SKILL.md +5 -3
- package/skills/bmad-testarch-evaluate/assets/inspection-record.md +1 -1
- package/skills/bmad-testarch-evaluate/references/authoring-routing.md +29 -0
- package/skills/bmad-testarch-evaluate/references/ci.md +5 -5
- package/skills/bmad-testarch-evaluate/references/run.md +19 -0
- package/skills/bmad-testarch-framework/SKILL.md +2 -2
- package/skills/bmad-testarch-framework/checklist.md +4 -4
- package/skills/bmad-testarch-framework/ci/checklist.md +2 -2
- package/skills/bmad-testarch-framework/ci/instructions.md +1 -1
- package/skills/bmad-testarch-framework/resources/setup-routing.md +4 -4
- package/skills/bmad-testarch-test-design/checklist.md +6 -6
- package/skills/bmad-testarch-test-design/resources/test-design-epic-3.example.md +1 -1
- package/skills/bmad-testarch-test-design/test-design-template.md +1 -1
- package/skills/bmad-testarch-trace/checklist.md +2 -2
- package/skills/bmad-testarch-trace/steps-c/step-04-analyze-gaps.md +1 -1
- package/skills/bmad-testarch-trace/trace-template.md +1 -1
- package/skills/bmod-tea/bmod.toml +2 -4
- package/skills/bmod-tea/help/help.md +1 -3
- package/skills/bmod-tea/help/integrations.md +1 -1
- package/skills/bmod-tea/knowledge/burn-in.md +1 -1
- package/skills/bmod-tea/migration-1.toml +1 -1
- package/skills/bmad-testarch-atdd/SKILL.md +0 -16
- package/skills/bmad-testarch-atdd/bmod.toml +0 -4
- package/skills/bmad-testarch-atdd/customize.toml +0 -38
- package/skills/bmad-testarch-atdd/workflow.yaml +0 -40
- package/skills/bmad-testarch-ci/SKILL.md +0 -14
- package/skills/bmad-testarch-ci/bmod.toml +0 -4
- package/skills/bmad-testarch-ci/customize.toml +0 -43
- package/skills/bmad-testarch-ci/workflow.yaml +0 -44
|
@@ -232,7 +232,7 @@ jobs:
|
|
|
232
232
|
|
|
233
233
|
## Integration with CI Workflow
|
|
234
234
|
|
|
235
|
-
When setting up CI with the `/bmad-testarch-
|
|
235
|
+
When setting up CI with the `/bmad-testarch-framework` skill's CI scope, recommend burn-in for:
|
|
236
236
|
|
|
237
237
|
- Pull request validation
|
|
238
238
|
- Pre-merge checks
|
|
@@ -58,6 +58,6 @@ checklist = [
|
|
|
58
58
|
"`risk_threshold`, `test_design_output`, `test_review_output` and `trace_output` are in no `[modules.tea]` layer.",
|
|
59
59
|
"`ci_platform` and `tea_evaluations_folder` are in no `[modules.tea]` layer.",
|
|
60
60
|
"`uv run _bmad/scripts/resolve_config.py --project-root . --key modules.tea` prints only supported v7 keys; omitted healing options use the shipped defaults.",
|
|
61
|
-
"`uv run _bmad/scripts/resolve_customization.py --skill <skill-root> --project-root . --key workflow`
|
|
61
|
+
"`uv run _bmad/scripts/resolve_customization.py --skill <evaluate-skill-root> --project-root . --key workflow` prints the migrated Evaluate value; Framework CI scope merges `_bmad/custom/bmad-testarch-ci.toml` and its user layer to read the migrated CI value.",
|
|
62
62
|
"Every file the plan listed for removal is either removed in the commit the user chose or reported as still present.",
|
|
63
63
|
]
|
|
@@ -1,16 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: bmad-testarch-atdd
|
|
3
|
-
description: 'Generate red-phase acceptance test scaffolds using the TDD cycle. Use when the user says "lets write acceptance tests" or "I want to do ATDD"'
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# Acceptance Test Generation
|
|
7
|
-
|
|
8
|
-
`bmad-testarch-automate` owns test generation in red and expand modes.
|
|
9
|
-
This entry preserves the ATDD command and AT menu code, with red as its default.
|
|
10
|
-
|
|
11
|
-
1. Preserve the original request, supplied artifacts and Create, Resume, Validate or Edit operation. Set `test_entry = bmad-testarch-atdd`; default to red only when the task has no explicit mode signal.
|
|
12
|
-
2. Set `skill-root` to the sibling `bmad-testarch-automate` directory. Require its `SKILL.md`, `resources/test-generation-routing.md`, `resources/run-and-heal.md`, and `red/steps-c/step-01-preflight-and-context.md`. If any are missing, explain that the canonical skill is missing or older than combined test generation and offer `npx skills add bmad-code-org/bmad-method-test-architecture-enterprise --skill bmad-testarch-automate`. Continue only after installation succeeds and all required files exist.
|
|
13
|
-
3. Read `{skill-root}/SKILL.md` completely and execute its router and activation with the original request. Keep `{skill-root}` canonical throughout. Run only the selected mode's customization hooks; do not activate twice or repeat its operation menu.
|
|
14
|
-
|
|
15
|
-
Existing ATDD customization files and checklist paths keep working.
|
|
16
|
-
Resume accepts interrupted 2.0.0 checklists and preserves their story identity and saved next step.
|
|
@@ -1,38 +0,0 @@
|
|
|
1
|
-
# DO NOT EDIT -- overwritten on every update.
|
|
2
|
-
#
|
|
3
|
-
# Workflow customization surface for bmad-testarch-atdd. Mirrors the
|
|
4
|
-
# agent customization shape under the [workflow] namespace.
|
|
5
|
-
|
|
6
|
-
[workflow]
|
|
7
|
-
|
|
8
|
-
# --- Configurable below. Overrides merge per BMad structural rules: ---
|
|
9
|
-
# scalars: override wins • arrays (persistent_facts, activation_steps_*): append
|
|
10
|
-
|
|
11
|
-
# Steps to run before the standard activation (config load, greet).
|
|
12
|
-
# Overrides append. Use for pre-flight loads, compliance checks, etc.
|
|
13
|
-
|
|
14
|
-
activation_steps_prepend = []
|
|
15
|
-
|
|
16
|
-
# Steps to run after greet but before the workflow begins.
|
|
17
|
-
# Overrides append. Use for context-heavy setup that should happen
|
|
18
|
-
# once the user has been acknowledged.
|
|
19
|
-
|
|
20
|
-
activation_steps_append = []
|
|
21
|
-
|
|
22
|
-
# Persistent facts the workflow keeps in mind for the whole run
|
|
23
|
-
# (testing standards, framework conventions, compliance constraints).
|
|
24
|
-
# Distinct from the runtime memory sidecar — these are static context
|
|
25
|
-
# loaded on activation. Overrides append.
|
|
26
|
-
#
|
|
27
|
-
# Each entry is either:
|
|
28
|
-
# - a literal sentence, e.g. "Every test must run deterministically in CI."
|
|
29
|
-
# - a file reference prefixed with `file:`, e.g. "file:{project-root}/docs/test-standards.md"
|
|
30
|
-
# (glob patterns are supported; matching files load in lexical path order as facts).
|
|
31
|
-
|
|
32
|
-
persistent_facts = []
|
|
33
|
-
|
|
34
|
-
# Scalar: executed when the workflow reaches its terminal step in any
|
|
35
|
-
# mode (create, validate, edit), after the final outputs are produced.
|
|
36
|
-
# Override wins. Leave empty for no custom post-completion behavior.
|
|
37
|
-
|
|
38
|
-
on_complete = ""
|
|
@@ -1,40 +0,0 @@
|
|
|
1
|
-
# Test Architect workflow: bmad-testarch-atdd
|
|
2
|
-
name: bmad-testarch-atdd
|
|
3
|
-
# prettier-ignore
|
|
4
|
-
description: 'Generate red-phase acceptance test scaffolds using TDD cycle. Use when the user says "lets write acceptance tests" or "I want to do ATDD"'
|
|
5
|
-
|
|
6
|
-
# Config (test_artifacts, user_name, languages) is resolved at activation in SKILL.md from modules.tea and core.
|
|
7
|
-
date: system-generated
|
|
8
|
-
|
|
9
|
-
# Workflow components
|
|
10
|
-
installed_path: "../bmad-testarch-automate/red"
|
|
11
|
-
instructions: "../bmad-testarch-automate/red/instructions.md"
|
|
12
|
-
validation: "../bmad-testarch-automate/red/checklist.md"
|
|
13
|
-
template: "../bmad-testarch-automate/red/atdd-checklist-template.md"
|
|
14
|
-
|
|
15
|
-
# Variables and inputs
|
|
16
|
-
variables:
|
|
17
|
-
test_dir: "{project-root}/tests" # Root test directory
|
|
18
|
-
|
|
19
|
-
# Output configuration
|
|
20
|
-
default_output_file: "{test_artifacts}/atdd/atdd-checklist-{story_key}.md"
|
|
21
|
-
|
|
22
|
-
# Required tools
|
|
23
|
-
required_tools:
|
|
24
|
-
- read_file # Read story markdown, framework config
|
|
25
|
-
- write_file # Create test files, checklist, factory stubs
|
|
26
|
-
- create_directory # Create test directories
|
|
27
|
-
- list_files # Find existing fixtures and helpers
|
|
28
|
-
- search_repo # Search for similar test patterns
|
|
29
|
-
|
|
30
|
-
tags:
|
|
31
|
-
- qa
|
|
32
|
-
- atdd
|
|
33
|
-
- test-architect
|
|
34
|
-
- tdd
|
|
35
|
-
- red-green-refactor
|
|
36
|
-
|
|
37
|
-
execution_hints:
|
|
38
|
-
interactive: false # Minimize prompts
|
|
39
|
-
autonomous: true # Proceed without user input unless blocked
|
|
40
|
-
iterative: true
|
|
@@ -1,14 +0,0 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: bmad-testarch-ci
|
|
3
|
-
description: 'Scaffold CI/CD quality pipeline with test execution. Use when the user says "lets setup CI pipeline" or "I want to create quality gates"'
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# CI/CD Setup Compatibility Entry
|
|
7
|
-
|
|
8
|
-
`bmad-testarch-framework` owns framework and CI setup. This installed name and the CI menu code forward to its CI phase.
|
|
9
|
-
|
|
10
|
-
1. Preserve the original request, its supplied artifacts, and its create/resume/validate/edit operation. Preset `setup_scope = ci` and `setup_entry = bmad-testarch-ci`. An explicit request for both scopes sets `setup_scope = both`.
|
|
11
|
-
2. Set `ci-skill-root` to this directory. Set `skill-root` to its sibling `bmad-testarch-framework` directory. Require its `SKILL.md`, `{skill-root}/resources/setup-routing.md`, and `{skill-root}/ci/steps-c/step-01-preflight.md`. If any are missing, explain that the canonical framework skill is missing or older than combined setup support and offer to install/update it with `npx skills add bmad-code-org/bmad-method-test-architecture-enterprise --skill bmad-testarch-framework`; continue only after installation succeeds and all three required files exist.
|
|
12
|
-
3. Load `{skill-root}/SKILL.md` completely and execute its activation and shared router with the preset scope and original operation. Keep `{skill-root}` bound to that canonical directory throughout all phases. Do not run a second mode menu or CI-scope question.
|
|
13
|
-
|
|
14
|
-
The canonical router resolves this entry's `customize.toml`, `_bmad/custom/bmad-testarch-ci.toml`, and `_bmad/custom/bmad-testarch-ci.user.toml` when the CI phase activates. It preserves legacy activation steps, persistent facts, `ci_platform`, and `on_complete` hooks. Existing CI checkpoint and validation-report paths remain under `{test_artifacts}/ci/`, including their legacy migration rules.
|
|
@@ -1,43 +0,0 @@
|
|
|
1
|
-
# DO NOT EDIT -- overwritten on every update.
|
|
2
|
-
#
|
|
3
|
-
# Workflow customization surface for bmad-testarch-ci. Mirrors the
|
|
4
|
-
# agent customization shape under the [workflow] namespace.
|
|
5
|
-
|
|
6
|
-
[workflow]
|
|
7
|
-
|
|
8
|
-
# --- Configurable below. Overrides merge per BMad structural rules: ---
|
|
9
|
-
# scalars: override wins • arrays (persistent_facts, activation_steps_*): append
|
|
10
|
-
|
|
11
|
-
# Steps to run before the standard activation (config load, greet).
|
|
12
|
-
# Overrides append. Use for pre-flight loads, compliance checks, etc.
|
|
13
|
-
|
|
14
|
-
activation_steps_prepend = []
|
|
15
|
-
|
|
16
|
-
# Steps to run after greet but before the workflow begins.
|
|
17
|
-
# Overrides append. Use for context-heavy setup that should happen
|
|
18
|
-
# once the user has been acknowledged.
|
|
19
|
-
|
|
20
|
-
activation_steps_append = []
|
|
21
|
-
|
|
22
|
-
# Persistent facts the workflow keeps in mind for the whole run
|
|
23
|
-
# (testing standards, framework conventions, compliance constraints).
|
|
24
|
-
# Distinct from the runtime memory sidecar — these are static context
|
|
25
|
-
# loaded on activation. Overrides append.
|
|
26
|
-
#
|
|
27
|
-
# Each entry is either:
|
|
28
|
-
# - a literal sentence, e.g. "Every test must run deterministically in CI."
|
|
29
|
-
# - a file reference prefixed with `file:`, e.g. "file:{project-root}/docs/test-standards.md"
|
|
30
|
-
# (glob patterns are supported; matching files load in lexical path order as facts).
|
|
31
|
-
|
|
32
|
-
persistent_facts = []
|
|
33
|
-
|
|
34
|
-
# Scalar: executed when the workflow reaches its terminal step in any
|
|
35
|
-
# mode (create, validate, edit), after the final outputs are produced.
|
|
36
|
-
# Override wins. Leave empty for no custom post-completion behavior.
|
|
37
|
-
|
|
38
|
-
on_complete = ""
|
|
39
|
-
|
|
40
|
-
# CI platform to generate for: auto (detect from the repository), github-actions, gitlab-ci,
|
|
41
|
-
# jenkins, azure-devops, harness, circle-ci or other. Anything but auto skips detection.
|
|
42
|
-
|
|
43
|
-
ci_platform = "auto"
|
|
@@ -1,44 +0,0 @@
|
|
|
1
|
-
# Test Architect workflow: bmad-testarch-ci
|
|
2
|
-
name: bmad-testarch-ci
|
|
3
|
-
# prettier-ignore
|
|
4
|
-
description: 'Scaffold CI/CD quality pipeline with test execution. Use when the user says "lets setup CI pipeline" or "I want to create quality gates"'
|
|
5
|
-
|
|
6
|
-
# Config (test_artifacts, user_name, languages) is resolved at activation in SKILL.md from modules.tea and core.
|
|
7
|
-
date: system-generated
|
|
8
|
-
|
|
9
|
-
# Compatibility metadata. Canonical framework SKILL.md activates shared routing with CI scope.
|
|
10
|
-
# Workflow components
|
|
11
|
-
installed_path: "../bmad-testarch-framework"
|
|
12
|
-
instructions: "../bmad-testarch-framework/ci/instructions.md"
|
|
13
|
-
validation: "../bmad-testarch-framework/ci/checklist.md"
|
|
14
|
-
|
|
15
|
-
# Variables and inputs
|
|
16
|
-
variables:
|
|
17
|
-
setup_scope: "ci" # preset by compatibility entry
|
|
18
|
-
setup_entry: "bmad-testarch-ci"
|
|
19
|
-
test_dir: "{project-root}/tests" # Root test directory
|
|
20
|
-
test_stack_type: "auto" # auto, frontend, backend, fullstack, mobile - detected or user override
|
|
21
|
-
test_framework: "auto" # auto, playwright, cypress, jest, vitest - detected or user override
|
|
22
|
-
|
|
23
|
-
# Output configuration (resolved dynamically based on ci_platform detection)
|
|
24
|
-
default_output_file: "{project-root}/.github/workflows/test.yml" # GitHub Actions default; overridden per platform
|
|
25
|
-
|
|
26
|
-
# Required tools
|
|
27
|
-
required_tools:
|
|
28
|
-
- read_file # Read .nvmrc, package.json, framework config
|
|
29
|
-
- write_file # Create CI config, scripts, documentation
|
|
30
|
-
- create_directory # Create .github/workflows/ or .gitlab-ci/ directories
|
|
31
|
-
- list_files # Detect existing CI configuration
|
|
32
|
-
- search_repo # Find test files for selective testing
|
|
33
|
-
|
|
34
|
-
tags:
|
|
35
|
-
- qa
|
|
36
|
-
- ci-cd
|
|
37
|
-
- test-architect
|
|
38
|
-
- pipeline
|
|
39
|
-
- automation
|
|
40
|
-
|
|
41
|
-
execution_hints:
|
|
42
|
-
interactive: false # Minimize prompts, auto-detect when possible
|
|
43
|
-
autonomous: true # Proceed without user input unless blocked
|
|
44
|
-
iterative: true
|