@tea-agent/loop-agent 0.13.0 → 0.14.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (270) hide show
  1. package/AGENTS.md +157 -157
  2. package/CHANGELOG.md +73 -301
  3. package/README.md +338 -334
  4. package/bin/agent-worker.js +22 -22
  5. package/bin/loop-agent.js +21 -21
  6. package/dist/commands/cursor-prompt.js +6 -6
  7. package/dist/commands/init.js +505 -505
  8. package/dist/commands/loop-benchmark.js +11 -11
  9. package/dist/commands/pi-reuse-benchmark.js +16 -16
  10. package/dist/executors/pi-event-serializer.js +33 -11
  11. package/dist/sidecars/cursor-prompt/executor.js +1 -1
  12. package/dist/task/runtime.js +27 -27
  13. package/dist/worker/observe/spec-evidence.js +19 -10
  14. package/dist/worker/observe/static/api.js +46 -46
  15. package/dist/worker/observe/static/app.js +151 -150
  16. package/dist/worker/observe/static/constants.js +156 -148
  17. package/dist/worker/observe/static/copy.js +67 -67
  18. package/dist/worker/observe/static/dag-helpers.js +201 -172
  19. package/dist/worker/observe/static/dag-layout.d.ts +31 -31
  20. package/dist/worker/observe/static/dag-layout.js +83 -83
  21. package/dist/worker/observe/static/dag-model.js +72 -72
  22. package/dist/worker/observe/static/dom.js +122 -122
  23. package/dist/worker/observe/static/format-pool.d.ts +71 -0
  24. package/dist/worker/observe/static/format-pool.js +134 -67
  25. package/dist/worker/observe/static/format.js +317 -292
  26. package/dist/worker/observe/static/index.html +350 -308
  27. package/dist/worker/observe/static/kpi.js +100 -94
  28. package/dist/worker/observe/static/markdown-render.js +124 -0
  29. package/dist/worker/observe/static/relations.js +133 -133
  30. package/dist/worker/observe/static/router.js +93 -93
  31. package/dist/worker/observe/static/run-processing.js +148 -148
  32. package/dist/worker/observe/static/shell-chrome.js +74 -68
  33. package/dist/worker/observe/static/state.js +273 -267
  34. package/dist/worker/observe/static/styles.css +2504 -1902
  35. package/dist/worker/observe/static/views/batch.js +227 -227
  36. package/dist/worker/observe/static/views/dag-graph.js +172 -172
  37. package/dist/worker/observe/static/views/dag-inspector.js +530 -627
  38. package/dist/worker/observe/static/views/dag.js +371 -371
  39. package/dist/worker/observe/static/views/dashboard.js +86 -100
  40. package/dist/worker/observe/static/views/failures.js +143 -143
  41. package/dist/worker/observe/static/views/feature.js +492 -492
  42. package/dist/worker/observe/static/views/pool.js +708 -350
  43. package/dist/worker/observe/static/views/run.js +453 -453
  44. package/dist/worker/observe/static/views/session-timeline.js +771 -219
  45. package/dist/worker/observe/static/views/shell.js +7 -7
  46. package/dist/worker/observe/static/views/task.js +314 -314
  47. package/dist/worker/observe/static/views/timeline.js +163 -163
  48. package/dist/workflows/dag/canvas-observer.js +275 -275
  49. package/docs/README.md +105 -104
  50. package/docs/agent-dag-recovery-playbook.md +195 -195
  51. package/docs/agent-dag-runner.md +67 -67
  52. package/docs/architecture/README.md +26 -26
  53. package/docs/architecture/dag-execution.md +140 -140
  54. package/docs/architecture/evolution.md +54 -54
  55. package/docs/architecture/facts-and-state.md +71 -71
  56. package/docs/architecture/runtime-boundaries.md +191 -191
  57. package/docs/architecture/system-overview.md +93 -93
  58. package/docs/architecture/worker-and-feature.md +85 -85
  59. package/docs/cursor-prompt-sidecar.md +36 -36
  60. package/docs/decisions/README.md +18 -18
  61. package/docs/design/README.md +167 -167
  62. package/docs/development-principles.md +73 -73
  63. package/docs/exec-plans/README.md +6 -6
  64. package/docs/exec-plans/active/README.md +2 -1
  65. package/docs/exec-plans/completed/README.md +105 -104
  66. package/docs/feature-workflow.md +414 -414
  67. package/docs/harness-methodology-debugging.md +153 -153
  68. package/docs/harness-methodology-tdd.md +130 -130
  69. package/docs/harness-methodology-verification.md +27 -27
  70. package/docs/init-surface.manifest.json +307 -307
  71. package/docs/loop-agent-harness.md +142 -142
  72. package/docs/production-readiness.md +96 -96
  73. package/docs/progress/README.md +59 -58
  74. package/docs/reports/README.md +123 -119
  75. package/docs/skills/README.md +7 -7
  76. package/docs/skills/vetted-skill-registry.md +29 -29
  77. package/docs/templates/adr.md +60 -60
  78. package/docs/templates/agent-dag-authority-surface-audit.prompt.md +94 -94
  79. package/docs/templates/agent-dag-decision-envelope.schema.json +213 -213
  80. package/docs/templates/agent-dag-decision-gate-dogfood-report.md +117 -117
  81. package/docs/templates/agent-dag-decision-gate.prompt.md +246 -246
  82. package/docs/templates/agent-dag-process-supervisor.prompt.md +98 -98
  83. package/docs/templates/agent-dag-report.schema.json +473 -473
  84. package/docs/templates/agent-dag-review-verdict.prompt.md +68 -68
  85. package/docs/templates/agent-dag.base.json +190 -190
  86. package/docs/templates/agent-dag.final-verification.json +185 -185
  87. package/docs/templates/agent-dag.schema.json +411 -411
  88. package/docs/templates/agent-dag.supervised-implementation.json +620 -620
  89. package/docs/templates/backend-test-analysis.schema.json +44 -44
  90. package/docs/templates/backend-test-case-manifest.schema.json +190 -190
  91. package/docs/templates/backend-test-dag.classify.prompt.md +75 -75
  92. package/docs/templates/backend-test-dag.generate-pytest.prompt.md +204 -204
  93. package/docs/templates/backend-test-dag.json +559 -559
  94. package/docs/templates/backend-test-dag.retrospect.prompt.md +139 -139
  95. package/docs/templates/backend-test-dag.review-cases.prompt.md +83 -83
  96. package/docs/templates/backend-test-execution.schema.json +133 -133
  97. package/docs/templates/backend-test-result.schema.json +99 -99
  98. package/docs/templates/exec-plan.md +64 -64
  99. package/docs/templates/feature-spec.md +53 -53
  100. package/docs/templates/frontend-design-contract.md +42 -42
  101. package/docs/templates/frontend-eval/fixtures/failures/01-type-build-error.md +17 -17
  102. package/docs/templates/frontend-eval/fixtures/failures/02-unit-component-test-fail.md +16 -16
  103. package/docs/templates/frontend-eval/fixtures/failures/03-fixture-schema-drift.md +16 -16
  104. package/docs/templates/frontend-eval/fixtures/failures/04-missing-loading-empty-error-state.md +16 -16
  105. package/docs/templates/frontend-eval/fixtures/failures/05-forbidden-write-writeset-expansion.md +16 -16
  106. package/docs/templates/frontend-eval/fixtures/failures/06-unapproved-dependency-add.md +16 -16
  107. package/docs/templates/frontend-eval/fixtures/failures/07-mock-production-on.md +21 -21
  108. package/docs/templates/frontend-eval/fixtures/functional/01-simple-component-style.md +29 -29
  109. package/docs/templates/frontend-eval/fixtures/functional/02-form-validation.md +28 -28
  110. package/docs/templates/frontend-eval/fixtures/functional/03-list-detail-page.md +28 -28
  111. package/docs/templates/frontend-eval/fixtures/functional/04-api-mock.md +29 -29
  112. package/docs/templates/frontend-eval/fixtures/functional/05-permission-auth-gated-ui.md +27 -27
  113. package/docs/templates/frontend-eval/fixtures/functional/06-ssr-server-client-boundary.md +28 -28
  114. package/docs/templates/frontend-eval/fixtures/functional/07-shared-public-component-api.md +28 -28
  115. package/docs/templates/frontend-eval/fixtures/functional/08-pure-local-no-remote.md +27 -27
  116. package/docs/templates/frontend-eval/metrics.md +138 -138
  117. package/docs/templates/frontend-eval/smoke-targets.md +53 -53
  118. package/docs/templates/frontend-implementation-contract.schema.json +27 -27
  119. package/docs/templates/frontend-task-constraints.md +35 -35
  120. package/docs/templates/frontend-task-requirement.md +70 -70
  121. package/docs/templates/frontend-test-dag.generate-cases.prompt.md +5 -5
  122. package/docs/templates/frontend-test-dag.json +23 -23
  123. package/docs/templates/frontend-test-dag.retrieve-context.prompt.md +3 -3
  124. package/docs/templates/frontend-test-dag.retrospect.prompt.md +3 -3
  125. package/docs/templates/frontend-test-dag.review-cases.prompt.md +3 -3
  126. package/docs/templates/frontend-test-dag.review-execution.prompt.md +3 -3
  127. package/docs/templates/harness.schema.json +221 -221
  128. package/docs/templates/hybrid-dag.json +188 -188
  129. package/docs/templates/init-evolution-review.md +35 -35
  130. package/docs/templates/interactive-ui-round2-experiment.md +66 -66
  131. package/docs/templates/knowledge-graph-bootstrap-dag.json +118 -118
  132. package/docs/templates/knowledge-sync-dag.json +178 -178
  133. package/docs/templates/knowledge-sync-draft.schema.json +71 -71
  134. package/docs/templates/product-line/AGENTS.md +8 -8
  135. package/docs/templates/product-line/README.md +9 -9
  136. package/docs/templates/product-line/acceptance.yaml +14 -14
  137. package/docs/templates/product-line/closeout.yaml +9 -9
  138. package/docs/templates/product-line/design.md +13 -13
  139. package/docs/templates/product-line/links.md +10 -10
  140. package/docs/templates/product-line/requirement.md +17 -17
  141. package/docs/templates/product-line/task-graph.yaml +15 -15
  142. package/docs/templates/product-line/task.yaml +64 -64
  143. package/docs/templates/product-line/test-plan.md +7 -7
  144. package/docs/templates/production-readiness-checklist.md +57 -57
  145. package/docs/templates/progress-log.md +17 -17
  146. package/docs/templates/project-start-checklist.md +9 -9
  147. package/docs/templates/qa-report.md +48 -48
  148. package/docs/templates/sprint-contract.md +29 -29
  149. package/docs/templates/worker-dogfood-evidence.md +80 -80
  150. package/docs/templates/worker-dogfood-setup.md +68 -68
  151. package/docs/verification-matrix.md +70 -70
  152. package/examples/decision-gate-agent-dag.json +173 -173
  153. package/examples/example-dag.json +46 -46
  154. package/examples/hybrid-loop-agent-dag.json +188 -188
  155. package/harness.json +66 -66
  156. package/package.json +88 -52
  157. package/scripts/check-product-line-docs.sh +29 -29
  158. package/scripts/check-task-pool-root.sh +32 -32
  159. package/scripts/kb-bootstrap-init-skeleton.sh +240 -240
  160. package/scripts/kb-graph-incremental-prepare.mjs +386 -386
  161. package/scripts/kb-graph-incremental-prepare.sh +5 -5
  162. package/scripts/kb-graph-materialize.mjs +105 -105
  163. package/scripts/kb-graph-materialize.sh +4 -4
  164. package/scripts/kb-graph-promote.mjs +164 -164
  165. package/scripts/kb-graph-promote.sh +4 -4
  166. package/scripts/kb-query.mjs +554 -554
  167. package/scripts/kb-query.sh +5 -5
  168. package/skills/agent-worker/SKILL.md +39 -39
  169. package/skills/agent-worker/references/agent-worker-operator.md +60 -60
  170. package/skills/ai-engineering-context/SKILL.md +48 -48
  171. package/skills/analyze-product-dependencies/SKILL.md +67 -67
  172. package/skills/analyze-product-dependencies/agents/openai.yaml +4 -4
  173. package/skills/analyze-product-dependencies/references/api-documentation-schema.md +30 -30
  174. package/skills/analyze-product-dependencies/references/dependency-analysis-schema.md +28 -28
  175. package/skills/analyze-product-dependencies/references/example.md +76 -76
  176. package/skills/analyze-product-dependencies/references/forward-test-cases.md +35 -35
  177. package/skills/analyze-product-dependencies/references/input-contract.md +11 -11
  178. package/skills/analyze-product-dependencies/references/scouting-rules.md +61 -61
  179. package/skills/analyze-product-dependencies/scripts/test-validators.mjs +267 -267
  180. package/skills/analyze-product-dependencies/scripts/validate-api-documentation.mjs +101 -101
  181. package/skills/analyze-product-dependencies/scripts/validate-dependency-analysis.mjs +142 -142
  182. package/skills/analyze-product-dependencies/scripts/validate-product-requirement-input.mjs +76 -76
  183. package/skills/analyze-product-dependencies/scripts/validation-helpers.mjs +146 -146
  184. package/skills/analyze-product-requirements/SKILL.md +90 -90
  185. package/skills/analyze-product-requirements/agents/openai.yaml +4 -4
  186. package/skills/analyze-product-requirements/references/acceptance-criteria.md +91 -91
  187. package/skills/analyze-product-requirements/references/clarification-and-knowledge.md +56 -56
  188. package/skills/analyze-product-requirements/references/example.md +86 -86
  189. package/skills/analyze-product-requirements/references/forward-test-cases.md +66 -66
  190. package/skills/analyze-product-requirements/references/product-analysis-schema.md +32 -32
  191. package/skills/analyze-product-requirements/references/product-requirement-schema.md +33 -33
  192. package/skills/analyze-product-requirements/references/requirement-clarification-schema.md +35 -35
  193. package/skills/analyze-product-requirements/scripts/test-validators.mjs +193 -193
  194. package/skills/analyze-product-requirements/scripts/validate-product-analysis.mjs +69 -69
  195. package/skills/analyze-product-requirements/scripts/validate-product-requirement.mjs +97 -97
  196. package/skills/analyze-product-requirements/scripts/validate-requirement-clarification.mjs +98 -98
  197. package/skills/analyze-product-requirements/scripts/validation-helpers.mjs +156 -156
  198. package/skills/browser-tools/SKILL.md +196 -196
  199. package/skills/browser-tools/browser-content.js +103 -103
  200. package/skills/browser-tools/browser-cookies.js +35 -35
  201. package/skills/browser-tools/browser-eval.js +53 -53
  202. package/skills/browser-tools/browser-hn-scraper.js +108 -108
  203. package/skills/browser-tools/browser-nav.js +44 -44
  204. package/skills/browser-tools/browser-pick.js +162 -162
  205. package/skills/browser-tools/browser-screenshot.js +34 -34
  206. package/skills/browser-tools/browser-start.js +86 -86
  207. package/skills/browser-tools/package-lock.json +2556 -2556
  208. package/skills/browser-tools/package.json +19 -19
  209. package/skills/code-review-core/SKILL.md +20 -20
  210. package/skills/codebase-scout/SKILL.md +19 -19
  211. package/skills/frontend-design-review/SKILL.md +66 -66
  212. package/skills/frontend-design-review/references/review-checklist.md +58 -58
  213. package/skills/frontend-implementation/SKILL.md +49 -49
  214. package/skills/frontend-implementation/references/code-standards.md +32 -32
  215. package/skills/frontend-implementation/references/design-spec.md +46 -46
  216. package/skills/frontend-implementation/references/node-contracts.md +27 -27
  217. package/skills/frontend-review/SKILL.md +59 -59
  218. package/skills/frontend-review/references/review-findings.md +47 -47
  219. package/skills/frontend-verification/SKILL.md +53 -53
  220. package/skills/frontend-verification/references/verification-checklist.md +68 -68
  221. package/skills/grill-me/SKILL.md +10 -10
  222. package/skills/grill-with-docs/SKILL.md +88 -88
  223. package/skills/grill-with-docs/adr-format.md +47 -47
  224. package/skills/grill-with-docs/context-format.md +60 -60
  225. package/skills/init-capability-evolution/SKILL.md +70 -70
  226. package/skills/loop-agent/SKILL.md +151 -151
  227. package/skills/loop-agent/references/README.md +67 -67
  228. package/skills/loop-agent/references/command-reference.md +527 -527
  229. package/skills/loop-agent/references/docs-converge.md +126 -126
  230. package/skills/loop-agent/references/harness-policy.md +263 -263
  231. package/skills/loop-agent/references/hybrid-dag.md +243 -243
  232. package/skills/loop-agent/references/learned/README.md +21 -21
  233. package/skills/loop-agent/references/long-running-loop.md +57 -57
  234. package/skills/loop-agent/references/model-routing.md +36 -36
  235. package/skills/loop-agent/references/multi-worktree.md +54 -54
  236. package/skills/loop-agent/references/one-shot-runs.md +85 -85
  237. package/skills/loop-agent/references/orchestrator-and-interventions.md +169 -169
  238. package/skills/loop-agent/references/pi-prompt.md +23 -23
  239. package/skills/loop-agent/references/pi-subagent-assisted-mode.md +84 -84
  240. package/skills/loop-agent/references/post-implementation-and-patterns.md +44 -44
  241. package/skills/loop-agent/references/task-workflow.md +89 -89
  242. package/skills/loop-agent/references/verification-and-failure-handling.md +141 -141
  243. package/skills/playwright-cli/SKILL.md +420 -420
  244. package/skills/playwright-cli/references/element-attributes.md +23 -23
  245. package/skills/playwright-cli/references/playwright-tests.md +39 -39
  246. package/skills/playwright-cli/references/request-mocking.md +87 -87
  247. package/skills/playwright-cli/references/running-code.md +241 -241
  248. package/skills/playwright-cli/references/session-management.md +225 -225
  249. package/skills/playwright-cli/references/storage-state.md +275 -275
  250. package/skills/playwright-cli/references/test-generation.md +433 -433
  251. package/skills/playwright-cli/references/tracing.md +139 -139
  252. package/skills/playwright-cli/references/video-recording.md +143 -143
  253. package/skills/playwright-cli-case-generator/SKILL.md +74 -74
  254. package/skills/requesting-code-review/SKILL.md +101 -101
  255. package/skills/requesting-code-review/code-reviewer.md +168 -168
  256. package/skills/systematic-debugging/CREATION-LOG.md +119 -119
  257. package/skills/systematic-debugging/SKILL.md +296 -296
  258. package/skills/systematic-debugging/condition-based-waiting-example.ts +158 -158
  259. package/skills/systematic-debugging/condition-based-waiting.md +115 -115
  260. package/skills/systematic-debugging/defense-in-depth.md +122 -122
  261. package/skills/systematic-debugging/find-polluter.sh +63 -63
  262. package/skills/systematic-debugging/root-cause-tracing.md +169 -169
  263. package/skills/systematic-debugging/test-academic.md +14 -14
  264. package/skills/systematic-debugging/test-pressure-1.md +58 -58
  265. package/skills/systematic-debugging/test-pressure-2.md +68 -68
  266. package/skills/systematic-debugging/test-pressure-3.md +69 -69
  267. package/skills/test-driven-development/SKILL.md +20 -20
  268. package/skills/using-git-worktrees/SKILL.md +215 -215
  269. package/skills/verification-before-completion/SKILL.md +154 -154
  270. package/skills/webapp-testing/SKILL.md +19 -19
@@ -1,75 +1,75 @@
1
- # Backend Test DAG Classify Prompt Template
2
-
3
- ## Purpose
4
-
5
- Use this prompt for a **read-only classification** node: `executor: "pi"`, `role: "reviewer"`, `writePolicy: "read-only"`. The agent reads the run-owned Backend Test Result v1 artifact and returns structured failure classification JSON.
6
-
7
- Do **not** create a new executor type. Do **not** write repository files.
8
-
9
- ## Recommended DAG Node Shape
10
-
11
- ```json
12
- {
13
- "id": "classify-backend-test-result-pi",
14
- "depends_on": ["parse-backend-test-result-shell"],
15
- "complexity": "MED",
16
- "executor": "pi",
17
- "role": "reviewer",
18
- "writePolicy": "read-only",
19
- "allowedPaths": ["**"],
20
- "forbiddenPaths": [".harness/**", "artifacts/**"],
21
- "outputContract": "Pure JSON classification: category in {ProductBug,TestBug,EnvFailure,ContractMismatch,FlakyTest,Unknown}, evidence[], confidence (capped), notes. No file writes.",
22
- "subtask_prompt_markdown": "./backend-test-dag.classify.prompt.md"
23
- }
24
- ```
25
-
26
- ## Prompt Body
27
-
28
- You are the Backend Test DAG **result classifier** agent.
29
-
30
- Your job is to classify the structured Backend Test Result v1 produced by `parse-backend-test-result-shell`. Return **exactly one JSON object**. Prefer pure JSON; a single fenced `json` block is tolerated; no trailing prose. Read-only: do not modify code, docs, artifacts, or repository files.
31
-
32
- ### Inputs (authoritative)
33
-
34
- 1. **Result v1** — `$HARNESS_DAG_RUN_DIR/contracts/backend-test-result.json` (schemaId `backend-test-result-v1`).
35
- 2. Optional: execute-node stdout markers (`pytestExitCode=…`, `JUnit report: …`) as secondary evidence only.
36
-
37
- Do **not** invent pass rates or failure lists from raw logs when Result v1 is present. Counts and `failures[]` come from the result artifact only.
38
-
39
- ### Output JSON shape
40
-
41
- ```json
42
- {
43
- "schemaVersion": 1,
44
- "category": "ProductBug",
45
- "confidence": 0.0,
46
- "evidence": ["result.outcome=completed-with-failures", "failures[0].name=…"],
47
- "notes": "short rationale",
48
- "forbiddenCategoriesHonored": ["FlakyTest"]
49
- }
50
- ```
51
-
52
- ### Categories
53
-
54
- | Category | When |
55
- |----------|------|
56
- | **ProductBug** | Assertion failures that indicate implementation/API behavior mismatch (only when collection/command/report are healthy). |
57
- | **TestBug** | Broken test code, wrong expectations, bad fixtures, or collection/import errors clearly in tests. |
58
- | **EnvFailure** | Missing env, service down, tooling/runtime failure, command-error. |
59
- | **ContractMismatch** | Execution/analysis contract assumptions violated (wrong testRoot/mode, missing readiness). |
60
- | **FlakyTest** | **Only** with multi-run historical evidence of intermittent pass/fail. |
61
- | **Unknown** | Insufficient evidence. |
62
-
63
- ### Hard constraints (MUST)
64
-
65
- 1. **Single-run failure MUST NOT use `FlakyTest`.** Prefer `Unknown`, `TestBug`, or `ProductBug`.
66
- 2. If `executionStatus` or `outcome` is `collection-error`, `command-error`, or `report-error`, **MUST NOT** use `ProductBug`. Prefer `EnvFailure`, `TestBug`, or `Unknown`.
67
- 3. If `outcome=passed` with `failed=0` and `error=0`, set `category` to `Unknown` (or omit product diagnosis) and note all-pass; do not invent bugs.
68
- 4. `confidence` caps: ≤ `0.75` for assertion failures; ≤ `0.6` for env/collection/command/report errors; `1.0` only for all-pass with no issues.
69
- 5. `evidence[]` must cite concrete result fields (`outcome`, `executionStatus`, `failed`, `failures[].name`, `pytestExitCode`).
70
-
71
- ### Non-goals
72
-
73
- - Do not rewrite Result v1.
74
- - Do not decide final DAG success/failure (that is `backend-test-outcome-gate-shell`).
75
- - Do not implement M3 case manifest / Task Pool auto follow-up.
1
+ # Backend Test DAG Classify Prompt Template
2
+
3
+ ## Purpose
4
+
5
+ Use this prompt for a **read-only classification** node: `executor: "pi"`, `role: "reviewer"`, `writePolicy: "read-only"`. The agent reads the run-owned Backend Test Result v1 artifact and returns structured failure classification JSON.
6
+
7
+ Do **not** create a new executor type. Do **not** write repository files.
8
+
9
+ ## Recommended DAG Node Shape
10
+
11
+ ```json
12
+ {
13
+ "id": "classify-backend-test-result-pi",
14
+ "depends_on": ["parse-backend-test-result-shell"],
15
+ "complexity": "MED",
16
+ "executor": "pi",
17
+ "role": "reviewer",
18
+ "writePolicy": "read-only",
19
+ "allowedPaths": ["**"],
20
+ "forbiddenPaths": [".harness/**", "artifacts/**"],
21
+ "outputContract": "Pure JSON classification: category in {ProductBug,TestBug,EnvFailure,ContractMismatch,FlakyTest,Unknown}, evidence[], confidence (capped), notes. No file writes.",
22
+ "subtask_prompt_markdown": "./backend-test-dag.classify.prompt.md"
23
+ }
24
+ ```
25
+
26
+ ## Prompt Body
27
+
28
+ You are the Backend Test DAG **result classifier** agent.
29
+
30
+ Your job is to classify the structured Backend Test Result v1 produced by `parse-backend-test-result-shell`. Return **exactly one JSON object**. Prefer pure JSON; a single fenced `json` block is tolerated; no trailing prose. Read-only: do not modify code, docs, artifacts, or repository files.
31
+
32
+ ### Inputs (authoritative)
33
+
34
+ 1. **Result v1** — `$HARNESS_DAG_RUN_DIR/contracts/backend-test-result.json` (schemaId `backend-test-result-v1`).
35
+ 2. Optional: execute-node stdout markers (`pytestExitCode=…`, `JUnit report: …`) as secondary evidence only.
36
+
37
+ Do **not** invent pass rates or failure lists from raw logs when Result v1 is present. Counts and `failures[]` come from the result artifact only.
38
+
39
+ ### Output JSON shape
40
+
41
+ ```json
42
+ {
43
+ "schemaVersion": 1,
44
+ "category": "ProductBug",
45
+ "confidence": 0.0,
46
+ "evidence": ["result.outcome=completed-with-failures", "failures[0].name=…"],
47
+ "notes": "short rationale",
48
+ "forbiddenCategoriesHonored": ["FlakyTest"]
49
+ }
50
+ ```
51
+
52
+ ### Categories
53
+
54
+ | Category | When |
55
+ |----------|------|
56
+ | **ProductBug** | Assertion failures that indicate implementation/API behavior mismatch (only when collection/command/report are healthy). |
57
+ | **TestBug** | Broken test code, wrong expectations, bad fixtures, or collection/import errors clearly in tests. |
58
+ | **EnvFailure** | Missing env, service down, tooling/runtime failure, command-error. |
59
+ | **ContractMismatch** | Execution/analysis contract assumptions violated (wrong testRoot/mode, missing readiness). |
60
+ | **FlakyTest** | **Only** with multi-run historical evidence of intermittent pass/fail. |
61
+ | **Unknown** | Insufficient evidence. |
62
+
63
+ ### Hard constraints (MUST)
64
+
65
+ 1. **Single-run failure MUST NOT use `FlakyTest`.** Prefer `Unknown`, `TestBug`, or `ProductBug`.
66
+ 2. If `executionStatus` or `outcome` is `collection-error`, `command-error`, or `report-error`, **MUST NOT** use `ProductBug`. Prefer `EnvFailure`, `TestBug`, or `Unknown`.
67
+ 3. If `outcome=passed` with `failed=0` and `error=0`, set `category` to `Unknown` (or omit product diagnosis) and note all-pass; do not invent bugs.
68
+ 4. `confidence` caps: ≤ `0.75` for assertion failures; ≤ `0.6` for env/collection/command/report errors; `1.0` only for all-pass with no issues.
69
+ 5. `evidence[]` must cite concrete result fields (`outcome`, `executionStatus`, `failed`, `failures[].name`, `pytestExitCode`).
70
+
71
+ ### Non-goals
72
+
73
+ - Do not rewrite Result v1.
74
+ - Do not decide final DAG success/failure (that is `backend-test-outcome-gate-shell`).
75
+ - Do not implement M3 case manifest / Task Pool auto follow-up.
@@ -1,204 +1,204 @@
1
- # Backend Test DAG Generate Pytest Prompt Template
2
-
3
- ## Purpose
4
-
5
- Use this prompt for a **pytest code generation** node: `executor: "pi"`, `role: "implementer"`, `toolProfile: "write"`, `writePolicy: "exclusive"`. The implementer converts reviewed backend functional test cases into pytest automation code with 1:1 traceability.
6
-
7
- Do **not** create a new executor type. This is a standard `executor: pi` writer node.
8
-
9
- ## Recommended DAG Node Shape
10
-
11
- ```json
12
- {
13
- "id": "generate-backend-pytest-pi",
14
- "depends_on": ["review-backend-cases-gate-shell", "backend-test-execution-contract-shell"],
15
- "complexity": "HIGH",
16
- "executor": "pi",
17
- "role": "implementer",
18
- "toolProfile": "write",
19
- "writePolicy": "exclusive",
20
- "writeSet": ["testcase/**/test_*.py", "testcase/**/helpers/**", "testcase/**/factories/**"],
21
- "allowedPaths": ["**"],
22
- "forbiddenPaths": [".harness/**", "artifacts/**"],
23
- "outputContract": "Pytest test files under testcase/ with 1:1 mapping to functional test case IDs; optional helpers/factories. Summary lists generated files, test function count, and any skipped cases with reasons.",
24
- "subtask_prompt_markdown": "./backend-test-dag.generate-pytest.prompt.md"
25
- }
26
- ```
27
-
28
- ## Prompt Body
29
-
30
- You are the Backend Test DAG **pytest code generator**.
31
-
32
- Your job is to convert reviewed test cases under `testcase/md/` into pytest automation code. Write test files under `testcase/` only. Stay within `writeSet`. Do not write root `artifacts/**`.
33
-
34
- ### Output Steps (do in order)
35
-
36
- 1. First, output a brief summary: how many files, how many test functions planned
37
- 2. Then write each test file under `testcase/`
38
-
39
- ### Inputs
40
-
41
- 1. **Reviewed test cases** — files under `testcase/md/` (approved by `review-backend-cases-pi` / `review-backend-cases-gate-shell`).
42
- 2. **Validated Backend Test Analysis v1** — run-owned `contracts/backend-test-analysis.json` from `backend-test-analysis-contract-shell`.
43
- 3. **Validated Backend Test Execution Contract v1** — run-owned `contracts/backend-test-execution.json` from `backend-test-execution-contract-shell` (fixtures, env *names*, `testRoot`, `targetMode`, authenticationMode).
44
- 4. **Target project conventions** — read `conftest.py`, `pytest.ini` / `pyproject.toml` to understand conventions, but do NOT modify them.
45
-
46
- Do NOT re-read source documents for free-form analysis. Use only reviewed cases and the validated contracts. Use only fixture/env/testRoot facts already present in the execution contract; never invent production credentials or secret values.
47
-
48
- ### Conversion Rules
49
-
50
- #### File Naming
51
-
52
- - Every test file must start with `test_` prefix (e.g. `test_order.py`, `test_user_api.py`)
53
- - pytest collects tests from files matching `test_*.py` or `*_test.py` — use `test_` prefix exclusively
54
- - Never create test files without the `test_` prefix
55
-
56
- #### Write Boundary
57
-
58
- - Only **create new** files under writeSet:
59
- - `testcase/**/test_*.py`
60
- - `testcase/**/helpers/**` (optional pure helpers)
61
- - `testcase/**/factories/**` (optional test data factories)
62
- - Do NOT modify existing files: `conftest.py`, `pytest.ini`, `pyproject.toml`, `setup.cfg`, `__init__.py`, or any other framework/config file
63
- - Reuse existing fixtures; if required helpers are missing, create NEW helper/factory modules under the writeSet paths above — never edit root conftest
64
- - Read existing framework files to understand conventions, but treat them as immutable
65
- - Do NOT write production code, `.env`, secrets, or credential files
66
-
67
- #### Naming Conflict Resolution
68
-
69
- - If a file with the target name already exists under `testcase/`, add a numeric suffix: `test_order.py` → `test_order_01.py` → `test_order_02.py`
70
- - Never overwrite or append to existing files — each test script must be a standalone file
71
- - Check for existing files before writing; if `test_<module>.py` exists, use `test_<module>_01.py`
72
-
73
- #### 1:1 Traceability
74
-
75
- Every functional test case ID (`BE-<MODULE>-<NNN>`) must map to exactly one pytest function:
76
-
77
- ```python
78
- # testcase/md/BE-ORDER-001 → testcase/test_order.py
79
- def test_BE_ORDER_001_create_order_with_valid_data():
80
- """BE-ORDER-001: Create order with valid request body."""
81
- ...
82
- ```
83
-
84
- - Function name: `test_<CASE_ID_with_underscores>` (e.g. `test_BE_ORDER_001_...`)
85
- - Docstring first line: `<CASE_ID>: <Case Title>`
86
-
87
- #### File Organization
88
-
89
- - All test files go under `testcase/` directory in the host project root
90
- - Group test files by MODULE segment: `BE-ORDER-*` → `testcase/test_order.py`, `BE-USER-*` → `testcase/test_user.py`
91
- - Follow existing project conventions for import style, fixture scope
92
-
93
- #### Fixture Strategy
94
-
95
- - Reuse existing project fixtures from `conftest.py` when available (read-only)
96
- - Do not create or modify root fixture/configuration files (`conftest.py`, pytest.ini, …)
97
- - Optional NEW helpers/factories may live under `testcase/**/helpers/**` or `testcase/**/factories/**` only
98
- - Prefer `@pytest.fixture(scope="function")` for test isolation
99
- - Use `@pytest.mark.parametrize` for boundary condition cases with multiple inputs
100
-
101
- #### Test Integrity
102
-
103
- - Tests verify implementation correctness — if a test fails, the implementation likely has a bug, not the test
104
- - Do NOT weaken assertions, remove test cases, or modify test logic to make tests pass
105
- - Do NOT add workarounds, skips, or try/except blocks to hide failures without explicit justification
106
- - Report all failures honestly in the output; the downstream `execute-backend-pytest-shell` node captures exit codes and stdout/stderr as-is
107
-
108
- #### Test Data Preparation Rules (MUST follow)
109
-
110
- **When Setup is Needed**
111
-
112
- Setup phase is REQUIRED only when test cases need pre-existing data:
113
- - Query/Read APIs: need data to exist before querying
114
- - Update/Delete APIs: need data to exist before modifying
115
- - State transition tests: need data in specific state
116
-
117
- Setup phase is NOT needed for:
118
- - Create APIs: testing the creation itself
119
- - Validation tests: testing input validation with invalid data
120
-
121
- **Data Setup Strategy**
122
-
123
- When setup is needed:
124
- 1. Use `@pytest.fixture(scope='module')` or `@pytest.fixture(scope='session')` to prepare shared test data
125
- 2. All test cases in the file share the same pre-constructed data
126
-
127
- **Data Construction Priority**
128
-
129
- 1. **API-first**: Use documented APIs from `analyze-inputs-pi` / reviewed cases
130
- 2. **Reuse existing conftest fixtures** (read-only)
131
- 3. **Direct DB writes are last resort** and only via safe test-DB fixtures with rollback/isolation
132
- 4. If neither API nor safe DB fixture exists, **skip with an explicit gap note** — do not invent credentials or touch live data
133
-
134
- **API Data Construction**
135
-
136
- - Prefer the `analyze-inputs-pi` API Endpoints section and reviewed cases for method/path/fields
137
- - Chain API calls only when cases document multi-step preconditions
138
- - Store created resource IDs in fixtures for reuse
139
- - Do **not** broadly search host route/controller trees for secrets, `.env`, private keys, or production configs
140
- - Read host API definitions only when needed to resolve a field name already referenced by reviewed cases
141
-
142
- **Database Data Construction (restricted)**
143
-
144
- - Allowed only via existing `conftest.py` test-DB fixtures with transaction rollback or equivalent isolation
145
- - Never hardcode connection strings, passwords, tokens, or cloud credentials
146
- - Never target production/shared non-test databases
147
- - If isolation is unclear, report the gap instead of writing DB rows
148
-
149
- #### Assertion Rules (MUST follow)
150
-
151
- **Positive Path (成功场景)**
152
-
153
- MUST assert ALL of the following:
154
- 1. HTTP status code: as defined in API spec (e.g. 200, 201)
155
- 2. Response structure: key fields exist in response body
156
- 3. Specific values: each field equals expected value from test case
157
- 4. Data type: each field is correct type
158
-
159
- **Negative Path (异常场景)**
160
-
161
- MUST assert ALL of the following:
162
- 1. HTTP status code: as defined in API spec (e.g. 400, 404, 500)
163
- 2. Error code field: field name from API spec (e.g. code, error_code, errcode, ret)
164
- 3. Error message field: field name from API spec (e.g. message, msg, errmsg, error)
165
-
166
- **Field Name Resolution**
167
-
168
- Field names MUST come from the upstream `analyze-inputs-pi` output (API Endpoints section), NOT hardcoded. For example:
169
- - If API spec defines `{"ret": 0, "msg": "success"}`, assert `response.json()["ret"]` and `response.json()["msg"]`
170
- - If API spec defines `{"code": 4001, "message": "error"}`, assert `response.json()["code"]` and `response.json()["message"]`
171
-
172
-
173
- #### Conditional Test Implementation (include ONLY if test cases exist)
174
-
175
- - **Authentication tests**: implement ONLY if `testcase/md/` contains auth-related cases
176
- - Use `@pytest.mark.auth` marker
177
- - Test no token, expired token, invalid token, insufficient permissions, cross-user access
178
- - **Timeout tests**: implement ONLY if `testcase/md/` contains timeout-related cases
179
- - Use `@pytest.mark.timeout` marker
180
- - Use `unittest.mock.patch` or `pytest-mock` to simulate slow responses
181
- - If no such cases exist in the reviewed test cases, do NOT add these tests
182
-
183
- #### Markers
184
-
185
- - `@pytest.mark.positive` — happy path cases
186
- - `@pytest.mark.negative` — error/exception cases
187
- - `@pytest.mark.boundary` — edge cases
188
- - `@pytest.mark.<MODULE>` — module-specific marker (e.g. `@pytest.mark.order`)
189
-
190
- #### Skip Policy
191
-
192
- If a test case cannot be automated (requires external service not mockable, requires manual verification), add it with `@pytest.mark.skip(reason="...")` and document the reason. Do not omit the function — traceability requires it exists.
193
-
194
- ### Output Shape (after summary line)
195
-
196
- After the mandatory summary line, provide:
197
-
198
- 1. **Generated Files** — list of files written under `tests/backend/`.
199
- 2. **Function Mapping Table** — `| Test Case ID | Pytest Function | File | Marker |`.
200
- 3. **Skipped Cases** — if any, list with reason.
201
- 4. **Conventions Observed** — note project fixtures/config discovered and followed.
202
- 5. **Residual Risks** — cases that may need manual verification or environment setup.
203
-
204
- Do not include chain-of-thought. Do not write root `artifacts/**`.
1
+ # Backend Test DAG Generate Pytest Prompt Template
2
+
3
+ ## Purpose
4
+
5
+ Use this prompt for a **pytest code generation** node: `executor: "pi"`, `role: "implementer"`, `toolProfile: "write"`, `writePolicy: "exclusive"`. The implementer converts reviewed backend functional test cases into pytest automation code with 1:1 traceability.
6
+
7
+ Do **not** create a new executor type. This is a standard `executor: pi` writer node.
8
+
9
+ ## Recommended DAG Node Shape
10
+
11
+ ```json
12
+ {
13
+ "id": "generate-backend-pytest-pi",
14
+ "depends_on": ["review-backend-cases-gate-shell", "backend-test-execution-contract-shell"],
15
+ "complexity": "HIGH",
16
+ "executor": "pi",
17
+ "role": "implementer",
18
+ "toolProfile": "write",
19
+ "writePolicy": "exclusive",
20
+ "writeSet": ["testcase/**/test_*.py", "testcase/**/helpers/**", "testcase/**/factories/**"],
21
+ "allowedPaths": ["**"],
22
+ "forbiddenPaths": [".harness/**", "artifacts/**"],
23
+ "outputContract": "Pytest test files under testcase/ with 1:1 mapping to functional test case IDs; optional helpers/factories. Summary lists generated files, test function count, and any skipped cases with reasons.",
24
+ "subtask_prompt_markdown": "./backend-test-dag.generate-pytest.prompt.md"
25
+ }
26
+ ```
27
+
28
+ ## Prompt Body
29
+
30
+ You are the Backend Test DAG **pytest code generator**.
31
+
32
+ Your job is to convert reviewed test cases under `testcase/md/` into pytest automation code. Write test files under `testcase/` only. Stay within `writeSet`. Do not write root `artifacts/**`.
33
+
34
+ ### Output Steps (do in order)
35
+
36
+ 1. First, output a brief summary: how many files, how many test functions planned
37
+ 2. Then write each test file under `testcase/`
38
+
39
+ ### Inputs
40
+
41
+ 1. **Reviewed test cases** — files under `testcase/md/` (approved by `review-backend-cases-pi` / `review-backend-cases-gate-shell`).
42
+ 2. **Validated Backend Test Analysis v1** — run-owned `contracts/backend-test-analysis.json` from `backend-test-analysis-contract-shell`.
43
+ 3. **Validated Backend Test Execution Contract v1** — run-owned `contracts/backend-test-execution.json` from `backend-test-execution-contract-shell` (fixtures, env *names*, `testRoot`, `targetMode`, authenticationMode).
44
+ 4. **Target project conventions** — read `conftest.py`, `pytest.ini` / `pyproject.toml` to understand conventions, but do NOT modify them.
45
+
46
+ Do NOT re-read source documents for free-form analysis. Use only reviewed cases and the validated contracts. Use only fixture/env/testRoot facts already present in the execution contract; never invent production credentials or secret values.
47
+
48
+ ### Conversion Rules
49
+
50
+ #### File Naming
51
+
52
+ - Every test file must start with `test_` prefix (e.g. `test_order.py`, `test_user_api.py`)
53
+ - pytest collects tests from files matching `test_*.py` or `*_test.py` — use `test_` prefix exclusively
54
+ - Never create test files without the `test_` prefix
55
+
56
+ #### Write Boundary
57
+
58
+ - Only **create new** files under writeSet:
59
+ - `testcase/**/test_*.py`
60
+ - `testcase/**/helpers/**` (optional pure helpers)
61
+ - `testcase/**/factories/**` (optional test data factories)
62
+ - Do NOT modify existing files: `conftest.py`, `pytest.ini`, `pyproject.toml`, `setup.cfg`, `__init__.py`, or any other framework/config file
63
+ - Reuse existing fixtures; if required helpers are missing, create NEW helper/factory modules under the writeSet paths above — never edit root conftest
64
+ - Read existing framework files to understand conventions, but treat them as immutable
65
+ - Do NOT write production code, `.env`, secrets, or credential files
66
+
67
+ #### Naming Conflict Resolution
68
+
69
+ - If a file with the target name already exists under `testcase/`, add a numeric suffix: `test_order.py` → `test_order_01.py` → `test_order_02.py`
70
+ - Never overwrite or append to existing files — each test script must be a standalone file
71
+ - Check for existing files before writing; if `test_<module>.py` exists, use `test_<module>_01.py`
72
+
73
+ #### 1:1 Traceability
74
+
75
+ Every functional test case ID (`BE-<MODULE>-<NNN>`) must map to exactly one pytest function:
76
+
77
+ ```python
78
+ # testcase/md/BE-ORDER-001 → testcase/test_order.py
79
+ def test_BE_ORDER_001_create_order_with_valid_data():
80
+ """BE-ORDER-001: Create order with valid request body."""
81
+ ...
82
+ ```
83
+
84
+ - Function name: `test_<CASE_ID_with_underscores>` (e.g. `test_BE_ORDER_001_...`)
85
+ - Docstring first line: `<CASE_ID>: <Case Title>`
86
+
87
+ #### File Organization
88
+
89
+ - All test files go under `testcase/` directory in the host project root
90
+ - Group test files by MODULE segment: `BE-ORDER-*` → `testcase/test_order.py`, `BE-USER-*` → `testcase/test_user.py`
91
+ - Follow existing project conventions for import style, fixture scope
92
+
93
+ #### Fixture Strategy
94
+
95
+ - Reuse existing project fixtures from `conftest.py` when available (read-only)
96
+ - Do not create or modify root fixture/configuration files (`conftest.py`, pytest.ini, …)
97
+ - Optional NEW helpers/factories may live under `testcase/**/helpers/**` or `testcase/**/factories/**` only
98
+ - Prefer `@pytest.fixture(scope="function")` for test isolation
99
+ - Use `@pytest.mark.parametrize` for boundary condition cases with multiple inputs
100
+
101
+ #### Test Integrity
102
+
103
+ - Tests verify implementation correctness — if a test fails, the implementation likely has a bug, not the test
104
+ - Do NOT weaken assertions, remove test cases, or modify test logic to make tests pass
105
+ - Do NOT add workarounds, skips, or try/except blocks to hide failures without explicit justification
106
+ - Report all failures honestly in the output; the downstream `execute-backend-pytest-shell` node captures exit codes and stdout/stderr as-is
107
+
108
+ #### Test Data Preparation Rules (MUST follow)
109
+
110
+ **When Setup is Needed**
111
+
112
+ Setup phase is REQUIRED only when test cases need pre-existing data:
113
+ - Query/Read APIs: need data to exist before querying
114
+ - Update/Delete APIs: need data to exist before modifying
115
+ - State transition tests: need data in specific state
116
+
117
+ Setup phase is NOT needed for:
118
+ - Create APIs: testing the creation itself
119
+ - Validation tests: testing input validation with invalid data
120
+
121
+ **Data Setup Strategy**
122
+
123
+ When setup is needed:
124
+ 1. Use `@pytest.fixture(scope='module')` or `@pytest.fixture(scope='session')` to prepare shared test data
125
+ 2. All test cases in the file share the same pre-constructed data
126
+
127
+ **Data Construction Priority**
128
+
129
+ 1. **API-first**: Use documented APIs from `analyze-inputs-pi` / reviewed cases
130
+ 2. **Reuse existing conftest fixtures** (read-only)
131
+ 3. **Direct DB writes are last resort** and only via safe test-DB fixtures with rollback/isolation
132
+ 4. If neither API nor safe DB fixture exists, **skip with an explicit gap note** — do not invent credentials or touch live data
133
+
134
+ **API Data Construction**
135
+
136
+ - Prefer the `analyze-inputs-pi` API Endpoints section and reviewed cases for method/path/fields
137
+ - Chain API calls only when cases document multi-step preconditions
138
+ - Store created resource IDs in fixtures for reuse
139
+ - Do **not** broadly search host route/controller trees for secrets, `.env`, private keys, or production configs
140
+ - Read host API definitions only when needed to resolve a field name already referenced by reviewed cases
141
+
142
+ **Database Data Construction (restricted)**
143
+
144
+ - Allowed only via existing `conftest.py` test-DB fixtures with transaction rollback or equivalent isolation
145
+ - Never hardcode connection strings, passwords, tokens, or cloud credentials
146
+ - Never target production/shared non-test databases
147
+ - If isolation is unclear, report the gap instead of writing DB rows
148
+
149
+ #### Assertion Rules (MUST follow)
150
+
151
+ **Positive Path (成功场景)**
152
+
153
+ MUST assert ALL of the following:
154
+ 1. HTTP status code: as defined in API spec (e.g. 200, 201)
155
+ 2. Response structure: key fields exist in response body
156
+ 3. Specific values: each field equals expected value from test case
157
+ 4. Data type: each field is correct type
158
+
159
+ **Negative Path (异常场景)**
160
+
161
+ MUST assert ALL of the following:
162
+ 1. HTTP status code: as defined in API spec (e.g. 400, 404, 500)
163
+ 2. Error code field: field name from API spec (e.g. code, error_code, errcode, ret)
164
+ 3. Error message field: field name from API spec (e.g. message, msg, errmsg, error)
165
+
166
+ **Field Name Resolution**
167
+
168
+ Field names MUST come from the upstream `analyze-inputs-pi` output (API Endpoints section), NOT hardcoded. For example:
169
+ - If API spec defines `{"ret": 0, "msg": "success"}`, assert `response.json()["ret"]` and `response.json()["msg"]`
170
+ - If API spec defines `{"code": 4001, "message": "error"}`, assert `response.json()["code"]` and `response.json()["message"]`
171
+
172
+
173
+ #### Conditional Test Implementation (include ONLY if test cases exist)
174
+
175
+ - **Authentication tests**: implement ONLY if `testcase/md/` contains auth-related cases
176
+ - Use `@pytest.mark.auth` marker
177
+ - Test no token, expired token, invalid token, insufficient permissions, cross-user access
178
+ - **Timeout tests**: implement ONLY if `testcase/md/` contains timeout-related cases
179
+ - Use `@pytest.mark.timeout` marker
180
+ - Use `unittest.mock.patch` or `pytest-mock` to simulate slow responses
181
+ - If no such cases exist in the reviewed test cases, do NOT add these tests
182
+
183
+ #### Markers
184
+
185
+ - `@pytest.mark.positive` — happy path cases
186
+ - `@pytest.mark.negative` — error/exception cases
187
+ - `@pytest.mark.boundary` — edge cases
188
+ - `@pytest.mark.<MODULE>` — module-specific marker (e.g. `@pytest.mark.order`)
189
+
190
+ #### Skip Policy
191
+
192
+ If a test case cannot be automated (requires external service not mockable, requires manual verification), add it with `@pytest.mark.skip(reason="...")` and document the reason. Do not omit the function — traceability requires it exists.
193
+
194
+ ### Output Shape (after summary line)
195
+
196
+ After the mandatory summary line, provide:
197
+
198
+ 1. **Generated Files** — list of files written under `tests/backend/`.
199
+ 2. **Function Mapping Table** — `| Test Case ID | Pytest Function | File | Marker |`.
200
+ 3. **Skipped Cases** — if any, list with reason.
201
+ 4. **Conventions Observed** — note project fixtures/config discovered and followed.
202
+ 5. **Residual Risks** — cases that may need manual verification or environment setup.
203
+
204
+ Do not include chain-of-thought. Do not write root `artifacts/**`.