hunter-harness 0.1.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (184) hide show
  1. package/LICENSE +21 -0
  2. package/README.md +17 -0
  3. package/dist/bin.js +3356 -0
  4. package/package.json +34 -0
  5. package/resources/bootstrap-ir/manifest.json +19 -0
  6. package/resources/bootstrap-ir/skills/harness-apidoc.yaml +24 -0
  7. package/resources/bootstrap-ir/skills/harness-archive.yaml +24 -0
  8. package/resources/bootstrap-ir/skills/harness-codebase-map.yaml +24 -0
  9. package/resources/bootstrap-ir/skills/harness-knowledge-ingest.yaml +24 -0
  10. package/resources/bootstrap-ir/skills/harness-package.yaml +24 -0
  11. package/resources/bootstrap-ir/skills/harness-plan.yaml +24 -0
  12. package/resources/bootstrap-ir/skills/harness-review.yaml +24 -0
  13. package/resources/bootstrap-ir/skills/harness-run.yaml +24 -0
  14. package/resources/bootstrap-ir/skills/harness-skill-optimizer.yaml +28 -0
  15. package/resources/bootstrap-ir/skills/harness-submit.yaml +24 -0
  16. package/resources/bootstrap-ir/skills/harness-sync.yaml +24 -0
  17. package/resources/bootstrap-ir/skills/harness-test.yaml +24 -0
  18. package/resources/bootstrap-ir/templates/claude-code-skill.md +12 -0
  19. package/resources/harness/general/.harness-build.json +5 -0
  20. package/resources/harness/general/CONTEXT.md +65 -0
  21. package/resources/harness/general/README.md +478 -0
  22. package/resources/harness/general/agents/harness-evaluator.md +96 -0
  23. package/resources/harness/general/agents/harness-explorer.md +72 -0
  24. package/resources/harness/general/agents/harness-reviewer.md +69 -0
  25. package/resources/harness/general/harness-archive/SKILL.md +215 -0
  26. package/resources/harness/general/harness-archive/checklist.md +52 -0
  27. package/resources/harness/general/harness-archive/reference.md +103 -0
  28. package/resources/harness/general/harness-archive/scripts/gen-manifest.ps1 +31 -0
  29. package/resources/harness/general/harness-archive/templates/render-summary.mjs +171 -0
  30. package/resources/harness/general/harness-archive/templates/summary-data-template.json +128 -0
  31. package/resources/harness/general/harness-codebase-map/SKILL.md +112 -0
  32. package/resources/harness/general/harness-codebase-map/checklist.md +126 -0
  33. package/resources/harness/general/harness-codebase-map/reference.md +364 -0
  34. package/resources/harness/general/harness-codebase-map/templates/ARCHITECTURE.md +57 -0
  35. package/resources/harness/general/harness-codebase-map/templates/CONCERNS.md +49 -0
  36. package/resources/harness/general/harness-codebase-map/templates/CONVENTIONS.md +57 -0
  37. package/resources/harness/general/harness-codebase-map/templates/INTEGRATIONS.md +52 -0
  38. package/resources/harness/general/harness-codebase-map/templates/STACK.md +55 -0
  39. package/resources/harness/general/harness-codebase-map/templates/STRUCTURE.md +69 -0
  40. package/resources/harness/general/harness-codebase-map/templates/TESTING.md +64 -0
  41. package/resources/harness/general/harness-codebase-map/templates/map-manifest.schema.json +73 -0
  42. package/resources/harness/general/harness-codebase-map/templates/map-summary.md +64 -0
  43. package/resources/harness/general/harness-knowledge-ingest/SKILL.md +246 -0
  44. package/resources/harness/general/harness-knowledge-ingest/design.md +842 -0
  45. package/resources/harness/general/harness-knowledge-ingest/evaluations/harness_knowledge_evaluation.xml +42 -0
  46. package/resources/harness/general/harness-knowledge-ingest/mcp-config.example.json +10 -0
  47. package/resources/harness/general/harness-knowledge-ingest/reference.md +309 -0
  48. package/resources/harness/general/harness-knowledge-ingest/scripts/harness_knowledge.py +4082 -0
  49. package/resources/harness/general/harness-knowledge-ingest/scripts/harness_knowledge_mcp.py +273 -0
  50. package/resources/harness/general/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-01-10-ledger-reconciliation/reports/final/summary-data.json +43 -0
  51. package/resources/harness/general/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-02-14-ledger-snapshot-followup/reports/final/summary-data.json +38 -0
  52. package/resources/harness/general/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-03-05-webhook-contract/reports/final/summary-data.json +36 -0
  53. package/resources/harness/general/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/project.yaml +1 -0
  54. package/resources/harness/general/harness-knowledge-ingest/tests/test_harness_knowledge.py +1792 -0
  55. package/resources/harness/general/harness-knowledge-query/SKILL.md +164 -0
  56. package/resources/harness/general/harness-plan/SKILL.md +127 -0
  57. package/resources/harness/general/harness-plan/checklist.md +243 -0
  58. package/resources/harness/general/harness-plan/protocols.md +124 -0
  59. package/resources/harness/general/harness-plan/reference.md +376 -0
  60. package/resources/harness/general/harness-review/SKILL.md +156 -0
  61. package/resources/harness/general/harness-review/checklist.md +124 -0
  62. package/resources/harness/general/harness-review/protocols.md +68 -0
  63. package/resources/harness/general/harness-review/reference.md +86 -0
  64. package/resources/harness/general/harness-run/SKILL.md +132 -0
  65. package/resources/harness/general/harness-run/checklist.md +259 -0
  66. package/resources/harness/general/harness-run/protocols.md +78 -0
  67. package/resources/harness/general/harness-run/reference.md +834 -0
  68. package/resources/harness/general/harness-submit/SKILL.md +159 -0
  69. package/resources/harness/general/harness-submit/checklist.md +407 -0
  70. package/resources/harness/general/harness-submit/reference.md +152 -0
  71. package/resources/harness/general/harness-sync/SKILL.md +82 -0
  72. package/resources/harness/general/harness-sync/reference.md +153 -0
  73. package/resources/harness/general/harness-test/SKILL.md +180 -0
  74. package/resources/harness/general/harness-test/checklist.md +319 -0
  75. package/resources/harness/general/harness-test/pitfalls.md +260 -0
  76. package/resources/harness/general/harness-test/reference.md +791 -0
  77. package/resources/harness/general/protocols/archive-report-protocol.md +175 -0
  78. package/resources/harness/general/protocols/evidence-based-reporting-protocol.md +134 -0
  79. package/resources/harness/general/protocols/ledger-protocol.md +270 -0
  80. package/resources/harness/general/protocols/powershell-protocol.md +181 -0
  81. package/resources/harness/general/protocols/report-pipeline-protocol.md +150 -0
  82. package/resources/harness/general/protocols/sensitive-info-protocol.md +92 -0
  83. package/resources/harness/general/protocols/state-layout-protocol.md +131 -0
  84. package/resources/harness/general/protocols/submit-protocol.md +78 -0
  85. package/resources/harness/general/scripts/harness_archive.py +2319 -0
  86. package/resources/harness/general/scripts/harness_deploy.py +613 -0
  87. package/resources/harness/general/scripts/harness_events.py +680 -0
  88. package/resources/harness/general/scripts/harness_ledger.py +671 -0
  89. package/resources/harness/general/scripts/harness_preflight.py +780 -0
  90. package/resources/harness/general/scripts/harness_service.py +1331 -0
  91. package/resources/harness/java/.harness-build.json +5 -0
  92. package/resources/harness/java/CONTEXT.md +65 -0
  93. package/resources/harness/java/README.md +478 -0
  94. package/resources/harness/java/agents/harness-evaluator.md +96 -0
  95. package/resources/harness/java/agents/harness-explorer.md +72 -0
  96. package/resources/harness/java/agents/harness-reviewer.md +69 -0
  97. package/resources/harness/java/harness-apidoc/SKILL.md +86 -0
  98. package/resources/harness/java/harness-apidoc/checklist.md +142 -0
  99. package/resources/harness/java/harness-apidoc/reference.md +233 -0
  100. package/resources/harness/java/harness-archive/SKILL.md +215 -0
  101. package/resources/harness/java/harness-archive/checklist.md +52 -0
  102. package/resources/harness/java/harness-archive/reference.md +103 -0
  103. package/resources/harness/java/harness-archive/scripts/gen-manifest.ps1 +31 -0
  104. package/resources/harness/java/harness-archive/templates/render-summary.mjs +171 -0
  105. package/resources/harness/java/harness-archive/templates/summary-data-template.json +128 -0
  106. package/resources/harness/java/harness-codebase-map/SKILL.md +112 -0
  107. package/resources/harness/java/harness-codebase-map/checklist.md +126 -0
  108. package/resources/harness/java/harness-codebase-map/reference.md +364 -0
  109. package/resources/harness/java/harness-codebase-map/templates/ARCHITECTURE.md +57 -0
  110. package/resources/harness/java/harness-codebase-map/templates/CONCERNS.md +49 -0
  111. package/resources/harness/java/harness-codebase-map/templates/CONVENTIONS.md +57 -0
  112. package/resources/harness/java/harness-codebase-map/templates/INTEGRATIONS.md +52 -0
  113. package/resources/harness/java/harness-codebase-map/templates/STACK.md +55 -0
  114. package/resources/harness/java/harness-codebase-map/templates/STRUCTURE.md +69 -0
  115. package/resources/harness/java/harness-codebase-map/templates/TESTING.md +64 -0
  116. package/resources/harness/java/harness-codebase-map/templates/map-manifest.schema.json +73 -0
  117. package/resources/harness/java/harness-codebase-map/templates/map-summary.md +64 -0
  118. package/resources/harness/java/harness-knowledge-ingest/SKILL.md +246 -0
  119. package/resources/harness/java/harness-knowledge-ingest/design.md +842 -0
  120. package/resources/harness/java/harness-knowledge-ingest/evaluations/harness_knowledge_evaluation.xml +42 -0
  121. package/resources/harness/java/harness-knowledge-ingest/mcp-config.example.json +10 -0
  122. package/resources/harness/java/harness-knowledge-ingest/reference.md +309 -0
  123. package/resources/harness/java/harness-knowledge-ingest/scripts/harness_knowledge.py +4082 -0
  124. package/resources/harness/java/harness-knowledge-ingest/scripts/harness_knowledge_mcp.py +273 -0
  125. package/resources/harness/java/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-01-10-ledger-reconciliation/reports/final/summary-data.json +43 -0
  126. package/resources/harness/java/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-02-14-ledger-snapshot-followup/reports/final/summary-data.json +38 -0
  127. package/resources/harness/java/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/archive/2026-03-05-webhook-contract/reports/final/summary-data.json +36 -0
  128. package/resources/harness/java/harness-knowledge-ingest/tests/fixtures/mcp-eval-project/.harness/project.yaml +1 -0
  129. package/resources/harness/java/harness-knowledge-ingest/tests/test_harness_knowledge.py +1792 -0
  130. package/resources/harness/java/harness-knowledge-query/SKILL.md +164 -0
  131. package/resources/harness/java/harness-package/SKILL.md +87 -0
  132. package/resources/harness/java/harness-package/checklist.md +322 -0
  133. package/resources/harness/java/harness-package/reference.md +210 -0
  134. package/resources/harness/java/harness-plan/SKILL.md +127 -0
  135. package/resources/harness/java/harness-plan/checklist.md +243 -0
  136. package/resources/harness/java/harness-plan/protocols.md +124 -0
  137. package/resources/harness/java/harness-plan/reference.md +376 -0
  138. package/resources/harness/java/harness-review/SKILL.md +156 -0
  139. package/resources/harness/java/harness-review/checklist.md +124 -0
  140. package/resources/harness/java/harness-review/protocols.md +68 -0
  141. package/resources/harness/java/harness-review/reference.md +86 -0
  142. package/resources/harness/java/harness-run/SKILL.md +148 -0
  143. package/resources/harness/java/harness-run/checklist.md +250 -0
  144. package/resources/harness/java/harness-run/protocols.md +78 -0
  145. package/resources/harness/java/harness-run/reference.md +814 -0
  146. package/resources/harness/java/harness-submit/SKILL.md +166 -0
  147. package/resources/harness/java/harness-submit/checklist.md +407 -0
  148. package/resources/harness/java/harness-submit/reference.md +152 -0
  149. package/resources/harness/java/harness-sync/SKILL.md +82 -0
  150. package/resources/harness/java/harness-sync/reference.md +153 -0
  151. package/resources/harness/java/harness-test/SKILL.md +192 -0
  152. package/resources/harness/java/harness-test/checklist.md +317 -0
  153. package/resources/harness/java/harness-test/pitfalls-java.md +16 -0
  154. package/resources/harness/java/harness-test/pitfalls.md +260 -0
  155. package/resources/harness/java/harness-test/reference.md +788 -0
  156. package/resources/harness/java/protocols/archive-report-protocol.md +175 -0
  157. package/resources/harness/java/protocols/evidence-based-reporting-protocol.md +134 -0
  158. package/resources/harness/java/protocols/ledger-protocol.md +270 -0
  159. package/resources/harness/java/protocols/powershell-protocol.md +181 -0
  160. package/resources/harness/java/protocols/report-pipeline-protocol.md +150 -0
  161. package/resources/harness/java/protocols/sensitive-info-protocol.md +92 -0
  162. package/resources/harness/java/protocols/state-layout-protocol.md +131 -0
  163. package/resources/harness/java/protocols/submit-protocol.md +78 -0
  164. package/resources/harness/java/scripts/harness_archive.py +2319 -0
  165. package/resources/harness/java/scripts/harness_deploy.py +613 -0
  166. package/resources/harness/java/scripts/harness_events.py +680 -0
  167. package/resources/harness/java/scripts/harness_ledger.py +671 -0
  168. package/resources/harness/java/scripts/harness_preflight.py +780 -0
  169. package/resources/harness/java/scripts/harness_service.py +1331 -0
  170. package/resources/harness/manifests/general.json +296 -0
  171. package/resources/harness/manifests/java.json +324 -0
  172. package/resources/manifest.json +19 -0
  173. package/resources/skills/harness-apidoc/SKILL.md +50 -0
  174. package/resources/skills/harness-archive/SKILL.md +48 -0
  175. package/resources/skills/harness-codebase-map/SKILL.md +53 -0
  176. package/resources/skills/harness-knowledge-ingest/SKILL.md +48 -0
  177. package/resources/skills/harness-package/SKILL.md +48 -0
  178. package/resources/skills/harness-plan/SKILL.md +51 -0
  179. package/resources/skills/harness-review/SKILL.md +50 -0
  180. package/resources/skills/harness-run/SKILL.md +48 -0
  181. package/resources/skills/harness-skill-optimizer/SKILL.md +54 -0
  182. package/resources/skills/harness-submit/SKILL.md +47 -0
  183. package/resources/skills/harness-sync/SKILL.md +48 -0
  184. package/resources/skills/harness-test/SKILL.md +50 -0
@@ -0,0 +1,791 @@
1
+ ---
2
+ description: harness-test 的 API 测试执行细节、批量 runner、token 缓存、测试数据治理、报告模板和关门检查。仅在执行接口测试需要参考详细操作时读取。
3
+ ---
4
+
5
+ # harness-test 参考 — API 测试详情
6
+
7
+ ## 命令执行模式 preflight(0.1)
8
+
9
+ `/harness-test` 高度依赖 PowerShell 与接口测试执行器。在编译/启动服务/生成执行器 **之前**
10
+ 必须执行 4 项执行模式检查:
11
+
12
+ | 检查项 | 命令 | 预期 |
13
+ |---|---|---|
14
+ | PowerShell 基础命令 | `powershell.exe -NoProfile -Command "$PSVersionTable.PSVersion"` | exitCode=0 |
15
+ | 执行器运行时(如 Node) | `powershell.exe -NoProfile -Command "& 'C:\nvm4w\nodejs\node.exe' --version"` | exitCode=0 |
16
+ | 构建工具(如 Maven) | `powershell.exe -NoProfile -Command "mvn -version"` | exitCode=0 |
17
+ | 安全分类器 | 任一 PowerShell 命令是否返回"安全分类器暂时不可用"/"Auto mode 拦截" | 不应出现 |
18
+
19
+ 将通过的 `executorPath` 等元数据写入 `.harness/changes/<change-name>/runtime/preflight.json`,
20
+ 供后续接口测试执行器启动命令读取。
21
+
22
+ **触发硬停**(任一情况):
23
+
24
+ - "安全分类器暂时不可用"
25
+ - Auto mode 导致 PowerShell 命令不可执行
26
+ - PowerShell 被拒
27
+ - PowerShell 可用但执行器 / 构建工具不可执行
28
+
29
+ **硬停输出**(不得意译,不得继续编译/启动服务/生成执行器,不得长时间等待,不得盲目降级到 Playwright MCP):
30
+
31
+ ```
32
+ ❌ 命令执行模式不可用:PowerShell/接口测试执行器无法稳定执行。
33
+ 请切换 Claude Code 权限模式,例如 bypassPermissions / 非 Auto mode,
34
+ 或用允许命令执行的方式启动 Claude Code。
35
+ 不要继续进入接口测试,避免长时间等待和错误 fallback。
36
+ ```
37
+
38
+ 重复重试 ≤ 1 次。
39
+
40
+ ## fallback 执行器探测
41
+
42
+ ### 探测流程
43
+
44
+ Phase 0.1 必须先确认 PowerShell / 执行器 / 构建工具 可用。
45
+
46
+ 如果首选接口测试执行器可用,**不执行 fallback 探测**,直接使用接口测试执行器。
47
+ 只有首选执行器不可用时,才按顺序探测 PowerShell batch、Playwright MCP、curl fallback。
48
+
49
+ **fallback 探测项**:
50
+
51
+ 1. PowerShell batch runner (`.ps1`) 是否可用
52
+ 2. Claude Code 是否暴露 Playwright MCP 工具(检查工具列表中是否有 `mcp__plugin_playwright_playwright__*`)
53
+ 3. 如果可以执行命令,检查 `claude mcp list` 中是否有 playwright
54
+ 4. `@playwright/mcp` 是否可启动
55
+ 5. 当前 skill 的 `allowed-tools` 是否允许 Playwright 相关工具
56
+ 6. curl fallback 是否只能使用 UTF-8 JSON body file,禁止中文 JSON 内联
57
+
58
+ ### 输出格式
59
+
60
+ ```markdown
61
+ ### fallback 执行器可用性
62
+ | 项 | 结果 | 证据 |
63
+ |---|---|---|
64
+ | 接口测试执行器 | ✅使用 / ❌不可用 | ... |
65
+ | PowerShell batch runner | 未使用 / ✅fallback / ❌不可用 | ... |
66
+ | Playwright MCP browser_evaluate | 未使用 / ✅fallback / ❌不可用 | ... |
67
+ | curl + UTF-8 JSON body file | 未使用 / ✅fallback / ❌不可用 | ... |
68
+ | 最终决策 | 接口测试执行器 / PowerShell batch / Playwright MCP browser_evaluate / curl fallback | ... |
69
+ ```
70
+
71
+ 如果 fallback 不可用,必须写明原因,不得静默改用 curl。
72
+
73
+ ## 接口测试工具优先级
74
+
75
+ **优先级**(从高到低):
76
+
77
+ | 优先级 | 工具 | 适用场景 | 说明 |
78
+ |:------:|------|---------|------|
79
+ | 1 | **PowerShell + 接口测试执行器 (`.mjs`,Node runner 为一种实现)** | 默认且首选 | PowerShell + 执行器绝对路径执行,统一 baseURL/headers/凭证,结构化输出+耗时统计;可按项目替换为其他 HTTP 客户端 |
80
+ | 2 | **PowerShell batch runner (`.ps1`)** | 首选不可用时降级 | UTF-8 编码正确,可脚本化批量执行 |
81
+ | 3 | **Playwright MCP `browser_evaluate` + `fetch`** | 1+2 不可用时 fallback | UTF-8 编码正确,但每场景单独调用 MCP,**不得替代执行器** |
82
+ | 4 | **curl + UTF-8 JSON body file** | 最后兜底 | 必须先将 JSON body 写入 UTF-8 文件,再通过 PowerShell(`curl.exe` 或 `Invoke-RestMethod`,经 `Bash(powershell.exe:*)` 通道)发送;`disallowed-tools` 已禁 `Bash(curl *)`,不得用 Bash 直接 curl |
83
+ | ❌ | curl 内联含中文 JSON | **禁止** | Windows 下 GBK 编码导致 UTF-8 解析失败 |
84
+ | ❌ | Bash 裸 `node ...` | **禁止** | Bash 在中文路径项目下被 hook 拒绝;且 Node 在 Bash 中常不在 PATH |
85
+
86
+ > **Windows 环境避免用 curl 发送含中文的请求体**(GBK 编码导致 UTF-8 解析失败)。
87
+ > **如果执行器在 PowerShell 可用,禁止使用 Playwright MCP 逐条执行接口测试。**
88
+
89
+ ## 已知良好测试配置(known-good-test-profile,按项目固化)
90
+
91
+ 本项目默认使用 **local-dev profile + 本地数据库 + 远程缓存 + 远程 SDK 网关 + 远程认证服务**(按技术栈;Java Spring Boot 为例)。
92
+
93
+ ```yaml
94
+ known-good-test-profile:
95
+ name: <配置名,如 local-dev-remote-sdk>
96
+ module: <模块/服务(按项目)>
97
+ profile: <运行时 profile(按技术栈,如 Spring Boot 的 springProfile)>
98
+ port: <端口>
99
+ contextPath: <上下文路径>
100
+ healthUrl: <健康检查 URL>
101
+
102
+ database:
103
+ primary: <主库连接(按项目)>
104
+ cache: <缓存连接(按项目)>
105
+
106
+ remote:
107
+ gateway: <网关 URL(如适用)>
108
+ sdkUrl: <外部 SDK URL(如适用)>
109
+ authLoginUrl: <认证服务登录 URL(如 SSO)>
110
+
111
+ overlay:
112
+ pathStrategy: ascii-temp
113
+ directory: C:/temp/harness-test-overlay
114
+ fileName: application-harness-test.yml
115
+
116
+ service:
117
+ askBeforeReusingExisting: true
118
+ askBeforeRestartingUserService: true
119
+ stopAfterTest: true
120
+ restoreOriginalService: false
121
+ ```
122
+
123
+ 默认不假设本地网关存在。
124
+
125
+ ## 运行时配置叠加(不动 tracked 配置)
126
+
127
+ 不要直接 Edit tracked 应用配置文件(如 `application-local-dev.yml`)。默认生成 ASCII 绝对路径运行时配置叠加:
128
+
129
+ ```text
130
+ C:/temp/harness-test-overlay/<change-name>/application-harness-test.yml
131
+ ```
132
+
133
+ 内容按已知良好测试配置渲染(按项目;Java Spring Boot 为例):
134
+
135
+ ```yaml
136
+ # 按项目填入需要覆盖的配置项,示例:
137
+ <external-service>:
138
+ sdk:
139
+ url: <外部 SDK URL>
140
+ spring:
141
+ cloud:
142
+ nacos:
143
+ discovery:
144
+ register-enabled: false # 避免本地服务注册到线上
145
+ ```
146
+
147
+ 唯一默认启动命令(按技术栈,Java Spring Boot 为例):
148
+
149
+ ```powershell
150
+ powershell.exe -NoProfile -Command "mvn spring-boot:run -pl <module> -Dspring-boot.run.profiles=<profile> -Dspring-boot.run.jvmArguments='-Dspring.config.additional-location=file:C:/temp/harness-test-overlay/<change-name>/application-harness-test.yml'"
151
+ ```
152
+
153
+ 不得默认使用 `.harness/changes/<change>/runtime/application-harness-test.yml` 相对路径作为 JVM `additional-location`。如必须修改 tracked 配置文件,先 AskUserQuestion,最终报告至少 🟡 WARN。
154
+
155
+ ## 服务决策门(Service Decision Gate)与服务生命周期管理
156
+
157
+ 运行时文件:
158
+
159
+ | 文件 | 内容 |
160
+ |---|---|
161
+ | `service.pid` | AI 启动/重启后的进程 PID |
162
+ | `service-start-command.txt` | 实际执行的 PowerShell 启动命令(脱敏) |
163
+ | `service-start.log` | 应用启动 stdout/stderr |
164
+ | `runtime/service-session.json` | pid、moduleInputsHash、moduleInputsFiles、profile、startCommandHash、overlayPath、command、startedBy、startedAt |
165
+
166
+ serviceState:`AI_STARTED` / `AI_RESTARTED_FROM_USER_SERVICE` / `USER_STARTED` / `REUSED_EXISTING` / `NOT_STARTED`。
167
+
168
+ > **Task 3 §5.1/§5.2**:`build-profile.json` 的 `serviceStart.inputFiles`(glob 列表,相对 project 展开)是服务指纹的来源;`harness_service.py ensure` 取 CLI `--files` ∪ `serviceStart.inputFiles` 计算依赖闭包。**空输入被拒绝**(exit 非 0,`service inputs are empty`),**不得生成可复用的空指纹**。通用项目 detect 无法猜 module 源,`inputFiles` 默认空数组,须人工配置。
169
+
170
+ 发现已有应用服务时,先展示服务决策门,再问:
171
+
172
+ ```text
173
+ 1. 直接复用当前服务
174
+ 2. 重启服务,使用已知良好测试配置
175
+ 3. 跳过接口测试,只执行单元测试
176
+ 4. 停止测试
177
+ ```
178
+
179
+ 只有 `service-session.json` 与当前**同时**满足以下条件才允许自动复用(§5.3):`moduleInputsHash` 一致、`startCommandHash` 一致、`profile` 一致、`overlayPath` 一致、进程身份(pid 存活 + create time 与 `startedAt` 匹配)可确认。任一变化 -> AI 自动 restart;身份无法确认 -> `needs-user-decision`;非 AI 用户进程**永不自动 kill**。否则必须询问。
180
+
181
+ 若用户选择重启已有服务,必须提示:测试结束后关闭新测试服务,不会恢复原服务。
182
+
183
+ 最终报告必须包含 originalServicePid、originalServiceStopped、testServicePid、testServiceStopped、restoredOriginalService、finalPortState。
184
+
185
+ ### 重入沿用
186
+
187
+ 同一变更的 harness-test 重入时,若环境未变(PG/端口/执行器与上次一致)、上次已确认执行器方案、且源码未改服务启动逻辑,可沿用上次服务决策不重复询问,执行日志记 `重入沿用+环境未变`。不适用情形(fingerprint 不匹配、环境已变、USER_STARTED、源码改启动逻辑)仍须询问/重启。详见 checklist.md「0.10.x 重入沿用」。
188
+
189
+ ## 启动等待状态机
190
+
191
+ | 阶段 | 探测频率 | 行为 |
192
+ |---|---|---|
193
+ | 0–30s | 每 2s 一次(端口 + healthUrl) | 命中即继续 |
194
+ | 30–120s | 每 5s 一次 | 命中即继续 |
195
+ | 超过 120s | 读取最近 200 行 `service-start.log` | 异常即停 |
196
+
197
+ 立即失败的异常关键字(按技术栈识别,如 Java Spring Boot 的 `BindException` / `Could not resolve placeholder` /
198
+ `Connection refused during bean init` / `BeanCreationException` /
199
+ `Failed to start bean` / `BUILD FAILURE`)。
200
+
201
+ 每等待 >10s 必须输出一次状态行:
202
+
203
+ ```
204
+ 服务启动中:elapsed=20s, port=not listening, lastLog="..."
205
+ ```
206
+
207
+ ## 批量测试执行器(强制 setup / test / cleanup 三阶段)
208
+
209
+ > ⚠️ **强制单次执行**:执行器必须一次性跑完所有场景并输出 JSON,主会话不再逐条调用 Playwright MCP。只有首选执行器失败才降级为 PowerShell batch / 多次 `browser_evaluate`。
210
+
211
+ ### 文件位置
212
+
213
+ - 脚本:`.harness/changes/<change-name>/runtime/api-test-runner.mjs`
214
+ - 结果:`.harness/changes/<change-name>/runtime/api-test-results.json`
215
+ - 均在 `.harness/changes/<change>/runtime/` 下,不提交到 git
216
+
217
+ ### 执行方式(一次命令,PowerShell + 执行器绝对路径)
218
+
219
+ ```powershell
220
+ powershell.exe -NoProfile -ExecutionPolicy Bypass -Command "& 'C:\nvm4w\nodejs\node.exe' '.harness/changes/<change-name>/runtime/api-test-runner.mjs'"
221
+ ```
222
+
223
+ - 绝对路径默认 `C:\nvm4w\nodejs\node.exe`(Node runner 为一种实现,可按项目替换);不同环境从 `preflight.json` 的 `executorPath` 读取
224
+ - 禁止裸 `node ...`,禁止用 Bash 执行 node
225
+ - 失败 ≤ 1 次重试,仍失败必须提示用户切换权限模式或手动执行执行器
226
+
227
+ 执行器内部按 setup → test → cleanup 三阶段,失败时不会用 null ID 继续请求。
228
+ 主会话只 Read `api-test-results.json` 生成摘要,不再调用 MCP。
229
+
230
+ ### 执行器三阶段模板(setup / test / cleanup)
231
+
232
+ ```javascript
233
+ // api-test-runner.mjs — 批量接口测试执行器(PowerShell + 执行器绝对路径执行;Node runner 为一种实现,可按项目替换)
234
+ import { request } from '@playwright/test';
235
+ import { writeFileSync, readFileSync } from 'node:fs';
236
+
237
+ const BASE_URL = 'http://127.0.0.1:<port>'; // 直连本地 baseURL
238
+ const CONTEXT_PATH = '<context-path>';
239
+ const HEADERS = {
240
+ 'Content-Type': 'application/json; charset=UTF-8',
241
+ 'tenant-id': '1' // 如项目适用,从配置读取
242
+ };
243
+ const RESULTS_FILE = '.harness/changes/<change-name>/runtime/api-test-results.json';
244
+ const CREDENTIAL_CACHE = '.harness/changes/<change-name>/runtime/credential-cache.json';
245
+
246
+ // ===== Payload schema(从数据契约/接口定义/真实样例生成,禁止临场猜)=====
247
+ // 关键字段从项目的数据契约(如 VO/DTO/接口定义)读取,必填字段逐一核对
248
+ // 详见 .harness/changes/<change>/plans/<change>-test-scenarios.md
249
+
250
+ const setupState = {
251
+ resourceId: null,
252
+ errors: []
253
+ };
254
+
255
+ // ===== 凭证复用:先本地轻量接口验证,失败才走远程认证服务 =====
256
+ let credentialRefreshCount = 0;
257
+ async function resolveCredential(role) {
258
+ let cache = {};
259
+ try { cache = JSON.parse(readFileSync(CREDENTIAL_CACHE, 'utf8')); } catch {}
260
+ const entry = cache.credentials?.[role];
261
+ if (entry?.token) {
262
+ const ctx = await request.newContext({ baseURL: BASE_URL });
263
+ const probe = await ctx.get(`${CONTEXT_PATH}/meta`, { // 本地轻量健康接口
264
+ headers: { ...HEADERS, Authorization: `Bearer ${entry.token}` },
265
+ timeout: 5000
266
+ });
267
+ if (probe.ok()) return entry.token;
268
+ }
269
+ if (credentialRefreshCount >= 1) {
270
+ throw new Error('凭证重取超过 1 次,请检查认证服务/账号配置');
271
+ }
272
+ credentialRefreshCount++;
273
+ return await loginViaAuthService(role); // 写回 cache
274
+ }
275
+
276
+ // ===== setup:创建前置数据 =====
277
+ async function setup(token) {
278
+ const ctx = await request.newContext({ baseURL: BASE_URL });
279
+ // 唯一前缀,避免冲突
280
+ const prefix = `TEST_<change-name>_${Date.now()}_${Math.random().toString(36).slice(2,6)}`;
281
+ // 唯一约束字段必须随机或避让,避免冲突导致 BLOCKED
282
+ const uniqueField = 900000 + Math.floor(Math.random() * 9999);
283
+ try {
284
+ const resp = await ctx.post(`${CONTEXT_PATH}/<resource>/create`, {
285
+ headers: { ...HEADERS, Authorization: `Bearer ${token}` },
286
+ data: JSON.stringify({
287
+ // payload 字段从数据契约/接口定义/真实样例生成,禁止临场猜
288
+ code: `${prefix}_res1`,
289
+ name: `${prefix}_资源`,
290
+ uniqueField // 唯一约束字段,随机或避让
291
+ }),
292
+ timeout: 10000
293
+ });
294
+ const json = await resp.json();
295
+ if (json.code === 0 || json.code === '0') {
296
+ setupState.resourceId = json.data?.id;
297
+ } else {
298
+ setupState.errors.push({ step: 'createResource', code: json.code, message: json.message });
299
+ }
300
+ } catch (e) {
301
+ setupState.errors.push({ step: 'createResource', error: e.message });
302
+ }
303
+ }
304
+
305
+ // ===== test:依赖判定 → BLOCKED 不发请求 =====
306
+ const results = [];
307
+ async function runOne(scenario, token) {
308
+ // 依赖检查
309
+ if (scenario.requires?.resourceId && !setupState.resourceId) {
310
+ results.push({ scenario: scenario.id, status: 0, passed: false, state: 'BLOCKED',
311
+ reason: 'setup.createResource failed' });
312
+ return;
313
+ }
314
+ const start = Date.now();
315
+ try {
316
+ const ctx = await request.newContext({ baseURL: BASE_URL });
317
+ const url = scenario.url.replace('{resourceId}', setupState.resourceId ?? '');
318
+ const resp = await ctx.fetch(url, {
319
+ method: scenario.method,
320
+ headers: { ...HEADERS, ...scenario.headers, Authorization: `Bearer ${token}` },
321
+ data: scenario.body ? JSON.stringify(scenario.body(setupState)) : undefined,
322
+ timeout: scenario.timeout || 10000
323
+ });
324
+ const data = await resp.json();
325
+ const durationMs = Date.now() - start;
326
+ results.push({
327
+ scenario: scenario.id, method: scenario.method, url,
328
+ status: resp.status(), code: data.code, message: data.message || data.msg,
329
+ durationMs,
330
+ state: checkPassed(scenario, resp.status(), data) ? 'PASS' : 'FAIL',
331
+ passed: checkPassed(scenario, resp.status(), data)
332
+ });
333
+ } catch (err) {
334
+ results.push({
335
+ scenario: scenario.id, method: scenario.method, url: scenario.url,
336
+ status: 0, code: 'ERROR', message: err.message,
337
+ durationMs: Date.now() - start,
338
+ state: 'FAIL', passed: false
339
+ });
340
+ }
341
+ }
342
+
343
+ // ===== cleanup:尽力清理 =====
344
+ async function cleanup(token) {
345
+ const ctx = await request.newContext({ baseURL: BASE_URL });
346
+ let cleaned = 0, leftover = 0;
347
+ const errors = [];
348
+ if (setupState.resourceId) {
349
+ try {
350
+ const resp = await ctx.delete(`${CONTEXT_PATH}/<resource>/${setupState.resourceId}`, {
351
+ headers: { ...HEADERS, Authorization: `Bearer ${token}` },
352
+ timeout: 10000
353
+ });
354
+ if (resp.ok()) cleaned++; else { leftover++; errors.push({ id: setupState.resourceId, status: resp.status() }); }
355
+ } catch (e) {
356
+ leftover++; errors.push({ id: setupState.resourceId, error: e.message });
357
+ }
358
+ }
359
+ return { cleaned, leftover, errors };
360
+ }
361
+
362
+ // ===== 主流程 =====
363
+ const token = await resolveCredential('admin');
364
+ await setup(token);
365
+ for (const scenario of scenarios) {
366
+ await runOne(scenario, token);
367
+ }
368
+ const cleanupResult = await cleanup(token);
369
+
370
+ const summary = {
371
+ runner: 'api-test-executor',
372
+ scenariosTotal: results.length,
373
+ passed: results.filter(r => r.state === 'PASS').length,
374
+ failed: results.filter(r => r.state === 'FAIL').length,
375
+ blocked: results.filter(r => r.state === 'BLOCKED').length,
376
+ skipped: results.filter(r => r.state === 'SKIPPED').length,
377
+ setupErrors: setupState.errors,
378
+ cleanupResult,
379
+ credentialRefreshCount,
380
+ startedAt: '<ISO>', finishedAt: '<ISO>', durationMs: 0
381
+ };
382
+ writeFileSync(RESULTS_FILE, JSON.stringify({ results, summary }, null, 2));
383
+ console.log(`\n结果已写入 ${RESULTS_FILE}`);
384
+ ```
385
+
386
+ > **关键点**:
387
+ > - `setup` / `test` / `cleanup` 三阶段,依赖未满足时标 `BLOCKED`,**不发起请求**
388
+ > - 执行器用 `request.newContext({ baseURL })` 或原生 HTTP 客户端 **直连本地 baseURL**
389
+ > - 凭证从本地 cache 读 + 本地轻量接口验证,**完全不依赖浏览器当前页面 origin**
390
+ > - 同一次执行内 `credentialRefreshCount` 不得 > 1
391
+ > - payload 从数据契约/接口定义/真实样例生成,并在脚本注释中标注字段来源
392
+
393
+ ### 执行器降级方案(PowerShell batch runner .ps1)
394
+
395
+ ```powershell
396
+ # api-test-runner.ps1 — PowerShell 批量接口测试
397
+ $baseUrl = "http://127.0.0.1:<port>"
398
+ $headers = @{
399
+ "Content-Type" = "application/json; charset=UTF-8"
400
+ "tenant-id" = "1" # 如项目适用
401
+ }
402
+
403
+ $results = @()
404
+ foreach ($scenario in $scenarios) {
405
+ $sw = [System.Diagnostics.Stopwatch]::StartNew()
406
+ try {
407
+ $body = $scenario.body | ConvertTo-Json -Depth 10 -Compress
408
+ $resp = Invoke-RestMethod -Uri "$baseUrl$($scenario.url)" -Method $scenario.method -Headers $headers -Body $body -ContentType "application/json; charset=UTF-8"
409
+ $sw.Stop()
410
+ $results += [PSCustomObject]@{
411
+ scenario = $scenario.id
412
+ method = $scenario.method
413
+ url = $scenario.url
414
+ status = 200
415
+ code = $resp.code
416
+ message = $resp.message
417
+ durationMs = $sw.ElapsedMilliseconds
418
+ passed = $true
419
+ }
420
+ } catch {
421
+ $sw.Stop()
422
+ $results += [PSCustomObject]@{
423
+ scenario = $scenario.id
424
+ method = $scenario.method
425
+ url = $scenario.url
426
+ status = $_.Exception.Response.StatusCode.value__
427
+ code = "ERROR"
428
+ message = $_.Exception.Message
429
+ durationMs = $sw.ElapsedMilliseconds
430
+ passed = $false
431
+ }
432
+ }
433
+ }
434
+
435
+ $results | ConvertTo-Json -Depth 4
436
+ ```
437
+
438
+ ## 命令与请求超时治理
439
+
440
+ 所有命令必须有"预期时长 + 超时上限",超过预期时长**必须输出一次当前状态**:
441
+
442
+ | 命令类型 | 预期 | 超时 | 超时行为 |
443
+ |----------|:----:|:----:|----------|
444
+ | PowerShell preflight (0.1) | 1–2s | **5s** | 失败立即停 0.1 |
445
+ | 接口测试执行器(普通) | 30s | **60s** | 抛错继续报告,不再重试 |
446
+ | 接口测试执行器(复杂场景) | 60s | **120s** | 同上 |
447
+ | 凭证获取(认证服务) | 5–10s | **15s** | 计 1 次重取;超过 1 次 → 🟡 WARN |
448
+ | 单个 HTTP GET | < 1s | **8s** | durationMs > 10s → 🟡 SLOW |
449
+ | 单个 HTTP POST/PUT | < 2s | **10s** | durationMs > 10s → 🟡 SLOW |
450
+ | health probe | < 1s | **3s** | 计入启动状态机 |
451
+ | 构建工具编译(如 Maven compile) | 10–60s | **180s** | 输出最后 30 行日志后停 |
452
+ | 测试命令(如 Maven test) | 60–180s | **300s** | 输出失败用例后停 |
453
+ | service start | 30–60s | **120s** | 4.1 启动状态机收敛 |
454
+
455
+ **反馈规则**:
456
+ - 等待 > 10s 必须输出一次状态行(启动等待、执行器、构建工具均适用)
457
+ - 不得静默等待
458
+ - `durationMs > 10000` → 🟡 SLOW
459
+ - `durationMs > 30000` → ❌ TIMEOUT_RISK
460
+ - 请求慢不得忽略,必须说明是服务、网络、认证还是工具调用开销
461
+
462
+ ## 认证凭证缓存与复用
463
+
464
+ ### 缓存文件
465
+
466
+ `.harness/changes/<change-name>/runtime/credential-cache.json`(不提交到 git)
467
+
468
+ ### 缓存结构
469
+
470
+ ```json
471
+ {
472
+ "baseUrl": "http://127.0.0.1:<port>",
473
+ "profile": "<profile>",
474
+ "credentials": {
475
+ "admin": {
476
+ "username": "admin",
477
+ "role": "<角色,如 SUPER_ADMIN>",
478
+ "token": "<raw token only in runtime file>",
479
+ "tokenHash": "<sha256 prefix>",
480
+ "createdAt": "2026-06-22T10:00:00+08:00",
481
+ "lastValidatedAt": "2026-06-22T10:15:00+08:00",
482
+ "expiresAt": null
483
+ },
484
+ "normal_user": {
485
+ "username": "user1",
486
+ "role": "<角色,如 NORMAL>",
487
+ "token": "<raw token only in runtime file>",
488
+ "tokenHash": "<sha256 prefix>",
489
+ "createdAt": "2026-06-22T10:00:00+08:00",
490
+ "lastValidatedAt": "2026-06-22T10:15:00+08:00",
491
+ "expiresAt": null
492
+ }
493
+ }
494
+ }
495
+ ```
496
+
497
+ ### 凭证使用策略
498
+
499
+ 1. 先读取 `credential-cache.json`
500
+ 2. 如果已有目标角色凭证,先用**本地轻量接口**验证(如 `GET /meta`,直连本地 baseURL)
501
+ 3. 验证通过(200 + code=0)则复用,**不重新登录、不访问远程认证服务**
502
+ 4. 验证失败(401 / 凭证过期 / login required)→ 才访问远程认证服务(如 SSO)重新获取并写回 cache
503
+ 5. 同一上下文中,前面已获取过凭证时必须优先复用
504
+ 6. **接口测试执行器必须使用 request context 或原生 HTTP 客户端直接请求本地 baseURL,不得依赖浏览器当前页面 origin**
505
+ 7. **不得因浏览器当前页面 origin 在认证服务就重新获取凭证**——凭证是独立凭证,与浏览器停留页面无关
506
+ 8. **禁止低效流程**:先在远程认证服务页面获取凭证 → 导航到 localhost → 再重新获取凭证。正确流程是直接用本地 baseURL + 已缓存凭证验证,缓存失效才走认证服务
507
+ 9. **不得在报告、execution-log、对话总结中输出明文凭证**
508
+
509
+ > 凭证脱敏与持久化处理遵循 `../protocols/sensitive-info-protocol.md`。
510
+
511
+ **输出示例(正确)**:
512
+ ```
513
+ 凭证策略:
514
+ - admin 凭证: ✅ 复用缓存(本地轻量接口验证通过),lastValidatedAt=2026-06-22T10:15:00+08:00
515
+ - normal 凭证: 🔄 缓存失效,已通过认证服务刷新
516
+ Admin 凭证获取成功:<CREDENTIAL_REDACTED>,hash=sha256:abcd1234
517
+ ```
518
+
519
+ **输出示例(错误)**:
520
+ ```
521
+ Admin 凭证获取成功:aedcf3b8c9d2e1f4...
522
+ ```
523
+
524
+ ## 测试数据治理
525
+
526
+ ### 测试数据命名
527
+
528
+ 接口测试创建数据必须使用唯一前缀:
529
+
530
+ ```
531
+ TEST_<change-name>_<timestamp>_<short-random>
532
+ ```
533
+
534
+ 示例:`TEST_fix-pagination_20260622_a3f2`
535
+
536
+ 所有测试数据编码、名称等必须带此前缀。
537
+
538
+ ### 测试数据冲突预防
539
+
540
+ 存在唯一约束的字段(按项目识别):
541
+
542
+ 1. 使用随机值(如 `900000 + random`)
543
+ 2. 先查询已有值后避让
544
+ 3. 使用唯一隔离值
545
+
546
+ **不得**因唯一约束字段与本地预存数据冲突导致大面积 BLOCKED。
547
+
548
+ ### 请求体生成(禁止临场猜字段)
549
+
550
+ 生成执行器前必须建立 payload schema:
551
+
552
+ 1. 读取对应数据契约 / DTO / 接口定义(如 `<XxxSaveReqVO>` / `<XxxQueryReqVO>`)
553
+ 2. 读取接口层方法(参数注解、校验注解,如 Controller 方法)
554
+ 3. 读取已有测试 / Postman / 真实请求样例
555
+ 4. 在执行器注释或 JSON 中记录字段来源(如 "from <数据契约名>")
556
+
557
+ ### 测试数据记录
558
+
559
+ 测试报告必须包含测试数据表:
560
+
561
+ ```markdown
562
+ ## 测试数据
563
+ | 类型 | ID | Code | 用途 | 是否需要清理 |
564
+ |------|----|------|------|:----------:|
565
+ | 资源 | 123 | TEST_fix-pagination_20260622_a3f2_res1 | 分页查询测试 | ✅ 已清理 |
566
+ | 资源 | 456 | TEST_fix-pagination_20260622_a3f2_res2 | 分页查询测试 | 🟡 接口不支持删除 |
567
+ ```
568
+
569
+ ### 清理策略
570
+
571
+ - 如果接口支持删除、禁用或回滚 → 测试结束后清理
572
+ - 不能清理 → 记录遗留数据和原因
573
+ - 不得反复试错创建冲突数据
574
+
575
+ ## 响应验证
576
+
577
+ - HTTP 状态码 与预期对比
578
+ - `code` 字段 与预期对比(**自动兼容两种格式**:下划线 `1_003_002_009` 和数字 `1003002009`)
579
+ - `message` 关键词匹配(模糊匹配即可)
580
+
581
+ ## 数据兼容测试
582
+
583
+ 如果场景表有「数据兼容场景」:查询已有数据,验证新字段返回 null 或默认值,不报错。
584
+
585
+ ## 输出格式(测试报告模板)
586
+
587
+ 测试完成后,将报告保存到 `.harness/changes/<change-name>/reports/test/test-report-YYYYMMDD-HHmm.md`(时间戳格式:日期+时分),同时在控制台输出摘要。
588
+
589
+ ```markdown
590
+ ## 测试报告 — <功能名>
591
+
592
+ ### 请求执行器
593
+ - 接口测试执行器: ✅ 使用 / ❌ 不可用,原因:...
594
+ - PowerShell batch runner (.ps1): 未使用 / 🟡 fallback,原因:...
595
+ - Playwright MCP browser_evaluate: 未使用 / 🟡 fallback,原因:...
596
+ - curl: 未使用 / 🟡 fallback,原因:...
597
+
598
+ ### 服务生命周期
599
+ | 项 | 值 |
600
+ |---|---|
601
+ | serviceState | AI_STARTED / USER_STARTED / REUSED_EXISTING / NOT_STARTED |
602
+ | pid | 12345 |
603
+ | startCommand | <脱敏的 PowerShell 启动命令> |
604
+ | stopAfterTest | true / false |
605
+ | stopped | ✅ / ❌ / N/A |
606
+
607
+ ### 凭证策略
608
+ - admin 凭证: ✅ 复用缓存(本地验证通过) / 🔄 缓存失效已刷新(认证服务)
609
+ - normal 凭证: ✅ 复用缓存 / 🔄 已刷新
610
+ - credentialRefreshCount: 0 / 1(>1 → 🟡 WARN)
611
+
612
+ ### 单元测试
613
+ > ✅ 复用 harness-run 单元测试结果:Tests run: N, Failures: 0, Errors: 0
614
+ > (diffHash=<...>, module=<...>, profile=<...>, scope=<...>)
615
+ > 或:🔄 已重跑(原因:diffHash 变化 / 行为性 post-test 修改 / run 未跑全量)
616
+
617
+ | 指标 | 数值 |
618
+ |------|:----:|
619
+ | 总测试数 | 31 |
620
+ | 通过 | 31 |
621
+ | 失败 | 0 |
622
+ | 跳过 | 0 |
623
+
624
+ ### 执行器三阶段
625
+ | 阶段 | 状态 | 说明 |
626
+ |---|---|---|
627
+ | setup | ✅ 全部成功 / ❌ N 个错误 | createResource OK |
628
+ | test | N PASS / M FAIL / K BLOCKED / J SKIPPED | BLOCKED 全部因 setup.createResource 失败 |
629
+ | cleanup | cleaned=X / leftover=Y | 接口 /<resource> 不支持删除,2 条遗留 |
630
+
631
+ ### 接口测试
632
+ | # | 场景 | 方法 | URL | 预期 | 实际 | durationMs | 状态 |
633
+ |:--:|------|:----:|-----|------|------|----------:|:--:|
634
+ | API-001 | 创建资源 | POST | /api/xxx | 200, code=0 | 200, code=0 | 245 | ✅ PASS |
635
+ | API-002 | 参数校验 | POST | /api/xxx | code=xxx | code=xxx | 180 | ✅ PASS |
636
+ | API-003 | 查询子规则 | GET | /api/xxx/{id} | 200 | — | — | 🟡 BLOCKED(setup.createRule 失败) |
637
+
638
+ ### 请求耗时统计
639
+ | 场景 | 方法 | URL | durationMs | 状态 |
640
+ |------|:----:|-----|----------:|:----:|
641
+ | API-001 | POST | /api/xxx | 245 | ✅ |
642
+ | API-010 | GET | /api/yyy | 12450 | 🟡SLOW |
643
+
644
+ ### 数据兼容
645
+ | # | 场景 | 预期 | 实际 | 结果 |
646
+ |:--:|------|------|------|:--:|
647
+ | COM-001 | 旧数据查询 | 200, 不报错 | 200, 新字段=null | ✅ |
648
+
649
+ ### 测试数据
650
+ | 类型 | ID | Code | 用途 | 是否需要清理 |
651
+ |------|----|------|------|:----------:|
652
+ | 资源 | 123 | TEST_xxx_20260622_a3f2_res1 | 分页测试 | ✅ 已清理 |
653
+
654
+ ### 汇总
655
+ - 单元测试: N 通过 / 0 失败
656
+ - 接口测试: K PASS / L FAIL / B BLOCKED / S SKIPPED / P 🟡SLOW
657
+ - 数据兼容: N 通过 / 0 失败
658
+ - 请求执行器: 接口测试执行器(✅ 正常)
659
+ - serviceState: AI_STARTED → ✅ stopped
660
+ - 测试数据: N 条已清理 / M 条遗留
661
+ - credentialRefreshCount: 0
662
+
663
+ ### final-summary(顶层维度状态)
664
+ - compile: ✅ OK
665
+ - unitTest: ✅ OK / 🟡 REUSED_FROM_RUN
666
+ - apiTest: **OK / PARTIAL / BLOCKED / NOT_RUN / FAIL**
667
+ - 例:`apiTest=PARTIAL` — 15 个 API 场景中 5 个 PASS,9 个 BLOCKED,1 个 FAIL
668
+ - gitDiffCheck: ✅
669
+ - serviceLifecycle: ✅ AI_STARTED stopped / 🟡 USER_STARTED 保留
670
+
671
+ ### 关门检查结果
672
+ - git status --porcelain: ✅/❌
673
+ - git diff --stat: ✅/❌
674
+ - git diff --check: ✅/❌(❌ → 最终结果 ❌FAIL)
675
+ - 明文敏感信息: ✅无/❌有
676
+ - runtime 不提交: ✅已确认
677
+ - 服务生命周期: AI_STARTED→✅stopped(pid=12345) / USER_STARTED→🟡保留 / REUSED_EXISTING→🟡保留
678
+ - 测试数据清理: ✅已清理/🟡N条遗留
679
+ - 执行器表完整性: ✅四种执行器均已列出,未与接口测试执行器混写
680
+
681
+ ### 下一步
682
+ - 如果 ✅OK:进入 /harness-review
683
+ - 如果 🟡WARN:根据 WARN 原因决定是否补充测试或进入 review
684
+ - 如果 ❌FAIL:修复失败项后重新运行 /harness-test
685
+ ```
686
+
687
+ ## 结果分级规则
688
+
689
+ > 结果状态分级与证据要求遵循 `../protocols/evidence-based-reporting-protocol.md`。
690
+
691
+ ### 整体结果
692
+
693
+ **✅OK**(全部满足):
694
+ - 所有 P0 接口/权限/数据兼容场景真实验证通过
695
+ - 无未解释的环境变更
696
+ - 请求执行器、token 策略、测试数据均有记录
697
+ - 关键测试请求有 durationMs 证据
698
+ - git diff --check 通过
699
+ - 服务生命周期已正确收尾
700
+
701
+ **🟡WARN**(任一满足):
702
+ - 业务验证通过,但存在测试环境变更
703
+ - 使用了 fallback 请求执行器
704
+ - 有测试数据未清理
705
+ - 有 P1 场景未验证
706
+ - 有慢请求(🟡SLOW)/ 任一 P0 场景被跳过 / BLOCKED
707
+ - 有非关键降级
708
+ - AI_STARTED 服务未关闭
709
+ - `credentialRefreshCount > 1`
710
+
711
+ **❌FAIL**(任一满足):
712
+ - 任一 P0 场景 FAIL(请求执行了,断言失败)
713
+ - 服务无法启动 / 0.1 命令执行模式失败且未恢复
714
+ - 编译/单测失败
715
+ - 批量 runner 执行失败且无有效 fallback
716
+ - git diff --check 失败
717
+
718
+ > **P0 场景 BLOCKED 不得仍 OK**:必须 🟡 WARN 或 ❌ FAIL。
719
+
720
+ ### API 测试维度状态(final-summary 中输出)
721
+
722
+ | 状态 | 定义 |
723
+ |---|---|
724
+ | `OK` | P0 API 全部 PASS |
725
+ | `PARTIAL` | 部分 PASS + 部分 FAIL/BLOCKED |
726
+ | `BLOCKED` | P0 API 全部无法执行(环境/前置数据) |
727
+ | `NOT_RUN` | 完全没执行任何 API |
728
+ | `FAIL` | P0 API 明确 FAIL |
729
+
730
+ > ⚠️ **不得**把"5 PASS + 9 BLOCKED + 1 FAIL"写成 `apiTest=NOT_RUN`。正确:`apiTest=PARTIAL`。
731
+
732
+ ## 请求执行器 fallback 输出
733
+
734
+ 在测试报告中必须区分四种执行器(不得笼统写"Playwright"):
735
+
736
+ ```markdown
737
+ ## 请求执行器
738
+ - 接口测试执行器: ✅ 使用 / ❌ 不可用,原因:...
739
+ - PowerShell batch runner (.ps1): 未使用 / 🟡 fallback,原因:...
740
+ - Playwright MCP browser_evaluate: 未使用 / 🟡 fallback,原因:...
741
+ - curl: 未使用 / 🟡 fallback,原因:...
742
+ ```
743
+
744
+ 默认期望:`接口测试执行器 ✅ 使用`,其余三项 `未使用`。
745
+
746
+ - 如果执行器正常执行,其余三项均标"未使用"
747
+ - 如果首选执行器不可执行降级为 PowerShell batch / 多次 MCP `browser_evaluate`,按实际标 🟡 fallback 并写原因
748
+ - 如果最终用了 curl,必须解释为什么接口测试执行器、PowerShell batch、Playwright MCP 都不可用
749
+ - **不得**把 "Playwright API 执行器" 与 "Playwright MCP browser_evaluate" 混写
750
+
751
+ ## 关门检查
752
+
753
+ 在输出最终总结前,必须执行并展示以下 10 项检查:
754
+
755
+ 1. `powershell.exe -NoProfile -Command "git status --porcelain"`
756
+ 2. `powershell.exe -NoProfile -Command "git diff --stat"`
757
+ 3. `powershell.exe -NoProfile -Command "git diff --check"`(如果失败 → 最终结果 ❌FAIL)
758
+ 4. 检查报告和日志是否包含明文凭证/password/secret/access-key/client-secret
759
+ 5. 检查 `.harness/changes/<change>/runtime/` 是否不会被提交(.gitignore 确认)
760
+ 6. **服务生命周期收尾**:AI_STARTED→Stop-Process / USER_STARTED→只提示 / REUSED_EXISTING→保留或用户确认 / NOT_STARTED→N/A
761
+ 7. 检查测试数据是否需要清理
762
+ 8. 检查请求执行器结果是否完整(4 种执行器表完整、未与接口测试执行器混写)
763
+ 9. 检查是否存在慢请求或超时风险
764
+ 10. 如果存在未清理测试数据、fallback 请求执行器、慢请求或环境变更 → 至少 🟡WARN
765
+
766
+ ## 真实 diffHash 生成
767
+
768
+ > diffHash 与 ledger 复用规则遵循 `../protocols/ledger-protocol.md`。
769
+
770
+ 后续复用 ledger 前必须生成真实 SHA-256 diffHash,且**必须 commit-invariant**(含 `git diff baseCommit..HEAD` 已提交部分)。否则 run 的 Step 5 checkpoint commit 后工作树干净、`git diff` 为空,harness-test 会误判"diffHash 变化"而重跑 run 已跑过的全量测试,复用链断裂。`<baseCommit>` 从 ledger 读取(plan 阶段写入),缺失时用 `git merge-base HEAD <默认分支>`:
771
+
772
+ ```powershell
773
+ powershell.exe -NoProfile -Command "$base = '<baseCommit>'; $patch = '.harness/changes/<change>/runtime/current-diff.patch'; & { git diff $base HEAD --binary; git diff --binary; git ls-files --others --exclude-standard | ForEach-Object { Get-Content -Raw -LiteralPath $_ } } | Out-File -Encoding utf8 $patch; (Get-FileHash $patch -Algorithm SHA256).Hash"
774
+ ```
775
+
776
+ 写入 `.harness/changes/<change>/evidence/verification-ledger.json`:
777
+
778
+ ```json
779
+ {
780
+ "diffHash": "sha256:<real_hash>",
781
+ "diffPatchFile": ".harness/changes/<change>/runtime/current-diff.patch"
782
+ }
783
+ ```
784
+
785
+ 禁止使用 `3files-84plus-5minus` 这类描述性 diffHash 作为复用依据。**禁止仅用 `git diff`(未提交)计算 diffHash**——commit 后工作树干净致指纹变空,断裂 run→test 复用链。**同样禁止** `git diff <base> HEAD` 已提交单部分或 `node -e` 自算 SHA-256——commit 后 clean 致单部分偶然等价不得作为依据,无论时序必须三部分合并。
786
+
787
+ ## 执行日志记录
788
+
789
+ `/harness-test` 只向 `events.ndjson` 追加事件(schema_version 2);`logs/execution-log.md` 由 `harness_events.py append` 自动渲染。Phase 0 之前 append `phase.start`;各阶段写入 `command` / `verification` / `decision` / `issue` / `artifact`,人类可读摘要放 `note`。事件类型与脚本用法见 [[../protocols/report-pipeline-protocol.md|report-pipeline-protocol]] 与 SKILL.md `## 执行日志`。
790
+
791
+ 关键 `note` / 事件须覆盖:0.1 命令执行模式、fallback 执行器、serviceState、凭证策略、单元测试复用、批量执行器、verification-ledger 写入、关门检查、API 状态(不得把 PARTIAL 写成 NOT_RUN)。