superlab 0.1.16 → 0.1.17
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/lib/i18n.cjs +49 -5
- package/package-assets/claude/commands/lab-report.md +1 -1
- package/package-assets/codex/prompts/lab-report.md +1 -1
- package/package-assets/shared/lab/.managed/templates/final-report.md +18 -2
- package/package-assets/shared/lab/.managed/templates/main-tables.md +19 -0
- package/package-assets/shared/skills/lab/stages/auto.md +1 -0
- package/package-assets/shared/skills/lab/stages/report.md +7 -0
- package/package.json +1 -1
package/lib/i18n.cjs
CHANGED
|
@@ -55,7 +55,7 @@ const ZH_CONTENT = {
|
|
|
55
55
|
[path.join(".codex", "prompts", "lab-report.md")]: codexPrompt(
|
|
56
56
|
"基于验证后的迭代工件生成最终报告",
|
|
57
57
|
"report context",
|
|
58
|
-
"使用已安装的 `lab` 技能:`.codex/skills/lab/SKILL.md`。\n\n立刻针对用户当前给出的参数执行 `/lab:report`,不要只推荐别的 `/lab` 阶段。只有在缺少阻塞性前提时,才明确指出缺什么,并且一次最多追问一个问题。\n\n本命令运行 `/lab:report`
|
|
58
|
+
"使用已安装的 `lab` 技能:`.codex/skills/lab/SKILL.md`。\n\n立刻针对用户当前给出的参数执行 `/lab:report`,不要只推荐别的 `/lab` 阶段。只有在缺少阻塞性前提时,才明确指出缺什么,并且一次最多追问一个问题。\n\n本命令运行 `/lab:report` 阶段。它必须生成给用户直接阅读的最终实验报告和受管的 `main-tables.md`,明确写出主指标、次级指标和必要终局证据,并用白话解释这些指标分别衡量什么、哪些只是健康度或支持性指标、以及每张主表到底证明了什么和没证明什么。"
|
|
59
59
|
),
|
|
60
60
|
[path.join(".codex", "prompts", "lab-write.md")]: codexPrompt(
|
|
61
61
|
"把验证过的研究工件转成论文 section,并按小步方式修订",
|
|
@@ -102,7 +102,7 @@ const ZH_CONTENT = {
|
|
|
102
102
|
"lab-report",
|
|
103
103
|
"基于验证后的迭代工件生成最终报告",
|
|
104
104
|
"report context",
|
|
105
|
-
"使用已安装的 `lab` 技能:`.claude/skills/lab/SKILL.md`。\n\n立刻针对用户当前给出的参数执行 `report` 阶段,不要只推荐别的 lab 阶段。只有在缺少阻塞性前提时,才明确指出缺什么,并且一次最多追问一个问题。\n\n本命令运行 lab workflow 的 `report`
|
|
105
|
+
"使用已安装的 `lab` 技能:`.claude/skills/lab/SKILL.md`。\n\n立刻针对用户当前给出的参数执行 `report` 阶段,不要只推荐别的 lab 阶段。只有在缺少阻塞性前提时,才明确指出缺什么,并且一次最多追问一个问题。\n\n本命令运行 lab workflow 的 `report` 阶段。它必须生成给用户直接阅读的最终实验报告和受管的 `main-tables.md`,明确写出主指标、次级指标和必要终局证据,并用白话解释这些指标分别衡量什么、哪些只是健康度或支持性指标、以及每张主表到底证明了什么和没证明什么。"
|
|
106
106
|
),
|
|
107
107
|
[path.join(".claude", "commands", "lab-write.md")]: claudeCommand(
|
|
108
108
|
"lab-write",
|
|
@@ -289,11 +289,14 @@ const ZH_SKILL_FILES = {
|
|
|
289
289
|
|
|
290
290
|
## 必要输出
|
|
291
291
|
|
|
292
|
+
- 给用户看的总结
|
|
292
293
|
- 方法概述
|
|
293
294
|
- 选定指标摘要
|
|
295
|
+
- 指标白话释义
|
|
294
296
|
- 实验设置
|
|
295
297
|
- 已验证主结果
|
|
296
298
|
- 位于 \`<deliverables_root>/main-tables.md\` 的受管主表工件
|
|
299
|
+
- 怎么看主表的阅读指引
|
|
297
300
|
- 消融
|
|
298
301
|
- 失败尝试
|
|
299
302
|
- 局限性
|
|
@@ -319,6 +322,8 @@ const ZH_SKILL_FILES = {
|
|
|
319
322
|
- 主表结构、gate 和最终结果 framing 必须对齐已批准的评估协议。
|
|
320
323
|
- 不要凭记忆重述指标定义、baseline 行为或对比方法实现;直接引用评估协议里记录的来源。
|
|
321
324
|
- 必须把已批准的主指标、次级指标和必要终局证据明确写进 \`report.md\` 与受管的 \`main-tables.md\`。
|
|
325
|
+
- 必须用白话解释选定的主指标和次级指标:每个指标在衡量什么、越高还是越低更好、它是主结果指标还是健康度/支持性指标。
|
|
326
|
+
- 如果出现 coverage、completeness、confidence 或类似健康度指标,必须明确说明这类指标回答的是“实验是否跑稳、证据是否完整”,而不是主要科学效应本身。
|
|
322
327
|
- 如果报告依赖了对原始指标或原始实现的偏差,必须明确写出这个偏差。
|
|
323
328
|
- 如果 workflow language 是中文,\`report.md\` 和 \`<deliverables_root>/main-tables.md\` 也应使用中文,除非文件路径、代码标识符或字面指标名必须保持原样。
|
|
324
329
|
- 解释优先保守,不要写成营销文案。
|
|
@@ -327,6 +332,8 @@ const ZH_SKILL_FILES = {
|
|
|
327
332
|
## 交互约束
|
|
328
333
|
|
|
329
334
|
- 开始前先简洁说明:campaign outcome、选定的主指标和次级指标、最强已支撑 claim、最大的报告风险。
|
|
335
|
+
- 当该阶段由 \`/lab:auto\` 进入时,要主动给出用户可读的白话总结,不要等用户再追问“这些指标是什么意思”或“这些表怎么看”。
|
|
336
|
+
- 把 \`report.md\` 当作给用户看的工件,而不是内部 dump。术语第一次出现时就解释;先讲结论,再讲术语。
|
|
330
337
|
- 如果某个未决前提会改变报告解释,一次只问一个问题。
|
|
331
338
|
- 如果存在多种报告 framing,先给 2-3 个方案、trade-offs 和推荐项,优先最忠于证据的 framing。
|
|
332
339
|
- 如果某种 framing 会实质影响后续论文 claim,要保留 approval gate。
|
|
@@ -684,10 +691,12 @@ const ZH_SKILL_FILES = {
|
|
|
684
691
|
[path.join(".lab", ".managed", "templates", "final-report.md")]:
|
|
685
692
|
`# 最终报告
|
|
686
693
|
|
|
687
|
-
##
|
|
694
|
+
## 给用户看的总结
|
|
688
695
|
|
|
689
|
-
-
|
|
690
|
-
-
|
|
696
|
+
- 一句话结论:
|
|
697
|
+
- 已经被验证的内容:
|
|
698
|
+
- 还没有被证明的内容:
|
|
699
|
+
- 当前最大报告风险:
|
|
691
700
|
|
|
692
701
|
## 选定指标
|
|
693
702
|
|
|
@@ -695,6 +704,19 @@ const ZH_SKILL_FILES = {
|
|
|
695
704
|
- 次级指标:
|
|
696
705
|
- 必要终局证据:
|
|
697
706
|
|
|
707
|
+
## 指标白话释义
|
|
708
|
+
|
|
709
|
+
- 主指标在衡量什么:
|
|
710
|
+
- 次级指标在衡量什么:
|
|
711
|
+
- 健康度/支持性指标在衡量什么,为什么它们不是主结论:
|
|
712
|
+
|
|
713
|
+
## 怎么看主表
|
|
714
|
+
|
|
715
|
+
- Table 1 负责回答什么:
|
|
716
|
+
- Table 2 负责回答什么:
|
|
717
|
+
- Table 3 负责回答什么:
|
|
718
|
+
- Table 4 负责回答什么:
|
|
719
|
+
|
|
698
720
|
## 主表工件
|
|
699
721
|
|
|
700
722
|
- 受管主表路径:\`<deliverables_root>/main-tables.md\`
|
|
@@ -719,18 +741,37 @@ const ZH_SKILL_FILES = {
|
|
|
719
741
|
[path.join(".lab", ".managed", "templates", "main-tables.md")]:
|
|
720
742
|
`# 主表工件
|
|
721
743
|
|
|
744
|
+
## 给用户看的总结
|
|
745
|
+
|
|
746
|
+
- 用户可直接复述的结论:
|
|
747
|
+
- 这些主表证明了什么:
|
|
748
|
+
- 这些主表还不能证明什么:
|
|
749
|
+
|
|
722
750
|
## 选定指标
|
|
723
751
|
|
|
724
752
|
- 主指标:
|
|
725
753
|
- 次级指标:
|
|
726
754
|
- 必要终局证据:
|
|
727
755
|
|
|
756
|
+
## 指标白话释义
|
|
757
|
+
|
|
758
|
+
- 主指标在衡量什么:
|
|
759
|
+
- 次级指标在衡量什么:
|
|
760
|
+
- 健康度/支持性指标该怎么读:
|
|
761
|
+
|
|
728
762
|
## 最终表现摘要
|
|
729
763
|
|
|
730
764
|
- 主要结果摘要:
|
|
731
765
|
- 最重要数字:
|
|
732
766
|
- 报告边界:
|
|
733
767
|
|
|
768
|
+
## 怎么看这些表
|
|
769
|
+
|
|
770
|
+
- Table 1 负责回答什么:
|
|
771
|
+
- Table 2 负责回答什么:
|
|
772
|
+
- Table 3 负责回答什么:
|
|
773
|
+
- Table 4 负责回答什么:
|
|
774
|
+
|
|
734
775
|
## Table 1
|
|
735
776
|
|
|
736
777
|
- 作用:
|
|
@@ -2015,6 +2056,7 @@ ZH_CONTENT[path.join(".codex", "skills", "lab", "stages", "auto.md")] = `# \`/la
|
|
|
2015
2056
|
- 先做输入归一化:把 \`Autonomy level L1/L2/L3\` 视为执行权限级别,把 \`Layer 3\`、\`Phase 1\`、\`Table 2\` 视为论文范围目标。
|
|
2016
2057
|
- 如果用户同时提了论文层、实验 phase 和自治级别,先用一句话重述:objective、自治级别、terminal goal、scope、allowed modifications。
|
|
2017
2058
|
- 如果 workflow language 是中文,摘要、清单条目、任务标签和进度更新都应使用中文,除非文件路径、代码标识符或字面指标名必须保持原样。
|
|
2059
|
+
- 当循环进入 \`report\` 时,要主动给出用户可读的白话总结,解释主指标、次级指标和主表作用;不要等用户额外发一句“解释这些指标”。
|
|
2018
2060
|
- 当循环即将进入 \`write\`,且 \`paper_template_root\` 为空时:
|
|
2019
2061
|
- 如果 \`paper_template_decision\` 是 \`unconfirmed\`,必须先追问一次:继续使用默认 scaffold,还是先接入模板目录
|
|
2020
2062
|
- 如果用户选择默认 scaffold,就持久化 \`paper_template_decision: default-scaffold\`
|
|
@@ -2027,6 +2069,8 @@ ZH_CONTENT[path.join(".codex", "skills", "lab", "stages", "auto.md")] = `# \`/la
|
|
|
2027
2069
|
|
|
2028
2070
|
ZH_CONTENT[path.join(".claude", "skills", "lab", "stages", "auto.md")] =
|
|
2029
2071
|
ZH_CONTENT[path.join(".codex", "skills", "lab", "stages", "auto.md")];
|
|
2072
|
+
ZH_CONTENT[path.join(".claude", "skills", "lab", "stages", "report.md")] =
|
|
2073
|
+
ZH_CONTENT[path.join(".codex", "skills", "lab", "stages", "report.md")];
|
|
2030
2074
|
|
|
2031
2075
|
function getLocalizedContent(relativePath, lang) {
|
|
2032
2076
|
if (lang !== "zh") {
|
|
@@ -7,4 +7,4 @@ argument-hint: report context
|
|
|
7
7
|
Use the installed `lab` skill at `.claude/skills/lab/SKILL.md`.
|
|
8
8
|
|
|
9
9
|
Execute the requested `/lab-report` command against the user's argument now. Do not only recommend another lab stage. If a blocking prerequisite is missing, say exactly what is missing and ask at most one clarifying question.
|
|
10
|
-
This command runs the `report` stage of the lab workflow.
|
|
10
|
+
This command runs the `report` stage of the lab workflow. It must produce a user-facing final report plus the managed `main-tables.md` artifact, explicitly carry the approved primary and secondary metrics forward, explain the selected metrics in plain language, say which metrics are only health or support metrics, and explain what each main table proves or does not prove.
|
|
@@ -6,4 +6,4 @@ argument-hint: report context
|
|
|
6
6
|
Use the installed `lab` skill at `.codex/skills/lab/SKILL.md`.
|
|
7
7
|
|
|
8
8
|
Execute the requested `/lab:report` stage against the user's argument now. Do not only recommend another lab stage. If a blocking prerequisite is missing, say exactly what is missing and ask at most one clarifying question.
|
|
9
|
-
This command runs the `/lab:report` stage.
|
|
9
|
+
This command runs the `/lab:report` stage. It must produce a user-facing final report plus the managed `main-tables.md` artifact, explicitly carry the approved primary and secondary metrics forward, explain the selected metrics in plain language, say which metrics are only health or support metrics, and explain what each main table proves or does not prove.
|
|
@@ -1,8 +1,11 @@
|
|
|
1
1
|
# Final Report
|
|
2
2
|
|
|
3
|
-
##
|
|
3
|
+
## Reader Summary
|
|
4
4
|
|
|
5
|
-
|
|
5
|
+
- One-sentence conclusion:
|
|
6
|
+
- What is validated:
|
|
7
|
+
- What is still unproven:
|
|
8
|
+
- Biggest reporting risk:
|
|
6
9
|
|
|
7
10
|
## Selected Metrics
|
|
8
11
|
|
|
@@ -10,6 +13,12 @@ Summarize the method and overall outcome.
|
|
|
10
13
|
- Secondary metrics:
|
|
11
14
|
- Required terminal evidence:
|
|
12
15
|
|
|
16
|
+
## Metric Guide
|
|
17
|
+
|
|
18
|
+
- Primary metric plain-language explanation:
|
|
19
|
+
- Secondary metric plain-language explanation:
|
|
20
|
+
- Health or support metrics and why they are not the main claim:
|
|
21
|
+
|
|
13
22
|
## Experiment Setup
|
|
14
23
|
|
|
15
24
|
- Datasets:
|
|
@@ -17,6 +26,13 @@ Summarize the method and overall outcome.
|
|
|
17
26
|
- Baselines:
|
|
18
27
|
- Metrics:
|
|
19
28
|
|
|
29
|
+
## How to Read the Main Tables
|
|
30
|
+
|
|
31
|
+
- Table 1 is for:
|
|
32
|
+
- Table 2 is for:
|
|
33
|
+
- Table 3 is for:
|
|
34
|
+
- Table 4 is for:
|
|
35
|
+
|
|
20
36
|
## Main Tables
|
|
21
37
|
|
|
22
38
|
- Managed main tables artifact: `<deliverables_root>/main-tables.md`
|
|
@@ -1,17 +1,36 @@
|
|
|
1
1
|
# Main Tables
|
|
2
2
|
|
|
3
|
+
## Reader Summary
|
|
4
|
+
|
|
5
|
+
- User-facing takeaway:
|
|
6
|
+
- What the tables prove:
|
|
7
|
+
- What the tables do not yet prove:
|
|
8
|
+
|
|
3
9
|
## Selected Metrics
|
|
4
10
|
|
|
5
11
|
- Primary metrics:
|
|
6
12
|
- Secondary metrics:
|
|
7
13
|
- Required terminal evidence:
|
|
8
14
|
|
|
15
|
+
## Metric Guide
|
|
16
|
+
|
|
17
|
+
- Primary metric plain-language explanation:
|
|
18
|
+
- Secondary metric plain-language explanation:
|
|
19
|
+
- Health or support metrics and how to read them:
|
|
20
|
+
|
|
9
21
|
## Final Performance Summary
|
|
10
22
|
|
|
11
23
|
- Main result summary:
|
|
12
24
|
- Most important numbers:
|
|
13
25
|
- Reporting caveat:
|
|
14
26
|
|
|
27
|
+
## How to Read These Tables
|
|
28
|
+
|
|
29
|
+
- Table 1 is for:
|
|
30
|
+
- Table 2 is for:
|
|
31
|
+
- Table 3 is for:
|
|
32
|
+
- Table 4 is for:
|
|
33
|
+
|
|
15
34
|
## Table 1
|
|
16
35
|
|
|
17
36
|
- Purpose:
|
|
@@ -108,6 +108,7 @@
|
|
|
108
108
|
- Then ask at most one clarifying question if a blocking field is still missing.
|
|
109
109
|
- If `.lab/config/workflow.json` sets the workflow language to Chinese, write summaries, options, checklist items, task labels, and progress updates in Chinese unless a file path, code identifier, or literal metric name must remain unchanged.
|
|
110
110
|
- When the loop reaches `report`, apply the same workflow-language rule to `report.md` and the managed `main-tables.md` artifact.
|
|
111
|
+
- When the loop reaches `report`, proactively deliver a user-facing plain-language summary of the selected metrics, what they mean, what the tables prove, and what remains unproven. Do not wait for a separate user request asking for interpretation.
|
|
111
112
|
- When the loop is about to enter `write` and `paper_template_root` is empty:
|
|
112
113
|
- if `paper_template_decision` is `unconfirmed`, ask one explicit question: continue with the default scaffold or attach a template directory first
|
|
113
114
|
- if the user chooses the default scaffold, persist `paper_template_decision: default-scaffold`
|
|
@@ -2,11 +2,14 @@
|
|
|
2
2
|
|
|
3
3
|
## Required Output
|
|
4
4
|
|
|
5
|
+
- reader summary for the user
|
|
5
6
|
- method overview
|
|
6
7
|
- selected metrics summary
|
|
8
|
+
- plain-language metric guide
|
|
7
9
|
- experiment setup
|
|
8
10
|
- validated main results
|
|
9
11
|
- managed main tables artifact under `<deliverables_root>/main-tables.md`
|
|
12
|
+
- how-to-read-the-tables guide
|
|
10
13
|
- ablations
|
|
11
14
|
- failed attempts
|
|
12
15
|
- limitations
|
|
@@ -34,6 +37,8 @@
|
|
|
34
37
|
- Structure tables, gates, and main claims against the approved evaluation protocol.
|
|
35
38
|
- Do not restate metric definitions, baseline behavior, or comparison implementations from memory; use the approved evaluation protocol and its recorded sources.
|
|
36
39
|
- Carry the approved `Primary metrics`, `Secondary metrics`, and `Required terminal evidence` into both the report and the managed main-tables artifact.
|
|
40
|
+
- Explain the selected primary and secondary metrics in plain language for the user: what each metric measures, whether higher or lower is better, and whether it is a main result metric or only a health/support metric.
|
|
41
|
+
- If coverage, completeness, confidence, or similar health metrics appear, explicitly say that they describe experimental reliability rather than the main scientific effect.
|
|
37
42
|
- If the report depends on a deviation from an original metric or implementation, state that deviation explicitly instead of smoothing it over.
|
|
38
43
|
- If `.lab/config/workflow.json` sets the workflow language to Chinese, write `report.md` and `<deliverables_root>/main-tables.md` in Chinese unless a file path, code identifier, or literal metric name must remain unchanged.
|
|
39
44
|
- Prefer conservative interpretation over marketing language.
|
|
@@ -42,6 +47,8 @@
|
|
|
42
47
|
## Interaction Contract
|
|
43
48
|
|
|
44
49
|
- Start with a concise summary of the campaign outcome, the selected primary and secondary metrics, the strongest supported claim, and the biggest reporting risk.
|
|
50
|
+
- Proactively deliver a user-readable plain-language summary when the stage is reached from `/lab:auto`; do not wait for a separate follow-up request asking what the metrics or tables mean.
|
|
51
|
+
- Treat `report.md` as a user-facing artifact rather than an internal dump. Prefer plain-language explanations before jargon, and explain each metric the first time it matters.
|
|
45
52
|
- If a missing assumption would change report interpretation, ask one clarifying question at a time.
|
|
46
53
|
- If there are multiple defensible report framings, present 2-3 approaches with trade-offs and recommend the most evidence-faithful framing before writing.
|
|
47
54
|
- Keep an approval gate when the reporting frame would materially affect what the paper later claims.
|