superlab 0.1.1 → 0.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +21 -18
- package/README.zh-CN.md +20 -16
- package/lib/i18n.cjs +594 -7
- package/lib/install.cjs +31 -0
- package/package-assets/claude/commands/lab/spec.md +1 -1
- package/package-assets/codex/prompts/lab-spec.md +1 -1
- package/package-assets/shared/changes/README.md +10 -0
- package/package-assets/shared/config/workflow.json +5 -0
- package/package-assets/shared/context/decisions.md +11 -0
- package/package-assets/shared/context/evidence-index.md +16 -0
- package/package-assets/shared/context/mission.md +27 -0
- package/package-assets/shared/context/open-questions.md +11 -0
- package/package-assets/shared/context/state.md +19 -0
- package/package-assets/shared/examples/minimal-uplift-workflow.md +4 -4
- package/package-assets/shared/skills/lab/SKILL.md +37 -10
- package/package-assets/shared/skills/lab/references/brainstorming-integration.md +21 -0
- package/package-assets/shared/skills/lab/references/workflow.md +1 -1
- package/package-assets/shared/skills/lab/stages/idea.md +13 -0
- package/package-assets/shared/skills/lab/stages/iterate.md +21 -0
- package/package-assets/shared/skills/lab/stages/report.md +19 -0
- package/package-assets/shared/skills/lab/stages/review.md +30 -0
- package/package-assets/shared/skills/lab/stages/run.md +17 -0
- package/package-assets/shared/skills/lab/stages/spec.md +36 -17
- package/package-assets/shared/skills/lab/stages/write.md +27 -3
- package/package-assets/shared/templates/design.md +5 -5
- package/package-assets/shared/templates/paper-section.tex +10 -0
- package/package-assets/shared/templates/paper.tex +29 -0
- package/package-assets/shared/templates/proposal.md +4 -4
- package/package-assets/shared/templates/review-checklist.md +23 -0
- package/package-assets/shared/templates/spec.md +4 -6
- package/package-assets/shared/templates/tasks.md +3 -5
- package/package.json +3 -3
- package/package-assets/shared/scripts/check_openspec.sh +0 -10
- package/package-assets/shared/scripts/openspec_change.sh +0 -50
|
@@ -0,0 +1,10 @@
|
|
|
1
|
+
# `.superlab/changes`
|
|
2
|
+
|
|
3
|
+
Each approved `/lab:spec` change lives in one directory:
|
|
4
|
+
|
|
5
|
+
- `.superlab/changes/<change-id>/proposal.md`
|
|
6
|
+
- `.superlab/changes/<change-id>/design.md`
|
|
7
|
+
- `.superlab/changes/<change-id>/spec.md`
|
|
8
|
+
- `.superlab/changes/<change-id>/tasks.md`
|
|
9
|
+
|
|
10
|
+
This keeps spec artifacts grouped under `lab` instead of depending on external directory conventions.
|
|
@@ -0,0 +1,16 @@
|
|
|
1
|
+
# Evidence Index
|
|
2
|
+
|
|
3
|
+
Map every important claim to concrete artifacts.
|
|
4
|
+
|
|
5
|
+
## Claims
|
|
6
|
+
|
|
7
|
+
1. Claim:
|
|
8
|
+
Supporting artifacts:
|
|
9
|
+
Metrics:
|
|
10
|
+
Limits or caveats:
|
|
11
|
+
|
|
12
|
+
## Rejected Claims
|
|
13
|
+
|
|
14
|
+
1. Claim:
|
|
15
|
+
Why it was weakened or removed:
|
|
16
|
+
Artifact showing the failure:
|
|
@@ -0,0 +1,27 @@
|
|
|
1
|
+
# Research Mission
|
|
2
|
+
|
|
3
|
+
## Core Problem
|
|
4
|
+
|
|
5
|
+
- One-sentence problem:
|
|
6
|
+
- Why it matters:
|
|
7
|
+
- Target failure case:
|
|
8
|
+
|
|
9
|
+
## Success Criteria
|
|
10
|
+
|
|
11
|
+
- Primary metric:
|
|
12
|
+
- Success threshold:
|
|
13
|
+
- Required baselines:
|
|
14
|
+
- Minimum evidence needed:
|
|
15
|
+
|
|
16
|
+
## Frozen Boundaries
|
|
17
|
+
|
|
18
|
+
- Dataset or benchmark scope:
|
|
19
|
+
- Split policy:
|
|
20
|
+
- Evaluation protocol:
|
|
21
|
+
- Hard constraints:
|
|
22
|
+
|
|
23
|
+
## Campaign Status
|
|
24
|
+
|
|
25
|
+
- Approved direction:
|
|
26
|
+
- Current owner or session:
|
|
27
|
+
- Last stage that updated this mission:
|
|
@@ -0,0 +1,19 @@
|
|
|
1
|
+
# Workflow State
|
|
2
|
+
|
|
3
|
+
## Current Stage
|
|
4
|
+
|
|
5
|
+
- Active stage:
|
|
6
|
+
- Current objective:
|
|
7
|
+
- Next required output:
|
|
8
|
+
|
|
9
|
+
## Latest Update
|
|
10
|
+
|
|
11
|
+
- Last completed action:
|
|
12
|
+
- Latest artifact path:
|
|
13
|
+
- Latest run or report id:
|
|
14
|
+
|
|
15
|
+
## Next Step
|
|
16
|
+
|
|
17
|
+
- Immediate next action:
|
|
18
|
+
- Blocking issue:
|
|
19
|
+
- Human decision needed:
|
|
@@ -20,10 +20,10 @@ Use `/lab:spec` after approving the idea artifact.
|
|
|
20
20
|
|
|
21
21
|
Expected artifacts:
|
|
22
22
|
|
|
23
|
-
-
|
|
24
|
-
-
|
|
25
|
-
-
|
|
26
|
-
-
|
|
23
|
+
- `.superlab/changes/<change-id>/proposal.md`
|
|
24
|
+
- `.superlab/changes/<change-id>/design.md`
|
|
25
|
+
- `.superlab/changes/<change-id>/spec.md`
|
|
26
|
+
- `.superlab/changes/<change-id>/tasks.md`
|
|
27
27
|
|
|
28
28
|
## 3. Run
|
|
29
29
|
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
---
|
|
2
2
|
name: lab
|
|
3
|
-
description: Strict research workflow for idea development,
|
|
3
|
+
description: Strict research workflow for idea development, lab change specification, small-scale experiment execution, bounded iteration, reviewer-grade critique, final reporting, and paper-writing.
|
|
4
4
|
---
|
|
5
5
|
|
|
6
6
|
# /lab Skill
|
|
@@ -9,10 +9,18 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
9
9
|
|
|
10
10
|
## Global Rules
|
|
11
11
|
|
|
12
|
-
- Treat OpenSpec CLI as required from `/lab:spec` onward.
|
|
13
12
|
- Keep idea generation, specification, execution, review, and reporting as separate stages.
|
|
14
13
|
- Keep paper writing separate from experiment execution and reporting.
|
|
14
|
+
- Start each stage with a concise user-facing summary before writing artifacts.
|
|
15
|
+
- After that summary, decide whether immediate artifact creation is useful; if yes, write the artifact and then report the output path plus next step.
|
|
16
|
+
- When a missing assumption would materially change the stage outcome, ask one clarifying question at a time.
|
|
17
|
+
- When there are multiple viable paths, present 2-3 approaches with trade-offs and a recommendation before converging.
|
|
18
|
+
- When a stage materially sets downstream direction, keep an explicit approval gate before proceeding.
|
|
15
19
|
- Write durable artifacts to disk instead of leaving key decisions only in chat.
|
|
20
|
+
- Use `.superlab/config/workflow.json` as the global contract for workflow language, paper language, and paper format.
|
|
21
|
+
- Use `.superlab/context/`` as the shared project state for both Codex and Claude entrypoints.
|
|
22
|
+
- Workflow artifacts should follow the installed workflow language.
|
|
23
|
+
- Final paper output should default to LaTeX, and its manuscript language should be decided separately from the workflow language.
|
|
16
24
|
- Separate sourced facts from model-generated hypotheses.
|
|
17
25
|
- Preserve failed runs, failed ideas, and limitations.
|
|
18
26
|
|
|
@@ -21,6 +29,8 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
21
29
|
### `/lab:idea`
|
|
22
30
|
|
|
23
31
|
- Search relevant literature, baselines, datasets, and evaluation metrics before proposing a plan.
|
|
32
|
+
- Read `.superlab/context/`mission.md` and `.superlab/context/`open-questions.md` before drafting.
|
|
33
|
+
- Ask one clarifying question at a time when critical ambiguity remains.
|
|
24
34
|
- State the problem, the failure case, and why the problem matters before proposing solutions.
|
|
25
35
|
- Classify the idea by contribution category and breakthrough level.
|
|
26
36
|
- Compare against existing methods explicitly and state why the idea should be better.
|
|
@@ -30,24 +40,26 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
30
40
|
- Critique the idea before converging on it.
|
|
31
41
|
- Keep an explicit approval gate before `/lab:spec`.
|
|
32
42
|
- Write idea artifacts with the template in `.superlab/templates/idea.md`.
|
|
43
|
+
- Update `.superlab/context/`mission.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`open-questions.md` after convergence.
|
|
33
44
|
- Do not implement code in this stage.
|
|
34
45
|
|
|
35
46
|
### `/lab:spec`
|
|
36
47
|
|
|
37
|
-
-
|
|
38
|
-
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
- Convert the approved idea into OpenSpec `spec-driven` artifacts using `.superlab/templates/proposal.md`, `.superlab/templates/design.md`, `.superlab/templates/spec.md`, and `.superlab/templates/tasks.md`.
|
|
48
|
+
- Read `.superlab/config/workflow.json` before drafting the change.
|
|
49
|
+
- Read `.superlab/context/`mission.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`state.md` before drafting the change.
|
|
50
|
+
- Use `.superlab/changes/<change-id>/` as the canonical lab change directory.
|
|
51
|
+
- Convert the approved idea into lab change artifacts using `.superlab/templates/proposal.md`, `.superlab/templates/design.md`, `.superlab/templates/spec.md`, and `.superlab/templates/tasks.md`.
|
|
52
|
+
- Update `.superlab/context/`state.md` and `.superlab/context/`decisions.md` after freezing the spec.
|
|
43
53
|
- Do not skip task definition.
|
|
44
54
|
|
|
45
55
|
### `/lab:run`
|
|
46
56
|
|
|
47
57
|
- Start with the smallest meaningful experiment.
|
|
58
|
+
- Read `.superlab/context/`mission.md` and `.superlab/context/`state.md` before choosing the run.
|
|
48
59
|
- Register the run with `.superlab/scripts/register_run.py`.
|
|
49
60
|
- Normalize the result with `.superlab/scripts/eval_report.py`.
|
|
50
61
|
- Validate normalized output with `.superlab/scripts/validate_results.py`.
|
|
62
|
+
- Update `.superlab/context/`state.md` and `.superlab/context/`evidence-index.md` after the run.
|
|
51
63
|
|
|
52
64
|
### `/lab:iterate`
|
|
53
65
|
|
|
@@ -61,29 +73,40 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
61
73
|
- maximum iteration count
|
|
62
74
|
- Only change implementation hypotheses within the loop.
|
|
63
75
|
- Require a normalized evaluation report each round.
|
|
76
|
+
- Read `.superlab/context/`mission.md`, `.superlab/context/`state.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`evidence-index.md` at the start of each round.
|
|
64
77
|
- Switch to diagnostic mode if risk increases for two consecutive rounds.
|
|
65
78
|
- Write round reports with `.superlab/templates/iteration-report.md`.
|
|
79
|
+
- Update `.superlab/context/`state.md`, `.superlab/context/`decisions.md`, `.superlab/context/`evidence-index.md`, and `.superlab/context/`open-questions.md` each round as needed.
|
|
66
80
|
- Stop at threshold success or iteration cap, and record blockers plus next-best actions when the campaign ends without success.
|
|
67
81
|
|
|
68
82
|
### `/lab:review`
|
|
69
83
|
|
|
70
84
|
- Work in reviewer mode, not implementation mode.
|
|
85
|
+
- Read `.superlab/context/`mission.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`evidence-index.md` before reviewing.
|
|
86
|
+
- Start with a concise summary of what is being reviewed and the top review question.
|
|
71
87
|
- Prioritize methodology, fairness, leakage, statistics, ablations, and claim discipline.
|
|
88
|
+
- Output findings first, then fatal flaws, then fix priority, then residual risks.
|
|
72
89
|
- Use `.superlab/templates/review-checklist.md`.
|
|
90
|
+
- Write durable review conclusions back to `.superlab/context/`state.md` or `.superlab/context/`open-questions.md` when they affect later stages.
|
|
73
91
|
|
|
74
92
|
### `/lab:report`
|
|
75
93
|
|
|
76
94
|
- Summarize all validated iteration summaries.
|
|
95
|
+
- Read `.superlab/context/`mission.md`, `.superlab/context/`state.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`evidence-index.md` before drafting.
|
|
77
96
|
- Aggregate them with `.superlab/scripts/summarize_iterations.py`.
|
|
78
97
|
- Write the final document with `.superlab/templates/final-report.md`.
|
|
79
98
|
- Keep failed attempts and limitations visible.
|
|
99
|
+
- Update `.superlab/context/`state.md` and `.superlab/context/`evidence-index.md` with report-level handoff notes.
|
|
80
100
|
|
|
81
101
|
### `/lab:write`
|
|
82
102
|
|
|
83
103
|
- Start only after `report` artifacts are stable enough to support paper claims.
|
|
104
|
+
- Read `.superlab/config/workflow.json` before drafting and enforce its `paper_language` and `paper_format`.
|
|
105
|
+
- Read `.superlab/context/`mission.md`, `.superlab/context/`decisions.md`, and `.superlab/context/`evidence-index.md` before drafting.
|
|
84
106
|
- Write one paper section or one explicit subproblem per round.
|
|
85
107
|
- Bind each claim to evidence from `report`, iteration reports, or normalized summaries.
|
|
86
|
-
- Write
|
|
108
|
+
- Write planning artifacts with `.superlab/templates/paper-plan.md`, `.superlab/templates/paper-section.md`, and `.superlab/templates/write-iteration.md`.
|
|
109
|
+
- Write final manuscript artifacts with `.superlab/templates/paper.tex` and `.superlab/templates/paper-section.tex`.
|
|
87
110
|
- Use the vendored paper-writing references under `skills/lab/references/paper-writing/`.
|
|
88
111
|
- Load only the current section guide, plus `paper-review.md` and `does-my-writing-flow-source.md`.
|
|
89
112
|
- Build a compact mini-outline before prose.
|
|
@@ -93,17 +116,19 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
93
116
|
- Before finalizing a round, append and answer the five-dimension self-review checklist and revise unresolved items.
|
|
94
117
|
- Apply paper-writing discipline without changing experimental truth.
|
|
95
118
|
- If the evidence is insufficient, stop and route back to `review` or `iterate`.
|
|
119
|
+
- Update `.superlab/context/`state.md` and `.superlab/context/`evidence-index.md` when section-level claim status changes.
|
|
96
120
|
|
|
97
121
|
## Hard Gates
|
|
98
122
|
|
|
99
123
|
- No implementation before `/lab:spec`.
|
|
100
124
|
- No unconstrained iteration. Every `/lab:iterate` campaign must declare done criteria and `max_iterations`.
|
|
101
125
|
- No final report without validated normalized results.
|
|
102
|
-
- No paper-writing round without stable report artifacts and
|
|
126
|
+
- No paper-writing round without stable report artifacts, evidence links, and LaTeX manuscript output.
|
|
103
127
|
|
|
104
128
|
## References
|
|
105
129
|
|
|
106
130
|
- Workflow summary: `.codex/skills/lab/references/workflow.md` or `.claude/skills/lab/references/workflow.md`
|
|
131
|
+
- Brainstorming integration: `.codex/skills/lab/references/brainstorming-integration.md` or `.claude/skills/lab/references/brainstorming-integration.md`
|
|
107
132
|
- Idea stage guide: `.codex/skills/lab/stages/idea.md` or `.claude/skills/lab/stages/idea.md`
|
|
108
133
|
- Spec stage guide: `.codex/skills/lab/stages/spec.md` or `.claude/skills/lab/stages/spec.md`
|
|
109
134
|
- Run stage guide: `.codex/skills/lab/stages/run.md` or `.claude/skills/lab/stages/run.md`
|
|
@@ -114,5 +139,7 @@ Use this skill when the user invokes `/lab:*` or asks for the structured researc
|
|
|
114
139
|
- Paper-writing integration: `.codex/skills/lab/references/paper-writing-integration.md` or `.claude/skills/lab/references/paper-writing-integration.md`
|
|
115
140
|
- Vendored paper-writing references: `.codex/skills/lab/references/paper-writing/{abstract,introduction,related-work,method,experiments,conclusion,paper-review,does-my-writing-flow-source}.md` or `.claude/skills/lab/references/paper-writing/{abstract,introduction,related-work,method,experiments,conclusion,paper-review,does-my-writing-flow-source}.md`
|
|
116
141
|
- Command adapters: the installed `/lab:*` command assets
|
|
142
|
+
- Shared workflow config: `.superlab/config/workflow.json`
|
|
143
|
+
- Shared project context: `.superlab/context/`{mission,state,decisions,evidence-index,open-questions}.md`
|
|
117
144
|
- Templates: `.superlab/templates/`
|
|
118
145
|
- Scripts: `.superlab/scripts/`
|
|
@@ -0,0 +1,21 @@
|
|
|
1
|
+
# Brainstorming Integration for `/lab`
|
|
2
|
+
|
|
3
|
+
This reference keeps brainstorming-style interaction rules centralized so each `/lab` stage can stay small and stage-specific.
|
|
4
|
+
|
|
5
|
+
## Shared Rules
|
|
6
|
+
|
|
7
|
+
- Start with a concise user-facing summary before creating or revising artifacts.
|
|
8
|
+
- If a missing assumption would materially change the stage outcome, ask one clarifying question at a time.
|
|
9
|
+
- If multiple viable directions exist, present 2-3 approaches with trade-offs and a recommendation before converging.
|
|
10
|
+
- Keep an explicit approval gate when the stage commits downstream direction or locks in scope.
|
|
11
|
+
- Prefer thin stage-specific contracts over copying the full brainstorming workflow into every stage guide.
|
|
12
|
+
|
|
13
|
+
## Stage Adaptation
|
|
14
|
+
|
|
15
|
+
- `idea`: use the full pattern most strongly because ambiguity and design exploration are highest here.
|
|
16
|
+
- `spec`: compare viable change decomposition or validation plans before freezing the lab change directory.
|
|
17
|
+
- `run`: compare the smallest meaningful experiment options before spending compute.
|
|
18
|
+
- `iterate`: compare the next 2-3 hypotheses when there is more than one defensible next move.
|
|
19
|
+
- `review`: clarify review scope only when ambiguity changes findings, then stay in reviewer mode.
|
|
20
|
+
- `report`: compare report framing options only when they change interpretation or reader takeaway.
|
|
21
|
+
- `write`: compare section-level narrative structures only when more than one structure is defensible.
|
|
@@ -25,7 +25,7 @@ Escalate to a higher-level redesign instead of mutating the mission when the cur
|
|
|
25
25
|
## Required Artifacts
|
|
26
26
|
|
|
27
27
|
- `docs/lab/idea.md`
|
|
28
|
-
-
|
|
28
|
+
- one lab change directory under `.superlab/changes/<change-id>/`
|
|
29
29
|
- normalized JSON summary from `scripts/eval_report.py`
|
|
30
30
|
- per-round report in `docs/lab/iterations/`
|
|
31
31
|
- final report in `docs/lab/report.md`
|
|
@@ -24,6 +24,19 @@
|
|
|
24
24
|
- Mark sourced facts clearly.
|
|
25
25
|
- Mark generated hypotheses clearly.
|
|
26
26
|
- Do not merge them into one undifferentiated summary.
|
|
27
|
+
- Ask one clarifying question at a time when a missing assumption would materially change the proposal.
|
|
28
|
+
- Before writing the full artifact, give the user a short summary with the one-sentence problem, why current methods fail, and the three meaningful points.
|
|
29
|
+
|
|
30
|
+
## Context Read Set
|
|
31
|
+
|
|
32
|
+
- `.superlab/context/mission.md`
|
|
33
|
+
- `.superlab/context/open-questions.md`
|
|
34
|
+
|
|
35
|
+
## Context Write Set
|
|
36
|
+
|
|
37
|
+
- `.superlab/context/mission.md`
|
|
38
|
+
- `.superlab/context/decisions.md`
|
|
39
|
+
- `.superlab/context/open-questions.md`
|
|
27
40
|
|
|
28
41
|
## Recommended Structure
|
|
29
42
|
|
|
@@ -12,6 +12,20 @@ Declare and keep fixed:
|
|
|
12
12
|
- completion_promise
|
|
13
13
|
- maximum iteration count
|
|
14
14
|
|
|
15
|
+
## Context Read Set
|
|
16
|
+
|
|
17
|
+
- `.superlab/context/mission.md`
|
|
18
|
+
- `.superlab/context/state.md`
|
|
19
|
+
- `.superlab/context/decisions.md`
|
|
20
|
+
- `.superlab/context/evidence-index.md`
|
|
21
|
+
|
|
22
|
+
## Context Write Set
|
|
23
|
+
|
|
24
|
+
- `.superlab/context/state.md`
|
|
25
|
+
- `.superlab/context/decisions.md`
|
|
26
|
+
- `.superlab/context/evidence-index.md`
|
|
27
|
+
- `.superlab/context/open-questions.md`
|
|
28
|
+
|
|
15
29
|
## Per-Round Output
|
|
16
30
|
|
|
17
31
|
- round hypothesis
|
|
@@ -35,3 +49,10 @@ If the loop stops without success, record:
|
|
|
35
49
|
- what failed
|
|
36
50
|
- top 3 blockers
|
|
37
51
|
- next best actions
|
|
52
|
+
|
|
53
|
+
## Interaction Contract
|
|
54
|
+
|
|
55
|
+
- Start each round with a concise summary of current status, the leading hypothesis, and the main round risk.
|
|
56
|
+
- If the next move depends on an unresolved assumption, ask one clarifying question at a time.
|
|
57
|
+
- If more than one next hypothesis is credible, present 2-3 approaches with trade-offs and recommend the next bounded experiment before changing the mission state.
|
|
58
|
+
- Keep an approval gate when a proposed change would alter the frozen mission instead of only changing the implementation hypothesis.
|
|
@@ -10,9 +10,28 @@
|
|
|
10
10
|
- limitations
|
|
11
11
|
- next steps
|
|
12
12
|
|
|
13
|
+
## Context Read Set
|
|
14
|
+
|
|
15
|
+
- `.superlab/context/mission.md`
|
|
16
|
+
- `.superlab/context/state.md`
|
|
17
|
+
- `.superlab/context/decisions.md`
|
|
18
|
+
- `.superlab/context/evidence-index.md`
|
|
19
|
+
|
|
20
|
+
## Context Write Set
|
|
21
|
+
|
|
22
|
+
- `.superlab/context/state.md`
|
|
23
|
+
- `.superlab/context/evidence-index.md`
|
|
24
|
+
|
|
13
25
|
## Evidence Rules
|
|
14
26
|
|
|
15
27
|
- Do not hide failed iterations.
|
|
16
28
|
- Tie every major claim to recorded summaries or iteration artifacts.
|
|
17
29
|
- Prefer conservative interpretation over marketing language.
|
|
18
30
|
- Leave a clear handoff path into `/lab:write` with evidence links that section drafts can cite.
|
|
31
|
+
|
|
32
|
+
## Interaction Contract
|
|
33
|
+
|
|
34
|
+
- Start with a concise summary of the campaign outcome, strongest supported claim, and biggest reporting risk.
|
|
35
|
+
- If a missing assumption would change report interpretation, ask one clarifying question at a time.
|
|
36
|
+
- If there are multiple defensible report framings, present 2-3 approaches with trade-offs and recommend the most evidence-faithful framing before writing.
|
|
37
|
+
- Keep an approval gate when the reporting frame would materially affect what the paper later claims.
|
|
@@ -1,5 +1,25 @@
|
|
|
1
1
|
# `/lab:review` Stage Guide
|
|
2
2
|
|
|
3
|
+
## Required Flow
|
|
4
|
+
|
|
5
|
+
1. Give a concise summary of the artifact or result under review.
|
|
6
|
+
2. State the top review question or risk focus.
|
|
7
|
+
3. Audit in reviewer mode.
|
|
8
|
+
4. Output fatal flaws first when present.
|
|
9
|
+
5. Rank the fix priority.
|
|
10
|
+
6. End with residual risks and a clear next action.
|
|
11
|
+
|
|
12
|
+
## Context Read Set
|
|
13
|
+
|
|
14
|
+
- `.superlab/context/mission.md`
|
|
15
|
+
- `.superlab/context/decisions.md`
|
|
16
|
+
- `.superlab/context/evidence-index.md`
|
|
17
|
+
|
|
18
|
+
## Context Write Set
|
|
19
|
+
|
|
20
|
+
- `.superlab/context/state.md`
|
|
21
|
+
- `.superlab/context/open-questions.md`
|
|
22
|
+
|
|
3
23
|
## Reviewer Priorities
|
|
4
24
|
|
|
5
25
|
- unfair or weak baselines
|
|
@@ -11,6 +31,16 @@
|
|
|
11
31
|
|
|
12
32
|
## Output Style
|
|
13
33
|
|
|
34
|
+
- concise summary first
|
|
14
35
|
- findings first
|
|
36
|
+
- fatal flaws called out explicitly
|
|
37
|
+
- fix priority stated clearly
|
|
15
38
|
- evidence-linked critique
|
|
16
39
|
- explicit residual risks
|
|
40
|
+
|
|
41
|
+
## Interaction Contract
|
|
42
|
+
|
|
43
|
+
- Start with a concise summary of the review target and the main reviewer question.
|
|
44
|
+
- Ask one clarifying question at a time only if review scope ambiguity would change findings or severity.
|
|
45
|
+
- If there are multiple legitimate review framings, present 2-3 approaches with trade-offs and recommend the strictest useful framing.
|
|
46
|
+
- Do not use brainstorming to soften critique; once scope is clear, stay in reviewer mode and deliver findings directly.
|
|
@@ -7,6 +7,16 @@
|
|
|
7
7
|
- normalized evaluation summary
|
|
8
8
|
- validation result for the normalized summary
|
|
9
9
|
|
|
10
|
+
## Context Read Set
|
|
11
|
+
|
|
12
|
+
- `.superlab/context/mission.md`
|
|
13
|
+
- `.superlab/context/state.md`
|
|
14
|
+
|
|
15
|
+
## Context Write Set
|
|
16
|
+
|
|
17
|
+
- `.superlab/context/state.md`
|
|
18
|
+
- `.superlab/context/evidence-index.md`
|
|
19
|
+
|
|
10
20
|
## Constraints
|
|
11
21
|
|
|
12
22
|
- Prefer the smallest experiment that exercises the full pipeline.
|
|
@@ -20,3 +30,10 @@
|
|
|
20
30
|
3. Execute the smallest useful experiment
|
|
21
31
|
4. Normalize raw metrics
|
|
22
32
|
5. Validate the normalized summary
|
|
33
|
+
|
|
34
|
+
## Interaction Contract
|
|
35
|
+
|
|
36
|
+
- Start with a concise summary of the run goal, smallest candidate experiment, and primary execution risk.
|
|
37
|
+
- If the next run depends on an unresolved assumption, ask one clarifying question at a time.
|
|
38
|
+
- If there are multiple defensible tiny-run options, present 2-3 approaches with trade-offs and recommend the cheapest informative run.
|
|
39
|
+
- Only ask for approval when choosing a run path would materially spend more time or compute than the default smallest experiment.
|
|
@@ -2,21 +2,33 @@
|
|
|
2
2
|
|
|
3
3
|
## Required Output
|
|
4
4
|
|
|
5
|
-
-
|
|
6
|
-
-
|
|
7
|
-
-
|
|
8
|
-
-
|
|
9
|
-
-
|
|
10
|
-
|
|
11
|
-
##
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
5
|
+
- a lab change id
|
|
6
|
+
- `.superlab/changes/<change-id>/proposal.md`
|
|
7
|
+
- `.superlab/changes/<change-id>/design.md`
|
|
8
|
+
- `.superlab/changes/<change-id>/spec.md`
|
|
9
|
+
- `.superlab/changes/<change-id>/tasks.md`
|
|
10
|
+
|
|
11
|
+
## Config Read Set
|
|
12
|
+
|
|
13
|
+
- `.superlab/config/workflow.json`
|
|
14
|
+
|
|
15
|
+
## Context Read Set
|
|
16
|
+
|
|
17
|
+
- `.superlab/context/mission.md`
|
|
18
|
+
- `.superlab/context/decisions.md`
|
|
19
|
+
- `.superlab/context/state.md`
|
|
20
|
+
|
|
21
|
+
## Context Write Set
|
|
22
|
+
|
|
23
|
+
- `.superlab/context/state.md`
|
|
24
|
+
- `.superlab/context/decisions.md`
|
|
25
|
+
|
|
26
|
+
## Required Change Layout
|
|
27
|
+
|
|
28
|
+
1. Identify or create a lab change id.
|
|
29
|
+
2. Create `.superlab/changes/<change-id>/`.
|
|
30
|
+
3. Draft `proposal.md`, `design.md`, `spec.md`, and `tasks.md` inside that directory.
|
|
31
|
+
4. Keep the change self-contained so downstream stages can read one directory and its linked context.
|
|
20
32
|
|
|
21
33
|
## Conversion Rules
|
|
22
34
|
|
|
@@ -24,11 +36,18 @@
|
|
|
24
36
|
- Preserve evaluation boundaries from the idea stage.
|
|
25
37
|
- Translate risks into concrete tasks when possible.
|
|
26
38
|
- Make task granularity small enough that `/lab:run` and `/lab:iterate` can execute predictably.
|
|
27
|
-
-
|
|
39
|
+
- Use one lab-native change directory per approved idea instead of scattering spec artifacts.
|
|
40
|
+
|
|
41
|
+
## Interaction Contract
|
|
42
|
+
|
|
43
|
+
- Start with a concise summary of the approved idea, target change, and the main spec risk.
|
|
44
|
+
- If change decomposition or validation strategy is materially ambiguous, ask one clarifying question at a time.
|
|
45
|
+
- If there are multiple viable ways to structure the lab change directory, present 2-3 approaches with trade-offs and a recommendation before freezing the change.
|
|
46
|
+
- Keep an approval gate before locking a change structure that will drive `/lab:run` and `/lab:iterate`.
|
|
28
47
|
|
|
29
48
|
## Minimum Task Coverage
|
|
30
49
|
|
|
31
|
-
- change setup
|
|
50
|
+
- change setup
|
|
32
51
|
- artifact creation
|
|
33
52
|
- validation run
|
|
34
53
|
- evaluation normalization
|
|
@@ -8,6 +8,21 @@
|
|
|
8
8
|
- reviewer notes when available
|
|
9
9
|
- vendored paper-writing references under `skills/lab/references/paper-writing/`
|
|
10
10
|
|
|
11
|
+
## Config Read Set
|
|
12
|
+
|
|
13
|
+
- `.superlab/config/workflow.json`
|
|
14
|
+
|
|
15
|
+
## Context Read Set
|
|
16
|
+
|
|
17
|
+
- `.superlab/context/mission.md`
|
|
18
|
+
- `.superlab/context/decisions.md`
|
|
19
|
+
- `.superlab/context/evidence-index.md`
|
|
20
|
+
|
|
21
|
+
## Context Write Set
|
|
22
|
+
|
|
23
|
+
- `.superlab/context/state.md`
|
|
24
|
+
- `.superlab/context/evidence-index.md`
|
|
25
|
+
|
|
11
26
|
## Required References
|
|
12
27
|
|
|
13
28
|
Load the exact vendored file that matches the current target:
|
|
@@ -27,6 +42,7 @@ Run these on every round:
|
|
|
27
42
|
## Small-Step Writing Rules
|
|
28
43
|
|
|
29
44
|
- Change one section or one clearly bounded subsection per round.
|
|
45
|
+
- LaTeX is the required manuscript output format.
|
|
30
46
|
- Load only the current section guide. Do not load every section guide at once.
|
|
31
47
|
- Build a compact mini-outline before prose.
|
|
32
48
|
- For each subsection, explicitly include motivation, design, and technical advantage when applicable.
|
|
@@ -42,12 +58,20 @@ Run these on every round:
|
|
|
42
58
|
|
|
43
59
|
## Required Artifacts
|
|
44
60
|
|
|
45
|
-
-
|
|
46
|
-
-
|
|
47
|
-
- `docs/
|
|
61
|
+
- `.superlab/write/plan.md`
|
|
62
|
+
- `.superlab/write/iterations/<n>.md`
|
|
63
|
+
- `docs/paper/paper.tex`
|
|
64
|
+
- `docs/paper/sections/<section>.tex`
|
|
48
65
|
|
|
49
66
|
## Stop Conditions
|
|
50
67
|
|
|
51
68
|
- the target section is accepted for this round
|
|
52
69
|
- evidence is missing and the workflow must return to `review` or `iterate`
|
|
53
70
|
- the writing loop reaches its declared round limit
|
|
71
|
+
|
|
72
|
+
## Interaction Contract
|
|
73
|
+
|
|
74
|
+
- Start with a concise summary of the target section, evidence base, and main writing risk for this round.
|
|
75
|
+
- If a missing assumption would change the section structure or claim strength, ask one clarifying question at a time.
|
|
76
|
+
- If there are multiple defensible narrative structures for the current section, present 2-3 approaches with trade-offs and recommend one before drafting.
|
|
77
|
+
- Keep an approval gate when the chosen narrative structure would materially affect downstream sections or paper-level framing.
|
|
@@ -1,9 +1,9 @@
|
|
|
1
1
|
# Design
|
|
2
2
|
|
|
3
|
-
##
|
|
3
|
+
## Lab Change
|
|
4
4
|
|
|
5
5
|
- Change id:
|
|
6
|
-
-
|
|
6
|
+
- Target path: `.superlab/changes/<change-id>/design.md`
|
|
7
7
|
|
|
8
8
|
## Research Approach
|
|
9
9
|
|
|
@@ -27,7 +27,7 @@ Describe the method and why it is plausible.
|
|
|
27
27
|
- Normalized summary path:
|
|
28
28
|
- Iteration report path:
|
|
29
29
|
|
|
30
|
-
##
|
|
30
|
+
## Change Links
|
|
31
31
|
|
|
32
|
-
-
|
|
33
|
-
-
|
|
32
|
+
- Spec path: `.superlab/changes/<change-id>/spec.md`
|
|
33
|
+
- Tasks path: `.superlab/changes/<change-id>/tasks.md`
|
|
@@ -0,0 +1,29 @@
|
|
|
1
|
+
\documentclass{article}
|
|
2
|
+
\usepackage[utf8]{inputenc}
|
|
3
|
+
\usepackage[T1]{fontenc}
|
|
4
|
+
\usepackage{hyperref}
|
|
5
|
+
\usepackage{graphicx}
|
|
6
|
+
\usepackage{booktabs}
|
|
7
|
+
|
|
8
|
+
\title{Paper Title}
|
|
9
|
+
\author{Author Name}
|
|
10
|
+
\date{}
|
|
11
|
+
|
|
12
|
+
\begin{document}
|
|
13
|
+
\maketitle
|
|
14
|
+
|
|
15
|
+
\begin{abstract}
|
|
16
|
+
% Keep the final paper language independent from the workflow language.
|
|
17
|
+
\input{sections/abstract}
|
|
18
|
+
\end{abstract}
|
|
19
|
+
|
|
20
|
+
\input{sections/introduction}
|
|
21
|
+
\input{sections/related_work}
|
|
22
|
+
\input{sections/method}
|
|
23
|
+
\input{sections/experiments}
|
|
24
|
+
\input{sections/conclusion}
|
|
25
|
+
|
|
26
|
+
\bibliographystyle{plain}
|
|
27
|
+
\bibliography{references}
|
|
28
|
+
|
|
29
|
+
\end{document}
|