skill-harness 0.16.0 → 0.17.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/dist/index.js +5006 -1313
- package/docs/PRODUCT-GUIDE.md +67 -10
- package/docs/STATUS.md +13 -2
- package/package.json +2 -2
package/docs/PRODUCT-GUIDE.md
CHANGED
|
@@ -1,15 +1,14 @@
|
|
|
1
1
|
# Factory: work, review, learn
|
|
2
2
|
|
|
3
|
-
**
|
|
4
|
-
Principal
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
cannot replace the old global API. No other running session needs to be stopped.
|
|
3
|
+
**Release candidate: skill-harness 0.17.0**, paired with **pi-daddy 0.27.3**.
|
|
4
|
+
Principal 3.2.0 is unchanged. The session retrospective feature is merged in PR82
|
|
5
|
+
with independent Sol review and green CI. This release adds explicit local session
|
|
6
|
+
import, timeline/usage coverage and evidence-linked notes. The producer adds a
|
|
7
|
+
visible count and toggle for completed ledger history.
|
|
8
|
+
|
|
9
|
+
Canonical packaging, installed verification and publication are recorded separately
|
|
10
|
+
in the release PR. Use a fresh Pi session after updating the harness: an existing
|
|
11
|
+
immutable dashboard bridge survives reload. Other running sessions need not stop.
|
|
13
12
|
|
|
14
13
|
## Who does what?
|
|
15
14
|
|
|
@@ -131,3 +130,61 @@ All learning commands are offline/no-model. Command completion is never a qualit
|
|
|
131
130
|
Local author attribution and content hashes are not authentication or hostile-owner attestation.
|
|
132
131
|
|
|
133
132
|
Current requirements and remaining evidence: [STATUS.md](STATUS.md).
|
|
133
|
+
|
|
134
|
+
## Whole-session retrospective (0.17.0)
|
|
135
|
+
|
|
136
|
+
Use this after a real task to inspect the conversation, model/thinking settings,
|
|
137
|
+
tool use, individual delegation attempts and provider-reported usage. The importer
|
|
138
|
+
reads only explicitly selected files and never contacts or interrupts an agent.
|
|
139
|
+
|
|
140
|
+
Start with the terminal CLI (or prefix these arguments with
|
|
141
|
+
"/skill-harness learning" in Pi instead of "skill-harness learning"):
|
|
142
|
+
|
|
143
|
+
skill-harness learning session preview --session /absolute/parent.jsonl --ledger /absolute/grants.jsonl
|
|
144
|
+
skill-harness learning session import --session /absolute/parent.jsonl --ledger /absolute/grants.jsonl --name task --title "Task retrospective" --expected DIGEST_FROM_PREVIEW --confirm --state /private/learning/workspace --archive /private/learning/archive --author operator
|
|
145
|
+
skill-harness learning session show task --state /private/learning/workspace
|
|
146
|
+
skill-harness learning session source task --item 1 --state /private/learning/workspace
|
|
147
|
+
|
|
148
|
+
The first import can create a workspace. For an existing workspace omit --archive
|
|
149
|
+
and --author. Optional --feedback FILE and --artifact FILE retain selected external
|
|
150
|
+
feedback and artifact/source evidence. Use --sources FILE for a JSON array of
|
|
151
|
+
additional selections, for example:
|
|
152
|
+
|
|
153
|
+
[{"kind":"child","path":"/absolute/child.jsonl","executionId":"exec:10000000-0000-4000-8000-000000000001"}]
|
|
154
|
+
|
|
155
|
+
Every source must be a regular, unlinked file: at most 16 files, 8 MiB each,
|
|
156
|
+
32 MiB total; Pi/ledger JSONL is bounded to 4096 records with complete final lines.
|
|
157
|
+
Pi session format v3 and the existing frozen pi-daddy v3 ledger contract are
|
|
158
|
+
supported. Re-preview if any selected bytes change. The ledger association and
|
|
159
|
+
child execution mapping are operator declarations, not authenticated parentage.
|
|
160
|
+
|
|
161
|
+
**Privacy:** import retains exact original bytes locally, potentially including
|
|
162
|
+
credentials, reasoning, tool arguments or private text present in the source.
|
|
163
|
+
Preview prints paths, hashes and coverage, not a redacted copy. Inspect selected
|
|
164
|
+
inputs before confirming; no scanning, automatic redaction or publication occurs.
|
|
165
|
+
Full-source readback deliberately displays the selected source; terminal control
|
|
166
|
+
characters are escaped for display without altering archived bytes.
|
|
167
|
+
|
|
168
|
+
Open the existing learning wizard with the same --state path to choose **Import
|
|
169
|
+
session** or **Review sessions**. Editors display evidence; edits are discarded.
|
|
170
|
+
The ordinary producer "/grants learning" bridge also reaches those menu items
|
|
171
|
+
when its current host workspace is already connected. Reading does not reserve
|
|
172
|
+
attention, run a model or change a next-order policy.
|
|
173
|
+
|
|
174
|
+
Record a finding, proposal, acceptance observation or context note against a
|
|
175
|
+
specific retained source line:
|
|
176
|
+
|
|
177
|
+
skill-harness learning session note task --kind proposal --note "Ask for the capability map before implementation; compare this on a later task." --item 1 --line 2 --confirm --state /private/learning/workspace
|
|
178
|
+
|
|
179
|
+
Notes identify the configured local author. An acceptance note is an operator
|
|
180
|
+
annotation, not an authenticated user approval or qualified comparison.
|
|
181
|
+
The timeline is chronological and may include abandoned branches; excerpts are
|
|
182
|
+
labelled. It does not reconstruct the active branch or verify a test claimed in prose.
|
|
183
|
+
Child usage and missing evidence are reported separately; totals are provider
|
|
184
|
+
observations, not billing or a complete parent-plus-child cost.
|
|
185
|
+
|
|
186
|
+
This slice makes sessions reviewable. It does **not** automatically generate or
|
|
187
|
+
measure skill/tool/instruction improvements. A later experiment still needs a
|
|
188
|
+
frozen task and candidate, appropriate independent assessment and actual retained
|
|
189
|
+
measurements before claiming faster or equally good output. Existing adoption
|
|
190
|
+
supports its documented model/effort policy scope only; annotations do not expand it.
|
package/docs/STATUS.md
CHANGED
|
@@ -1,10 +1,21 @@
|
|
|
1
|
-
# Factory requirement register
|
|
1
|
+
# Factory requirement register
|
|
2
2
|
|
|
3
3
|
Current entry point: [PRODUCT-GUIDE.md](PRODUCT-GUIDE.md). The dated
|
|
4
4
|
[CURRENT.md](CURRENT.md), build reports and transport decisions are retained history,
|
|
5
5
|
not current instructions to supply manifests or judge engineering repairs.
|
|
6
6
|
|
|
7
|
-
##
|
|
7
|
+
## 0.17.0 release candidate — session learning
|
|
8
|
+
|
|
9
|
+
Adds explicit Pi-session import, exact private retention, chronological evidence,
|
|
10
|
+
per-execution delegation history, parent/child usage coverage, and line-bound
|
|
11
|
+
operator annotations through the existing CLI/Pi learning workspace. No model
|
|
12
|
+
calls, automatic acceptance, calibrated improvement or expanded adoption authority.
|
|
13
|
+
See the whole-session section of PRODUCT-GUIDE.md. Feature PR82 is merged with independent review and green CI. Release metadata
|
|
14
|
+
pairs harness 0.17.0 with producer 0.27.3; canonical publication and installed user
|
|
15
|
+
testing remain separate. Entire-session optimization and measured skill/tool variants remain
|
|
16
|
+
follow-up work.
|
|
17
|
+
|
|
18
|
+
## Historical 0.16.0 release preparation
|
|
8
19
|
|
|
9
20
|
Release pair: **skill-harness 0.16.0 / pi-daddy 0.27.0**; Principal 3.2.0 is unchanged.
|
|
10
21
|
The prior audited baseline was harness 0.15.0 (`a725579`) / producer 0.26.1 (`93a9b01`).
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "skill-harness",
|
|
3
|
-
"version": "0.
|
|
3
|
+
"version": "0.17.0",
|
|
4
4
|
"description": "Test/optimize loop for agent skills — run spec'd scenarios on pi, LLM-judge, score, review, re-run",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"keywords": [
|
|
@@ -34,7 +34,7 @@
|
|
|
34
34
|
"README.md"
|
|
35
35
|
],
|
|
36
36
|
"dependencies": {
|
|
37
|
-
"@skill-harness/cli": "0.
|
|
37
|
+
"@skill-harness/cli": "0.17.0",
|
|
38
38
|
"typebox": "^1.1.38"
|
|
39
39
|
},
|
|
40
40
|
"repository": {
|