quantum-reasoning-skill 1.1.1 → 1.1.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +50 -11
- package/VERSION +1 -1
- package/package.json +1 -1
package/README.md
CHANGED
|
@@ -10,11 +10,11 @@ alive, tests each against evidence and tools, revives alternatives when new evid
|
|
|
10
10
|
and collapses to the best-supported answer only at the end. It is a **metaphor, not quantum
|
|
11
11
|
computing** — "measurement" means letting evidence collapse a branch.
|
|
12
12
|
|
|
13
|
-
> **Status: protocol implemented,
|
|
14
|
-
> the reference controller
|
|
15
|
-
> baseline-vs-skill model evaluation has
|
|
16
|
-
> that it improves
|
|
17
|
-
> [Benchmark status](#benchmark-status) before citing any number from here.
|
|
13
|
+
> **Status: protocol implemented, controller benchmark published, model evaluation pending.**
|
|
14
|
+
> The skill contract, the reference controller, the benchmark harness and a deterministic
|
|
15
|
+
> falsification benchmark are here and run. **A baseline-vs-skill model evaluation has NOT
|
|
16
|
+
> been published**, so this project makes **no claim that it improves any language model's
|
|
17
|
+
> accuracy.** See [Benchmark status](#benchmark-status) before citing any number from here.
|
|
18
18
|
|
|
19
19
|
## Quick start
|
|
20
20
|
|
|
@@ -30,7 +30,7 @@ python docs/quickstart.py
|
|
|
30
30
|
pip install quantum-reasoning-skill
|
|
31
31
|
quantum-reasoning --validate
|
|
32
32
|
|
|
33
|
-
# 3. from npm — also published
|
|
33
|
+
# 3. from npm — also published
|
|
34
34
|
npm i quantum-reasoning-skill
|
|
35
35
|
npx quantum-reasoning --validate
|
|
36
36
|
```
|
|
@@ -54,7 +54,33 @@ Three channels ship `SKILL.md`, all on one version: a `git clone` (everything);
|
|
|
54
54
|
wheel (`SKILL.md` + `VERSION` as package data, plus `reference/`, `benchmark/`, `docs/`,
|
|
55
55
|
`examples/`, and a `quantum-reasoning` console script); and the npm tarball (`SKILL.md`,
|
|
56
56
|
`VERSION`, `index.js`, `LICENSE`, `README.md`, and a `quantum-reasoning` bin). Both packaged
|
|
57
|
-
artifacts are verified against the **built** artifact, not a checkout.
|
|
57
|
+
artifacts are verified against the **built** artifact, not a checkout.
|
|
58
|
+
|
|
59
|
+
### Supply-chain attestations
|
|
60
|
+
|
|
61
|
+
Only some published versions carry a build attestation, so check before relying on one:
|
|
62
|
+
|
|
63
|
+
| release | npm attestation | PyPI PEP 740 attestation |
|
|
64
|
+
| --- | --- | --- |
|
|
65
|
+
| `1.1.0` (npm) | yes — SLSA provenance and npm publish attestation, Sigstore | n/a |
|
|
66
|
+
| `1.1.1` (npm and PyPI) | **no** | **no** |
|
|
67
|
+
|
|
68
|
+
`1.1.1` was published through the long-lived-token path, which cannot produce a Sigstore
|
|
69
|
+
attestation. Attestations are bound to a publish event and cannot be added afterwards, so
|
|
70
|
+
this is permanent for that version. The package itself is unchanged and passes the same
|
|
71
|
+
release contract as every other version; only the provenance *record* is missing.
|
|
72
|
+
|
|
73
|
+
If you need to verify how a build was produced, use `1.1.0` on npm. To check an attestation
|
|
74
|
+
yourself:
|
|
75
|
+
|
|
76
|
+
```bash
|
|
77
|
+
curl -sS -o /dev/null -w '%{http_code}\n' \
|
|
78
|
+
https://registry.npmjs.org/-/npm/v1/attestations/quantum-reasoning-skill@1.1.0 # 200
|
|
79
|
+
curl -sS -o /dev/null -w '%{http_code}\n' \
|
|
80
|
+
https://registry.npmjs.org/-/npm/v1/attestations/quantum-reasoning-skill@1.1.1 # 404
|
|
81
|
+
```
|
|
82
|
+
|
|
83
|
+
A missing attestation is not evidence of tampering. Versions are locked
|
|
58
84
|
across `VERSION`, `pyproject.toml`, `package.json`, `CITATION.cff` and `CHANGELOG.md` — read
|
|
59
85
|
the value from `VERSION`, not a badge ([details](CONTRIBUTING.md#toolchain-pinning)).
|
|
60
86
|
|
|
@@ -155,9 +181,22 @@ trivially answerable questions should not pay branching cost.
|
|
|
155
181
|
|
|
156
182
|
## Benchmark status
|
|
157
183
|
|
|
158
|
-
**
|
|
159
|
-
|
|
160
|
-
|
|
184
|
+
**What has been measured — the controller, not the model.** On 9 deterministic falsification
|
|
185
|
+
scenarios, the multi-hypothesis branch controller achieved **100% final accuracy versus 22%**
|
|
186
|
+
for a single-hypothesis policy that commits to its first leader (0/4 on falsification
|
|
187
|
+
scenarios, 0/3 on revival scenarios; both policies scored 2/2 on the control scenarios). It
|
|
188
|
+
abandoned the falsified hypothesis at the same evidence step the falsification arrived, and
|
|
189
|
+
revived a rejected-then-supported alternative in 3/3 revival scenarios. Confidence calibration
|
|
190
|
+
showed **no difference** (Brier score 0.033 vs 0.033), and the accuracy gain cost **109.6%
|
|
191
|
+
more tokens** per scenario. Methodology and reproduction:
|
|
192
|
+
[`benchmark/falsification/METHODOLOGY.md`](benchmark/falsification/METHODOLOGY.md).
|
|
193
|
+
|
|
194
|
+
These results measure the reference decision controller on **synthetic evidence streams**, not
|
|
195
|
+
any language model. `benchmark/cases.jsonl` holds six deterministic smoke-test cases that
|
|
196
|
+
prove the harness runs; they are explicitly **not sufficient evidence of reasoning
|
|
197
|
+
improvement**. A baseline-vs-skill **model** evaluation has not been published, so this
|
|
198
|
+
project makes **no claim that it improves any language model's accuracy or costs less
|
|
199
|
+
compute.** Anyone can evaluate on models they have access to; every submitted
|
|
161
200
|
number must carry provenance (script, skill commit, provider and exact model version, run date,
|
|
162
201
|
sampling parameters, repetitions, platform), and one positive run establishes no general claim.
|
|
163
202
|
Rules: [CONTRIBUTING.md](CONTRIBUTING.md#benchmark-provenance-requirements).
|
|
@@ -178,4 +217,4 @@ benchmarked against the rows above it.
|
|
|
178
217
|
|
|
179
218
|
Everything lives in [`docs/index.md`](docs/index.md) — getting started, quickstart and its
|
|
180
219
|
verified output, measurement methodology, host compatibility, report forms. Release history:
|
|
181
|
-
[CHANGELOG.md](CHANGELOG.md). License: [MIT](LICENSE).
|
|
220
|
+
[CHANGELOG.md](CHANGELOG.md). License: [MIT](LICENSE).
|
package/VERSION
CHANGED
|
@@ -1 +1 @@
|
|
|
1
|
-
1.1.
|
|
1
|
+
1.1.3
|