quantum-reasoning-skill 1.0.0 → 1.1.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -21
- package/README.md +86 -133
- package/SKILL.md +146 -146
- package/VERSION +1 -1
- package/index.js +207 -1
- package/package.json +41 -1
- package/.github/ISSUE_TEMPLATE/benchmark-result.yml +0 -81
- package/.github/ISSUE_TEMPLATE/bug-report.yml +0 -38
- package/.github/ISSUE_TEMPLATE/feature-request.yml +0 -31
- package/.github/PULL_REQUEST_TEMPLATE.md +0 -15
- package/.github/workflows/npm-publish.yml +0 -32
- package/.github/workflows/publish-release.yml +0 -79
- package/.github/workflows/validate-skill.yml +0 -154
- package/CHANGELOG.md +0 -51
- package/CITATION.cff +0 -17
- package/CONTRIBUTING.md +0 -88
- package/SECURITY.md +0 -17
- package/benchmark/README.md +0 -134
- package/benchmark/cases.jsonl +0 -6
- package/benchmark/evaluate.py +0 -257
- package/benchmark/schemas/case.schema.json +0 -20
- package/benchmark/schemas/comparison.schema.json +0 -64
- package/benchmark/schemas/metadata.schema.json +0 -53
- package/benchmark/schemas/result.schema.json +0 -25
- package/benchmark/validate_submission.py +0 -114
- package/docs/COMPATIBILITY.md +0 -44
- package/docs/MEASUREMENT.md +0 -131
- package/examples/host-integration.md +0 -57
- package/examples/usage.md +0 -31
- package/reference/branch_controller.py +0 -256
- package/tests/test_benchmark.py +0 -120
- package/tests/test_reference.py +0 -128
- package/tests/test_submission_validation.py +0 -78
package/LICENSE
CHANGED
|
@@ -1,21 +1,21 @@
|
|
|
1
|
-
MIT License
|
|
2
|
-
|
|
3
|
-
Copyright (c) 2026 Furox
|
|
4
|
-
|
|
5
|
-
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
6
|
-
of this software and associated documentation files (the "Software"), to deal
|
|
7
|
-
in the Software without restriction, including without limitation the rights
|
|
8
|
-
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
9
|
-
copies of the Software, and to permit persons to whom the Software is
|
|
10
|
-
furnished to do so, subject to the following conditions:
|
|
11
|
-
|
|
12
|
-
The above copyright notice and this permission notice shall be included in all
|
|
13
|
-
copies or substantial portions of the Software.
|
|
14
|
-
|
|
15
|
-
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
16
|
-
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
17
|
-
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
18
|
-
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
19
|
-
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
20
|
-
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
21
|
-
SOFTWARE.
|
|
1
|
+
MIT License
|
|
2
|
+
|
|
3
|
+
Copyright (c) 2026 Furox
|
|
4
|
+
|
|
5
|
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
|
6
|
+
of this software and associated documentation files (the "Software"), to deal
|
|
7
|
+
in the Software without restriction, including without limitation the rights
|
|
8
|
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
|
9
|
+
copies of the Software, and to permit persons to whom the Software is
|
|
10
|
+
furnished to do so, subject to the following conditions:
|
|
11
|
+
|
|
12
|
+
The above copyright notice and this permission notice shall be included in all
|
|
13
|
+
copies or substantial portions of the Software.
|
|
14
|
+
|
|
15
|
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
16
|
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
17
|
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
|
18
|
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
|
19
|
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
|
20
|
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
|
21
|
+
SOFTWARE.
|
package/README.md
CHANGED
|
@@ -1,133 +1,86 @@
|
|
|
1
|
-
# Quantum Reasoning Skill
|
|
2
|
-
|
|
3
|
-
|
|
4
|
-
|
|
5
|
-
|
|
6
|
-
|
|
7
|
-
|
|
8
|
-
|
|
9
|
-
|
|
10
|
-
|
|
11
|
-
|
|
12
|
-
|
|
13
|
-
|
|
14
|
-
|
|
15
|
-
|
|
16
|
-
|
|
17
|
-
|
|
18
|
-
|
|
19
|
-
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
|
|
37
|
-
|
|
38
|
-
|
|
39
|
-
|
|
40
|
-
|
|
41
|
-
|
|
42
|
-
|
|
43
|
-
|
|
44
|
-
|
|
45
|
-
-
|
|
46
|
-
-
|
|
47
|
-
|
|
48
|
-
-
|
|
49
|
-
|
|
50
|
-
|
|
51
|
-
|
|
52
|
-
-
|
|
53
|
-
-
|
|
54
|
-
|
|
55
|
-
-
|
|
56
|
-
-
|
|
57
|
-
-
|
|
58
|
-
|
|
59
|
-
|
|
60
|
-
|
|
61
|
-
|
|
62
|
-
|
|
63
|
-
|
|
64
|
-
|
|
65
|
-
-
|
|
66
|
-
-
|
|
67
|
-
-
|
|
68
|
-
-
|
|
69
|
-
-
|
|
70
|
-
|
|
71
|
-
|
|
72
|
-
|
|
73
|
-
-
|
|
74
|
-
|
|
75
|
-
|
|
76
|
-
|
|
77
|
-
|
|
78
|
-
|
|
79
|
-
|
|
80
|
-
|
|
81
|
-
|
|
82
|
-
|
|
83
|
-
|
|
84
|
-
|
|
85
|
-
|
|
86
|
-
|
|
87
|
-
## Benchmarking
|
|
88
|
-
|
|
89
|
-
The repository provides the **protocol, cases, schemas, evaluator and submission validator** needed to test the skill. Real model evaluations are intentionally **community-run**: users test the models/providers they have access to and may submit reproducible results back to the project.
|
|
90
|
-
|
|
91
|
-
The project does not require the maintainer to run every commercial or local model, and it does not treat the absence of maintainer-run model tests as a missing implementation feature.
|
|
92
|
-
|
|
93
|
-
A valid comparison uses the **same model, model version, task set, tool access, temperature/sampling settings and token-budget policy** with and without `SKILL.md`.
|
|
94
|
-
|
|
95
|
-
```bash
|
|
96
|
-
python benchmark/evaluate.py \
|
|
97
|
-
--cases benchmark/cases.jsonl \
|
|
98
|
-
--baseline path/to/baseline-results.jsonl \
|
|
99
|
-
--skill path/to/skill-results.jsonl \
|
|
100
|
-
--output comparison.json
|
|
101
|
-
```
|
|
102
|
-
|
|
103
|
-
Community PR bundles are machine-checked. They must contain their own `cases.jsonl`, raw baseline and skill JSONL files, metadata, the generated comparison output and a short README. CI recomputes the comparison and rejects tampered or incomplete bundles.
|
|
104
|
-
|
|
105
|
-
```bash
|
|
106
|
-
python benchmark/validate_submission.py \
|
|
107
|
-
--root benchmark/results/community \
|
|
108
|
-
--allow-empty
|
|
109
|
-
```
|
|
110
|
-
|
|
111
|
-
Third-party results remain measurements from their submitters, not automatic project endorsements or universal performance claims. A single positive run is not enough to claim general improvement.
|
|
112
|
-
|
|
113
|
-
Users can submit results through the **Benchmark result** issue template or as a reproducible benchmark-result pull request. See [`benchmark/README.md`](./benchmark/README.md) and [`CONTRIBUTING.md`](./CONTRIBUTING.md).
|
|
114
|
-
|
|
115
|
-
## Validation
|
|
116
|
-
|
|
117
|
-
Run the repository checks locally with:
|
|
118
|
-
|
|
119
|
-
```bash
|
|
120
|
-
python -m unittest discover -s tests -v
|
|
121
|
-
python benchmark/evaluate.py --help
|
|
122
|
-
python benchmark/validate_submission.py --root benchmark/results/community --allow-empty
|
|
123
|
-
```
|
|
124
|
-
|
|
125
|
-
CI validates the skill contract, local links, Python syntax, benchmark seed data, JSON Schema files, community benchmark bundles and behavioral tests. Third-party GitHub Actions are pinned to exact commit SHAs.
|
|
126
|
-
|
|
127
|
-
## Releases
|
|
128
|
-
|
|
129
|
-
Release publishing is repository-native and CI-gated. Update `CHANGELOG.md`, then change the root `VERSION` file to a semantic version. A release is considered only after the `validate-skill` workflow succeeds on `main`; the `publish-release` workflow then creates the corresponding `v<version>` tag and GitHub Release if it does not already exist.
|
|
130
|
-
|
|
131
|
-
## Status
|
|
132
|
-
|
|
133
|
-
**v0.3.1 — hardened measurable prototype.** The branch-control mechanism, benchmark infrastructure, host compatibility contract, community-result validation, repository security/citation metadata and CI-gated release controls are implemented. Real-model evaluation is intentionally delegated to independent users and contributors, and the project makes no universal performance claim without reproducible external evidence.
|
|
1
|
+
# Quantum Reasoning Skill
|
|
2
|
+
|
|
3
|
+
[](https://pypi.org/project/quantum-reasoning-skill/)
|
|
4
|
+
[](https://www.npmjs.com/package/quantum-reasoning-skill)
|
|
5
|
+
[](https://pypi.org/project/quantum-reasoning-skill/#stats)
|
|
6
|
+
[](LICENSE)
|
|
7
|
+
|
|
8
|
+
I built this because I noticed that most AI reasoning goes like this:
|
|
9
|
+
|
|
10
|
+
1. Here's a plausible answer
|
|
11
|
+
2. Let me justify it
|
|
12
|
+
3. Done
|
|
13
|
+
|
|
14
|
+
That's backwards. Real thinking explores multiple paths, tests them against evidence, and only commits when the alternatives have been genuinely eliminated.
|
|
15
|
+
|
|
16
|
+
This skill forces that process. It keeps multiple hypotheses alive, assigns them probabilities based on actual evidence (not just "sounds good"), and collapses to a conclusion only when one path is clearly better supported than the rest.
|
|
17
|
+
|
|
18
|
+
## Quick Start
|
|
19
|
+
|
|
20
|
+
```bash
|
|
21
|
+
pip install quantum-reasoning-skill
|
|
22
|
+
```
|
|
23
|
+
|
|
24
|
+
```python
|
|
25
|
+
from quantum_reasoning_skill import ReasoningSession
|
|
26
|
+
|
|
27
|
+
session = ReasoningSession(problem="Should we migrate our monolith to microservices?")
|
|
28
|
+
session.open_branch("strangler-fig incremental")
|
|
29
|
+
session.open_branch("big-bang rewrite")
|
|
30
|
+
session.open_branch("modular monolith refactor")
|
|
31
|
+
|
|
32
|
+
session.evaluate(evidence="team has zero k8s experience", branch="big-bang rewrite", impact=-0.4)
|
|
33
|
+
session.evaluate(evidence="current deploys take 45min", branch="modular monolith", impact=+0.2)
|
|
34
|
+
|
|
35
|
+
verdict = session.collapse()
|
|
36
|
+
print(verdict.winner, verdict.confidence, verdict.rejected)
|
|
37
|
+
```
|
|
38
|
+
|
|
39
|
+
Also available as an [Agent Skill](SKILL.md) for Claude and MCP-compatible hosts, and on npm: `npm i quantum-reasoning-skill`.
|
|
40
|
+
|
|
41
|
+
## How it compares
|
|
42
|
+
|
|
43
|
+
| Approach | What it does | Where it falls short |
|
|
44
|
+
|---|---|---|
|
|
45
|
+
| Chain-of-Thought | One linear reasoning path | Early anchoring; no alternatives kept alive |
|
|
46
|
+
| Tree-of-Thought | Branches + scoring | Static scoring; no evidence weighting or revival |
|
|
47
|
+
| Self-consistency | Samples the same prompt N times | Paraphrase diversity, not genuine hypothesis diversity |
|
|
48
|
+
| **This skill** | Branches with evidence-weighted probabilities, cross-checking, pruning with revival, and explicit collapse criteria | — |
|
|
49
|
+
|
|
50
|
+
## The protocol
|
|
51
|
+
|
|
52
|
+
1. **Frame the problem** - what do we actually know vs. assume?
|
|
53
|
+
2. **Open branches** - generate genuinely different approaches, not paraphrases
|
|
54
|
+
3. **Evaluate independently** - each branch gets judged on evidence, not eloquence
|
|
55
|
+
4. **Cross-check** - branches that reach the same conclusion independently get boosted
|
|
56
|
+
5. **Prune and revive** - kill contradicted paths, but keep dormant ones that might come back
|
|
57
|
+
6. **Collapse** - only when one answer is clearly better than the rest
|
|
58
|
+
|
|
59
|
+
## Why "quantum"?
|
|
60
|
+
|
|
61
|
+
It's a metaphor, not a claim about actual quantum computing. The idea is to keep possibilities in superposition until measurement (evidence) forces a collapse. Most AI systems measure too early.
|
|
62
|
+
|
|
63
|
+
## Common use cases
|
|
64
|
+
|
|
65
|
+
- **Multi-branch reasoning** for difficult questions where one early answer can anchor the rest of the analysis.
|
|
66
|
+
- **AI agent planning and decision support** with explicit competing hypotheses.
|
|
67
|
+
- Evidence-based **problem solving, search, pruning, and branch selection**.
|
|
68
|
+
- Scientific or technical analysis where independent approaches should be compared before a conclusion is chosen.
|
|
69
|
+
- Benchmarking reasoning systems that need an inspectable explore-score-prune-merge protocol.
|
|
70
|
+
|
|
71
|
+
## Documentation
|
|
72
|
+
|
|
73
|
+
- [SKILL.md](SKILL.md) — agent skill contract and protocol
|
|
74
|
+
- [Usage examples](examples/usage.md)
|
|
75
|
+
- [Host integration](examples/host-integration.md)
|
|
76
|
+
- [Branch controller reference](reference/branch_controller.py)
|
|
77
|
+
- [Measurement methodology](docs/MEASUREMENT.md)
|
|
78
|
+
- [Compatibility notes](docs/COMPATIBILITY.md)
|
|
79
|
+
- [Benchmark documentation](benchmark/README.md)
|
|
80
|
+
- [Contributing](CONTRIBUTING.md)
|
|
81
|
+
- [Security](SECURITY.md)
|
|
82
|
+
- [Citation metadata](CITATION.cff)
|
|
83
|
+
|
|
84
|
+
## License
|
|
85
|
+
|
|
86
|
+
MIT.
|
package/SKILL.md
CHANGED
|
@@ -1,146 +1,146 @@
|
|
|
1
|
-
---
|
|
2
|
-
name: quantum-reasoning
|
|
3
|
-
description: Maintain multiple genuinely different candidate hypotheses or solution paths, test them against evidence and tools, suppress weak or contradictory paths, revive useful alternatives when new evidence appears, and collapse to the best-supported answer only at the end.
|
|
4
|
-
---
|
|
5
|
-
|
|
6
|
-
# Quantum Reasoning Skill
|
|
7
|
-
|
|
8
|
-
A model-facing reasoning protocol inspired by the idea of keeping multiple possibilities alive before selection. It runs on classical models and classical hardware; it is not quantum computation.
|
|
9
|
-
|
|
10
|
-
## When to use
|
|
11
|
-
|
|
12
|
-
Use this skill when a problem is difficult, ambiguous, high-stakes, multi-step, or vulnerable to early commitment: mathematics, scientific reasoning, debugging, planning, architecture, model selection, hypothesis testing, and technical diagnosis.
|
|
13
|
-
|
|
14
|
-
Do not add branching overhead to trivial questions.
|
|
15
|
-
|
|
16
|
-
## Core protocol
|
|
17
|
-
|
|
18
|
-
### 1. Frame the state
|
|
19
|
-
|
|
20
|
-
Identify the objective, constraints, verified facts, assumptions, unknowns, and available tools. Keep facts separate from hypotheses.
|
|
21
|
-
|
|
22
|
-
### 2. Open a diverse possibility set
|
|
23
|
-
|
|
24
|
-
Create several materially different candidate paths. Diversity is mandatory: do not count paraphrases, cosmetic variants, or branches that depend on the same hidden assumption as independent possibilities.
|
|
25
|
-
|
|
26
|
-
Prefer orthogonal strategy classes when applicable, such as:
|
|
27
|
-
|
|
28
|
-
- direct derivation
|
|
29
|
-
- counterexample / falsification
|
|
30
|
-
- decomposition
|
|
31
|
-
- alternative model or mechanism
|
|
32
|
-
- numerical or executable test
|
|
33
|
-
- independent reconstruction
|
|
34
|
-
- adversarial critique
|
|
35
|
-
|
|
36
|
-
### 3. Maintain branch states
|
|
37
|
-
|
|
38
|
-
Treat each candidate as one of:
|
|
39
|
-
|
|
40
|
-
- **active** — worth more compute now
|
|
41
|
-
- **dormant** — currently weak but potentially recoverable
|
|
42
|
-
- **rejected** — contradicted or decisively invalidated
|
|
43
|
-
|
|
44
|
-
Never permanently reject a branch merely because another branch initially looks more plausible.
|
|
45
|
-
|
|
46
|
-
### 4. Evaluate each branch independently
|
|
47
|
-
|
|
48
|
-
Judge branches using evidence, not eloquence. Consider:
|
|
49
|
-
|
|
50
|
-
- empirical or logical support
|
|
51
|
-
- external verification
|
|
52
|
-
- independence from other branches
|
|
53
|
-
- information gain
|
|
54
|
-
- contradiction count and severity
|
|
55
|
-
- unresolved assumptions
|
|
56
|
-
- expected value of another reasoning step
|
|
57
|
-
- compute / tool cost
|
|
58
|
-
|
|
59
|
-
Self-reported model confidence alone is weak evidence.
|
|
60
|
-
|
|
61
|
-
### 5. Use tools to falsify, not merely confirm
|
|
62
|
-
|
|
63
|
-
When available, route claims through the strongest suitable verifier: executable code, numerical tests, formal solvers, source lookup, direct file inspection, unit tests, symbolic algebra, or an independent model pass.
|
|
64
|
-
|
|
65
|
-
Actively search for evidence that would disprove leading branches.
|
|
66
|
-
|
|
67
|
-
### 6. Apply interference-like comparison
|
|
68
|
-
|
|
69
|
-
Compare branches against each other without pretending to perform quantum interference.
|
|
70
|
-
|
|
71
|
-
- Reinforce conclusions independently reached by different verified paths.
|
|
72
|
-
- Penalize branches that conflict with verified facts.
|
|
73
|
-
- Detect shared assumptions so correlated branches are not double-counted.
|
|
74
|
-
- Transfer newly verified facts to every branch they constrain.
|
|
75
|
-
- Preserve meaningful disagreement instead of averaging incompatible claims.
|
|
76
|
-
|
|
77
|
-
### 7. Allocate compute dynamically
|
|
78
|
-
|
|
79
|
-
Use uncertainty to control width and depth.
|
|
80
|
-
|
|
81
|
-
- **Low uncertainty:** narrow quickly and deepen the strongest path.
|
|
82
|
-
- **High uncertainty:** widen the possibility set.
|
|
83
|
-
- **High-value unresolved branch:** spend additional tool or reasoning budget.
|
|
84
|
-
- **Redundant or contradicted branch:** move to dormant or rejected.
|
|
85
|
-
|
|
86
|
-
Branch count is adaptive, not fixed.
|
|
87
|
-
|
|
88
|
-
### 8. Permit branch revival
|
|
89
|
-
|
|
90
|
-
If new evidence invalidates a leading assumption or materially improves a dormant branch, restore that branch to active status and re-evaluate the ranking.
|
|
91
|
-
|
|
92
|
-
### 9. Stop when more search has low value
|
|
93
|
-
|
|
94
|
-
Collapse the possibility set when one result is sufficiently verified, remaining branches are redundant or falsified, or additional search is unlikely to change the decision enough to justify its cost.
|
|
95
|
-
|
|
96
|
-
If multiple branches remain genuinely unresolved, report the alternatives and what evidence would distinguish them.
|
|
97
|
-
|
|
98
|
-
### 10. Produce the answer
|
|
99
|
-
|
|
100
|
-
Synthesize only from the strongest supported surviving branches. Run a final contradiction and requirement check before answering.
|
|
101
|
-
|
|
102
|
-
Do not expose hidden chain-of-thought. Return the conclusion, concise supporting evidence, important uncertainty, and materially different surviving alternatives when necessary.
|
|
103
|
-
|
|
104
|
-
## Adaptive intensity
|
|
105
|
-
|
|
106
|
-
Use a rough internal intensity level:
|
|
107
|
-
|
|
108
|
-
- **light:** 2–3 distinct candidates, one comparison pass
|
|
109
|
-
- **standard:** 4–8 candidates, verification + pruning + one revival check
|
|
110
|
-
- **deep:** 8+ candidates only when the problem and compute budget justify it; use repeated verification and adaptive expansion
|
|
111
|
-
|
|
112
|
-
Do not mechanically maximize branch count. The goal is better search of the possibility space, not more text.
|
|
113
|
-
|
|
114
|
-
## Operational reference policy
|
|
115
|
-
|
|
116
|
-
When the host system can track aggregate branch metadata, use explicit normalized values in `[0, 1]` for evidence, verification, independence, information gain, contradiction severity, unresolved assumptions, compute cost, shared-assumption overlap, and semantic redundancy.
|
|
117
|
-
|
|
118
|
-
A provider-agnostic reference controller is available in [`reference/branch_controller.py`](./reference/branch_controller.py). Its defaults make the qualitative protocol testable:
|
|
119
|
-
|
|
120
|
-
- independence is reduced when branches share critical assumptions or are near-duplicates
|
|
121
|
-
- strong contradiction can reject a branch
|
|
122
|
-
- weak branches become dormant instead of disappearing
|
|
123
|
-
- dormant branches can revive after a material evidence, verification, or contradiction change
|
|
124
|
-
- uncertainty controls a recommended search width
|
|
125
|
-
- collapse requires a verified leader, low contradiction, and a meaningful margin over surviving alternatives
|
|
126
|
-
|
|
127
|
-
The exact scoring weights and thresholds are **reference defaults, not validated constants**. They must be calibrated against benchmark evidence rather than treated as universal truths. See [`docs/MEASUREMENT.md`](./docs/MEASUREMENT.md) for the auditable formulas and thresholds.
|
|
128
|
-
|
|
129
|
-
Hosts that cannot expose these aggregate measurements should still follow the qualitative protocol above and must not invent numeric telemetry.
|
|
130
|
-
|
|
131
|
-
## Benchmark requirement
|
|
132
|
-
|
|
133
|
-
Do not claim that this skill improves reasoning merely because the protocol sounds plausible. Compare the same model and task configuration with and without the skill and measure at least accuracy, compute/token cost, latency, error recovery, contradiction resolution, and branch diversity when observable.
|
|
134
|
-
|
|
135
|
-
The reproducible benchmark schema and evaluator live under [`benchmark/`](./benchmark/README.md).
|
|
136
|
-
|
|
137
|
-
## Non-negotiable rules
|
|
138
|
-
|
|
139
|
-
1. Do not call this real quantum computation.
|
|
140
|
-
2. Do not treat repeated wording as independent evidence.
|
|
141
|
-
3. Do not let one branch evaluate itself without challenge when verification is possible.
|
|
142
|
-
4. Prefer falsification and executable checks over intuition.
|
|
143
|
-
5. Preserve a recoverable record of high-information dormant branches.
|
|
144
|
-
6. Collapse only after cross-branch comparison.
|
|
145
|
-
7. Never fabricate evidence, tool results, sources, certainty, or branch telemetry.
|
|
146
|
-
8. Do not present reference thresholds as empirically validated until benchmark evidence exists.
|
|
1
|
+
---
|
|
2
|
+
name: quantum-reasoning
|
|
3
|
+
description: Maintain multiple genuinely different candidate hypotheses or solution paths, test them against evidence and tools, suppress weak or contradictory paths, revive useful alternatives when new evidence appears, and collapse to the best-supported answer only at the end.
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# Quantum Reasoning Skill
|
|
7
|
+
|
|
8
|
+
A model-facing reasoning protocol inspired by the idea of keeping multiple possibilities alive before selection. It runs on classical models and classical hardware; it is not quantum computation.
|
|
9
|
+
|
|
10
|
+
## When to use
|
|
11
|
+
|
|
12
|
+
Use this skill when a problem is difficult, ambiguous, high-stakes, multi-step, or vulnerable to early commitment: mathematics, scientific reasoning, debugging, planning, architecture, model selection, hypothesis testing, and technical diagnosis.
|
|
13
|
+
|
|
14
|
+
Do not add branching overhead to trivial questions.
|
|
15
|
+
|
|
16
|
+
## Core protocol
|
|
17
|
+
|
|
18
|
+
### 1. Frame the state
|
|
19
|
+
|
|
20
|
+
Identify the objective, constraints, verified facts, assumptions, unknowns, and available tools. Keep facts separate from hypotheses.
|
|
21
|
+
|
|
22
|
+
### 2. Open a diverse possibility set
|
|
23
|
+
|
|
24
|
+
Create several materially different candidate paths. Diversity is mandatory: do not count paraphrases, cosmetic variants, or branches that depend on the same hidden assumption as independent possibilities.
|
|
25
|
+
|
|
26
|
+
Prefer orthogonal strategy classes when applicable, such as:
|
|
27
|
+
|
|
28
|
+
- direct derivation
|
|
29
|
+
- counterexample / falsification
|
|
30
|
+
- decomposition
|
|
31
|
+
- alternative model or mechanism
|
|
32
|
+
- numerical or executable test
|
|
33
|
+
- independent reconstruction
|
|
34
|
+
- adversarial critique
|
|
35
|
+
|
|
36
|
+
### 3. Maintain branch states
|
|
37
|
+
|
|
38
|
+
Treat each candidate as one of:
|
|
39
|
+
|
|
40
|
+
- **active** — worth more compute now
|
|
41
|
+
- **dormant** — currently weak but potentially recoverable
|
|
42
|
+
- **rejected** — contradicted or decisively invalidated
|
|
43
|
+
|
|
44
|
+
Never permanently reject a branch merely because another branch initially looks more plausible.
|
|
45
|
+
|
|
46
|
+
### 4. Evaluate each branch independently
|
|
47
|
+
|
|
48
|
+
Judge branches using evidence, not eloquence. Consider:
|
|
49
|
+
|
|
50
|
+
- empirical or logical support
|
|
51
|
+
- external verification
|
|
52
|
+
- independence from other branches
|
|
53
|
+
- information gain
|
|
54
|
+
- contradiction count and severity
|
|
55
|
+
- unresolved assumptions
|
|
56
|
+
- expected value of another reasoning step
|
|
57
|
+
- compute / tool cost
|
|
58
|
+
|
|
59
|
+
Self-reported model confidence alone is weak evidence.
|
|
60
|
+
|
|
61
|
+
### 5. Use tools to falsify, not merely confirm
|
|
62
|
+
|
|
63
|
+
When available, route claims through the strongest suitable verifier: executable code, numerical tests, formal solvers, source lookup, direct file inspection, unit tests, symbolic algebra, or an independent model pass.
|
|
64
|
+
|
|
65
|
+
Actively search for evidence that would disprove leading branches.
|
|
66
|
+
|
|
67
|
+
### 6. Apply interference-like comparison
|
|
68
|
+
|
|
69
|
+
Compare branches against each other without pretending to perform quantum interference.
|
|
70
|
+
|
|
71
|
+
- Reinforce conclusions independently reached by different verified paths.
|
|
72
|
+
- Penalize branches that conflict with verified facts.
|
|
73
|
+
- Detect shared assumptions so correlated branches are not double-counted.
|
|
74
|
+
- Transfer newly verified facts to every branch they constrain.
|
|
75
|
+
- Preserve meaningful disagreement instead of averaging incompatible claims.
|
|
76
|
+
|
|
77
|
+
### 7. Allocate compute dynamically
|
|
78
|
+
|
|
79
|
+
Use uncertainty to control width and depth.
|
|
80
|
+
|
|
81
|
+
- **Low uncertainty:** narrow quickly and deepen the strongest path.
|
|
82
|
+
- **High uncertainty:** widen the possibility set.
|
|
83
|
+
- **High-value unresolved branch:** spend additional tool or reasoning budget.
|
|
84
|
+
- **Redundant or contradicted branch:** move to dormant or rejected.
|
|
85
|
+
|
|
86
|
+
Branch count is adaptive, not fixed.
|
|
87
|
+
|
|
88
|
+
### 8. Permit branch revival
|
|
89
|
+
|
|
90
|
+
If new evidence invalidates a leading assumption or materially improves a dormant branch, restore that branch to active status and re-evaluate the ranking.
|
|
91
|
+
|
|
92
|
+
### 9. Stop when more search has low value
|
|
93
|
+
|
|
94
|
+
Collapse the possibility set when one result is sufficiently verified, remaining branches are redundant or falsified, or additional search is unlikely to change the decision enough to justify its cost.
|
|
95
|
+
|
|
96
|
+
If multiple branches remain genuinely unresolved, report the alternatives and what evidence would distinguish them.
|
|
97
|
+
|
|
98
|
+
### 10. Produce the answer
|
|
99
|
+
|
|
100
|
+
Synthesize only from the strongest supported surviving branches. Run a final contradiction and requirement check before answering.
|
|
101
|
+
|
|
102
|
+
Do not expose hidden chain-of-thought. Return the conclusion, concise supporting evidence, important uncertainty, and materially different surviving alternatives when necessary.
|
|
103
|
+
|
|
104
|
+
## Adaptive intensity
|
|
105
|
+
|
|
106
|
+
Use a rough internal intensity level:
|
|
107
|
+
|
|
108
|
+
- **light:** 2–3 distinct candidates, one comparison pass
|
|
109
|
+
- **standard:** 4–8 candidates, verification + pruning + one revival check
|
|
110
|
+
- **deep:** 8+ candidates only when the problem and compute budget justify it; use repeated verification and adaptive expansion
|
|
111
|
+
|
|
112
|
+
Do not mechanically maximize branch count. The goal is better search of the possibility space, not more text.
|
|
113
|
+
|
|
114
|
+
## Operational reference policy
|
|
115
|
+
|
|
116
|
+
When the host system can track aggregate branch metadata, use explicit normalized values in `[0, 1]` for evidence, verification, independence, information gain, contradiction severity, unresolved assumptions, compute cost, shared-assumption overlap, and semantic redundancy.
|
|
117
|
+
|
|
118
|
+
A provider-agnostic reference controller is available in [`reference/branch_controller.py`](./reference/branch_controller.py). Its defaults make the qualitative protocol testable:
|
|
119
|
+
|
|
120
|
+
- independence is reduced when branches share critical assumptions or are near-duplicates
|
|
121
|
+
- strong contradiction can reject a branch
|
|
122
|
+
- weak branches become dormant instead of disappearing
|
|
123
|
+
- dormant branches can revive after a material evidence, verification, or contradiction change
|
|
124
|
+
- uncertainty controls a recommended search width
|
|
125
|
+
- collapse requires a verified leader, low contradiction, and a meaningful margin over surviving alternatives
|
|
126
|
+
|
|
127
|
+
The exact scoring weights and thresholds are **reference defaults, not validated constants**. They must be calibrated against benchmark evidence rather than treated as universal truths. See [`docs/MEASUREMENT.md`](./docs/MEASUREMENT.md) for the auditable formulas and thresholds.
|
|
128
|
+
|
|
129
|
+
Hosts that cannot expose these aggregate measurements should still follow the qualitative protocol above and must not invent numeric telemetry.
|
|
130
|
+
|
|
131
|
+
## Benchmark requirement
|
|
132
|
+
|
|
133
|
+
Do not claim that this skill improves reasoning merely because the protocol sounds plausible. Compare the same model and task configuration with and without the skill and measure at least accuracy, compute/token cost, latency, error recovery, contradiction resolution, and branch diversity when observable.
|
|
134
|
+
|
|
135
|
+
The reproducible benchmark schema and evaluator live under [`benchmark/`](./benchmark/README.md).
|
|
136
|
+
|
|
137
|
+
## Non-negotiable rules
|
|
138
|
+
|
|
139
|
+
1. Do not call this real quantum computation.
|
|
140
|
+
2. Do not treat repeated wording as independent evidence.
|
|
141
|
+
3. Do not let one branch evaluate itself without challenge when verification is possible.
|
|
142
|
+
4. Prefer falsification and executable checks over intuition.
|
|
143
|
+
5. Preserve a recoverable record of high-information dormant branches.
|
|
144
|
+
6. Collapse only after cross-branch comparison.
|
|
145
|
+
7. Never fabricate evidence, tool results, sources, certainty, or branch telemetry.
|
|
146
|
+
8. Do not present reference thresholds as empirically validated until benchmark evidence exists.
|
package/VERSION
CHANGED
|
@@ -1 +1 @@
|
|
|
1
|
-
|
|
1
|
+
1.1.0
|