harness-everything 0.47.1 → 0.47.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/.claude-plugin/marketplace.json +1 -1
- package/.claude-plugin/plugin.json +1 -1
- package/.github/workflows/ci.yml +12 -0
- package/CHANGELOG.md +9 -0
- package/benchmarks/issue290-pilot/README.md +199 -0
- package/benchmarks/issue290-pilot/analyze.py +299 -0
- package/benchmarks/issue290-pilot/analyze.test.py +146 -0
- package/benchmarks/issue290-pilot/check.py +19 -0
- package/benchmarks/issue290-pilot/evidence/archive.json +7 -0
- package/benchmarks/issue290-pilot/evidence/group-summary.json +684 -0
- package/benchmarks/issue290-pilot/evidence/inventory.json +3728 -0
- package/benchmarks/issue290-pilot/evidence/ledger.json +4644 -0
- package/benchmarks/issue290-pilot/evidence/replay/pairs.json +482 -0
- package/benchmarks/issue290-pilot/evidence/replay/provenance.json +24 -0
- package/benchmarks/issue290-pilot/evidence/replay/tables.md +37 -0
- package/benchmarks/issue290-pilot/evidence.tar.gz +0 -0
- package/benchmarks/issue290-pilot/export.py +110 -0
- package/benchmarks/issue290-pilot/export.test.py +65 -0
- package/benchmarks/issue290-pilot/fable-supplement.py +55 -0
- package/benchmarks/issue290-pilot/fixture.test.py +28 -0
- package/benchmarks/issue290-pilot/fixtures/polyglot/instructions.md +19 -0
- package/benchmarks/issue290-pilot/fixtures/polyglot/package.json +29 -0
- package/benchmarks/issue290-pilot/fixtures/polyglot/simple-linked-list.js +44 -0
- package/benchmarks/issue290-pilot/fixtures/polyglot/simple-linked-list.spec.js +131 -0
- package/benchmarks/issue290-pilot/fixtures/quixbugs/LICENSE +7 -0
- package/benchmarks/issue290-pilot/fixtures/quixbugs/cases.json +7 -0
- package/benchmarks/issue290-pilot/fixtures/quixbugs/find_in_sorted.py +31 -0
- package/benchmarks/issue290-pilot/fixtures/quixbugs/test_find_in_sorted.py +15 -0
- package/benchmarks/issue290-pilot/frozen-documents.json +41 -0
- package/benchmarks/issue290-pilot/grader.cjs +43 -0
- package/benchmarks/issue290-pilot/grader.test.cjs +10 -0
- package/benchmarks/issue290-pilot/hook.test.cjs +27 -0
- package/benchmarks/issue290-pilot/host-hook.cjs +35 -0
- package/benchmarks/issue290-pilot/metrics.test.py +131 -0
- package/benchmarks/issue290-pilot/preflight/amendment.md +32 -0
- package/benchmarks/issue290-pilot/preflight/environment.json +15 -0
- package/benchmarks/issue290-pilot/preflight/fable-amendment.md +20 -0
- package/benchmarks/issue290-pilot/preflight/fable-frozen-files.json +4 -0
- package/benchmarks/issue290-pilot/preflight/fable-infrastructure-amendment.md +27 -0
- package/benchmarks/issue290-pilot/preflight/fable-retry-frozen-files.json +4 -0
- package/benchmarks/issue290-pilot/preflight/fable-supplement-v1.py +47 -0
- package/benchmarks/issue290-pilot/preflight/frozen-files.json +18 -0
- package/benchmarks/issue290-pilot/preflight/graders.json +67 -0
- package/benchmarks/issue290-pilot/pricing-assumptions.json +29 -0
- package/benchmarks/issue290-pilot/protocol.json +32 -0
- package/benchmarks/issue290-pilot/read_metrics.py +166 -0
- package/benchmarks/issue290-pilot/replay.py +167 -0
- package/benchmarks/issue290-pilot/reporting.py +82 -0
- package/benchmarks/issue290-pilot/run.py +262 -0
- package/benchmarks/issue290-pilot/sources.json +10 -0
- package/benchmarks/issue290-pilot/verification/analyzer-tests.log +5 -0
- package/benchmarks/issue290-pilot/verification/final-gates.json +58 -0
- package/benchmarks/issue290-pilot/verification/fixture-tests.log +5 -0
- package/benchmarks/issue290-pilot/verification/gates.json +58 -0
- package/benchmarks/issue290-pilot/verification/npm-audit.json +84 -0
- package/benchmarks/issue290-pilot/verification/offline-correction.json +59 -0
- package/benchmarks/issue290-pilot/verification/post-report/helper-tests.log +22 -0
- package/benchmarks/issue290-pilot/verification/post-report/test-consistency.log +626 -0
- package/benchmarks/issue290-pilot/verification/post-report/test-references.log +6 -0
- package/benchmarks/issue290-pilot/verification/post-report/waza-tokens.log +710 -0
- package/benchmarks/issue290-pilot/verification/test-collision.log +28 -0
- package/benchmarks/issue290-pilot/verification/test-consistency.log +28 -0
- package/benchmarks/issue290-pilot/verification/test-docs-capabilities.log +131 -0
- package/benchmarks/issue290-pilot/verification/test-mechanism.log +1829 -0
- package/benchmarks/issue290-pilot/verification/test-mutations.log +16 -0
- package/benchmarks/issue290-pilot/verification/test-platform-compatibility.log +9 -0
- package/benchmarks/issue290-pilot/verification/test-plugin-openai.log +6 -0
- package/benchmarks/issue290-pilot/verification/test-plugin-submission.log +5 -0
- package/benchmarks/issue290-pilot/verification/test-references.log +6 -0
- package/benchmarks/issue290-pilot/verification/test-release.log +59 -0
- package/benchmarks/issue290-pilot/verification/test-repo-contract.log +5 -0
- package/benchmarks/issue290-pilot/verification/test-routing-invariants.log +785 -0
- package/benchmarks/issue290-pilot/verification/test-routing-skills.log +28 -0
- package/benchmarks/issue290-pilot/verification/test.log +3373 -0
- package/benchmarks/issue290-pilot/verification/verification-report.md +76 -0
- package/benchmarks/issue290-pilot/verification/waza-tokens.log +710 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/gates.json +26 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test-collision.log +8 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test-consistency.log +626 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test-mechanism.log +1693 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test-release.log +38 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test-routing-skills.log +44 -0
- package/benchmarks/issue290-pilot/verification/with-dependencies/test.log +3253 -0
- package/opencode-plugin/plugin.json +1 -1
- package/package.json +1 -1
- package/plugins/harness-everything/.codex-plugin/plugin.json +1 -1
- package/plugins/harness-everything/plugin.json +1 -1
- package/sbom.cdx.json +7 -7
|
@@ -0,0 +1,38 @@
|
|
|
1
|
+
|
|
2
|
+
> harness-everything@0.31.1 test:release
|
|
3
|
+
> node ci/release-consistency-check.js && node ci/mechanism-2x-release-automation.test.js && node ci/mechanism-2x-release-commit-message.test.js && node ci/mechanism-2ap-sbom.test.js
|
|
4
|
+
|
|
5
|
+
Release v0.31.1: 26 skill(s); current tree: 26 skill(s).
|
|
6
|
+
environment-detection: 3 file(s) in v0.31.1; 3 file(s) in current source
|
|
7
|
+
eval-harness: 3 file(s) in v0.31.1; 3 file(s) in current source
|
|
8
|
+
fable-discipline: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
9
|
+
fable-mode: 21 file(s) in v0.31.1; 21 file(s) in current source
|
|
10
|
+
find-skills: 3 file(s) in v0.31.1; 3 file(s) in current source
|
|
11
|
+
git-commit: 7 file(s) in v0.31.1; 7 file(s) in current source
|
|
12
|
+
grill-me: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
13
|
+
grill-with-docs: 4 file(s) in v0.31.1; 4 file(s) in current source
|
|
14
|
+
harness-everything: 30 file(s) in v0.31.1; 30 file(s) in current source
|
|
15
|
+
improve-codebase-architecture: 7 file(s) in v0.31.1; 7 file(s) in current source
|
|
16
|
+
install-cognitive-os: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
17
|
+
multi-agent-workspace: 35 file(s) in v0.31.1; 35 file(s) in current source
|
|
18
|
+
repo-docs: 12 file(s) in v0.31.1; 12 file(s) in current source
|
|
19
|
+
rewrite-commits: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
20
|
+
security-review: 5 file(s) in v0.31.1; 5 file(s) in current source
|
|
21
|
+
self-evolve: 7 file(s) in v0.31.1; 7 file(s) in current source
|
|
22
|
+
skill-creator: 6 file(s) in v0.31.1; 6 file(s) in current source
|
|
23
|
+
skill-style: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
24
|
+
tdd: 15 file(s) in v0.31.1; 15 file(s) in current source
|
|
25
|
+
to-spec: 8 file(s) in v0.31.1; 8 file(s) in current source
|
|
26
|
+
to-tickets: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
27
|
+
todo-driven-workflow: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
28
|
+
using-git-worktrees: 4 file(s) in v0.31.1; 4 file(s) in current source
|
|
29
|
+
verification-loop: 7 file(s) in v0.31.1; 7 file(s) in current source
|
|
30
|
+
verify-before-claim: 2 file(s) in v0.31.1; 2 file(s) in current source
|
|
31
|
+
zoom-out: 3 file(s) in v0.31.1; 3 file(s) in current source
|
|
32
|
+
Checked 70 release-tag skill reference(s).
|
|
33
|
+
Checked 68 current skill path reference(s).
|
|
34
|
+
RELEASE SKILL CATALOG PASSED for v0.31.1; current source has the same logical skill catalog (26 release entries, 26 current directories after merges).
|
|
35
|
+
Release automation contract verified: stable SemVer rules, full manifest lockstep, changed-skill versioning, drift detection, idempotency, and fail-before-write behavior.
|
|
36
|
+
Release commit contract verified: compact message passes commitlint and legacy release-note embedding is rejected.
|
|
37
|
+
npm warn gitignore-fallback No .npmignore file found, using .gitignore for file exclusion. Consider creating a .npmignore file to explicitly control published files.
|
|
38
|
+
CycloneDX SBOM verified: 123 lockfile components and npm pack inclusion.
|
|
@@ -0,0 +1,44 @@
|
|
|
1
|
+
|
|
2
|
+
> harness-everything@0.31.1 test:routing:skills
|
|
3
|
+
> node ci/skill-routing-check.js
|
|
4
|
+
|
|
5
|
+
PASS fable-mode/execution-guardrails/SKILL.md: routing=internal
|
|
6
|
+
PASS fable-mode/fable-haiku/SKILL.md: routing=parent
|
|
7
|
+
PASS fable-mode/fable-opus/SKILL.md: routing=parent
|
|
8
|
+
PASS fable-mode/fable-sonnet/SKILL.md: routing=parent
|
|
9
|
+
PASS environment-detection/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
10
|
+
PASS eval-harness/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
11
|
+
PASS fable-discipline/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
12
|
+
PASS fable-mode/positive-haiku-mode.yaml: skill-specific relevance proven without pre-step path leaks
|
|
13
|
+
PASS fable-mode/positive-opus-mode.yaml: skill-specific relevance proven without pre-step path leaks
|
|
14
|
+
PASS fable-mode/positive-sonnet-mode.yaml: skill-specific relevance proven without pre-step path leaks
|
|
15
|
+
PASS fable-mode/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
16
|
+
PASS find-skills/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
17
|
+
PASS git-commit/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
18
|
+
PASS grill-me/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
19
|
+
PASS grill-with-docs/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
20
|
+
PASS harness-everything/positive-tier1.yaml: skill-specific relevance proven without pre-step path leaks
|
|
21
|
+
PASS harness-everything/positive-tier2.yaml: skill-specific relevance proven without pre-step path leaks
|
|
22
|
+
PASS harness-everything/positive-tier3.yaml: skill-specific relevance proven without pre-step path leaks
|
|
23
|
+
PASS improve-codebase-architecture/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
24
|
+
PASS install-cognitive-os/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
25
|
+
PASS multi-agent-workspace/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
26
|
+
PASS repo-docs/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
27
|
+
PASS rewrite-commits/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
28
|
+
PASS security-review/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
29
|
+
PASS self-evolve/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
30
|
+
PASS skill-creator/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
31
|
+
PASS skill-style/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
32
|
+
PASS tdd/positive-bugfix.yaml: skill-specific relevance proven without pre-step path leaks
|
|
33
|
+
PASS tdd/positive-feature.yaml: skill-specific relevance proven without pre-step path leaks
|
|
34
|
+
PASS tdd/positive-refactor.yaml: skill-specific relevance proven without pre-step path leaks
|
|
35
|
+
PASS to-spec/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
36
|
+
PASS to-tickets/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
37
|
+
PASS todo-driven-workflow/positive-multi-step.yaml: skill-specific relevance proven without pre-step path leaks
|
|
38
|
+
PASS todo-driven-workflow/positive-refactor-flow.yaml: skill-specific relevance proven without pre-step path leaks
|
|
39
|
+
PASS using-git-worktrees/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
40
|
+
PASS verification-loop/positive-pre-ship.yaml: skill-specific relevance proven without pre-step path leaks
|
|
41
|
+
PASS verify-before-claim/positive-trigger.yaml: skill-specific relevance proven without pre-step path leaks
|
|
42
|
+
PASS zoom-out/positive-repeated-failure.yaml: skill-specific relevance proven without pre-step path leaks
|
|
43
|
+
|
|
44
|
+
Positive skill-eval coverage: 34 case(s) checked across 26 direct skills; 4 nested skill(s) classified.
|