@intentsolutions/audit-harness 0.1.0 → 1.1.6
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +435 -0
- package/LICENSE +202 -21
- package/NOTICE +15 -0
- package/README.md +36 -4
- package/bin/audit-harness.js +108 -8
- package/docs/gate-promotion.md +45 -0
- package/package.json +13 -9
- package/schemas/audit-profile/layer-applicability.md +146 -0
- package/schemas/audit-profile/registry.v1.json +87 -0
- package/schemas/audit-profile/v1.schema.json +294 -0
- package/schemas/conform/v1/agent-frontmatter.schema.json +24 -0
- package/schemas/conform/v1/mcp-config.schema.json +31 -0
- package/schemas/conform/v1/plugin-manifest.schema.json +26 -0
- package/schemas/conform/v1/skillmd-frontmatter.schema.json +40 -0
- package/schemas/currency/pins.v1.json +55 -0
- package/scripts/arch-check.sh +25 -1
- package/scripts/audit.py +386 -0
- package/scripts/bias-count.sh +50 -4
- package/scripts/classify.py +403 -0
- package/scripts/conform.py +481 -0
- package/scripts/crap-score.py +65 -5
- package/scripts/currency.py +118 -0
- package/scripts/emit-evidence.sh +256 -0
- package/scripts/escape-scan.sh +58 -4
- package/scripts/fp-rate.py +145 -0
- package/scripts/gen-layer-applicability.py +157 -0
- package/scripts/gherkin-lint.sh +53 -9
- package/scripts/harness-hash.sh +78 -5
- package/scripts/scan.py +228 -0
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,440 @@
|
|
|
1
1
|
# Changelog
|
|
2
2
|
|
|
3
|
+
All notable changes are recorded here. Format follows [Keep a Changelog](https://keepachangelog.com/en/1.1.0/) and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
|
4
|
+
|
|
5
|
+
## [Unreleased]
|
|
6
|
+
|
|
7
|
+
### Added — CI-only signed evidence emit for the intent-eval-dashboard (nr75.12)
|
|
8
|
+
|
|
9
|
+
The dashboard reports hub (labs.intentsolutions.io) ingests a signed `report-manifest.json` of kernel `gate-result/v1` rows per repo. This adds audit-harness's own emit, lighting up its row.
|
|
10
|
+
|
|
11
|
+
- **`ci/emit-evidence.ts` + `ci/assemble-manifest.ts`** — run the real deterministic self-gate (`harness-hash --verify`), shape it into a kernel `gate-result/v1` + `EvidenceBundle` (fail-closed against `@intentsolutions/core`), cosign-sign the canonical bytes (Fulcio OIDC + Rekor), and assemble the manifest the dashboard re-verifies at ingest.
|
|
12
|
+
- **Zero-dep guarantee preserved.** The emitter lives in `ci/` (excluded from `package.json#files`) and the kernel is installed CI-only via `npm i --no-save` — `dependencies` + `devDependencies` stay empty and the published tarball is unchanged (verified via `npm pack --dry-run`).
|
|
13
|
+
- **`.github/workflows/release.yml`** — adds a GitHub Release on tag push + an `emit-evidence` job (tag-only) that publishes the manifest as a Release asset.
|
|
14
|
+
|
|
15
|
+
### Added — `currency` advisory upstream-currency report (PP-PLAN-040 Phase 5 / E7)
|
|
16
|
+
|
|
17
|
+
The fifth verb, and deliberately the weakest: an advisory report with no exit-code authority.
|
|
18
|
+
|
|
19
|
+
- **`audit-harness currency`** (`scripts/currency.py`, stdlib): reads the per-upstream-identity pin relation (`schemas/currency/pins.v1.json`) and reports which pins are themselves **stale** — `checked_at` older than the pin's staleness window. Each upstream (mcp-spec, skill-md-schema, claude-code, gate-result-predicate, anthropic-sdk, agentskills-spec) carries its own `pinned_version` + `checked_at` + window, so the *pin's own staleness* is detectable (not one opaque scalar).
|
|
20
|
+
- **No exit-code authority (always exit 0), no live-fetch, no auto-fix.** Currency depends on upstream state — non-deterministic and network-bound — so it only reports. `/sync-testing-harness` consumes the report to open advisory bump PRs; it never reddens a build. `--today YYYY-MM-DD` makes reports reproducible.
|
|
21
|
+
- **`tests/currency/`**: golden suite (3 checks) — stale/current/unknown classification, the no-exit-authority guarantee (exit 0 even when all pins are stale), and the shipped relation reporting.
|
|
22
|
+
|
|
23
|
+
### Added — `scan` security/hygiene/skill-quality gate-runner (PP-PLAN-040 Phase 4 / E6)
|
|
24
|
+
|
|
25
|
+
The fourth read-only verb: security + hygiene + skill-quality, by orchestrating standard tools (never reimplementing them).
|
|
26
|
+
|
|
27
|
+
- **`audit-harness scan [repo]`** (`scripts/scan.py`, stdlib): for every `dimension: security | hygiene | skill-quality` gate in the profile, emits a `gate-result/v1` row. Three strategies: **local** (`hygiene-readme` README presence — deterministic), **shell-out** (every gate carrying a `tool` — gitleaks / osv-scanner / semgrep / syft / markdownlint / lychee — clean exit → PASS, findings → ADVISORY(error), tool absent → ADVISORY indeterminate), **consume** (`skill-behavioral` ingests a j-rig Evidence Bundle verdict via `--jrig-verdict`; the harness never runs behavioral judgment itself — no verdict → indeterminate).
|
|
28
|
+
- Advisory-first; `--strict` (or a blocking gate) turns a finding/gap into `FAIL`. Kill-switch → `[]`. Each row records `metadata.method` (`local-presence` / `shell-out` / `consume-j-rig`).
|
|
29
|
+
- **`tests/scan/`**: golden suite (10 checks) with pinned-profile isolation so shell-out tool availability never makes the suite flaky.
|
|
30
|
+
|
|
31
|
+
**Security note:** on first run this gate caught — and this release redacts from HEAD — a PyPI publish token that had been pasted as a literal value in `python/PUBLISH.md`. The value remains in git history; it must be rotated at the registry (tracked separately). The doc now carries a placeholder.
|
|
32
|
+
|
|
33
|
+
### Added — `audit` testing-depth gate-runner (PP-PLAN-040 Phase 3 / E5)
|
|
34
|
+
|
|
35
|
+
The third read-only verb: the "finish the pyramid" testing-depth diagnostic.
|
|
36
|
+
|
|
37
|
+
- **`audit-harness audit [repo]`** (`scripts/audit.py`, stdlib): for every `dimension: testing-depth` gate in the profile, assesses the gate and emits a `gate-result/v1` row. Two read-only strategies: `crap-score` runs the bundled `crap` scorer (static complexity×coverage); every pyramid layer (unit/integration/e2e/smoke/perf/a11y/contract/migration/property-based/fuzz/sanitizers) gets a per-layer **presence heuristic** (test dirs, framework configs, dependency markers). Layer present → `PASS`; absent → `ADVISORY(warn)` testing-depth gap; not statically assessable → `ADVISORY` indeterminate.
|
|
38
|
+
- **`--fast` (default)** presence heuristics only (<10s); **`--deep`** adds `crap-score`; **`--strict`** turns a gap on a blocking gate into `FAIL`. Kill-switch → `[]`. Each row records `metadata.method` (`crap-static` / `presence-heuristic` / `delegated`) for provenance.
|
|
39
|
+
- **Deliberately does NOT execute the repo's test suite.** Running arbitrary untrusted suites is the repo's own CI's job; the harness reports coverage *presence* and the repo's CI test step produces the execution verdict. `audit` is the diagnostic, not the test runner.
|
|
40
|
+
- **`tests/audit/`**: golden suite (7 checks) + `has-tests`/`no-tests` fixtures — asserts unit→PASS / gap→ADVISORY(default) / gap→FAIL(`--strict`), crap deep-only-in-fast, kill-switch, and gate-result/v1 validity. CI `audit` job.
|
|
41
|
+
|
|
42
|
+
### Added — registry projection + FP-rate harness (PP-PLAN-040 Phase 0 completion: c2b + c2e)
|
|
43
|
+
|
|
44
|
+
Closes the data/safety-spine epic (E2): the registry becomes the single canonical datum and gate promotion gets a measured bar.
|
|
45
|
+
|
|
46
|
+
- **`audit-harness gen-layer-applicability`** (`scripts/gen-layer-applicability.py`): projects `schemas/audit-profile/registry.v1.json` into `schemas/audit-profile/layer-applicability.md`. `--write` regenerates; `--check` fails on drift. The doc is now a **projection** of the registry datum, not a hand-maintained parallel source — CI gate `layer-applicability-drift` enforces it (c2b).
|
|
47
|
+
- **`audit-harness fp-rate`** (`scripts/fp-rate.py`): measures each gate's false-positive / false-negative rate over a labeled corpus (`tests/fixtures/conform/{valid,malformed}/`). This is the metric that gates advisory→blocking promotion. `--max-fp-rate X` exits 1 if any gate exceeds the bar; CI runs it advisory at the 5% default bar (c2e).
|
|
48
|
+
- **`docs/gate-promotion.md`**: the dedicated advisory→blocking promotion rule — FP-rate ≤ 5% bar, engineer-pinned in `tests/TESTING.md`, re-pinned manifest. Documents *why* FP-rate (not FN-rate) is the gate and how demotion/kill-switch works. `docs/` now ships in the npm package (`files`).
|
|
49
|
+
|
|
50
|
+
### Added — `conform` verb + bundled content-addressed schemas (PP-PLAN-040 Phase 2)
|
|
51
|
+
|
|
52
|
+
The second piece of the read-only brain: deterministic conformance, emitting Evidence Bundle rows.
|
|
53
|
+
|
|
54
|
+
- **`audit-harness conform [repo]`** (`scripts/conform.py`, stdlib + PyYAML): read-only conformance gate-runner. For every `dimension: conformance` gate in the repo's `audit-profile/v1`, it locates the artifact(s) and emits a `gate-result/v1` row (JSON array, stdout). **Never writes, never live-fetches.**
|
|
55
|
+
- **Bundled content-addressed schemas** (`schemas/conform/v1/`): `skillmd-frontmatter`, `mcp-config`, `plugin-manifest`, `agent-frontmatter` — the deterministic *structural floor* (parses + required keys + types), distinct from the IS 100-point rubric / SAK authoring kernel (judgment, stays in `/validate-*`). conform records each schema's sha256 in the row's `policy_hash`, so a row re-verifies against the exact schema version that produced it.
|
|
56
|
+
- **Reproducible-by-design engine.** Bundled JSON-Schemas are checked by an embedded subset validator (complete for the closed bundled schemas) rather than ajv — deliberately, because ajv's availability/version varies per machine and would make signed evidence non-reproducible. Same commit + same harness version produce an identical verdict.
|
|
57
|
+
- **Genuinely-external formats shell out**: OpenAPI to `spectral`, GitHub Action to `yamllint`. Missing tool produces an `ADVISORY` indeterminate (never a false `FAIL`).
|
|
58
|
+
- **Advisory-first.** A conformance violation on an `enforcement: advisory` gate is `ADVISORY` (severity `error`), exit 0 — logged, not blocking. `--strict` (or an engineer-promoted `enforcement: blocking` gate) turns a violation into `FAIL` (exit 1). Missing artifact produces `NOT_APPLICABLE`. Kill-switch (`AUDIT_HARNESS_DISABLE=1` / `.audit-harness.yml`) produces an empty `[]`, exit 0.
|
|
59
|
+
- **`tests/conform/`**: golden suite (31 checks) + pass/fail fixtures (valid + malformed SKILL.md, .mcp.json, plugin manifest, agent) — asserts valid to PASS, malformed to ADVISORY (default) / FAIL (`--strict`), every row validates against `gate-result/v1`, the NOT_APPLICABLE + indeterminate paths, and `policy_hash` == bundled-schema sha256 + reproducible. Wired into CI (`conform` job).
|
|
60
|
+
|
|
61
|
+
Scope boundary: conformance kinds without a bundled schema (`marketplace`, `hook`) resolve to `ADVISORY` indeterminate — drop a schema into `schemas/conform/v1/` to light them up, no code change. No gate *execution* for testing-depth/security yet (Phase 3+).
|
|
62
|
+
|
|
63
|
+
### Added — `classify` verb + `audit-profile/v1` (PP-PLAN-040 Phase 0 + Phase 1)
|
|
64
|
+
|
|
65
|
+
The first piece of the "comprehensive audit, on any repo" build: the read-only brain.
|
|
66
|
+
|
|
67
|
+
- **`audit-profile/v1` schema** (`schemas/audit-profile/v1.schema.json`): closed, versioned, hash-bearing value mirroring `gate-result/v1`. Four invariants: classifications are a UNION (not a winner), `unresolved[]` is the only Claude-refinable surface, `waived ⇒ disabled` (allOf-enforced), `registry_hash` makes a profile reproducible.
|
|
68
|
+
- **Canonical dimension→gate registry** (`schemas/audit-profile/registry.v1.json`): the single datum that answers "which gates apply to repo-type X, in which dimension, at what applicability" — `layer-applicability.md` and `TESTING.md` become projections of it.
|
|
69
|
+
- **`audit-harness classify [repo]`** (`scripts/classify.py`, stdlib-only): read-only repository classifier. Detects the UNION of repo-type + Claude-artifact classifications, resolves the gate set against the registry, records `registry_hash`, and emits an `audit-profile/v1` value to stdout. **Never writes to the repo.**
|
|
70
|
+
- **Safety levers**: `INDETERMINATE` result class (infra failure ≠ policy failure); dispatcher per-command supervision via `AUDIT_HARNESS_TIMEOUT` (kill a hung gate, exit 124); `AUDIT_HARNESS_DISABLE=1` kill-switch (gate commands no-op; classify emits an all-disabled profile); engineer-owned `.audit-harness.yml` override (`classify_pins`, `advisory`, `disable_gates`, `disable`) — see `.audit-harness.example.yml`.
|
|
71
|
+
- **`tests/classify/`**: golden fixture corpus (6 fixtures, authored before the classifier) + suite — golden-matches classifications, schema-validates every profile, exercises the kill-switch, the unknown/unresolved path, and override honoring. Wired into CI (`classify` job).
|
|
72
|
+
- **`schemas/` now ships in the npm package** (`files`) so the registry + schema are available to consumers on any repo.
|
|
73
|
+
|
|
74
|
+
Scope boundary: no `conform` verb, no gate execution yet (Phase 2+). `classify` is read-only and emits a profile only.
|
|
75
|
+
|
|
76
|
+
## [v1.1.5] - 2026-06-03
|
|
77
|
+
|
|
78
|
+
### Added — npm release pipeline (closes the publish-pipeline gap)
|
|
79
|
+
|
|
80
|
+
This is the first release published to npm via CI with Sigstore provenance. Until now the repo had **no release workflow** — npm was stuck at `0.1.0` while the code (and every other manifest) had advanced through `1.0.0` → `1.1.4`, four minors of CHANGELOG-documented work that never reached consumers. `npm install @intentsolutions/audit-harness` resolved to the stale `0.1.0` tarball.
|
|
81
|
+
|
|
82
|
+
- **`.github/workflows/release.yml`** (NEW): mirrors the provenance approach of `intent-eval-core`'s release workflow, adapted for this zero-dependency polyglot CLI (no pnpm, no lockfile, no TS build, no coverage). Triggers on `push` of a `v*.*.*` tag and on `workflow_dispatch`. Sets `id-token: write` for npm/Sigstore OIDC. Verifies the pushed tag matches `package.json#version` (skipped on manual dispatch since there's no tag), runs the `node bin/audit-harness.js --version` self-check + the repo's `escape-scan.sh --staged` test script (non-blocking on no-staged-diff), then `npm publish --provenance --access public`. The `NPM_TOKEN` repo secret is already configured.
|
|
83
|
+
|
|
84
|
+
### Fixed — package metadata + install.sh URLs for the `intent-audit-harness` repo rename
|
|
85
|
+
|
|
86
|
+
The GitHub repo was renamed `audit-harness` → `intent-audit-harness`, but the metadata still pointed at the old path.
|
|
87
|
+
|
|
88
|
+
- **`package.json`**: `homepage`, `repository.url`, and `bugs.url` repointed from `jeremylongshore/audit-harness` → `jeremylongshore/intent-audit-harness` (these render on npmjs.com).
|
|
89
|
+
- **`python/pyproject.toml` + `rust/Cargo.toml`**: project-URL fields (Homepage / Repository / Issues / Changelog / documentation) repointed to the renamed repo — these render on PyPI and crates.io.
|
|
90
|
+
- **`python/src/intent_audit_harness/__init__.py`**: docstring source-link repointed.
|
|
91
|
+
- **`README.md`**: the `curl … install.sh` line + the two "Related" skill links repointed to the renamed repo.
|
|
92
|
+
- **`install.sh`**: the `REPO=` variable, the usage-comment URLs at the top, and the re-run hint repointed; the default `VERSION` bumped from the stale `v0.1.0` → `v1.1.5`.
|
|
93
|
+
|
|
94
|
+
### Fixed — install.sh tarball-path glob broke after the rename
|
|
95
|
+
|
|
96
|
+
The GitHub archive tarball unpacks as `<repo>-<version>/`, which became `intent-audit-harness-1.1.5/` after the rename. The unpack-dir detection used `find … -name 'audit-harness-*'`, and `-name` matches the basename with no implicit leading wildcard, so it matched **nothing** under the new prefix — every vendored install would have failed at "could not find unpacked dir". Changed the glob to `-name '*audit-harness-*'` (leading wildcard), which matches both the current `intent-audit-harness-*` name and legacy `audit-harness-*` tags. Verified against both directory names.
|
|
97
|
+
|
|
98
|
+
### Added — README badge row
|
|
99
|
+
|
|
100
|
+
npm-version, License Apache-2.0, and Sigstore-provenance shields under the H1 (mirrors the `intent-eval-core` badge row). The "Part of the Intent Eval Platform" cross-link line is preserved.
|
|
101
|
+
|
|
102
|
+
### Changed — Version bumped to v1.1.5 across all manifests
|
|
103
|
+
|
|
104
|
+
Per the `version-canonical-check` CI gate (v1.0.2 PR #35). `package.json` (canonical), `version.txt`, `python/pyproject.toml`, `python/src/intent_audit_harness/__init__.py`, and `rust/Cargo.toml` all report `1.1.5`. (`rust/Cargo.lock` is gitignored; its working-tree entry is aligned for local cargo builds.)
|
|
105
|
+
|
|
106
|
+
### Why patch, not minor
|
|
107
|
+
|
|
108
|
+
No new CLI commands, no new flags, no API change, no script behavior change. This is release-engineering + metadata: the publish pipeline that ships the existing `1.1.x` code, plus URL corrections for the repo rename, plus the install.sh glob fix. The pinned policy scripts (`.harness-hash`) are untouched.
|
|
109
|
+
|
|
110
|
+
### Verification
|
|
111
|
+
|
|
112
|
+
- `npm pack --dry-run` → tarball contains `bin/`, `scripts/`, `README.md`, `LICENSE`, `NOTICE`, `CHANGELOG.md` per `package.json#files`
|
|
113
|
+
- `node bin/audit-harness.js --version` → `1.1.5`
|
|
114
|
+
- `bash -n install.sh` → exit 0; unpack-dir glob matches `intent-audit-harness-1.1.5` (and legacy `audit-harness-*`)
|
|
115
|
+
- `bash scripts/harness-hash.sh --verify` → OK (no pinned files changed)
|
|
116
|
+
|
|
117
|
+
## [v1.1.4] - 2026-05-25
|
|
118
|
+
|
|
119
|
+
### Fixed — gherkin-lint.sh prev_blank print-every-line noise (IEP P3, Gemini #71 review chain)
|
|
120
|
+
|
|
121
|
+
Closes `iah-gherkin-prev-blank-noise` (`bd_000-projects-o9q1`, P2). The third awk block in `scripts/gherkin-lint.sh` (the And-at-scenario-start checker) opened with a bare `prev_blank = 1` expression that awk interpreted as an always-true pattern with implicit `{ print }` default action — flooding stdout with every line of every feature file alongside the intentional ERROR printf. `prev_blank` was never USED anywhere in the awk script (verified via grep). Removed both touches: the top-level expression AND the assignment in the blank-line pattern (which was also unreachable for anything that mattered, since no downstream pattern read `prev_blank`). The third awk block now produces ONLY the targeted ERROR line when triggered. Verified via the same deliberate-failure test from v1.1.2 AAR — output before: full feature file printed interleaved with ERROR. Output after: just the ERROR line.
|
|
122
|
+
|
|
123
|
+
### Changed — gherkin-lint.sh process_awk_output() collapsed to single awk pass (Gemini #38 follow-up)
|
|
124
|
+
|
|
125
|
+
Closes `iah-gherkin-single-awk-opt` (`bd_000-projects-vawm`, P3). v1.1.2 introduced `process_awk_output()` with two awk subprocesses per call (one counting WARN, one counting ERROR). v1.1.4 collapses to a single awk pass via `read -r w e < <(awk '/^WARN /{w++} /^ERROR /{e++} END {print w+0, e+0}' <<< "$out")` per Gemini PR #39 verbatim suggestion. Halves the awk fork count (4 callsites × 2 subprocesses = 8 awk processes/feature → 4). Verified with mixed WARN+ERROR test: 2 WARNs + 1 ERROR in one feature file produces summary `2 warning(s), 1 error(s)` and exit 1.
|
|
126
|
+
|
|
127
|
+
### Fixed — crap-score.py exclusion sets deduplicated via EXCLUDED_DIRS constant (Gemini #71 review)
|
|
128
|
+
|
|
129
|
+
Closes `iah-crap-score-exclusion-dedup` (`bd_000-projects-niv8`, P2). Pre-v1.1.4, `scripts/crap-score.py` had TWO separate sets with overlapping intent but divergent contents:
|
|
130
|
+
|
|
131
|
+
- `ignore` set in `score_python()` (line 85): had `"reports"` but lacked `.next`, `.nuxt`, `.cache`
|
|
132
|
+
- `prune` set in `main()` (line 394, added v1.1.1 for `--json` input-hash walk): had `.next`, `.nuxt`, `.cache` but lacked `"reports"`
|
|
133
|
+
|
|
134
|
+
Asymmetry was a real bug: a repo with `reports/` would skip score_python's candidate scan but its `.py` files DID get hashed by the input-hash walk; opposite for `.next/.nuxt/.cache`. Fixed by extracting a single module-level constant `EXCLUDED_DIRS` (union of both prior sets) referenced by both call sites. Set contents: `.git`, `.venv`, `venv`, `node_modules`, `__pycache__`, `dist`, `build`, `target`, `.tox`, `.mypy_cache`, `.pytest_cache`, `.next`, `.nuxt`, `.cache`, `reports`.
|
|
135
|
+
|
|
136
|
+
### Changed — Shellcheck CI job version-pinned (parity with ruff v1.1.3)
|
|
137
|
+
|
|
138
|
+
Closes `iah-shellcheck-version-pin` (`bd_000-projects-v1ds`, P3). v1.1.2 (Phase A1) installed shellcheck via `apt-get install -y shellcheck` which pulls whatever Ubuntu's runner-image version happens to ship (currently 0.9.0). When the runner image upgrades shellcheck to 0.10.x or later, new rules activate silently and could surface findings in already-merged code. v1.1.4 pins to `v0.10.0` via download from the koalaman/shellcheck GitHub releases. CI step prints `shellcheck --version` for audit trail. To bump: edit `SHELLCHECK_VERSION` env in the workflow + run `shellcheck scripts/*.sh` locally + commit as explicit PR. Matches the ruff version-pin pattern from v1.1.3.
|
|
139
|
+
|
|
140
|
+
### Changed — Version bumped to v1.1.4 across all 5 manifests
|
|
141
|
+
|
|
142
|
+
Per the version-canonical-check CI gate (v1.0.2 PR #35). All 5 manifest locations now report `1.1.4`.
|
|
143
|
+
|
|
144
|
+
### Changed — `.harness-hash` regenerated
|
|
145
|
+
|
|
146
|
+
`scripts/gherkin-lint.sh` + `scripts/crap-score.py` modified; both are pinned. 2 of 9 pinned-file hashes change.
|
|
147
|
+
|
|
148
|
+
### Why patch, not minor
|
|
149
|
+
|
|
150
|
+
Pure cleanup release: dead-code removal, perf microoptimization, bug fixes for cross-call inconsistencies, CI version pin. No new CLI commands, no new flags, no API change. Consumers re-vendor / `pnpm up` and get the cleaner scripts + tighter CI transparently.
|
|
151
|
+
|
|
152
|
+
### Verification
|
|
153
|
+
|
|
154
|
+
- `shellcheck scripts/*.sh` → exit 0 (local 0.9.0; CI will run pinned 0.10.0)
|
|
155
|
+
- `ruff check` → `All checks passed!`
|
|
156
|
+
- `bash -n scripts/*.sh` → all pass
|
|
157
|
+
- `python3 -m py_compile scripts/crap-score.py + cli.py` → exit 0
|
|
158
|
+
- `bash scripts/harness-hash.sh --verify` → OK after `--init`
|
|
159
|
+
- gherkin-lint deliberate-failure test (And-at-start): exit 1, summary correct
|
|
160
|
+
- gherkin-lint mixed test (2 WARN + 1 ERROR): summary `2 warning(s), 1 error(s)`, exit 1
|
|
161
|
+
- Output noise gone: feature-file lines no longer printed alongside ERRORs
|
|
162
|
+
|
|
163
|
+
AAR: `000-docs/009-AA-AACR-v1.1.4-cleanup-bundle-2026-05-25.md`.
|
|
164
|
+
|
|
165
|
+
### Not bundled (separate scope)
|
|
166
|
+
|
|
167
|
+
`iah-python-wrapper-scripts-sync` (`bd_000-projects-65k4`) remains open. The Python wrapper's `python/src/intent_audit_harness/scripts/crap-score.py` (and the Rust wrapper's mirror) are stale by design — install.sh sources from canonical `scripts/` but wrapper packaging hasn't grown a build-time sync mechanism. Implementation requires choosing between hatch build-hook, Cargo build.rs, symlinks, or CI-enforced manual sync. Deferred to its own focused PR.
|
|
168
|
+
|
|
169
|
+
## [v1.1.3] - 2026-05-24
|
|
170
|
+
|
|
171
|
+
### Added — Ruff CI gate against own-code Python (IEP Convergence Debt Plan Priority 6 Phase A2)
|
|
172
|
+
|
|
173
|
+
Closes `iah-ruff` (`bd_000-projects-x9bs`, P1). New `.github/workflows/ci.yml` job `ruff (Python lint)` runs `ruff check` (version-pinned to 0.15.4 per the iah-shellcheck-version-pin lesson) against the own-code Python surface. Ruleset `select = ["B", "E", "F"]` — pyflakes (F) for dead imports + unused variables; pycodestyle errors (E) for syntax-level issues; **flake8-bugbear (B) for Python-specific bugs** (mutable default args, unreliable exception handling — added per Gemini PR #39 review after empirical confirmation that zero new findings fire on our codebase). Line length set to 120 (modern Python convention). Further ratchet (I import-order, UP pyupgrade, etc.) deferred to a future ratchet bead.
|
|
174
|
+
|
|
175
|
+
- New `ruff.toml` at repo root: lint scope = `scripts/*.py` + `python/src/intent_audit_harness/{__init__,__main__,cli}.py`; excludes `python/.venv/` + `python/src/intent_audit_harness/scripts/` + `rust/scripts/` (the last two are bundled-content mirrors of `scripts/*` — stale-sync tracked separately, see below).
|
|
176
|
+
- Version pinned via `pip install 'ruff==0.15.4'`; CI prints `ruff --version` for audit trail.
|
|
177
|
+
|
|
178
|
+
### Removed — 3 ruff-surfaced dead-code findings
|
|
179
|
+
|
|
180
|
+
- **`scripts/crap-score.py`**: redundant local `import hashlib, os` inside the `if args.json:` block was shadowing the module-level `import os`, causing ruff F401 against the top-level (which IS used by the same block). **Per Gemini PR #39 review (PEP 8 alignment)**, moved `hashlib` to module-level imports alongside the other stdlib imports; removed the local re-import entirely. The bandaid-comment explaining the local import is also gone.
|
|
181
|
+
- **`scripts/crap-score.py`**: dead local variable `metrics = rec.get("metrics", {}).get("cyclomatic", {})` in `score_rust()` (line 266; F841). Assigned but never read. The actual cyclomatic value is fetched freshly inside the loop on line 268.
|
|
182
|
+
- **`python/src/intent_audit_harness/cli.py`**: dead `import os` at line 12 (F401). Zero `os.*` usages in the file.
|
|
183
|
+
|
|
184
|
+
### Changed — Long-line reformat in scripts/crap-score.py
|
|
185
|
+
|
|
186
|
+
- Line 84 `ignore` set literal (155 chars) reformatted into a multi-line set literal that fits 120-char limit. Cosmetic; no behavior change.
|
|
187
|
+
|
|
188
|
+
### Changed — Version bumped to v1.1.3 across all 5 manifests
|
|
189
|
+
|
|
190
|
+
Per the version-canonical-check CI gate (v1.0.2 PR #35). All 5 manifest locations now report `1.1.3`.
|
|
191
|
+
|
|
192
|
+
### Changed — `.harness-hash` regenerated
|
|
193
|
+
|
|
194
|
+
`scripts/crap-score.py` is pinned by `.harness-hash-extra-patterns`; the dead-code removal + long-line reformat changes its hash. 1 of 9 pinned-file hashes change.
|
|
195
|
+
|
|
196
|
+
### Why patch, not minor
|
|
197
|
+
|
|
198
|
+
Pure lint-gate addition + dead-code removal. No new CLI commands, no new flags, no API change. Consumers re-vendor / `pnpm up` and get the cleaner scripts + the (new for them) ruff config transparently.
|
|
199
|
+
|
|
200
|
+
### Verification
|
|
201
|
+
|
|
202
|
+
- `ruff check` → `All checks passed!` on clean checkout
|
|
203
|
+
- `python3 -m py_compile scripts/crap-score.py` → exit 0
|
|
204
|
+
- `python3 -m py_compile python/src/intent_audit_harness/cli.py` → exit 0
|
|
205
|
+
- `shellcheck scripts/*.sh` → exit 0 (no regression on Phase A1)
|
|
206
|
+
- `bash scripts/harness-hash.sh --verify` → OK after `--init`
|
|
207
|
+
- CI ruff job will block any future PR that introduces a Python lint finding (F401, F841, E*, etc.)
|
|
208
|
+
|
|
209
|
+
### Follow-up bead filed
|
|
210
|
+
|
|
211
|
+
`iah-python-wrapper-scripts-sync` (new) — `python/src/intent_audit_harness/scripts/crap-score.py` is a stale mirror of `scripts/crap-score.py`, ~1 month behind canonical source. Missing the v1.1.1 `--json` envelope emission, the `which_or_none("go")` PATH guard, and the rglob-walk pruning. Same pattern likely in `rust/scripts/`. Either (a) build-time copy in the Python/Rust wrapper packaging, (b) symlink, or (c) hand-sync discipline with CI check. Currently excluded from ruff scope; exclusion drops once the sync mechanism ships.
|
|
212
|
+
|
|
213
|
+
AAR: `000-docs/008-AA-AACR-ruff-iep-P6-2026-05-24.md`.
|
|
214
|
+
|
|
215
|
+
### What unblocks next
|
|
216
|
+
|
|
217
|
+
P6 Phase A2 complete. Next-ready P6 work:
|
|
218
|
+
|
|
219
|
+
- A3: `iah-eslint-dispatcher` (`bd_000-projects-rnpy`) — eslint coverage for `bin/audit-harness.js`
|
|
220
|
+
- B1: `iep-shared-lint-configs` — `.audit-harness-configs/` for vendoring lint configs to consumer repos
|
|
221
|
+
- Plus 2 bundleable Gemini-found fixes from v1.1.2 review: `iah-gherkin-prev-blank-noise` + `iah-gherkin-single-awk-opt`
|
|
222
|
+
|
|
223
|
+
## [v1.1.2] - 2026-05-24
|
|
224
|
+
|
|
225
|
+
### Changed — Shellcheck CI gate flipped from tolerant to hard-fail (IEP Convergence Debt Plan Priority 6 Phase A1)
|
|
226
|
+
|
|
227
|
+
Closes `iah-shellcheck-hard-fail` (`bd_000-projects-4asc`, P1). The shellcheck job in `.github/workflows/ci.yml` previously ran `shellcheck scripts/*.sh || true` — warnings and errors were logged but never blocked the PR. As of this release the `|| true` suffix is removed: any shellcheck finding (warning or error) blocks the build. The locked precondition was v1.1.1 (PR #37) which addressed the 6 Gemini-flagged robustness findings — the surface was already clean enough that flipping the gate exposed exactly 3 residual dead-code findings, all fixed below.
|
|
228
|
+
|
|
229
|
+
### Removed — 3 pieces of dead code surfaced by the harder shellcheck gate
|
|
230
|
+
|
|
231
|
+
- **`scripts/bias-count.sh`**: `declare -A PATTERN_COUNTS` plus the per-call `PATTERN_COUNTS["$label"]=$count` assignment in `count_pattern()`. SC2034: the associative array was populated but never read. Per-pattern counts are still printed inline (line 61) and are aggregated into `TOTAL_BIAS` for the JSON output `bias_total` metadata field; the per-pattern breakdown was apparently intended for a richer JSON shape that was never wired. Restoring it would be a feature, not a fix; filed as deferred scope if a consumer asks.
|
|
232
|
+
- **`scripts/emit-evidence.sh`**: `INPUT_HASH_HEX="$(echo "$STATEMENT" | python3 -c ...)"` (formerly line 238). SC2034: computed but never read. Vestige from an earlier cosign integration; the surrounding `BLOB_FILE` construction relies on `ARTIFACT_NAME` only.
|
|
233
|
+
- **`scripts/gherkin-lint.sh`**: `err()` helper function. SC2317: zero call sites in the file (verified via `grep -n "\berr\b"` — only the definition matches). The helper was defined symmetrically with `warn()` but never wired up to the awk rubric or the subprocess-fallback path. Replaced with `process_awk_output()` helper (see Fixed section below).
|
|
234
|
+
|
|
235
|
+
### Fixed — gherkin-lint.sh awk subprocess undercount (silent-failure class bug; Gemini PR #38 review)
|
|
236
|
+
|
|
237
|
+
While processing the SC2317 cleanup above, Gemini's PR #38 review surfaced a deeper bug: the gherkin-lint.sh awk-fallback path printed `WARN`/`ERROR` lines via `awk printf` but those subprocesses never incremented the parent shell's `WARN_COUNT`/`ERROR_COUNT` counters. The summary line said "0 warnings, 0 errors" while errors were actively being printed; the exit code stayed 0 regardless. Exactly the silent-failure class the linter exists to surface in OTHER projects.
|
|
238
|
+
|
|
239
|
+
- **New `process_awk_output()` helper**: wraps each awk subprocess, captures its output, counts `WARN` / `ERROR` lines via inline awk (`'/^WARN /{c++} END{print c+0}'` — set-euo-pipefail safe, no `|| true` needed), increments the bash counters, then re-prints. 4 awk blocks now feed through it.
|
|
240
|
+
- **Verification**: deliberate-failure test against a feature with `Scenario: ... \n And ...` produces exit code 1 + summary `0 warning(s), 1 error(s)` (was: exit 0 + `0 warning(s), 0 error(s)` while still printing the ERROR line). Clean feature still exits 0.
|
|
241
|
+
- **Separate-scope finding**: the third awk script contains a stray top-level `prev_blank = 1` that awk treats as an always-true pattern, triggering its default print-every-line action. That's a pre-existing cosmetic issue (extra noise in script output) but not a counter bug — filed as deferred scope.
|
|
242
|
+
|
|
243
|
+
### Changed — Version bumped to v1.1.2 across all 5 manifests
|
|
244
|
+
|
|
245
|
+
Per the version-canonical-check CI gate (v1.0.2 PR #35). All 5 committed manifest locations now report `1.1.2`:
|
|
246
|
+
|
|
247
|
+
- `package.json`
|
|
248
|
+
- `version.txt`
|
|
249
|
+
- `python/pyproject.toml`
|
|
250
|
+
- `python/src/intent_audit_harness/__init__.py`
|
|
251
|
+
- `rust/Cargo.toml`
|
|
252
|
+
|
|
253
|
+
### Changed — `.harness-hash` regenerated
|
|
254
|
+
|
|
255
|
+
The self-pinning manifest is regenerated to capture the new script hashes (per `iep-P3 iah-self-pin` v1.1.0 mechanism). 3 of 9 pinned-file hashes change (the 3 modified scripts); 6 unchanged.
|
|
256
|
+
|
|
257
|
+
### Why patch, not minor
|
|
258
|
+
|
|
259
|
+
Pure dead-code removal + a CI policy tightening. No new CLI commands, no new flags, no API change, no behavioral change for any consumer. Downstream consumers re-vendor (or `pnpm up`) and get the cleaner scripts transparently.
|
|
260
|
+
|
|
261
|
+
### Verification
|
|
262
|
+
|
|
263
|
+
- `shellcheck scripts/*.sh` → exit 0 on a clean checkout (verified locally before push)
|
|
264
|
+
- `bash -n scripts/*.sh` → all pass
|
|
265
|
+
- `python3 -m py_compile scripts/crap-score.py` → exit 0
|
|
266
|
+
- `bash scripts/harness-hash.sh --verify` → harness-hash: OK after `--init`
|
|
267
|
+
- CI shellcheck job will now block on any future warning — try staging `cmd $var` (unquoted expansion) to verify the gate fires
|
|
268
|
+
|
|
269
|
+
AAR: `000-docs/007-AA-AACR-shellcheck-hard-fail-iep-P6-2026-05-24.md`.
|
|
270
|
+
|
|
271
|
+
### What this unblocks in the IEP Convergence Debt Plan
|
|
272
|
+
|
|
273
|
+
P6 Phase A1 closed. Next-ready P6 work:
|
|
274
|
+
|
|
275
|
+
- A2: `iah-ruff` — add Python ruff CI gate
|
|
276
|
+
- A3: `iah-eslint-dispatcher` — add eslint coverage for `bin/audit-harness.js`
|
|
277
|
+
- A4: `iah-script-robustness-upstream` (already shipped in v1.1.1; nothing more to do)
|
|
278
|
+
|
|
279
|
+
## [v1.1.1] - 2026-05-23
|
|
280
|
+
|
|
281
|
+
### Fixed — 6 script robustness + portability fixes (IEP Convergence Debt Plan Priority 3)
|
|
282
|
+
|
|
283
|
+
Closes `iah-script-robustness-upstream` (`bd_000-projects-qqkq`, P2). Addresses the 6 medium-severity Gemini findings surfaced when audit-harness scripts were vendored into `intent-eval-lab` via `iep-harness-hash-platform-rollout` (PR #67). All fixes are upstream-only: zero CLI surface change, zero runtime-dep change, zero policy change.
|
|
284
|
+
|
|
285
|
+
- **`scripts/escape-scan.sh`** (mktemp leak): `--staged` and `--range` modes allocate a temp file via `mktemp` to capture the diff but never clean it up. Adds `trap 'rm -f "$DIFF_SRC"' EXIT` immediately after each `mktemp` so the temp file is removed on every exit path (clean exit, REFUSE, CHALLENGE, signal). Matters most when escape-scan runs as a local git hook where temp accumulation is silent.
|
|
286
|
+
- **`scripts/crap-score.py`** (missing `go` PATH guard): `score_go()` called `run(["go", "test", "-coverprofile=...", ...])` without first checking that `go` is on PATH, so on systems without Go installed the subprocess raised `FileNotFoundError` and aborted the whole CRAP pass. Wraps the call in the existing `which_or_none("go")` pattern already used for `radon`, `gocyclo`, and the downstream `go tool cover` invocation.
|
|
287
|
+
- **`scripts/crap-score.py`** (rglob walk pruning): the `--json` input-hash computation walked every file under `root` via `rglob("*")`, only filtering `node_modules` / `.venv` after the directory had been traversed. Replaces with `os.walk` + `dirs[:] = [...]` in-place pruning, skipping `.git`, `node_modules`, `.venv`/`venv`, `__pycache__`, `dist`, `build`, `target`, `.tox`, `.mypy_cache`, `.pytest_cache`, `.next`, `.nuxt`, `.cache`. Major perf win on large repos; no behavioral change to the resulting hash for repos without pruned-extension files under those directories.
|
|
288
|
+
- **`scripts/emit-evidence.sh`** (shell→Python path injection): `python3 -c "import json, sys; print(json.load(open('$PKG_JSON'))['version'])"` interpolated the shell variable directly into the Python source. Paths containing single quotes (or arbitrary characters in adversarial cases) broke the parse. Now passes `$PKG_JSON` via `sys.argv[1]` — `python3 -c "import json, sys; print(json.load(open(sys.argv[1]))['version'])" "$PKG_JSON"` — moving the path through the safe argv channel.
|
|
289
|
+
- **`scripts/bias-count.sh`** (per-file sha256sum fork): `find ... -exec sha256sum {} \;` spawned one `sha256sum` process per matched file. Changes the terminator to `+` so `find` batches arguments into one (or few) sha256sum invocations. Perf win on test suites with many files; output identical because the downstream `sort | sha256sum` step normalizes.
|
|
290
|
+
- **`scripts/harness-hash.sh`** (cross-platform sha256sum): GNU coreutils ships `sha256sum`, macOS ships `shasum -a 256`. Adds detection at script top selecting whichever is available into a `SHA256_CMD` bash array, falling back with a clear error if neither is on PATH. Both produce identical `<hash> <file>` output, so the manifest format and downstream `awk` parsing are byte-equivalent. Enables engineer-local runs on macOS without forcing every contributor to install coreutils.
|
|
291
|
+
|
|
292
|
+
### Changed — Version bumped to v1.1.1 across all 5 manifests
|
|
293
|
+
|
|
294
|
+
Per the version-canonical-check CI gate (added in v1.0.2 PR #35). All 5 committed manifest locations now report `1.1.1`:
|
|
295
|
+
|
|
296
|
+
- `package.json`
|
|
297
|
+
- `version.txt`
|
|
298
|
+
- `python/pyproject.toml`
|
|
299
|
+
- `python/src/intent_audit_harness/__init__.py`
|
|
300
|
+
- `rust/Cargo.toml`
|
|
301
|
+
|
|
302
|
+
### Changed — `.harness-hash` regenerated
|
|
303
|
+
|
|
304
|
+
The self-pinning manifest is regenerated to capture the new script hashes (per `iep-P3 iah-self-pin` v1.1.0 mechanism). The 6 script edits change 4 of the 9 pinned-file hashes; `--init` rewrites the manifest.
|
|
305
|
+
|
|
306
|
+
### Why patch, not minor
|
|
307
|
+
|
|
308
|
+
Pure bug + portability fixes. No new flags, no new commands, no policy change, no breaking change to the manifest format. Downstream consumers re-vendor (or re-install via the polyglot installers) and get the improvements transparently.
|
|
309
|
+
|
|
310
|
+
### Why this matters for the platform
|
|
311
|
+
|
|
312
|
+
The scripts in this release are now vendored into `intent-eval-lab` (per `iep-harness-hash-platform-rollout` rollout 1, lab PR #67) and will land in `j-rig-binary-eval` next. Bug-fix patches travel via re-vendor — `AUDIT_HARNESS_VERSION=v1.1.1 curl -sSL https://raw.githubusercontent.com/jeremylongshore/audit-harness/main/install.sh | bash` for vendored consumers, `pnpm up @intentsolutions/audit-harness` for node consumers. Landing the fixes before the rollout reaches more repos avoids re-publishing buggy vendored copies that immediately need replacement.
|
|
313
|
+
|
|
314
|
+
AAR: `000-docs/006-AA-AACR-script-robustness-upstream-iep-P3-2026-05-23.md`.
|
|
315
|
+
|
|
316
|
+
### Sequencing impact on Priority 6 Phase A1
|
|
317
|
+
|
|
318
|
+
Priority 6 Phase A1 (`iah-shellcheck-hard-fail`) flips `.github/workflows/ci.yml:89` from `shellcheck scripts/*.sh || true` to hard-fail. Per the IEP Convergence Debt Plan risk-mitigation table ("Flipping shellcheck to hard-fail breaks existing audit-harness CI — mitigation: land fixes for Gemini's 6 findings FIRST, THEN flip the gate"), this release is the explicit precondition for the shellcheck flip. Phase A1 PR opens after v1.1.1 lands on main.
|
|
319
|
+
|
|
320
|
+
## [v1.1.0] - 2026-05-22
|
|
321
|
+
|
|
322
|
+
### Added — Per-repo `.harness-hash-extra-patterns` mechanism + audit-harness self-pin (IEP Convergence Debt Plan Priority 3)
|
|
323
|
+
|
|
324
|
+
Closes `iah-self-pin` (`bd_000-projects-itpl`, P1). The harness's own policy enforcement surface (scripts/*.sh + scripts/*.py + bin/audit-harness.js) is now hash-pinned at the audit-harness repo root. CI's `audit-harness list` + `harness-hash --verify` self-check steps are flipped from `|| true` exit-3 tolerance to hard-fail: any byte change to a pinned policy file without a fresh `--init` + commit of the regenerated `.harness-hash` exits 2 (HARNESS_TAMPERED) and blocks the PR.
|
|
325
|
+
|
|
326
|
+
- **`scripts/harness-hash.sh`**: NEW — reads an optional `.harness-hash-extra-patterns` file at the repo root and appends its lines to the default PATTERNS array. Comments (`#`) + blank lines ignored. Backward-compatible: repos without the file get exactly the previous behavior — consumer repos are not affected.
|
|
327
|
+
- **`.harness-hash-extra-patterns`** (NEW, audit-harness repo root): pins `scripts/*.sh`, `scripts/*.py`, `bin/audit-harness.js`, and the extras file itself (preventing silent edits to the self-pinning scope).
|
|
328
|
+
- **`.harness-hash`** (NEW, audit-harness repo root): 9-file manifest produced by `bash scripts/harness-hash.sh --init`. Committed to main.
|
|
329
|
+
- **`.github/workflows/ci.yml`**: `audit-harness list` + `harness-hash --verify` self-check steps drop `|| true` suffixes. Hard-fail in place. Comment block updated.
|
|
330
|
+
|
|
331
|
+
### Why minor not patch
|
|
332
|
+
|
|
333
|
+
The `.harness-hash-extra-patterns` mechanism is a new authored feature surface — repos that opt in get a new capability. Per SemVer, minor bump. Existing repos (zero adopters today; this is the first one) are unaffected.
|
|
334
|
+
|
|
335
|
+
### Why this matters
|
|
336
|
+
|
|
337
|
+
Before this release, the audit-harness CI workflow could not enforce its own policy. The "harness tests itself" design rule (CLAUDE.md rule 5) was aspirational — `audit-harness list` and `harness-hash --verify` both exited 0 when no manifest existed (intentional tolerance to avoid false-failing every PR). A silent edit to `scripts/escape-scan.sh` (the gate that REFUSES threshold-lowering changes) would pass CI. That's the failure mode this release closes.
|
|
338
|
+
|
|
339
|
+
### Cross-platform-rollout note
|
|
340
|
+
|
|
341
|
+
`iep-harness-hash-platform-rollout` (`bd_000-projects-g6zu`) unblocks on this release. The remaining 4 IEP repos (intent-eval-lab, j-rig-binary-eval, intent-rollout-gate — kernel already pinned) can now copy this pattern using their own `.harness-hash-extra-patterns` to pin per-repo policy files (CI workflow definitions, governance docs, vendored harness wrappers).
|
|
342
|
+
|
|
343
|
+
### Changed — Version bumped to v1.1.0 across all 5 manifests
|
|
344
|
+
|
|
345
|
+
Per the version-canonical-check CI gate landed in v1.0.2 (PR #35). All 5 committed manifest locations now report `1.1.0`.
|
|
346
|
+
|
|
347
|
+
AAR: `000-docs/005-AA-AACR-iah-self-pin-iep-P3-2026-05-22.md`.
|
|
348
|
+
|
|
349
|
+
## [v1.0.2] - 2026-05-21
|
|
350
|
+
|
|
351
|
+
### Chore — Polyglot manifest alignment + Apache-2.0 NOTICE inclusion in distributions (IEP Convergence Debt Plan Priority 3)
|
|
352
|
+
|
|
353
|
+
Aligned all polyglot manifests (`package.json` + `version.txt` + `python/pyproject.toml` + `python/src/intent_audit_harness/__init__.py` + `rust/Cargo.toml` + `rust/Cargo.lock`) at version `1.0.2`. Bumped from npm `v1.0.1` → `v1.0.2` (rather than aligning the PyPI/crates.io wrappers to npm's `v1.0.1`) so all four registries publish lockstep from this release forward — preserves the immutability of the already-shipped npm `v1.0.1` tarball. Added a CI gate that fails any future drift. Folded NOTICE file inclusion into Python sdist + Rust crate distributions per Apache-2.0 § 4. No CLI surface or runtime behavior changes — pure metadata + packaging alignment.
|
|
354
|
+
|
|
355
|
+
- `package.json`: version `1.0.1` → `1.0.2`
|
|
356
|
+
- `version.txt`: `0.2.0` → `1.0.2`
|
|
357
|
+
- `python/pyproject.toml`: version `0.1.0` → `1.0.2`; license `MIT` → `Apache-2.0`; PyPI classifier updated to "License :: OSI Approved :: Apache Software License"; `[tool.hatch.build.targets.sdist].include` adds `/LICENSE` + `/NOTICE` per Apache-2.0 § 4
|
|
358
|
+
- `python/src/intent_audit_harness/__init__.py`: `__version__` `0.1.0` → `1.0.2`
|
|
359
|
+
- `rust/Cargo.toml`: version `0.1.0` → `1.0.2`; license `MIT` → `Apache-2.0`; `include` adds `NOTICE` per Apache-2.0 § 4
|
|
360
|
+
- `rust/Cargo.lock`: package entry version `1.0.1` → `1.0.2` (file is gitignored but the working-tree state is consistent for cargo builds)
|
|
361
|
+
- `.github/workflows/ci.yml`: NEW `version-canonical-check` job — fails if any of the 5 tracked version locations diverge from `package.json`, or if any non-npm manifest carries a non-`Apache-2.0` license. The gate also includes a robustness check for `rust/Cargo.lock` (currently gitignored; no-ops gracefully when the file isn't present in CI checkout).
|
|
362
|
+
|
|
363
|
+
Closes beads (pending PR merge): `iah-version-drift` (bd_000-projects-uoz3), `iah-license-drift` (bd_000-projects-ck2e), `iah-version-canonical-check` (bd_000-projects-hd5y). AAR at `000-docs/004-AA-AACR-polyglot-version-license-alignment-2026-05-21.md`.
|
|
364
|
+
|
|
365
|
+
Notes for downstream consumers:
|
|
366
|
+
|
|
367
|
+
- **npm** users: `v1.0.2` is purely metadata + packaging — no observable behavior change vs. `v1.0.1`. Upgrade at your convenience.
|
|
368
|
+
- **PyPI + crates.io** users: this is the first published `v1.0.2` and the first published Apache-2.0 release on these registries. The prior published `0.1.0` artifacts pre-date the `v1.0.0` Apache-2.0 relicense and remain available under their original MIT terms (registry tarballs are immutable). From `v1.0.2` forward all four registries publish lockstep at the same SemVer.
|
|
369
|
+
|
|
370
|
+
## [v1.0.1] - 2026-05-20
|
|
371
|
+
|
|
372
|
+
### Fixed — NOTICE in published tarball
|
|
373
|
+
|
|
374
|
+
- Added `NOTICE` to `package.json#files` so the file ships in the npm tarball alongside `LICENSE`. Per Apache 2.0 § 4, derivatives must carry the NOTICE file's attribution text if one exists in the source. `v1.0.0` shipped the relicense to Apache 2.0 but the tarball only carried `LICENSE` — this corrects that omission.
|
|
375
|
+
|
|
376
|
+
No code, behavior, CLI, or dependency changes — packaging-only patch.
|
|
377
|
+
|
|
378
|
+
## [v1.0.0] - 2026-05-19
|
|
379
|
+
|
|
380
|
+
### Changed — License (BREAKING)
|
|
381
|
+
|
|
382
|
+
- **Relicensed from MIT to Apache 2.0.** Deliberate alignment with the rest of the Intent Eval Platform ecosystem (`intent-eval-lab`, `intent-eval-core`) so every repo ships under a single OSI-approved license with explicit patent-grant language.
|
|
383
|
+
- Existing `0.x` releases on npm remain available under their original MIT terms (npm tarballs are immutable). All releases `>= 1.0.0` are Apache 2.0.
|
|
384
|
+
- Added `NOTICE` file per Apache 2.0 best practice with copyright attribution and license summary.
|
|
385
|
+
- README license section updated to reflect the change with a backward-compat note.
|
|
386
|
+
|
|
387
|
+
No code, CLI surface, behavior, or runtime dependency changes in this release — license-only bump cut as MAJOR for legal clarity and consumer review signaling.
|
|
388
|
+
|
|
389
|
+
## [v0.3.0] - 2026-05-12
|
|
390
|
+
|
|
391
|
+
### Added — Evidence Bundle emission (Milestone 2 of the build journey)
|
|
392
|
+
|
|
393
|
+
- `--json` flag on every gate (`escape-scan`, `harness-hash --verify`, `arch`, `bias`,
|
|
394
|
+
`gherkin-lint`, `crap`). Emits a machine-readable gate-result envelope to stdout while
|
|
395
|
+
preserving the existing human-readable text on stderr. Exit codes unchanged.
|
|
396
|
+
- `emit-evidence` subcommand. Reads a gate-result envelope from stdin (or `--input`),
|
|
397
|
+
augments it with `timestamp`, `runner`, `commit_sha`, and emits a complete
|
|
398
|
+
[in-toto Statement v1](https://github.com/in-toto/attestation/blob/main/spec/v1/statement.md)
|
|
399
|
+
with `predicateType` `https://evals.intentsolutions.io/gate-result/v1` per
|
|
400
|
+
[`evidence-bundle/v0.1.0-draft/SPEC.md`](https://github.com/jeremylongshore/intent-eval-lab/blob/main/specs/evidence-bundle/v0.1.0-draft/SPEC.md).
|
|
401
|
+
Optional `--sign` (cosign keyless or `--key`), `--rekor-url` for transparency-log push.
|
|
402
|
+
OTel `agent.rollout.gate.evaluated` event when `AUDIT_HARNESS_OTEL=1` or
|
|
403
|
+
`OTEL_EXPORTER_OTLP_ENDPOINT` set (best-effort no-op otherwise).
|
|
404
|
+
- `SEMVER.md` — explicit SemVer commitment doc covering exit codes, stream contracts,
|
|
405
|
+
and the predicate URI freeze.
|
|
406
|
+
- `tests/regression/run-regression.sh` — backward-compat regression suite. 11 checks
|
|
407
|
+
across text-mode parity, `--json` stream separation, schema validation, and the
|
|
408
|
+
`emit-evidence` pipeline.
|
|
409
|
+
- CI: `regression` job in `.github/workflows/ci.yml` runs the regression suite on every PR.
|
|
410
|
+
|
|
411
|
+
### Changed
|
|
412
|
+
|
|
413
|
+
- `bin/audit-harness.js` dispatcher exposes the new `emit-evidence` subcommand.
|
|
414
|
+
- `scripts/arch-check.sh` `--json` output reshaped to the gate-result envelope shape
|
|
415
|
+
(the prior single-line `{"tool","status","violations","log"}` was internal — no
|
|
416
|
+
documented adopter parsed it).
|
|
417
|
+
|
|
418
|
+
### Notes
|
|
419
|
+
|
|
420
|
+
- **No breaking changes.** Pre-v0.3.0 callers see identical text-mode output and exit
|
|
421
|
+
codes. The `--json` flag is purely additive.
|
|
422
|
+
- **CISO gate (per ISEDC v1 Q1, 2026-05-10):** pushing a signed Statement to Rekor
|
|
423
|
+
against `evals.intentsolutions.io/gate-result/v1` is BLOCKED until DNSSEC + CAA
|
|
424
|
+
records are verified on the namespace. The script supports unsigned envelope
|
|
425
|
+
emission until that gate clears (tracked in `intent-eval-lab/.beads/` as `iel-4zr`).
|
|
426
|
+
- **Plan reference:** `~/.claude/plans/se-the-council-bubbly-frog.md` Milestone 2.
|
|
427
|
+
|
|
428
|
+
## [v0.2.0] - 2026-05-10
|
|
429
|
+
|
|
430
|
+
- docs: add release.yml — complete /repo-dress 21-file canon (c0298ef)
|
|
431
|
+
- docs: fill baseline OSS governance gaps via /repo-dress (closes #10) (29a8520)
|
|
432
|
+
- docs: Part 2 Workstream A upgrade landscape (c967f3e)
|
|
433
|
+
- docs(CLAUDE.md): add three-repo convergence section (b8255a3)
|
|
434
|
+
- infra: convergence Phase A.0 + A — bd init, GH templates, CI workflow, design notes (8f30db4)
|
|
435
|
+
- bd init: initialize beads issue tracking (ffc7597)
|
|
436
|
+
- feat: add PyPI and crates.io wrappers for audit-harness (9b97217)
|
|
437
|
+
|
|
3
438
|
All notable changes to `@intentsolutions/audit-harness` are documented here.
|
|
4
439
|
|
|
5
440
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/),
|