sigmap 5.7.0 → 5.9.0

package/CHANGELOG.md

@@ -10,6 +10,49 @@ Format: [Semantic Versioning](https://semver.org/)
 
 ---
 
+## [5.9.0] — 2026-04-18
+
+### Added
+
+- **`sigmap bench --submit`** — new CLI command that reads `version.json` + local `.context/benchmark-history.ndjson` and formats a shareable community benchmark submission block (text and `--json`).
+- **`scripts/verify-checksums.mjs`** — new standalone script to verify a downloaded binary against its `.sha256` checksum file; exits 0 on match, 1 on mismatch.
+- **SHA-256 checksum generation in `build-binary.mjs`** — each binary build now writes a matching `dist/<artifact>.sha256` file automatically.
+- **22 integration tests** in `test/integration/v590-binary-polish.test.js` covering all acceptance criteria.
+
+### Changed
+
+- **`scripts/verify-binary.mjs`** — extended smoke tests with 5 new checks (tests 6–10): `ask`, `weights`, `history`, `bench --submit`, and `bench --submit --json`.
+- **`version.json`** — bumped to `5.9.0`, `benchmark_id` updated to `sigmap-v5.9-main`.
+- **`test/integration/v580-trust-completion.test.js`** — version assertion relaxed from exact `5.8.0` to `>= 5.8.0` so future releases don't break the test.
+
+---
+
+## [5.8.0] — 2026-04-18
+
+### Added
+
+- **`docs-vp/guide/compare-alternatives.md`** — new page comparing SigMap vs embeddings/RAG, RepoMix, Copilot context, and manual curation with side-by-side tables.
+- **`docs-vp/guide/walkthrough.md`** — end-to-end walkthrough on a real repo (gin): ask → validate → judge → learn, with before/after token and cost table.
+- **Canonical benchmark header block** — `:::info` snapshot block added to all 5 benchmark guide pages (benchmark, retrieval, task, quality, generalization), each referencing `sigmap-v5.8-main`.
+- **30-second demo strip** — homepage `docs/index.html` now shows a terminal demo section (ask → validate → judge) directly below the stats bar.
+- **User-type routing table** — `docs-vp/index.md` landing now opens with a "Who is this for?" table routing new users, daily users, team setup, MCP users, and monorepo evaluators.
+- **Both new guide pages in sidebar** — `compare-alternatives` and `walkthrough` added under a new "Guides" section in `docs-vp/.vitepress/config.mts`.
+- **`version.json` — `retrieval_lift` field** — `metrics.retrieval_lift: 5.9` added; `version` bumped to `5.8.0`; `benchmark_id` updated to `sigmap-v5.8-main`.
+- **33 new integration tests** in `test/integration/v580-trust-completion.test.js` covering all 7 acceptance criteria.
+
+### Changed
+
+- **`version.json`** — bumped to `5.8.0`, `benchmark_id` updated to `sigmap-v5.8-main`.
+- **SVG metrics** — `docs/impact-banner.svg`: `78.9%→80.0%` hit@5, `1.69→1.68` prompts, `40.6%→40.8%` prompt reduction card, "hallucinates" replaced with "unsupported answers"; `docs/comparison-chart.svg`: `78.9%→80.0%`.
+- **`docs/index.html`** — `softwareVersion` structured-data updated to `5.8.0`; stats bar language count corrected from `21` to `29`.
+- **`docs/readmes/vscode-extension.md`** — language count updated from `21` to `29 languages and formats` in badge, table, and architecture diagram.
+- **`docs-vp/index.md`** — tagline updated to remove stale v5.5 text; `v5.7.0` snapshot reference updated to `v5.8.0`; stale v5.5 launch strip replaced with v5.8 announcement.
+- **Benchmark sub-pages** — `retrieval-benchmark.md`, `task-benchmark.md`, `quality-benchmark.md`, `generalization.md` all updated to `v5.8.0` as latest saved run.
+- **`generalization.md`** — adds "Why this matters" intro callout; stale `v5.5.0` snapshot reference updated to `v5.8.0`.
+- **`v560-docs-sync` tests** — version assertions updated to accept `v5.8.0` as the current benchmark version.
+
+---
+
 ## [5.7.0] — 2026-04-17
 
 ### Added

package/README.md

@@ -25,13 +25,13 @@ npx sigmap   # 10 seconds. zero config. your AI never reads the wrong file again
 - Fewer retries (1.68 vs 2.84 prompts per task)
 - Far smaller context (~2K–4K tokens instead of ~80K)
 
-> Latest: **v5.7.0** — Growth & Positioning. Canonical `version.json`, README rewrite, language count corrected to 29 everywhere, softwareVersion updated, stale metrics replaced with official v5.7 snapshot.
+> Latest: **v5.9.0** — Binary Polish & Community Benchmarks. SHA-256 checksum generation for binaries, `sigmap bench --submit` for community benchmark sharing, extended binary smoke tests covering the full v5.x workflow.
 
-**What's new in v5.7**
-- Canonical `version.json` — single source of truth for version, metrics, language count
-- README and all docs updated to official v5.7 benchmark snapshot
-- All surfaces now say `29 languages and formats` (corrected from 21)
-- 30-second quickstart and proof strip added to README
+**What's new in v5.9**
+- `sigmap bench --submit` — formats local benchmark history as a shareable community block (text and `--json`)
+- Binary builds now write a `.sha256` checksum file alongside each artifact
+- `scripts/verify-checksums.mjs` — verify any downloaded binary against its checksum
+- Extended `verify-binary.mjs` smoke tests: `ask`, `weights`, `history`, `bench --submit`
 
 **Daily workflow**
 

package/gen-context.js

@@ -5291,7 +5291,7 @@ __factories["./src/mcp/server"] = function(module, exports) {
   
   const SERVER_INFO = {
     name: 'sigmap',
-  version: '5.7.0',
+  version: '5.9.0',
     description: 'SigMap MCP server — code signatures on demand',
   };
   
@@ -7009,7 +7009,7 @@ const path = require('path');
 const os = require('os');
 const { execSync } = require('child_process');
 
-const VERSION = '5.7.0';
+const VERSION = '5.9.0';
 const MARKER = '\n\n## Auto-generated signatures\n<!-- Updated by gen-context.js -->\n';
 
 function requireSourceOrBundled(key) {
@@ -9081,6 +9081,74 @@ function main() {
     process.exit(0);
   }
 
+  // v5.9: `sigmap bench --submit` — format local benchmark history as a shareable community block
+  if (args[0] === 'bench' && args.includes('--submit')) {
+    const versionMeta = (() => {
+      try { return JSON.parse(fs.readFileSync(path.join(__dirname, 'version.json'), 'utf8')); }
+      catch (_) { return {}; }
+    })();
+
+    const histPath = path.join(cwd, '.context', 'benchmark-history.ndjson');
+    let localMetrics = null;
+    if (fs.existsSync(histPath)) {
+      try {
+        const entries = fs.readFileSync(histPath, 'utf8').trim().split('\n')
+          .map((l) => { try { return JSON.parse(l); } catch (_) { return null; } }).filter(Boolean);
+        const ret = [...entries].reverse().find((e) => e.type === 'retrieval');
+        const tok = [...entries].reverse().find((e) => e.type === 'token-reduction');
+        if (ret || tok) {
+          localMetrics = {
+            hitAt5Pct:       ret ? (ret.hitAt5Pct || Math.round((ret.hitAt5 || 0) * 100)) : null,
+            reductionPct:    tok ? (tok.reduction || tok.avgReductionPct || null) : null,
+            runDate:         (ret || tok).ts ? new Date((ret || tok).ts).toISOString().slice(0, 10) : null,
+          };
+        }
+      } catch (_) {}
+    }
+
+    const canonical = versionMeta.metrics || {};
+    const submission = {
+      sigmapVersion:     versionMeta.version || 'unknown',
+      benchmarkId:       versionMeta.benchmark_id || 'unknown',
+      canonicalHitAt5:   canonical.hit_at_5 != null ? Math.round(canonical.hit_at_5 * 1000) / 10 : null,
+      canonicalReduction: canonical.overall_token_reduction_pct || null,
+      local:             localMetrics,
+      submittedAt:       new Date().toISOString().slice(0, 10),
+    };
+
+    if (args.includes('--json')) {
+      process.stdout.write(JSON.stringify(submission, null, 2) + '\n');
+    } else {
+      const bar = '─'.repeat(56);
+      const lines = [
+        bar,
+        ' SigMap Community Benchmark Submission',
+        bar,
+        ` SigMap version : ${submission.sigmapVersion}`,
+        ` Benchmark ID   : ${submission.benchmarkId}`,
+        ` Submitted      : ${submission.submittedAt}`,
+        bar,
+        ' Canonical metrics (official release):',
+        ` hit@5          : ${submission.canonicalHitAt5 != null ? submission.canonicalHitAt5 + '%' : 'n/a'}`,
+        ` token reduction: ${submission.canonicalReduction != null ? submission.canonicalReduction + '%' : 'n/a'}`,
+      ];
+      if (localMetrics) {
+        lines.push(bar, ' Local run metrics (this repo):');
+        if (localMetrics.hitAt5Pct != null)    lines.push(` hit@5          : ${localMetrics.hitAt5Pct}%`);
+        if (localMetrics.reductionPct != null)  lines.push(` token reduction: ${localMetrics.reductionPct}%`);
+        if (localMetrics.runDate)               lines.push(` run date       : ${localMetrics.runDate}`);
+      } else {
+        lines.push(bar, ' Local run metrics: none yet — run node scripts/run-retrieval-benchmark.mjs');
+      }
+      lines.push(bar);
+      lines.push(' Paste the block above into a GitHub Discussion to share your results.');
+      lines.push(' https://github.com/manojmallick/sigmap/discussions');
+      lines.push(bar);
+      console.log(lines.join('\n'));
+    }
+    process.exit(0);
+  }
+
   // v5.2: `sigmap learn` — manual learning controls for ranking
   if (args[0] === 'learn') {
     const doReset = args.includes('--reset');

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap",
-  "version": "5.7.0",
+  "version": "5.9.0",
   "description": "Zero-dependency AI context engine — 97% token reduction. No npm install. Runs on Node 18+.",
   "main": "gen-context.js",
   "exports": {

package/packages/cli/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap-cli",
-  "version": "5.7.0",
+  "version": "5.9.0",
   "description": "SigMap CLI wrapper — thin adapter for programmatic CLI invocation",
   "main": "index.js",
   "keywords": [

package/packages/core/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap-core",
-  "version": "5.7.0",
+  "version": "5.9.0",
   "description": "SigMap core library — zero-dependency code signature extraction, retrieval, and security scanning",
   "main": "index.js",
   "keywords": [

package/src/mcp/server.js

@@ -18,7 +18,7 @@ const { readContext, searchSignatures, getMap, createCheckpoint, getRouting, exp
 
 const SERVER_INFO = {
   name: 'sigmap',
-  version: '5.7.0',
+  version: '5.9.0',
   description: 'SigMap MCP server — code signatures on demand',
 };