sigmap 8.7.1 → 8.8.1

package/CHANGELOG.md

@@ -10,6 +10,29 @@ Format: [Semantic Versioning](https://semver.org/)
 
 ---
 
+## [8.8.1] — 2026-07-05
+
+Patch release — **byte-stable context, reproducible benchmark.** Closes the determinism residual tracked in #440: `gen-context` output is now byte-identical run-to-run across all 43 benchmark repos, and the retrieval benchmark reproduces a single hit@5 (87.8%) instead of flapping 85.6–87.8%. Plus a test-count derivation fix, docs/CI serving fixes, and repo hygiene.
+
+### Fixed
+- **gen-context determinism residual — token-budget recency boost (#440, PR #444):** the recency boost stamped `mtime = Date.now()` on every recently-committed file. On repos where nearly every file is "recently changed", consecutive files often landed on the *same millisecond* — so which equal-priority files shared a millisecond (and thus fell through to the `filePath` tie-break instead of sorting by a distinct mtime) shifted run to run, swapping which files survived at the budget cutoff and making the output non-byte-stable. The `Date.now()` value wasn't just a boost: it encoded the alphabetical walk order that the budget's best-first sort relied on; the nondeterminism was only the millisecond *collisions*. Replaced it with a deterministic monotonic counter (`nextRecentMtime`) that reproduces the exact same processing-order ranking without collisions. Result: all 43 benchmark repos are byte-identical across two clean runs (excluding the `Updated:` timestamp), and retrieval hit@5 reproduces at **87.8%** with identical per-repo results. Adds an integration regression guard (`test/integration/gen-context-determinism.test.js`) that runs gen-context twice on a committed fixture and asserts byte-equality — verified to fail on the old `Date.now()` behaviour.
+- **Derived test count after test relocation (503a6e5):** the test-count derivation globbed `tests/**/*.py`; after relocating `test_python_ast_extractor.py` into `test/` it matched neither pattern and dropped the count, failing `check:metrics` in CI. Now counts `test/**/test_*.py` (unittest-named), which matches the relocated test and excludes the fixture.
+- **Docs / CI serving (b236e08):** serve the OG banner image and the Google Search Console verification file; run the Python extractor tests in CI.
+
+### Changed
+- **Repo hygiene (a49e9c5):** dropped orphaned demo GIFs and a dead script; relocated a stray test from `tests/` into `test/`.
+
+## [8.8.0] — 2026-07-05
+
+Minor release — **the squeeze engine, exposed mid-session (D6).** The always-on squeeze engine (`src/squeeze/`) that powers `sigmap squeeze` was reachable only from the CLI on pasted input. This release exposes it as an MCP tool an agent can call *mid-session*, and adds a named CLI entry point for compressing an agent/tool *response*. Zero-dependency, offline, deterministic — the last A+ ceiling item (Machine 9→10): the engine already shipped, this just exposes it.
+
+### Added
+- **`squeeze_output` MCP tool (#437, PR #438):** the 19th MCP tool (18 → 19) wraps the existing `squeeze()` engine so an agent can compress noisy tool/command output — a stack trace, CI/build log, or JSON payload — before it enters context. Keeps the signal (error frames, failing steps, JSON shape), strips the noise, and enriches the top stack frame with its signature; returns the squeezed text plus token-reduction stats. Passes the input through unchanged when no squeezable structure is detected, and returns usage on empty input. No LLM, no network. New handler `squeezeOutput` in `src/mcp/handlers.js`, wired through `src/mcp/tools.js` and `src/mcp/server.js`.
+- **`sigmap squeeze --response <file|->` (#437, PR #438):** names the agent/tool response input explicitly (mirroring the existing `sigmap judge --response` convention), routing it through the same squeeze engine. Supports `--json`. Documented in `--help`.
+
+### Fixed
+- **Deterministic context output — three nondeterminism sources (#440, PR #441):** `gen-context`'s signature output was not byte-stable across runs on some repos, making the retrieval benchmark's hit@5 non-reproducible. Fixes: (1) the token-budget drop-order now has a final `filePath` tie-break, so which files survive the budget no longer falls through to filesystem `readdir` order (test files sharing a git-checkout mtime tied on every prior key); (2) the source-file walk sorts `readdir` entries by name for stable section order; (3) auto source-root detection sorts its candidate enumeration and adds tie-breaks to the score sorts, so the `MAX_ROOTS` cutoff admits a deterministic directory set. Adds a resolver determinism regression guard. A residual affecting a few large repos remains tracked in #440.
+
 ## [8.7.1] — 2026-07-05
 
 Patch release — **multi-model cost savings + verified pricing.** The quality benchmark reported API input-cost savings for GPT-4o only; it now reports GPT-4o, Claude Sonnet, and Claude Haiku, and the hardcoded Claude rates were corrected to current published pricing.

package/README.md

@@ -57,10 +57,10 @@ That map is exactly what agentic grep is worst at: reproducible, auditable conte
 
 **Proof it pays off** (full benchmark below):
 <!--SM:whyMetrics-->
-- **86.7% hit@5** — right file found in top 5 results (vs 13.6% baseline)
+- **87.8% hit@5** — right file found in top 5 results (vs 13.6% baseline)
 - **97.0% token reduction** — average across 21 real repos
 - **67.8% task success rate** — up from 10% without context
-- **1.46 prompts per task** — down from 2.84 (48.8% fewer retries)
+- **1.44 prompts per task** — down from 2.84 (49.2% fewer retries)
 <!--/SM:whyMetrics-->
 - **<!--SM:languages-->33<!--/SM:languages--> languages supported** — TypeScript, Python, Go, Rust, Java, R, and more
 - **No vendor lock-in** — works with any AI assistant or local LLM
@@ -96,7 +96,7 @@ sigmap verify answer.md --report        # standalone red/amber/green HTML report
 | Without SigMap | With SigMap |
 |---|---|
 | ❌ Non-reproducible agent guesses | ✅ Deterministic map — same input, same output, every time |
-| ❌ "Trust me" AI answers | ✅ Grounded — right file in context <!--SM:hitWhole-->87%<!--/SM:hitWhole--> of the time, every symbol on a real line anchor |
+| ❌ "Trust me" AI answers | ✅ Grounded — right file in context <!--SM:hitWhole-->88%<!--/SM:hitWhole--> of the time, every symbol on a real line anchor |
 | ❌ Embeddings / vector DB required | ✅ Zero deps, no infra, fully offline |
 
 ---
@@ -120,12 +120,12 @@ Ask → Rank → Context → Validate → Judge → Learn
 
 <!--SM:benchmarkBlock-->
 ```
-Benchmark : sigmap-v8.7-main (21 repositories, including R language)
+Benchmark : sigmap-v8.8-main (21 repositories, including R language)
 Date      : 2026-07-05
 
-Hit@5          : 86.7%   (baseline 13.6%  — 6.4× lift)
+Hit@5          : 87.8%   (baseline 13.6%  — 6.5× lift)
 Token reduction: 97.0%   (across 21 repos)
-Prompt reduction : 48.8% (2.84 → 1.46 prompts per task)
+Prompt reduction : 49.2% (2.84 → 1.44 prompts per task)
 Task success   : 67.8%   (baseline 10%)
 Repos tested   : 21 (JavaScript, Python, Go, Rust, Java, R, C++, C#, Dart, Swift, Ruby, PHP, Scala, Kotlin, and more)
 ```
@@ -220,13 +220,13 @@ Use SigMap with open-source tools and fully self-hosted setups:
 | **JetBrains** | [Marketplace](https://plugins.jetbrains.com/plugin/31109-sigmap--ai-context-engine/) | [github.com/manojmallick/sigmap-jetbrains](https://github.com/manojmallick/sigmap-jetbrains) | IntelliJ IDEA, WebStorm, PyCharm, GoLand — tool window + actions |
 | **Neovim** | lazy.nvim / packer / vim-plug | [github.com/manojmallick/sigmap.nvim](https://github.com/manojmallick/sigmap.nvim) | `:SigMap`, `:SigMapQuery` float window, statusline widget |
 
-**MCP server** — 18 on-demand tools for Claude Code and Cursor:
+**MCP server** — 19 on-demand tools for Claude Code and Cursor:
 
 ```bash
 sigmap --mcp
 ```
 
-Tools: `read_context`, `search_signatures`, `get_map`, `create_checkpoint`, `get_routing`, `explain_file`, `list_modules`, `query_context`, `get_impact`, `get_lines`, `read_memory`, `get_callee_signatures`, `get_diff_context` (changed files + signatures + blast radius), `get_architecture_overview` (modules, hub files, cycles), plus the live-index notifications `sigmap_notify_file_created`, `sigmap_notify_symbol_added`, and `sigmap_notify_file_deleted`. Full reference: [llms-full.txt](llms-full.txt).
+Tools: `read_context`, `search_signatures`, `get_map`, `create_checkpoint`, `get_routing`, `explain_file`, `list_modules`, `query_context`, `get_impact`, `get_lines`, `read_memory`, `get_callee_signatures`, `get_diff_context` (changed files + signatures + blast radius), `get_architecture_overview` (modules, hub files, cycles), `verify_suggestion` (ground AI code against repo + installed libraries), `squeeze_output` (compress noisy tool/log/JSON output mid-session), plus the live-index notifications `sigmap_notify_file_created`, `sigmap_notify_symbol_added`, and `sigmap_notify_file_deleted`. Full reference: [llms-full.txt](llms-full.txt).
 
 ---
 
@@ -265,7 +265,7 @@ SigMap treats coding agents as **consumers, not competitors**: it hands them a d
 
 | Agent | One-time setup | How it consumes SigMap |
 |---|---|---|
-| **Claude Code** | `sigmap mcp install claude` | 17 MCP tools (`search_signatures`, `get_lines`, `get_diff_context`…) |
+| **Claude Code** | `sigmap mcp install claude` | 19 MCP tools (`search_signatures`, `get_lines`, `get_diff_context`, `squeeze_output`…) |
 | **Cursor** | `sigmap mcp install cursor` | MCP tools, plus the `cursor` adapter writes `.cursorrules` |
 | **Cline** | `sigmap mcp install cursor` | Reads `.cursorrules`; same MCP server |
 | **Continue** | `sigmap mcp install vscode` | MCP tools inside the Continue extension |

package/gen-context.js

@@ -3202,7 +3202,11 @@ __factories["./src/discovery/source-root-resolver"] = function(module, exports)
         score: scoreCandidate(name, full, context),
       }))
       .filter(c => c.score > 0)
-      .sort((a, b) => b.score - a.score);
+      // Final tie-break on dir keeps selection deterministic when scores tie — the
+      // top-MAX_ROOTS slice below would otherwise admit different dirs run to run
+      // (candidate order comes from filesystem readdir), changing which files are
+      // collected and making the generated context non-reproducible.
+      .sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
 
     // Handle special rules
     let roots = _applySpecialRules(scored, cwd, primaryFw, fwEntry, frameworks);
@@ -3245,9 +3249,12 @@ __factories["./src/discovery/source-root-resolver"] = function(module, exports)
     const candidates = [];
     const excSet     = new Set(excludeList);
 
-    // Root-level dirs
+    // Root-level dirs (sorted so candidate order — and downstream dedupe/selection
+    // — is deterministic regardless of filesystem readdir order)
     try {
-      for (const e of fs.readdirSync(cwd, { withFileTypes: true })) {
+      const rootEntries = fs.readdirSync(cwd, { withFileTypes: true })
+        .sort((a, b) => a.name.localeCompare(b.name));
+      for (const e of rootEntries) {
         if (!e.isDirectory()) continue;
         if (excSet.has(e.name)) continue;
         if (matchesIgnorePattern(e.name, ignorePatterns)) continue;
@@ -3316,7 +3323,7 @@ __factories["./src/discovery/source-root-resolver"] = function(module, exports)
           }
         }
       } catch (_) {}
-      roots.sort((a, b) => b.score - a.score);
+      roots.sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
     }
 
     // Swift project dir: dirs with ≥3 .swift files
@@ -3331,7 +3338,7 @@ __factories["./src/discovery/source-root-resolver"] = function(module, exports)
           }
         }
       } catch (_) {}
-      roots.sort((a, b) => b.score - a.score);
+      roots.sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
     }
 
     return roots;
@@ -13345,7 +13352,50 @@ __factories["./src/mcp/handlers"] = function(module, exports) {
     return out.join('\n');
   }
 
-  module.exports = { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion };
+  /**
+   * squeeze_output({ content }) → string
+   *
+   * Compress noisy tool/command/agent output (stack trace, CI/build log, or JSON
+   * payload) through the deterministic squeeze engine. Enriches the top stack
+   * frame with its signature when the symbol index is available. Passes the input
+   * through unchanged when no squeezable structure is detected.
+   */
+  function squeezeOutput(args, cwd) {
+    const content = args && typeof args.content === 'string' ? args.content : '';
+    if (!content.trim()) {
+      return 'Usage: squeeze_output({ content: "<raw tool/log/JSON output>" }) — provide the output to compress.';
+    }
+
+    let sq;
+    try {
+      const { squeeze } = __require('./src/squeeze/index');
+      let srcDirs;
+      let symbolIndex = null;
+      try {
+        const { loadConfig } = __require('./src/config/loader');
+        srcDirs = loadConfig(cwd).srcDirs;
+      } catch (_) {}
+      try {
+        const { buildSigIndex } = __require('./src/retrieval/ranker');
+        symbolIndex = buildSigIndex(cwd);
+      } catch (_) {}
+      sq = squeeze(content, { srcDirs, symbolIndex });
+    } catch (err) {
+      return `_squeeze_output failed: ${err.message}_`;
+    }
+
+    if (!sq.category || !sq.applies) {
+      return `No squeezable structure detected — content unchanged (${sq.rawTokens} tokens).\n\n${content}`;
+    }
+
+    const pct = Math.round(sq.reduction * 100);
+    const header =
+      `Squeezed ${sq.category} — ${sq.rawTokens} → ${sq.squeezedTokens} tokens ` +
+      `(${pct}% smaller)${sq.enriched ? ' · signature-enriched' : ''}\n\n`;
+    return header + sq.squeezed;
+  }
+
+  module.exports = { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion, squeezeOutput };
   
 };
 
@@ -13506,17 +13556,17 @@ __factories["./src/mcp/server"] = function(module, exports) {
    *
    * Supported methods:
    *   initialize        → serverInfo + capabilities
-   *   tools/list        → 18 tool definitions
+   *   tools/list        → 19 tool definitions
    *   tools/call        → dispatch to handler, return result
    */
 
   const readline = require('readline');
   const { TOOLS } = __require('./src/mcp/tools');
-  const { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion } = __require('./src/mcp/handlers');
+  const { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion, squeezeOutput } = __require('./src/mcp/handlers');
 
   const SERVER_INFO = {
     name: 'sigmap',
-    version: '8.7.1',
+    version: '8.8.1',
     description: 'SigMap MCP server — code signatures on demand',
   };
 
@@ -13582,6 +13632,7 @@ __factories["./src/mcp/server"] = function(module, exports) {
         else if (name === 'get_diff_context') text = getDiffContext(args, cwd);
         else if (name === 'get_architecture_overview') text = getArchitectureOverview(args, cwd);
         else if (name === 'verify_suggestion') text = verifySuggestion(args, cwd);
+        else if (name === 'squeeze_output') text = squeezeOutput(args, cwd);
         else {
           respondError(id, -32601, `Unknown tool: ${name}`);
           return;
@@ -13642,11 +13693,12 @@ __factories["./src/mcp/server"] = function(module, exports) {
 __factories["./src/mcp/tools"] = function(module, exports) {
   
   /**
-   * MCP tool definitions for SigMap (17 tools).
+   * MCP tool definitions for SigMap (19 tools).
    * read_context, search_signatures, get_map, create_checkpoint, get_routing,
    * explain_file, list_modules, query_context, get_impact, get_lines, read_memory,
    * get_callee_signatures, sigmap_notify_file_created, sigmap_notify_symbol_added,
-   * sigmap_notify_file_deleted, get_diff_context, get_architecture_overview.
+   * sigmap_notify_file_deleted, get_diff_context, get_architecture_overview,
+   * verify_suggestion, squeeze_output.
    */
 
   const TOOLS = [
@@ -13977,6 +14029,27 @@ __factories["./src/mcp/tools"] = function(module, exports) {
         required: ['code'],
       },
     },
+    {
+      name: 'squeeze_output',
+      description:
+        'Compress noisy tool, command, or agent output before it enters context — a stack ' +
+        'trace, CI/build log, or JSON payload. Same deterministic, offline engine as ' +
+        '`sigmap squeeze`: keeps the signal (error frames, failing steps, JSON shape), strips ' +
+        'the noise, and enriches the top stack frame with its signature. Returns the squeezed ' +
+        'text plus token-reduction stats; passes the input through unchanged when no squeezable ' +
+        'structure is detected. No LLM, no network.',
+      inputSchema: {
+        type: 'object',
+        properties: {
+          content: {
+            type: 'string',
+            description:
+              'The raw output to compress (a stack trace, CI/build log, or JSON payload).',
+          },
+        },
+        required: ['content'],
+      },
+    },
   ];
 
   module.exports = { TOOLS };
@@ -18085,7 +18158,7 @@ function __tryGit(args, opts = {}) {
   catch (_) { return ''; }
 }
 
-const VERSION = '8.7.1';
+const VERSION = '8.8.1';
 const MARKER = '\n\n## Auto-generated signatures\n<!-- Updated by gen-context.js -->\n';
 
 function requireSourceOrBundled(key) {
@@ -18198,6 +18271,10 @@ function walkDir(dir, exclude, maxDepth, depth = 0) {
   } catch (_) {
     return [];
   }
+  // Sort by name so the collected file list — and therefore the output section
+  // order — is deterministic. Raw readdir order is filesystem-dependent and can
+  // vary run to run, making the generated context non-byte-stable.
+  entries.sort((a, b) => a.name.localeCompare(b.name));
   for (const entry of entries) {
     if (exclude.includes(entry.name)) continue;
     const full = path.join(dir, entry.name);
@@ -18291,6 +18368,26 @@ function annotateCoverage(sigs, testIndex, enabled) {
 // ---------------------------------------------------------------------------
 // Token budget enforcement
 // ---------------------------------------------------------------------------
+// Deterministic recency boost for recently-committed files so the token budget
+// doesn't drop them first. Previously this used `Date.now()`, which encoded the
+// (alphabetical) processing order as a monotonically increasing mtime — but on
+// repos where nearly every file is "recently changed", consecutive files often
+// landed on the *same* millisecond. Which files shared a millisecond (and so
+// fell through to the filePath tie-break instead of sorting by a distinct
+// mtime) shifted run to run, swapping which files survived at the budget cutoff
+// and making the output non-byte-stable. A monotonic integer counter preserves
+// the exact processing-order ranking Date.now() produced — recent files stay
+// ahead of non-recent ones, ordered among themselves by walk order — but is
+// collision-free and reproducible. RECENT_MTIME_BASE sits far above any real
+// filesystem mtime (ms since epoch ≈ 1.7e12) so boosted files always out-rank
+// non-boosted ones, and far below MAX_SAFE_INTEGER so the counter never
+// overflows. Call nextRecentMtime() once per boosted file, in walk order. (#440)
+const RECENT_MTIME_BASE = 1e15;
+let _recentMtimeSeq = 0;
+function nextRecentMtime() {
+  return RECENT_MTIME_BASE + (_recentMtimeSeq++);
+}
+
 function estimateTokens(str) {
   return Math.ceil(str.length / 4);
 }
@@ -18409,10 +18506,15 @@ function applyTokenBudget(fileEntries, maxTokens) {
   });
 
   // Best-first order: lowest drop-priority, then most-recent, then most-informative.
+  // Final tie-break on filePath keeps the selection deterministic when priority,
+  // mtime, and signalQuality all tie (common for test files sharing a git-checkout
+  // mtime) — otherwise the choice fell through to filesystem readdir order, making
+  // which files are kept vs dropped non-reproducible run to run.
   const bestFirst = withPriority.slice().sort((a, b) => {
     if (a.priority !== b.priority) return a.priority - b.priority;
     if ((b.mtime || 0) !== (a.mtime || 0)) return (b.mtime || 0) - (a.mtime || 0);
-    return (b.signalQuality || 0) - (a.signalQuality || 0);
+    if ((b.signalQuality || 0) !== (a.signalQuality || 0)) return (b.signalQuality || 0) - (a.signalQuality || 0);
+    return a.filePath.localeCompare(b.filePath);
   });
 
   const entryCost = (e) => estimateTokens(e.sigs.join('\n')) + sectionOverhead(e);
@@ -19266,7 +19368,7 @@ function runDiff(cwd, config, stagedOnly, baseRef) {
 
     sigs = annotateCoverage(sigs, testIndex, !!config.testCoverage);
 
-    fileEntries.push({ filePath, sigs, deps: extractFileDeps(filePath, content, config), content, mtime: Date.now() });
+    fileEntries.push({ filePath, sigs, deps: extractFileDeps(filePath, content, config), content, mtime: nextRecentMtime() });
   }
 
   if (fileEntries.length === 0) {
@@ -19414,8 +19516,11 @@ function runGenerate(cwd, config, reportMode, reportJson = false) {
       mtime = fs.statSync(filePath).mtimeMs;
     } catch (_) {}
 
-    // Boost recently committed files (give them max mtime so they aren't dropped first)
-    if (recentFiles.has(filePath)) mtime = Date.now();
+    // Boost recently committed files (give them a max mtime so they aren't
+    // dropped first). A deterministic monotonic counter — not Date.now() — keeps
+    // the budget selection byte-stable when many files are recent, while
+    // preserving the original processing-order ranking (see nextRecentMtime, #440).
+    if (recentFiles.has(filePath)) mtime = nextRecentMtime();
 
     fileEntries.push({ filePath, sigs, deps: extractFileDeps(filePath, content, config), content, mtime });
   }
@@ -19911,6 +20016,7 @@ Usage:
   ${cmd} review-pr --markdown              PR Evidence Report — branded Markdown (signatures + blast radius + tests) to post as a PR comment
   ${cmd} create "<task>"                   Grounded-creation pipeline: scaffold → verify-plan → verify-ai-output → review-pr (--staged)
   ${cmd} squeeze <file|->                  Minimize a pasted stacktrace/CI-log/JSON blob (--json for stats)
+  ${cmd} squeeze --response <file|->       Minimize an agent/tool response (same engine; also exposed as the squeeze_output MCP tool)
   ${cmd} ask "<query>" --squeeze           Auto-accept input minimization (no prompt; for scripts/CI)
   ${cmd} ask "<query>" --no-squeeze        Disable input minimization entirely
   ${cmd} ask "<query>" --squeeze-threshold N  Min reduction %% to prompt (default 30)
@@ -21681,7 +21787,20 @@ function main() {
   // v7.0.0: `sigmap squeeze <file|->` — minimize a pasted stacktrace / CI-log / JSON blob
   if (args[0] === 'squeeze') {
     const jsonOut = args.includes('--json');
-    const target = args[1] && !args[1].startsWith('--') ? args[1] : '-';
+    // `--response <file|->` names the agent/tool response to squeeze explicitly
+    // (mirrors `sigmap judge --response`); otherwise fall back to the positional arg.
+    const respIdx = args.indexOf('--response');
+    let target;
+    if (respIdx !== -1) {
+      const val = args[respIdx + 1];
+      if (!val || val.startsWith('--')) {
+        console.error('[sigmap] Usage: sigmap squeeze --response <file|-> [--json]');
+        process.exit(1);
+      }
+      target = val;
+    } else {
+      target = args[1] && !args[1].startsWith('--') ? args[1] : '-';
+    }
     let input = '';
     try {
       input = fs.readFileSync(target === '-' ? 0 : path.resolve(cwd, target), 'utf8');

package/llms-full.txt

@@ -11,22 +11,22 @@ ranking keeps the relevant context in scope (cutting tokens ~97% as a side
 effect), with no LLM calls, embeddings, or vector database. Works with Claude,
 Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
 
-# Version: 8.7.1 | Benchmark: sigmap-v8.7-main (2026-07-05)
+# Version: 8.8.1 | Benchmark: sigmap-v8.8-main (2026-07-05)
 # Source: auto-generated from package.json, version.json, benchmarks/latest.json, src/mcp/tools.js, src/config/defaults.js
 # Regenerate: npm run generate:llms   |   Validate: npm run validate:llms
 
 ---
 
-## Core metrics (benchmark: sigmap-v8.7-main, 2026-07-05)
+## Core metrics (benchmark: sigmap-v8.8-main, 2026-07-05)
 
 | Metric | Without SigMap | With SigMap |
 |--------|----------------|-------------|
-| Retrieval hit@5 | 13.6% (random) | 86.7% (6.4× lift) |
+| Retrieval hit@5 | 13.6% (random) | 87.8% (6.5× lift) |
 | Token reduction | — | 97.0% average |
 | Task success proxy | 10% | 67.8% |
-| Prompts per task | 2.84 | 1.46 (48.8% fewer) |
+| Prompts per task | 2.84 | 1.44 (49.2% fewer) |
 | Supported languages | — | 33 |
-| MCP tools | — | 18 |
+| MCP tools | — | 19 |
 | npm runtime dependencies | — | 0 |
 
 ---
@@ -113,6 +113,7 @@ sigmap review-pr                         Audit a diff — scope drift, god-node
 sigmap review-pr --markdown              PR Evidence Report — branded Markdown (signatures + blast radius + tests) to post as a PR comment
 sigmap create "<task>"                   Grounded-creation pipeline: scaffold → verify-plan → verify-ai-output → review-pr (--staged)
 sigmap squeeze <file|->                  Minimize a pasted stacktrace/CI-log/JSON blob (--json for stats)
+sigmap squeeze --response <file|->       Minimize an agent/tool response (same engine; also exposed as the squeeze_output MCP tool)
 sigmap ask "<query>" --squeeze           Auto-accept input minimization (no prompt; for scripts/CI)
 sigmap ask "<query>" --no-squeeze        Disable input minimization entirely
 sigmap ask "<query>" --squeeze-threshold N  Min reduction %% to prompt (default 30)
@@ -132,7 +133,7 @@ sigmap --version                         Show version
 
 ---
 
-## MCP server — 18 tools
+## MCP server — 19 tools
 
 Start with `sigmap --mcp` (stdio JSON-RPC). Configure once:
 
@@ -284,6 +285,14 @@ Ground an AI code suggestion before writing it: verify a snippet or answer again
 Input:  { code: string }
 ```
 
+### squeeze_output
+
+Compress noisy tool, command, or agent output before it enters context — a stack trace, CI/build log, or JSON payload. Same deterministic, offline engine as `sigmap squeeze`: keeps the signal (error frames, failing steps, JSON shape), strips the noise, and enriches the top stack frame with its signature. Returns the squeezed text plus token-reduction stats; passes the input through unchanged when no squeezable structure is detected. No LLM, no network.
+
+```
+Input:  { content: string }
+```
+
 ---
 
 ## Configuration (gen-context.config.json)

package/llms.txt

@@ -11,7 +11,7 @@ ranking keeps the relevant context in scope (cutting tokens ~97% as a side
 effect), with no LLM calls, embeddings, or vector database. Works with Claude,
 Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
 
-# Version: 8.7.1 | Benchmark: sigmap-v8.7-main (2026-07-05)
+# Version: 8.8.1 | Benchmark: sigmap-v8.8-main (2026-07-05)
 # Source: auto-generated from package.json, version.json, benchmarks/latest.json, src/mcp/tools.js, src/config/defaults.js
 # Regenerate: npm run generate:llms   |   Validate: npm run validate:llms
 
@@ -23,13 +23,13 @@ Cursor, GitHub Copilot, Aider, Windsurf, local LLMs, and MCP.
 - No blast-radius awareness before editing a hub file — `--impact` shows every file a change touches.
 - Pasted stack traces, CI logs, and JSON bloat the prompt — `squeeze` minimizes them and enriches the top frame from the symbol index.
 
-## Core metrics (benchmark: sigmap-v8.7-main, 2026-07-05)
+## Core metrics (benchmark: sigmap-v8.8-main, 2026-07-05)
 
-- hit@5 retrieval: 86.7% vs 13.6% random baseline (6.4× lift)
+- hit@5 retrieval: 87.8% vs 13.6% random baseline (6.5× lift)
 - Token reduction: 97.0% average across benchmark repos
 - Task success: 67.8% vs 10% without SigMap
-- Prompts per task: 1.46 vs 2.84 baseline (48.8% fewer)
-- Languages: 33 supported · MCP tools: 18
+- Prompts per task: 1.44 vs 2.84 baseline (49.2% fewer)
+- Languages: 33 supported · MCP tools: 19
 - Dependencies: zero npm runtime dependencies · fully offline
 
 ## Quick start

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap",
-  "version": "8.7.1",
+  "version": "8.8.1",
   "description": "97% token reduction for AI coding. Extracts function & class signatures with TF-IDF ranking to feed only the right files to Claude, Cursor, Copilot, Aider, Windsurf, local LLMs & MCP. Zero dependencies, runs offline via npx.",
   "main": "packages/core/index.js",
   "exports": {
@@ -17,6 +17,7 @@
     "test": "node test/run.js && node test/r-language.test.js",
     "test:integration": "node test/integration/strategy.test.js && node test/integration/secret-scan.test.js && node test/integration/token-budget.test.js && node test/integration/auto-budget.test.js && node test/integration/mcp/server.test.js && node test/integration/verify-ai-output.test.js && node test/integration/memory-tools.test.js && node test/integration/squeeze.test.js && node test/integration/context-consistency.test.js && node test/integration/features/llms-current.test.js",
     "test:integration:all": "node test/integration/all.js",
+    "test:python": "python3 test/test_python_ast_extractor.py",
     "test:all": "node test/run.js && node test/r-language.test.js && node test/integration/strategy.test.js && node test/integration/secret-scan.test.js",
     "generate": "node gen-context.js",
     "watch": "node gen-context.js --watch",

package/packages/cli/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap-cli",
-  "version": "8.7.1",
+  "version": "8.8.1",
   "description": "SigMap CLI wrapper — thin adapter for programmatic CLI invocation",
   "main": "index.js",
   "keywords": [

package/packages/core/package.json

@@ -1,6 +1,6 @@
 {
   "name": "sigmap-core",
-  "version": "8.7.1",
+  "version": "8.8.1",
   "description": "SigMap core library — zero-dependency code signature extraction, retrieval, and security scanning",
   "main": "index.js",
   "keywords": [

package/src/discovery/source-root-resolver.js

@@ -43,7 +43,11 @@ function resolveSourceRoots(cwd, opts = {}) {
       score: scoreCandidate(name, full, context),
     }))
     .filter(c => c.score > 0)
-    .sort((a, b) => b.score - a.score);
+    // Final tie-break on dir keeps selection deterministic when scores tie — the
+    // top-MAX_ROOTS slice below would otherwise admit different dirs run to run
+    // (candidate order comes from filesystem readdir), changing which files are
+    // collected and making the generated context non-reproducible.
+    .sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
 
   // Handle special rules
   let roots = _applySpecialRules(scored, cwd, primaryFw, fwEntry, frameworks);
@@ -86,9 +90,12 @@ function _enumerateCandidates(cwd, isMonorepo, ignorePatterns, excludeList) {
   const candidates = [];
   const excSet     = new Set(excludeList);
 
-  // Root-level dirs
+  // Root-level dirs (sorted so candidate order — and downstream dedupe/selection
+  // — is deterministic regardless of filesystem readdir order)
   try {
-    for (const e of fs.readdirSync(cwd, { withFileTypes: true })) {
+    const rootEntries = fs.readdirSync(cwd, { withFileTypes: true })
+      .sort((a, b) => a.name.localeCompare(b.name));
+    for (const e of rootEntries) {
       if (!e.isDirectory()) continue;
       if (excSet.has(e.name)) continue;
       if (matchesIgnorePattern(e.name, ignorePatterns)) continue;
@@ -157,7 +164,7 @@ function _applySpecialRules(scored, cwd, primaryFw, fwEntry, frameworks) {
         }
       }
     } catch (_) {}
-    roots.sort((a, b) => b.score - a.score);
+    roots.sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
   }
 
   // Swift project dir: dirs with ≥3 .swift files
@@ -172,7 +179,7 @@ function _applySpecialRules(scored, cwd, primaryFw, fwEntry, frameworks) {
         }
       }
     } catch (_) {}
-    roots.sort((a, b) => b.score - a.score);
+    roots.sort((a, b) => b.score - a.score || a.dir.localeCompare(b.dir));
   }
 
   return roots;

package/src/mcp/handlers.js

@@ -898,4 +898,47 @@ function verifySuggestion(args, cwd) {
   return out.join('\n');
 }
 
-module.exports = { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion };
+/**
+ * squeeze_output({ content }) → string
+ *
+ * Compress noisy tool/command/agent output (stack trace, CI/build log, or JSON
+ * payload) through the deterministic squeeze engine. Enriches the top stack
+ * frame with its signature when the symbol index is available. Passes the input
+ * through unchanged when no squeezable structure is detected.
+ */
+function squeezeOutput(args, cwd) {
+  const content = args && typeof args.content === 'string' ? args.content : '';
+  if (!content.trim()) {
+    return 'Usage: squeeze_output({ content: "<raw tool/log/JSON output>" }) — provide the output to compress.';
+  }
+
+  let sq;
+  try {
+    const { squeeze } = require('../squeeze/index');
+    let srcDirs;
+    let symbolIndex = null;
+    try {
+      const { loadConfig } = require('../config/loader');
+      srcDirs = loadConfig(cwd).srcDirs;
+    } catch (_) {}
+    try {
+      const { buildSigIndex } = require('../retrieval/ranker');
+      symbolIndex = buildSigIndex(cwd);
+    } catch (_) {}
+    sq = squeeze(content, { srcDirs, symbolIndex });
+  } catch (err) {
+    return `_squeeze_output failed: ${err.message}_`;
+  }
+
+  if (!sq.category || !sq.applies) {
+    return `No squeezable structure detected — content unchanged (${sq.rawTokens} tokens).\n\n${content}`;
+  }
+
+  const pct = Math.round(sq.reduction * 100);
+  const header =
+    `Squeezed ${sq.category} — ${sq.rawTokens} → ${sq.squeezedTokens} tokens ` +
+    `(${pct}% smaller)${sq.enriched ? ' · signature-enriched' : ''}\n\n`;
+  return header + sq.squeezed;
+}
+
+module.exports = { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion, squeezeOutput };

package/src/mcp/server.js

@@ -8,17 +8,17 @@
  *
  * Supported methods:
  *   initialize        → serverInfo + capabilities
- *   tools/list        → 18 tool definitions
+ *   tools/list        → 19 tool definitions
  *   tools/call        → dispatch to handler, return result
  */
 
 const readline = require('readline');
 const { TOOLS } = require('./tools');
-const { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion } = require('./handlers');
+const { readContext, searchSignatures, getMap, createCheckpoint, getRouting, explainFile, listModules, queryContext, getImpact, getLines, readMemory, getCalleeSignatures, notifyFileCreated, notifySymbolAdded, notifyFileDeleted, getDiffContext, getArchitectureOverview, verifySuggestion, squeezeOutput } = require('./handlers');
 
 const SERVER_INFO = {
   name: 'sigmap',
-  version: '8.7.1',
+  version: '8.8.1',
   description: 'SigMap MCP server — code signatures on demand',
 };
 
@@ -84,6 +84,7 @@ function dispatch(msg, cwd) {
       else if (name === 'get_diff_context') text = getDiffContext(args, cwd);
       else if (name === 'get_architecture_overview') text = getArchitectureOverview(args, cwd);
       else if (name === 'verify_suggestion') text = verifySuggestion(args, cwd);
+      else if (name === 'squeeze_output') text = squeezeOutput(args, cwd);
       else {
         respondError(id, -32601, `Unknown tool: ${name}`);
         return;

package/src/mcp/tools.js

@@ -1,11 +1,12 @@
 'use strict';
 
 /**
- * MCP tool definitions for SigMap (17 tools).
+ * MCP tool definitions for SigMap (19 tools).
  * read_context, search_signatures, get_map, create_checkpoint, get_routing,
  * explain_file, list_modules, query_context, get_impact, get_lines, read_memory,
  * get_callee_signatures, sigmap_notify_file_created, sigmap_notify_symbol_added,
- * sigmap_notify_file_deleted, get_diff_context, get_architecture_overview.
+ * sigmap_notify_file_deleted, get_diff_context, get_architecture_overview,
+ * verify_suggestion, squeeze_output.
  */
 
 const TOOLS = [
@@ -336,6 +337,27 @@ const TOOLS = [
       required: ['code'],
     },
   },
+  {
+    name: 'squeeze_output',
+    description:
+      'Compress noisy tool, command, or agent output before it enters context — a stack ' +
+      'trace, CI/build log, or JSON payload. Same deterministic, offline engine as ' +
+      '`sigmap squeeze`: keeps the signal (error frames, failing steps, JSON shape), strips ' +
+      'the noise, and enriches the top stack frame with its signature. Returns the squeezed ' +
+      'text plus token-reduction stats; passes the input through unchanged when no squeezable ' +
+      'structure is detected. No LLM, no network.',
+    inputSchema: {
+      type: 'object',
+      properties: {
+        content: {
+          type: 'string',
+          description:
+            'The raw output to compress (a stack trace, CI/build log, or JSON payload).',
+        },
+      },
+      required: ['content'],
+    },
+  },
 ];
 
 module.exports = { TOOLS };