@nxuss/lemma 1.22.1 → 1.24.0

package/README.md

@@ -52,6 +52,23 @@ lemma start     # gateway + dashboard on http://localhost:8081
   real usage (`hits`), explicit negative feedback (`downvote_memory`), and `cognitive_map` domain
   tags; a passing `test_oracle` run over an uncommitted diff auto-captures itself; two memories
   about the same symbol that disagree on outcome are flagged, not silently both suggested.
+  Every hit explains itself (`whyShown` ranking signals + cited `evidence` files/symbols), and
+  every reuse books its savings onto the memory itself — `brain_stats` names which memories
+  actually pay for the Brain (`totalTokensSaved`, top savers).
+- **A memory that maintains itself** — `brain_upkeep` revalidates the most-reused memories,
+  surfaces exact duplicates and merge candidates, dead weight, and savings in one read-only
+  pass, each finding with its fix. `brain_merge` folds near-duplicate fragments into one
+  canonical entry (fragments survive as evidence-carrying claims). `forget_memory` moves to a
+  trash (`brain_trash`: list/restore/purge) instead of destroying, automatic snapshots roll
+  back every forget/import/clear/merge, and `brain_import dryRun:true` previews a bundle —
+  counts plus opposite-outcome conflicts — before a byte is written. Session onboarding
+  re-checks freshness of the memories it lists, so a day-one answer never starts stale.
+- **Integrity and encryption at rest** — the corpus carries a sha256 sidecar with `.prev`
+  backup rotation: a half-written or rotted file serves its intact lines, falls back to the
+  backup on total loss, and quarantines (never deletes) the bad bytes, with the incident
+  surfaced in `brain_stats`. `LEMMA_BRAIN_ENCRYPT=1` (or `LEMMA_BRAIN_KEY`) stores the
+  corpus AES-256-GCM encrypted under a local 0600 key; secrets never reach disk at all —
+  scrub-on-store redacts credentials one-way before indexing or persisting.
 - **Verifiable caching, not marketing numbers** — `state_hash_cache` only hits when the files an
   answer depends on are byte-identical; `token_receipt` gives a real per-session breakdown of how
   each answer was produced instead of an invented "% saved."
@@ -66,7 +83,7 @@ lemma start     # gateway + dashboard on http://localhost:8081
   compiler-verified AST location instead of asking the model to output a full-file rewrite.
 - **Infrastructure Command Center** — 22 free tools for Jenkins, OKD/OpenShift, and Terraform:
   discover, connect, deploy, diagnose, and detect drift, all via MCP.
-- **Scoped tool surface** — of the 98 registered tools, only the ones your project shows evidence
+- **Scoped tool surface** — of the 108 registered tools, only the ones your project shows evidence
   of needing are advertised to the model each turn; the rest stay one `lemma_toolbox` call away.
 
 See [`CHANGELOG.md`](CHANGELOG.md) for the full, per-version history.
@@ -75,13 +92,14 @@ See [`CHANGELOG.md`](CHANGELOG.md) for the full, per-version history.
 
 ## 💎 Free vs Pro
 
-48 of the 98 registered tools work with no license; 50 require Pro. Enforced by one allowlist in
-code (`FREE_TOOLS` in `src/mcp/tools.ts`), not by narrative. A session without a license doesn't
-even advertise the Pro tools — they stay registered and discoverable via `lemma_toolbox`.
+58 of the 108 registered tools work with no license; 50 require Pro. Enforced by one allowlist in
+code (`FREE_TOOLS` in `src/mcp/tools.ts`, including all 22 infrastructure tools), not by narrative.
+A session without a license doesn't even advertise the Pro tools — they stay registered and
+discoverable via `lemma_toolbox`.
 
-| | Free (48) | Pro (50) |
+| | Free (58) | Pro (50) |
 | :--- | :--- | :--- |
-| **Caching & memory** | `smarter_cache`, `state_hash_cache`, `token_receipt`, `search_memory`, `store_memory`, `downvote_memory`, `verify_memory`, `token_budget` | `get_telepathic_hints`, `query_hybrid_consensus`, `semantic_dedup_guard`, `local_semantic_autofix` |
+| **Caching & memory** | `smarter_cache`, `state_hash_cache`, `token_receipt`, `search_memory`, `store_memory`, `downvote_memory`, `verify_memory`, `token_budget`, `brain_upkeep`, `brain_trash`, `brain_merge` | `get_telepathic_hints`, `query_hybrid_consensus`, `semantic_dedup_guard`, `local_semantic_autofix` |
 | **Reading & context** | `read_workspace_file`, `scrub_privacy`, `import_tree_context`, `bulk_file_digest`, `auto_context_bundle`, `git_blame_heat`, `type_coverage_report` | `get_ast_hologram`, `smart_file_slice`, `get_symbol_surgical_context`, `diff_only` |
 | **Writing & workspace** | — | `write_workspace_file`, `apply_workspace_patch`, `multi_file_patch`, `search_workspace`, `run_workspace_command`, `validate_patch_sandbox`, `surgical_ast_insert` |
 | **Static analysis** | — | `entropy_score`, `coupling_radar`, `pattern_fossil`, `precrime_static`, `dead_export_necromancer`, `depgraph`, `refactor`, `ast_flow_visualizer`, `cognitive_map` |
@@ -96,7 +114,7 @@ Full per-tool listing: `lemma_toolbox { "action": "list" }`.
 
 ## 🎚️ Tool profiles
 
-Every advertised tool schema is re-sent on **every request** of the session — advertising all 97
+Every advertised tool schema is re-sent on **every request** of the session — advertising all 108
 costs ~11,600 tokens/turn. Lemma advertises a scoped surface instead: core tools always, situational
 groups (e.g. infrastructure) only when the repo shows evidence for them. Nothing is removed —
 everything stays registered and reachable via `lemma_toolbox`.
@@ -194,6 +212,14 @@ JS/TS, Python, Go, Rust, Ruby, JVM, `make`, git/gh, read-only shell utilities, a
 CLIs. Extend via `lemma.config.json` → `mcp.allowedCommandPrefixes`. See
 [`.env.security.example`](.env.security.example) for every security-related env var.
 
+**Brain at rest.** Secrets are redacted one-way before a memory is indexed or persisted
+(scrub-on-store, same patterns as the traffic firewall — the token map is discarded, there is
+no unmask step). `LEMMA_BRAIN_ENCRYPT=1` additionally stores the corpus AES-256-GCM encrypted
+under `<brainDir>/.brain.key` (0600, auto-generated); `LEMMA_BRAIN_KEY` (64 hex chars or base64
+of 32 bytes) overrides it for teams sharing one key. A malformed key fails loud at startup;
+a wrong key flows into the integrity fallback (backup → quarantine → fresh start), never an
+exception, never half a corpus.
+
 ---
 
 ## 🦜 SDK integrations & proxy mode

package/dist/cjs/cli/lemma-proxy.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"lemma-proxy.d.ts","sourceRoot":"","sources":["../../../src/cli/lemma-proxy.ts"],"names":[],"mappings":";AA0cA,wBAAgB,+BAA+B,CAAC,OAAO,CAAC,EAAE;IAAE,SAAS,CAAC,EAAE,OAAO,CAAA;CAAE,GAAG,IAAI,CA4DvF;AAqfD,eAAO,MAAM,sBAAsB,MAAM,CAAC;AAE1C,wBAAgB,iBAAiB,CAAC,GAAG,EAAE,MAAM,GAAG,OAAO,CAGtD;AAyqDD,wBAAsB,eAAe,CAAC,KAAK,EAAE,OAAO,GAAG,OAAO,CAAC;IAAE,OAAO,EAAE,OAAO,CAAC;IAAC,OAAO,EAAE,MAAM,CAAC;IAAC,KAAK,CAAC,EAAE,MAAM,CAAC;IAAC,QAAQ,CAAC,EAAE,MAAM,CAAC;IAAC,UAAU,CAAC,EAAE,MAAM,CAAC;IAAC,SAAS,CAAC,EAAE,MAAM,CAAA;CAAE,CAAC,CA8KhL"}
+{"version":3,"file":"lemma-proxy.d.ts","sourceRoot":"","sources":["../../../src/cli/lemma-proxy.ts"],"names":[],"mappings":";AA0cA,wBAAgB,+BAA+B,CAAC,OAAO,CAAC,EAAE;IAAE,SAAS,CAAC,EAAE,OAAO,CAAA;CAAE,GAAG,IAAI,CA4DvF;AAqfD,eAAO,MAAM,sBAAsB,MAAM,CAAC;AAE1C,wBAAgB,iBAAiB,CAAC,GAAG,EAAE,MAAM,GAAG,OAAO,CAGtD;AAsrDD,wBAAsB,eAAe,CAAC,KAAK,EAAE,OAAO,GAAG,OAAO,CAAC;IAAE,OAAO,EAAE,OAAO,CAAC;IAAC,OAAO,EAAE,MAAM,CAAC;IAAC,KAAK,CAAC,EAAE,MAAM,CAAC;IAAC,QAAQ,CAAC,EAAE,MAAM,CAAC;IAAC,UAAU,CAAC,EAAE,MAAM,CAAC;IAAC,SAAS,CAAC,EAAE,MAAM,CAAA;CAAE,CAAC,CA8KhL"}

package/dist/cjs/cli/lemma-proxy.js

@@ -1566,16 +1566,28 @@ class LemmaServer {
             // Cost Record Endpoint — the counterpart to /api/savings-record. Without it the
             // ledger only ever counts wins, which makes its totals unfalsifiable.
             this.app.post('/api/cost-record', (req, res) => {
-                const { source, tokens, chars } = req.body || {};
+                // AN-01: attribution rides in the same body — tool/host/origin are what turn
+                // the toolResult bucket from an inscrutable total into auditable accounting.
+                // Unknown/unset stays "unknown": unattributed events are labeled, never re-homed.
+                const { source, tokens, chars, toolName, tool, host, origin } = req.body || {};
                 const validSources = ['mcpInstructions', 'toolResult', 'cacheMiss'];
                 if (!source || !validSources.includes(source)) {
                     return res.status(400).json({ error: 'Invalid cost source' });
                 }
+                const attribution = typeof toolName === 'string' || typeof tool === 'string' ||
+                    typeof host === 'string' || typeof origin === 'string'
+                    ? {
+                        ...(typeof toolName === 'string' && toolName ? { tool: toolName.slice(0, 128) } : {}),
+                        ...(typeof tool === 'string' && tool ? { tool: tool.slice(0, 128) } : {}),
+                        ...(typeof host === 'string' && host ? { host } : {}),
+                        ...(typeof origin === 'string' && origin ? { origin } : {}),
+                    }
+                    : undefined;
                 if (typeof tokens === 'number' && tokens > 0) {
-                    SavingsLedger_1.savingsLedger.recordCost(source, tokens);
+                    SavingsLedger_1.savingsLedger.recordCost(source, tokens, attribution);
                 }
                 else if (typeof chars === 'number' && chars > 0) {
-                    SavingsLedger_1.savingsLedger.recordCostChars(source, chars);
+                    SavingsLedger_1.savingsLedger.recordCostChars(source, chars, attribution);
                 }
                 const snap = SavingsLedger_1.savingsLedger.getSnapshot();
                 res.json({ ok: true, totalCost: snap.totalCost, net: snap.net });