@nxuss/lemma 1.7.1 → 1.8.0

package/README.md

@@ -1,11 +1,11 @@
-# 🧠 Lemma v1.7.0
+# 🧠 Lemma v1.8.0
 
 [![npm version](https://img.shields.io/npm/v/@nxuss/lemma.svg?color=orange&style=flat-square)](https://www.npmjs.com/package/@nxuss/lemma)
 [![License](https://img.shields.io/npm/l/@nxuss/lemma.svg?color=blue&style=flat-square)](https://github.com/Nxusbets/lemma/blob/main/LICENSE)
-[![MCP Tools](https://img.shields.io/badge/MCP%20tools-94-ff69b4?style=flat-square)](https://github.com/Nxusbets/lemma)
+[![MCP Tools](https://img.shields.io/badge/MCP%20tools-95-ff69b4?style=flat-square)](https://github.com/Nxusbets/lemma)
 [![Security](https://img.shields.io/badge/privacy-firewall%20active-blueviolet?style=flat-square)](https://github.com/Nxusbets/lemma)
 [![Caching](https://img.shields.io/badge/semantic%20memory-enabled-success?style=flat-square)](https://github.com/Nxusbets/lemma)
-[![Tests](https://img.shields.io/badge/tests-267%20passing-00c853?style=flat-square)](https://github.com/Nxusbets/lemma)
+[![Tests](https://img.shields.io/badge/tests-293%20passing-00c853?style=flat-square)](https://github.com/Nxusbets/lemma)
 
 ```text
     __                                
@@ -17,9 +17,9 @@
 
 > **The Intelligent local-first AI Gateway — Privacy, Performance, Static Code Intelligence, and Infrastructure Command Center for the Agentic Era.**
 
-Lemma is a high-performance orchestration layer that sits between your development environment and LLM providers. It transforms the way you build with AI by providing **Shared Semantic Memory**, **Autonomous Cost Optimization**, **Privacy Guardrails**, **22 Infrastructure Management Tools**, and a suite of **94 MCP tools** — including zero-token static code intelligence that runs entirely on your machine with no LLM calls required.
+Lemma is a high-performance orchestration layer that sits between your development environment and LLM providers. It transforms the way you build with AI by providing **Shared Semantic Memory**, **Autonomous Cost Optimization**, **Privacy Guardrails**, **22 Infrastructure Management Tools**, and a suite of **95 MCP tools** — including zero-token static code intelligence that runs entirely on your machine with no LLM calls required.
 
-Since v1.7.0 those 94 tools are all registered, but only the ones your project can actually use
+Since v1.7.0 those 95 tools are all registered, but only the ones your project can actually use
 are advertised to the model each turn. The rest stay one `lemma_toolbox` call away. See
 [Tool profiles](#-tool-profiles).
 
@@ -27,7 +27,41 @@ are advertised to the model each turn. The rest stay one `lemma_toolbox` call aw
 
 ## 📋 Changelog
 
-### v1.7.0 — The cost of being connected *(NEW)*
+### v1.8.0 — The Brain learns from project history, not just what it's told *(NEW)*
+
+Every memory in The Brain used to depend on the assistant remembering to call `store_memory`. If
+nobody called it, the Brain knew nothing about work that already happened.
+
+| Change | What it does | Why it matters |
+| :--- | :--- | :--- |
+| **`lemma-brain-ingest`** *(new CLI)* | Feeds The Brain from git commits and `CHANGELOG.md` — no assistant call needed. Incremental via a marker file, safe to wire to `post-commit`. | The Brain stops depending on the model remembering to save anything. |
+| **Checkpoints now feed The Brain** | `saveCheckpoint()` indexes any checkpoint with real content into the same Brain `search_memory` reads. | Decisions and bugs recorded in a checkpoint used to be invisible to search. |
+| **`get_project_history`** *(new tool)* | Merges recent commits, checkpoints, and Brain memories for the current project into one call. | Answers "what have we done here" without three separate lookups. |
+| **Outcome tagging** | `store_memory` accepts `outcome: 'failed'`; search surfaces it as a warning, not a suggestion. | A dead end is now as memorable as a fix. |
+| **Symbol-level freshness** | `store_memory` accepts `symbols: [{filePath, symbolName}]` — freshness is judged by that function's own source, not the whole file. | An unrelated edit elsewhere in the file no longer stales the memory out. |
+
+**PR review memory was silently going nowhere.** `BrainBridge` talked to the proxy's
+`/api/search`/`/api/memory/store`, both backed by ChromaDB + a local Ollama server on `:11434` —
+the exact stack TheBrainV2 replaced in 1.0.0. Whenever Ollama wasn't running (the common case
+now), every call failed inside a `try/catch` and returned empty. It now reads/writes `TheBrainV2`
+directly, so PR review and interactive coding share one memory instead of two disconnected ones.
+
+**Two projects could quietly share — or split — memories.** `deriveProjectId` hashed the
+project path without resolving symlinks; on macOS `process.cwd()` and an `os.tmpdir()`-built path
+can report different strings for the same directory, hashing to two different project scopes. It
+now resolves via `fs.realpathSync` first.
+
+**Spanish text was mangled before it reached the index.** `tokenize()` used `\w` to strip
+punctuation, which doesn't match accented letters — "Cómo" became "mo", "diseño" became "dise",
+and the same word typed without its accent tokenized completely differently. `tokenize()` now
+normalizes diacritics first, and gained an additive English/Spanish stemmer and Spanish stopwords.
+
+**`token_budget` reported a multiplier no ledger backed.** It fetched a proxy route that doesn't
+exist, silently fell back to an uncosted estimate, and reported a bigger number than the
+session's own auditable ledger would support. It now reads the real `SavingsLedger` net position
+(`/api/savings-breakdown`) or says plainly there's nothing to report if the proxy isn't running.
+
+### v1.7.0 — The cost of being connected
 
 Every tool schema Lemma advertises goes into the model's system prompt and is **re-sent on every
 request of the session** — including schemas for tools the project can never use. On this repo that
@@ -288,7 +322,7 @@ Or use environment variables: `JENKINS_URL`, `JENKINS_USERNAME`, `JENKINS_API_TO
 ## 🎚️ Tool profiles
 
 Every tool schema an MCP server advertises is injected into the model's system prompt and re-sent
-on **every request** of the session. Advertising all 94 tools costs ~11,600 tokens per turn — much
+on **every request** of the session. Advertising all 95 tools costs ~11,600 tokens per turn — much
 of it schemas for tools a given project can never use.
 
 Lemma advertises a scoped surface instead. Nothing is removed: every tool stays registered and
@@ -349,9 +383,35 @@ the richer record when one exists.
 
 ---
 
+## 🧠 Feeding The Brain from project history
+
+`store_memory` also depends on the assistant remembering to call it. `lemma-brain-ingest` pulls
+memories from sources that already exist and don't need an assistant in the loop:
+
+```bash
+lemma-brain-ingest [projectRoot] [--max N] [--changelog] [--no-commits]
+```
+
+- Every git commit (message + files touched) becomes one Brain entry, so `search_memory` and
+  `get_telepathic_hints` can recall *why* a change happened, not just what the code looks like now.
+- `--changelog` also ingests `CHANGELOG.md` (falls back to `docs/CHANGELOG.md`) — one entry per release, parsed
+  directly, no LLM involved.
+
+A marker file under `<project>/.lemma/session/` tracks the last commit and changelog version
+ingested, so this is safe to run after every commit and safe to run by hand for a one-time
+backfill of existing history — both take the same incremental path and never double-store.
+Wire it to a post-commit hook to keep it current automatically:
+
+```bash
+echo 'lemma-brain-ingest "$(git rev-parse --show-toplevel)" &' >> .git/hooks/post-commit
+chmod +x .git/hooks/post-commit
+```
+
+---
+
 ## 💎 Free vs Pro
 
-### 🆓 Free (33 Tools)
+### 🆓 Free (34 Tools)
 
 These tools work **without a Pro license**. Activate them with just `lemma init`:
 
@@ -366,6 +426,7 @@ These tools work **without a Pro license**. Activate them with just `lemma init`
 | `auto_context_bundle` | Full context bundle per file |
 | `repeat_guard` | Duplicate output detector |
 | `conversation_checkpoint` | Session state save/load |
+| `get_project_history` | Git log + checkpoints + Brain memories in one call |
 | `test_autofix_interceptor` | Test failure → Brain auto-fix |
 | `prompt_pattern_cache` | Reusable prompt templates |
 | `infra_discover` | Auto-detect Jenkins, OKD, Terraform |

package/bin/brain-ingest.js

@@ -0,0 +1,56 @@
+#!/usr/bin/env node
+'use strict';
+
+/**
+ * Feeds The Brain from sources the model never has to remember to store manually.
+ *
+ * Meant to be wired to a git post-commit hook so every commit becomes a searchable memory
+ * without depending on the assistant calling `store_memory`:
+ *
+ *   echo 'lemma-brain-ingest "$(git rev-parse --show-toplevel)" &' >> .git/hooks/post-commit
+ *
+ * With no flags it's an incremental catch-up: a marker file under .lemma/session/ tracks the
+ * last commit ingested, so running this after every commit or by hand both take the same path
+ * and never double-store. `--max N` only matters the first time there is no marker yet.
+ *
+ * Usage: lemma-brain-ingest [projectRoot] [--max N] [--changelog] [--no-commits]
+ */
+
+const path = require('path');
+
+function main() {
+  const args = process.argv.slice(2);
+  const maxIndex = args.indexOf('--max');
+  const maxCommits = maxIndex >= 0 ? parseInt(args[maxIndex + 1], 10) : undefined;
+  const includeChangelog = args.includes('--changelog');
+  const includeCommits = !args.includes('--no-commits');
+  const positional = args.filter((a, i) => !a.startsWith('--') && i !== maxIndex + 1);
+  const projectRoot = path.resolve(positional[0] || process.cwd());
+
+  const distPath = path.join(__dirname, '..', 'dist', 'cjs', 'subconscious', 'GitIngest.js');
+  let ingestRecentCommits, ingestChangelog;
+  try {
+    ({ ingestRecentCommits, ingestChangelog } = require(distPath));
+  } catch {
+    console.error('[lemma-brain-ingest] Build not found. Run "npm run build" first.');
+    return;
+  }
+
+  if (includeCommits) {
+    const res = ingestRecentCommits(projectRoot, { maxCommits });
+    console.error(`[lemma-brain-ingest] commits: ${res.ingested} stored, ${res.skipped} skipped (up to ${res.lastSha ? res.lastSha.substring(0, 12) : 'none'})`);
+  }
+
+  if (includeChangelog) {
+    const res = ingestChangelog(projectRoot);
+    console.error(`[lemma-brain-ingest] changelog: ${res.ingested} stored, ${res.skipped} skipped (${res.versionsSeen} version(s) seen)`);
+  }
+}
+
+try {
+  main();
+} catch (err) {
+  // A hook that fails must never be the reason a commit or session goes bad.
+  console.error('[lemma-brain-ingest] Skipped:', err && err.message);
+}
+process.exit(0);

package/dist/cjs/mcp/tools.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"tools.d.ts","sourceRoot":"","sources":["../../../src/mcp/tools.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,MAAM,EAAE,MAAM,2CAA2C,CAAC;AA2hCnE,oFAAoF;AACpF,wBAAgB,kBAAkB,IAAI,MAAM,CAM3C;AAED,oEAAoE;AACpE,wBAAgB,sBAAsB,IAAI,MAAM,EAAE,CAEjD;AAED,iEAAiE;AACjE,wBAAgB,sBAAsB,IAAI,MAAM,EAAE,CAEjD;AAED,iFAAiF;AACjF,wBAAgB,qBAAqB,IAAI;IACvC,OAAO,EAAE,MAAM,CAAC;IAChB,UAAU,EAAE,MAAM,CAAC;IACnB,MAAM,EAAE,MAAM,CAAC;IACf,KAAK,EAAE,MAAM,CAAC;IACd,YAAY,EAAE,MAAM,EAAE,CAAC;CACxB,CAQA;AAoHD,MAAM,WAAW,aAAa;IAC5B,IAAI,EAAE,MAAM,CAAC;IACb,IAAI,EAAE,MAAM,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;IAC1B,MAAM,EAAE,IAAI,GAAG,OAAO,GAAG,KAAK,GAAG,MAAM,CAAC;IACxC,OAAO,EAAE,MAAM,CAAC;IAChB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,KAAK,CAAC,EAAE,MAAM,CAAC;CAChB;AAED,wBAAgB,kBAAkB,CAChC,MAAM,EAAE,MAAM,EACd,UAAU,CAAC,EAAE,CAAC,KAAK,EAAE,aAAa,KAAK,IAAI,GAC1C,IAAI,CA+DN"}
+{"version":3,"file":"tools.d.ts","sourceRoot":"","sources":["../../../src/mcp/tools.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,MAAM,EAAE,MAAM,2CAA2C,CAAC;AAwjCnE,oFAAoF;AACpF,wBAAgB,kBAAkB,IAAI,MAAM,CAM3C;AAED,oEAAoE;AACpE,wBAAgB,sBAAsB,IAAI,MAAM,EAAE,CAEjD;AAED,iEAAiE;AACjE,wBAAgB,sBAAsB,IAAI,MAAM,EAAE,CAEjD;AAED,iFAAiF;AACjF,wBAAgB,qBAAqB,IAAI;IACvC,OAAO,EAAE,MAAM,CAAC;IAChB,UAAU,EAAE,MAAM,CAAC;IACnB,MAAM,EAAE,MAAM,CAAC;IACf,KAAK,EAAE,MAAM,CAAC;IACd,YAAY,EAAE,MAAM,EAAE,CAAC;CACxB,CAQA;AAqHD,MAAM,WAAW,aAAa;IAC5B,IAAI,EAAE,MAAM,CAAC;IACb,IAAI,EAAE,MAAM,CAAC,MAAM,EAAE,GAAG,CAAC,CAAC;IAC1B,MAAM,EAAE,IAAI,GAAG,OAAO,GAAG,KAAK,GAAG,MAAM,CAAC;IACxC,OAAO,EAAE,MAAM,CAAC;IAChB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,KAAK,CAAC,EAAE,MAAM,CAAC;CAChB;AAqCD,wBAAgB,kBAAkB,CAChC,MAAM,EAAE,MAAM,EACd,UAAU,CAAC,EAAE,CAAC,KAAK,EAAE,aAAa,KAAK,IAAI,GAC1C,IAAI,CAwEN"}