superlocalmemory 3.6.9__tar.gz → 3.6.11__tar.gz

{superlocalmemory-3.6.9/src/superlocalmemory.egg-info → superlocalmemory-3.6.11}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: superlocalmemory
-Version: 3.6.9
+Version: 3.6.11
 Summary: Information-geometric agent memory with mathematical guarantees
 Author-email: Varun Pratap Bhardwaj <admin@superlocalmemory.com>
 License: AGPL-3.0-or-later
@@ -58,6 +58,7 @@ Requires-Dist: huggingface_hub==0.36.2
 Requires-Dist: torch==2.11.0
 Requires-Dist: scikit-learn==1.8.0
 Requires-Dist: sqlite-vec==0.1.9
+Requires-Dist: llmlingua==0.2.2
 Provides-Extra: search
 Requires-Dist: sentence-transformers==5.3.0; extra == "search"
 Requires-Dist: optimum==2.1.0; extra == "search"
@@ -94,18 +95,18 @@ Dynamic: license-file
   <img src="https://superlocalmemory.com/assets/logo-mark.png" alt="SuperLocalMemory" width="200"/>
 </p>
 
-<h1 align="center">SuperLocalMemory V3.6</h1>
-<p align="center"><strong>Save up to 90% on every LLM API call. Cache. Compress. Remember.</strong><br/><em>The only local-first memory system that SKIPS repeat calls (100% saved), SHRINKS prompts 60-95%, and REMEMBERS everything — locally, for free. For Claude Code, Cursor, Windsurf, and any AI client.</em></p>
-<p align="center"><code>v3.6.0 "Optimize"</code> — <strong>Cache & Compress & Align. Save up to 90% on every LLM API call — locally.</strong> One command: <code>slm wrap claude</code><br>Also includes v3.5 Scale-Ready: 6-channel recall &lt;1s, CozoDB + LanceDB, Core Memory Block. Your database auto-migrates.</p>
+<h1 align="center">SuperLocalMemory V3.6.11</h1>
+<p align="center"><strong>Cache. Compress. Remember. Three surfaces — proxy, MCP tools, or skill. Every setup covered.</strong><br/><em>The only local-first layer that pairs persistent memory with compression + caching across every Claude plan. Full 1M window preserved in MCP and skill mode.</em></p>
+<p align="center"><code>v3.6.11 "Optimize Everywhere"</code> — <strong>Compress + cache on any plan, three ways in.</strong><br/>Proxy (full-turn cache): <code>slm wrap claude</code> &nbsp;·&nbsp; MCP (proxy-free): add <code>slm_compress</code> to your MCP config &nbsp;·&nbsp; Skill (zero-config): <code>~/.claude/skills/slm-optimize/</code></p>
 <p align="center"><strong>Backed by 3 published research papers</strong> (arXiv preprints + Zenodo-archived) · <a href="https://arxiv.org/abs/2603.02240">arXiv:2603.02240</a> · <a href="https://arxiv.org/abs/2603.14588">arXiv:2603.14588</a> · <a href="https://arxiv.org/abs/2604.04514">arXiv:2604.04514</a></p>
 
 <p align="center">
-  <code>Saves up to 90% on LLM API costs</code> &nbsp;·&nbsp; <code>+10.6pp vs Mem0 zero-LLM</code> &nbsp;·&nbsp; <code>85% Open-Domain (best zero-LLM score)</code> &nbsp;·&nbsp; <code>EU AI Act Ready</code>
+  <code>Proxy · MCP tools · Skill — three surfaces</code> &nbsp;·&nbsp; <code>+10.6pp vs Mem0 zero-LLM</code> &nbsp;·&nbsp; <code>85% Open-Domain (best zero-LLM score)</code> &nbsp;·&nbsp; <code>EU AI Act Ready</code>
 </p>
 
 <p align="center">
   <a href="https://arxiv.org/abs/2603.14588"><img src="https://img.shields.io/badge/arXiv-2603.14588-b31b1b?style=for-the-badge&logo=arxiv&logoColor=white" alt="arXiv Paper"/></a>
-  <a href="https://img.shields.io/badge/Saves_90%25_on_LLM_Costs-22c55e?style=for-the-badge"><img src="https://img.shields.io/badge/Saves_90%25_on_LLM_Costs-22c55e?style=for-the-badge" alt="Saves 90% on LLM Costs"/></a>
+  <a href="#three-surfaces-proxy--mcp-tools--skill"><img src="https://img.shields.io/badge/Proxy_|_MCP_|_Skill-22c55e?style=for-the-badge" alt="Three Surfaces: Proxy, MCP Tools, Skill"/></a>
   <a href="https://pypi.org/project/superlocalmemory/"><img src="https://img.shields.io/pypi/v/superlocalmemory?style=for-the-badge&logo=pypi&logoColor=white" alt="PyPI"/></a>
   <a href="https://www.npmjs.com/package/superlocalmemory"><img src="https://img.shields.io/npm/v/superlocalmemory?style=for-the-badge&logo=npm&logoColor=white" alt="npm"/></a>
   <a href="https://www.gnu.org/licenses/agpl-3.0"><img src="https://img.shields.io/badge/License-AGPL_v3-blue.svg?style=for-the-badge" alt="AGPL v3"/></a>
@@ -125,18 +126,24 @@ Dynamic: license-file
 <details>
 <summary><strong>What's New in V3.6 — Optimize: SKIP, SHRINK, DISCOUNT, REMEMBER</strong> (click to expand)</summary>
 
-> V3.6 is the only local-first layer that SKIPS repeat LLM calls (cache: 100% saved), SHRINKS prompts 60-95% (compress: extractive + LLMLingua-2), and DISCOUNTS prefix costs (align: native KV-cache) — and remembers everything — in one install. **Your first cache hit pays for the install time. Hours of coding on repeat, minimal API cost.**
+> V3.6 is the only local-first layer that SKIPS repeat LLM calls (cache: 100% on a hit), SHRINKS tool outputs and injected context (compress: lossless-by-default, opt-in LLMLingua-2), and DISCOUNTS prefix costs (align: native KV-cache) — and remembers everything — in one install.
+>
+> **v3.6.11 "Optimize Everywhere":** Three surfaces. **Proxy** (Surface A) — full-turn cache + compress on transport; needs `ANTHROPIC_BASE_URL`, shrinks the context window. **MCP tools** (Surface B) — `slm_compress`, `slm_retrieve`, `slm_cache_set`, `slm_cache_get`, `slm_optimize_stats`; no proxy, no window shrink, works on any Claude subscription. **Skill** (Surface C) — `slm-optimize` installs in `~/.claude/skills/`; zero-config auto-compress for large tool outputs and CLAUDE.md. No proxy, full 1M window. [See Three Surfaces →](#three-surfaces-proxy--mcp-tools--skill)
+>
+> **v3.6.10:** cache and compression are now **independent runtime switches** (cache-only, compress-only, both, or neither — toggle live from the dashboard, no restart). Compression was rebuilt to be **lossless by default** (the old string/array/code truncation is gone); aggressive mode adds LLMLingua-2 for **prose only** — never code, numbers, structured data, or the current turn.
 
 ### The Three Levers
 
 | Lever | Mechanism | Saving | Off by default? |
 |-------|-----------|:------:|:---------------:|
-| **Cache** | Skip repeat calls — exact-match SQLite lookup, vCache-gated semantic (opt-in) | **100% on a hit** (input + output) | Cache ON, Semantic OFF |
-| **Compress** | Shrink prompts — extractive JSON/code (lossless) + LLMLingua-2 prose (opt-in) | **60–95% on a miss** (input only) | Safe mode ON, Aggressive OFF |
+| **Cache** | Skip repeat calls — exact-match SQLite lookup (zero false hits), vCache-gated semantic (opt-in) | **100% on a hit** (input + output) | Cache ON, Semantic OFF |
+| **Compress** | Shrink prompts — **safe = lossless** normalization; **aggressive = LLMLingua-2 prose only** (opt-in) | Safe: small + lossless · Aggressive: large on prose | Safe mode, Aggressive OFF |
 | **Align** | Stabilize prefix — maximize provider prefix-cache discounts | **Lossless extra** | ON when compression is ON |
 
 **Memory** (v3.5's existing engine) runs in parallel — it shapes *what is in* the prompt (relevant facts); Optimize decides *whether and how* it is sent.
 
+> **Independent at runtime:** enable caching only, compression only, both, or neither — from the dashboard Optimize tab, applied live (no restart). Each AI client can also get its own memory identity over HTTP MCP via `http://127.0.0.1:8765/mcp/{agent_id}`.
+
 ### Quick Start
 
 ```bash
@@ -152,7 +159,7 @@ slm wrap claude
 |:--------|:-------------|
 | `slm optimize status\|on\|off\|savings` | Master Optimize control + savings report (USD/INR/tokens) |
 | `slm cache status\|clear\|invalidate\|ttl\|semantic` | Cache sub-control — exact + semantic tiers |
-| `slm compress status\|mode\|code\|prose\|ccr\|align` | Compression control — per-channel toggles |
+| `slm compress status\|mode\|prose` | Compression control — safe (lossless) / aggressive (LLMLingua-2 prose) |
 | `slm proxy [--port] [--provider]` | Start the interception proxy (port 8765) |
 | `slm wrap <agent>` | Proxy-activate an agent — one command to start saving |
 | `slm help-optimize [topic]` | Full developer reference + per-agent setup recipes |
@@ -208,6 +215,57 @@ Full docs:
 
 ---
 
+## Three Surfaces: Proxy · MCP Tools · Skill
+
+v3.6.11 delivers one engine across **three ways in** — choose the surface that fits your setup:
+
+| Surface | How you use it | Requires proxy? | Window effect | Cache scope |
+|---------|---------------|:---------------:|:-------------:|-------------|
+| **A — Proxy** | `slm wrap claude` or `ANTHROPIC_BASE_URL=http://127.0.0.1:8765` | **Yes** | Shrinks (proxy intercepts full context) | Full-turn cache — every Claude call |
+| **B — MCP tools** | Add 5 tools to MCP config; call `slm_compress`, `slm_cache_set/get` | **No** | **Preserved** (full 1M) | Results you explicitly route through SLM |
+| **C — Skill** | Copy `skills/slm-optimize/SKILL.md` → `~/.claude/skills/` | **No** | **Preserved** (full 1M) | Auto-applied by the agent per skill rules |
+
+**How to choose:**
+- On a **metered API** (pay-per-token) and want to cache every call → **Proxy (A)**
+- On a **Pro/Max/Team subscription** or any plan where you can't or won't run a proxy → **MCP tools (B)** or **Skill (C)**
+- Want zero configuration → **Skill (C)**: install once, auto-compresses CLAUDE.md and large outputs
+- Want agent-controlled caching of repeated file reads and tool outputs → **MCP tools (B)**
+
+**The hard constraint:** The primary Claude conversation turn cannot be cached without a proxy — the MCP/skill path caches results you explicitly route through SLM (tool outputs, file reads, sub-model calls).
+
+### MCP Tools Setup (Surface B)
+
+Add to your `claude_desktop_config.json` or IDE MCP config alongside your existing SLM entry:
+
+```json
+{
+  "mcpServers": {
+    "superlocalmemory": {
+      "command": "slm",
+      "args": ["mcp"]
+    }
+  }
+}
+```
+
+The 5 optimize tools (`slm_compress`, `slm_retrieve`, `slm_cache_set`, `slm_cache_get`, `slm_optimize_stats`) are included automatically from v3.6.11+. Verify with `slm_optimize_stats()`.
+
+### Skill Setup (Surface C)
+
+```bash
+mkdir -p ~/.claude/skills/slm-optimize
+cp $(pip show superlocalmemory | grep Location | awk '{print $2}')/superlocalmemory/skills/slm-optimize/SKILL.md \
+   ~/.claude/skills/slm-optimize/SKILL.md
+```
+
+Then reference in your `CLAUDE.md`:
+```markdown
+## Context Management
+Use the `slm-optimize` skill to compress large outputs and cache repeated reads.
+```
+
+---
+
 <details>
 <summary><strong>What's New in V3.3 — The Living Brain Evolves</strong> (click to expand)</summary>
 
@@ -384,6 +442,7 @@ No manual commands. No data loss. Zero downtime.
 
 | Version | Codename | Key Features |
 |---|---|---|
+| **v3.6.11** | Optimize Everywhere | **Three surfaces** — Proxy (A: full-turn cache), MCP tools (B: `slm_compress`/`slm_retrieve`/`slm_cache_set`/`slm_cache_get`/`slm_optimize_stats` — proxy-free, 1M window), Skill (C: `slm-optimize` zero-config). `CacheDB.get_value()` (pure KV lookup). 23 new tests. Links: [Three Surfaces →](#three-surfaces-proxy--mcp-tools--skill) · [docs/optimize-overview.md](docs/optimize-overview.md) |
 | **v3.6.0** | Optimize | **Cache** (skip repeat calls, 100% on hit) · **Compress** (shrink prompts 60-95%) · **Align** (KV-cache stabilization) · `slm optimize\|cache\|compress\|proxy\|wrap` CLI · Live savings dashboard (USD/INR/tokens) · Hot-reload config · Safe defaults · Links: [docs/optimize-overview.md](docs/optimize-overview.md) · [V3.6 Wiki](https://github.com/qualixar/superlocalmemory/wiki/V3.6-Overview) |
 | **v3.5.0** | Scale-Ready + Context Injection v2 | CozoDB/LanceDB migration, 6-channel recall <1s, Core Memory Block, BM25→FTS5, context injection v2, score normalization |
 | **v3.4.5** | Scale-Ready (foundation) | Tiered storage (active/warm/cold), graph pruning, BackendOrchestrator scaffolding, CozoDB + LanceDB init + migration code (read path wired in v3.5.0) |

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/README.md

@@ -2,18 +2,18 @@
   <img src="https://superlocalmemory.com/assets/logo-mark.png" alt="SuperLocalMemory" width="200"/>
 </p>
 
-<h1 align="center">SuperLocalMemory V3.6</h1>
-<p align="center"><strong>Save up to 90% on every LLM API call. Cache. Compress. Remember.</strong><br/><em>The only local-first memory system that SKIPS repeat calls (100% saved), SHRINKS prompts 60-95%, and REMEMBERS everything — locally, for free. For Claude Code, Cursor, Windsurf, and any AI client.</em></p>
-<p align="center"><code>v3.6.0 "Optimize"</code> — <strong>Cache & Compress & Align. Save up to 90% on every LLM API call — locally.</strong> One command: <code>slm wrap claude</code><br>Also includes v3.5 Scale-Ready: 6-channel recall &lt;1s, CozoDB + LanceDB, Core Memory Block. Your database auto-migrates.</p>
+<h1 align="center">SuperLocalMemory V3.6.11</h1>
+<p align="center"><strong>Cache. Compress. Remember. Three surfaces — proxy, MCP tools, or skill. Every setup covered.</strong><br/><em>The only local-first layer that pairs persistent memory with compression + caching across every Claude plan. Full 1M window preserved in MCP and skill mode.</em></p>
+<p align="center"><code>v3.6.11 "Optimize Everywhere"</code> — <strong>Compress + cache on any plan, three ways in.</strong><br/>Proxy (full-turn cache): <code>slm wrap claude</code> &nbsp;·&nbsp; MCP (proxy-free): add <code>slm_compress</code> to your MCP config &nbsp;·&nbsp; Skill (zero-config): <code>~/.claude/skills/slm-optimize/</code></p>
 <p align="center"><strong>Backed by 3 published research papers</strong> (arXiv preprints + Zenodo-archived) · <a href="https://arxiv.org/abs/2603.02240">arXiv:2603.02240</a> · <a href="https://arxiv.org/abs/2603.14588">arXiv:2603.14588</a> · <a href="https://arxiv.org/abs/2604.04514">arXiv:2604.04514</a></p>
 
 <p align="center">
-  <code>Saves up to 90% on LLM API costs</code> &nbsp;·&nbsp; <code>+10.6pp vs Mem0 zero-LLM</code> &nbsp;·&nbsp; <code>85% Open-Domain (best zero-LLM score)</code> &nbsp;·&nbsp; <code>EU AI Act Ready</code>
+  <code>Proxy · MCP tools · Skill — three surfaces</code> &nbsp;·&nbsp; <code>+10.6pp vs Mem0 zero-LLM</code> &nbsp;·&nbsp; <code>85% Open-Domain (best zero-LLM score)</code> &nbsp;·&nbsp; <code>EU AI Act Ready</code>
 </p>
 
 <p align="center">
   <a href="https://arxiv.org/abs/2603.14588"><img src="https://img.shields.io/badge/arXiv-2603.14588-b31b1b?style=for-the-badge&logo=arxiv&logoColor=white" alt="arXiv Paper"/></a>
-  <a href="https://img.shields.io/badge/Saves_90%25_on_LLM_Costs-22c55e?style=for-the-badge"><img src="https://img.shields.io/badge/Saves_90%25_on_LLM_Costs-22c55e?style=for-the-badge" alt="Saves 90% on LLM Costs"/></a>
+  <a href="#three-surfaces-proxy--mcp-tools--skill"><img src="https://img.shields.io/badge/Proxy_|_MCP_|_Skill-22c55e?style=for-the-badge" alt="Three Surfaces: Proxy, MCP Tools, Skill"/></a>
   <a href="https://pypi.org/project/superlocalmemory/"><img src="https://img.shields.io/pypi/v/superlocalmemory?style=for-the-badge&logo=pypi&logoColor=white" alt="PyPI"/></a>
   <a href="https://www.npmjs.com/package/superlocalmemory"><img src="https://img.shields.io/npm/v/superlocalmemory?style=for-the-badge&logo=npm&logoColor=white" alt="npm"/></a>
   <a href="https://www.gnu.org/licenses/agpl-3.0"><img src="https://img.shields.io/badge/License-AGPL_v3-blue.svg?style=for-the-badge" alt="AGPL v3"/></a>
@@ -33,18 +33,24 @@
 <details>
 <summary><strong>What's New in V3.6 — Optimize: SKIP, SHRINK, DISCOUNT, REMEMBER</strong> (click to expand)</summary>
 
-> V3.6 is the only local-first layer that SKIPS repeat LLM calls (cache: 100% saved), SHRINKS prompts 60-95% (compress: extractive + LLMLingua-2), and DISCOUNTS prefix costs (align: native KV-cache) — and remembers everything — in one install. **Your first cache hit pays for the install time. Hours of coding on repeat, minimal API cost.**
+> V3.6 is the only local-first layer that SKIPS repeat LLM calls (cache: 100% on a hit), SHRINKS tool outputs and injected context (compress: lossless-by-default, opt-in LLMLingua-2), and DISCOUNTS prefix costs (align: native KV-cache) — and remembers everything — in one install.
+>
+> **v3.6.11 "Optimize Everywhere":** Three surfaces. **Proxy** (Surface A) — full-turn cache + compress on transport; needs `ANTHROPIC_BASE_URL`, shrinks the context window. **MCP tools** (Surface B) — `slm_compress`, `slm_retrieve`, `slm_cache_set`, `slm_cache_get`, `slm_optimize_stats`; no proxy, no window shrink, works on any Claude subscription. **Skill** (Surface C) — `slm-optimize` installs in `~/.claude/skills/`; zero-config auto-compress for large tool outputs and CLAUDE.md. No proxy, full 1M window. [See Three Surfaces →](#three-surfaces-proxy--mcp-tools--skill)
+>
+> **v3.6.10:** cache and compression are now **independent runtime switches** (cache-only, compress-only, both, or neither — toggle live from the dashboard, no restart). Compression was rebuilt to be **lossless by default** (the old string/array/code truncation is gone); aggressive mode adds LLMLingua-2 for **prose only** — never code, numbers, structured data, or the current turn.
 
 ### The Three Levers
 
 | Lever | Mechanism | Saving | Off by default? |
 |-------|-----------|:------:|:---------------:|
-| **Cache** | Skip repeat calls — exact-match SQLite lookup, vCache-gated semantic (opt-in) | **100% on a hit** (input + output) | Cache ON, Semantic OFF |
-| **Compress** | Shrink prompts — extractive JSON/code (lossless) + LLMLingua-2 prose (opt-in) | **60–95% on a miss** (input only) | Safe mode ON, Aggressive OFF |
+| **Cache** | Skip repeat calls — exact-match SQLite lookup (zero false hits), vCache-gated semantic (opt-in) | **100% on a hit** (input + output) | Cache ON, Semantic OFF |
+| **Compress** | Shrink prompts — **safe = lossless** normalization; **aggressive = LLMLingua-2 prose only** (opt-in) | Safe: small + lossless · Aggressive: large on prose | Safe mode, Aggressive OFF |
 | **Align** | Stabilize prefix — maximize provider prefix-cache discounts | **Lossless extra** | ON when compression is ON |
 
 **Memory** (v3.5's existing engine) runs in parallel — it shapes *what is in* the prompt (relevant facts); Optimize decides *whether and how* it is sent.
 
+> **Independent at runtime:** enable caching only, compression only, both, or neither — from the dashboard Optimize tab, applied live (no restart). Each AI client can also get its own memory identity over HTTP MCP via `http://127.0.0.1:8765/mcp/{agent_id}`.
+
 ### Quick Start
 
 ```bash
@@ -60,7 +66,7 @@ slm wrap claude
 |:--------|:-------------|
 | `slm optimize status\|on\|off\|savings` | Master Optimize control + savings report (USD/INR/tokens) |
 | `slm cache status\|clear\|invalidate\|ttl\|semantic` | Cache sub-control — exact + semantic tiers |
-| `slm compress status\|mode\|code\|prose\|ccr\|align` | Compression control — per-channel toggles |
+| `slm compress status\|mode\|prose` | Compression control — safe (lossless) / aggressive (LLMLingua-2 prose) |
 | `slm proxy [--port] [--provider]` | Start the interception proxy (port 8765) |
 | `slm wrap <agent>` | Proxy-activate an agent — one command to start saving |
 | `slm help-optimize [topic]` | Full developer reference + per-agent setup recipes |
@@ -116,6 +122,57 @@ Full docs:
 
 ---
 
+## Three Surfaces: Proxy · MCP Tools · Skill
+
+v3.6.11 delivers one engine across **three ways in** — choose the surface that fits your setup:
+
+| Surface | How you use it | Requires proxy? | Window effect | Cache scope |
+|---------|---------------|:---------------:|:-------------:|-------------|
+| **A — Proxy** | `slm wrap claude` or `ANTHROPIC_BASE_URL=http://127.0.0.1:8765` | **Yes** | Shrinks (proxy intercepts full context) | Full-turn cache — every Claude call |
+| **B — MCP tools** | Add 5 tools to MCP config; call `slm_compress`, `slm_cache_set/get` | **No** | **Preserved** (full 1M) | Results you explicitly route through SLM |
+| **C — Skill** | Copy `skills/slm-optimize/SKILL.md` → `~/.claude/skills/` | **No** | **Preserved** (full 1M) | Auto-applied by the agent per skill rules |
+
+**How to choose:**
+- On a **metered API** (pay-per-token) and want to cache every call → **Proxy (A)**
+- On a **Pro/Max/Team subscription** or any plan where you can't or won't run a proxy → **MCP tools (B)** or **Skill (C)**
+- Want zero configuration → **Skill (C)**: install once, auto-compresses CLAUDE.md and large outputs
+- Want agent-controlled caching of repeated file reads and tool outputs → **MCP tools (B)**
+
+**The hard constraint:** The primary Claude conversation turn cannot be cached without a proxy — the MCP/skill path caches results you explicitly route through SLM (tool outputs, file reads, sub-model calls).
+
+### MCP Tools Setup (Surface B)
+
+Add to your `claude_desktop_config.json` or IDE MCP config alongside your existing SLM entry:
+
+```json
+{
+  "mcpServers": {
+    "superlocalmemory": {
+      "command": "slm",
+      "args": ["mcp"]
+    }
+  }
+}
+```
+
+The 5 optimize tools (`slm_compress`, `slm_retrieve`, `slm_cache_set`, `slm_cache_get`, `slm_optimize_stats`) are included automatically from v3.6.11+. Verify with `slm_optimize_stats()`.
+
+### Skill Setup (Surface C)
+
+```bash
+mkdir -p ~/.claude/skills/slm-optimize
+cp $(pip show superlocalmemory | grep Location | awk '{print $2}')/superlocalmemory/skills/slm-optimize/SKILL.md \
+   ~/.claude/skills/slm-optimize/SKILL.md
+```
+
+Then reference in your `CLAUDE.md`:
+```markdown
+## Context Management
+Use the `slm-optimize` skill to compress large outputs and cache repeated reads.
+```
+
+---
+
 <details>
 <summary><strong>What's New in V3.3 — The Living Brain Evolves</strong> (click to expand)</summary>
 
@@ -292,6 +349,7 @@ No manual commands. No data loss. Zero downtime.
 
 | Version | Codename | Key Features |
 |---|---|---|
+| **v3.6.11** | Optimize Everywhere | **Three surfaces** — Proxy (A: full-turn cache), MCP tools (B: `slm_compress`/`slm_retrieve`/`slm_cache_set`/`slm_cache_get`/`slm_optimize_stats` — proxy-free, 1M window), Skill (C: `slm-optimize` zero-config). `CacheDB.get_value()` (pure KV lookup). 23 new tests. Links: [Three Surfaces →](#three-surfaces-proxy--mcp-tools--skill) · [docs/optimize-overview.md](docs/optimize-overview.md) |
 | **v3.6.0** | Optimize | **Cache** (skip repeat calls, 100% on hit) · **Compress** (shrink prompts 60-95%) · **Align** (KV-cache stabilization) · `slm optimize\|cache\|compress\|proxy\|wrap` CLI · Live savings dashboard (USD/INR/tokens) · Hot-reload config · Safe defaults · Links: [docs/optimize-overview.md](docs/optimize-overview.md) · [V3.6 Wiki](https://github.com/qualixar/superlocalmemory/wiki/V3.6-Overview) |
 | **v3.5.0** | Scale-Ready + Context Injection v2 | CozoDB/LanceDB migration, 6-channel recall <1s, Core Memory Block, BM25→FTS5, context injection v2, score normalization |
 | **v3.4.5** | Scale-Ready (foundation) | Tiered storage (active/warm/cold), graph pruning, BackendOrchestrator scaffolding, CozoDB + LanceDB init + migration code (read path wired in v3.5.0) |

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "superlocalmemory"
-version = "3.6.9"
+version = "3.6.11"
 description = "Information-geometric agent memory with mathematical guarantees"
 readme = "README.md"
 license = {text = "AGPL-3.0-or-later"}
@@ -69,6 +69,11 @@ dependencies = [
     "scikit-learn==1.8.0",
     # Vector KNN extension for the semantic channel.
     "sqlite-vec==0.1.9",
+    # v3.6.10: LLMLingua-2 prose compression (aggressive mode, opt-in at runtime).
+    # Hard dependency so `pip install superlocalmemory` ships compression-ready;
+    # the ~560MB model downloads on first setup/warmup (fail-open). Verified the
+    # pin does NOT disturb the transformers/torch/numpy pins above.
+    "llmlingua==0.2.2",
 ]
 
 [project.optional-dependencies]

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/src/superlocalmemory/__init__.py

@@ -1,4 +1,8 @@
-"""SuperLocalMemory — information-geometric agent memory."""
+"""SuperLocalMemory — information-geometric agent memory.
+
+v3.6.9: all 7 retrieval layers at full quality (Hopfield@1000, entity_graph@100,
+SA neighbor-cache fix, fast=True deprecated). See CHANGELOG.md.
+"""
 
 import os
 
@@ -28,7 +32,7 @@ if "OMP_NUM_THREADS" not in os.environ:
     os.environ["OMP_NUM_THREADS"] = "2"
 # ---------------------------------------------------------------------------
 
-__version__ = "3.6.9"
+__version__ = "3.6.10"
 
 _REQUIRED_VERSIONS = {
     "sentence_transformers": "5.3.0",

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/src/superlocalmemory/cli/compress_cmd.py

@@ -2,7 +2,7 @@
 # Licensed under AGPL-3.0-or-later - see LICENSE file
 # Part of SuperLocalMemory V3 | https://qualixar.com | https://varunpratap.com
 
-"""Handlers for ``slm compress status|mode|code|prose|ccr``."""
+"""Handlers for ``slm compress status|mode|prose``."""
 
 from __future__ import annotations
 
@@ -19,11 +19,6 @@ def _get_store():
     return ConfigStore()
 
 
-def _get_cache_db():
-    from superlocalmemory.optimize.storage.db import CacheDB
-    return CacheDB()
-
-
 def _write_config(**fields) -> None:
     """5-step immutable config-write."""
     store = _get_store()
@@ -44,18 +39,31 @@ def cmd_compress(args: Namespace) -> None:
     sub = getattr(args, "compress_command", None)
     _dispatch = {
         "status": cmd_compress_status,
-        "mode": cmd_compress_mode,
-        "code": cmd_compress_code,
-        "prose": cmd_compress_prose,
-        "ccr": cmd_compress_ccr,
-        "align": cmd_compress_align,
+        "mode":   cmd_compress_mode,
+        "prose":  cmd_compress_prose,
+        # removed in v3.6.10: code, ccr, align (extractive compressors removed)
+        "code":   _cmd_compress_removed("code"),
+        "ccr":    _cmd_compress_removed("ccr"),
+        "align":  _cmd_compress_removed("align"),
     }
     handler = _dispatch.get(sub or "")
     if handler:
         handler(args)
     else:
-        print("Usage: slm compress status|mode|code|prose|ccr [options]")
+        print("Usage: slm compress status|mode|prose [options]")
+        sys.exit(0)
+
+
+def _cmd_compress_removed(name: str):
+    def handler(args: Namespace) -> None:
+        print(
+            f"slm compress {name}: removed in SLM v3.6.10. "
+            f"Extractive {name} compression has been replaced by "
+            f"Layer 1 (lossless whitespace) + Layer 2 (LLMLingua-2 prose). "
+            f"Use 'slm compress prose on' to enable prose compression."
+        )
         sys.exit(0)
+    return handler
 
 
 def cmd_compress_status(args: Namespace) -> None:
@@ -68,21 +76,19 @@ def cmd_compress_status(args: Namespace) -> None:
             "status": "ok",
             "compress_enabled": cfg.compress_enabled,
             "compress_mode": cfg.compress_mode,
-            "compress_code": cfg.compress_code,
             "compress_prose": cfg.compress_prose,
-            "compress_ccr": cfg.compress_ccr,
+            "compress_protect_recent": cfg.compress_protect_recent,
         }
         print(json.dumps(data, indent=2))
         return
 
     print("Compression status:")
-    print(f"  Enabled:  {'yes' if cfg.compress_enabled else 'no'}")
-    print(f"  Mode:     {cfg.compress_mode}")
-    print(f"  Code:     {'ON' if cfg.compress_code else 'OFF'}"
-          "  (extractive JSON/code — lossless structure)")
-    print(f"  Prose:    {'ON' if cfg.compress_prose else 'OFF'}")
-    print(f"  CCR:      {'ON' if cfg.compress_ccr else 'OFF'}"
-          " (reversible context retrieval)")
+    print(f"  Enabled:         {'yes' if cfg.compress_enabled else 'no'}")
+    print(f"  Mode:            {cfg.compress_mode}")
+    print(f"  Prose (Layer 2): {'ON' if cfg.compress_prose else 'OFF'}"
+          "  (LLMLingua-2, aggressive mode only)")
+    print(f"  Protect recent:  {cfg.compress_protect_recent} user turns")
+    print("  Layer 1 (lossless whitespace normalization) is always ON when enabled.")
 
 
 def cmd_compress_mode(args: Namespace) -> None:
@@ -103,23 +109,8 @@ def cmd_compress_mode(args: Namespace) -> None:
     print("Daemon hot-reload: active within 2s. No restart required.")
 
 
-def cmd_compress_code(args: Namespace) -> None:
-    """Enable or disable code/JSON compression."""
-    use_json = getattr(args, "json", False)
-    value = getattr(args, "code_value", "on")
-
-    _write_config(compress_code=(value == "on"))
-
-    if use_json:
-        print(json.dumps({"status": "ok", "compress_code": value == "on"}))
-        return
-
-    print(f"Code compression: {'ENABLED' if value == 'on' else 'DISABLED'}.")
-    print("Daemon hot-reload: active within 2s.")
-
-
 def cmd_compress_prose(args: Namespace) -> None:
-    """Enable or disable prose compression."""
+    """Enable or disable prose compression (Layer 2, LLMLingua-2)."""
     use_json = getattr(args, "json", False)
     value = getattr(args, "prose_value", "off")
 
@@ -141,39 +132,10 @@ def cmd_compress_prose(args: Namespace) -> None:
         print(json.dumps({"status": "ok", "compress_prose": value == "on"}))
         return
 
-    print(f"Prose compression: {'ENABLED' if value == 'on' else 'DISABLED'}.")
+    print(f"Prose compression (LLMLingua-2): {'ENABLED' if value == 'on' else 'DISABLED'}.")
+    if value == "on":
+        print("  Requires: compress_mode=aggressive and llmlingua package installed.")
+        print("  Run: slm compress mode aggressive  (if not already set)")
     if value == "on" and "compress_enabled" in fields:
         print("  (also enabled global compress)")
     print("Daemon hot-reload: active within 2s.")
-
-
-def cmd_compress_align(args: Namespace) -> None:
-    """Enable or disable alignment compression."""
-    use_json = getattr(args, "json", False)
-    value = getattr(args, "align_value", "on")
-
-    _write_config(compress_align=(value == "on"))
-
-    if use_json:
-        print(json.dumps({"status": "ok", "compress_align": value == "on"}))
-        return
-
-    print(f"Alignment compression: {'ENABLED' if value == 'on' else 'DISABLED'}.")
-    print("Daemon hot-reload: active within 2s.")
-
-
-def cmd_compress_ccr(args: Namespace) -> None:
-    """Enable or disable CCR (Compressed Context Retrieval)."""
-    use_json = getattr(args, "json", False)
-    value = getattr(args, "ccr_value", "off")
-
-    _write_config(compress_ccr=(value == "on"))
-
-    if use_json:
-        print(json.dumps({"status": "ok", "compress_ccr": value == "on"}))
-        return
-
-    print(f"CCR (Compressed Context Retrieval): {'ENABLED' if value == 'on' else 'DISABLED'}.")
-    if value == "on":
-        print("Originals stored in llmcache.db for reversible retrieval.")
-    print("Daemon hot-reload: active within 2s.")

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/src/superlocalmemory/cli/optimize_cmd.py

@@ -97,9 +97,7 @@ def cmd_optimize_status(args: Namespace) -> None:
           f" semantic: {'OFF' if not cfg.semantic_enabled else f'{cfg.ttl.semantic_seconds}s'})")
     print(f"  Compress:  {'enabled' if cfg.compress_enabled else 'disabled'}"
           f"  (mode: {cfg.compress_mode},"
-          f" code: {'ON' if cfg.compress_code else 'OFF'},"
-          f" prose: {'ON' if cfg.compress_prose else 'OFF'},"
-          f" CCR: {'ON' if cfg.compress_ccr else 'OFF'})")
+          f" prose/L2: {'ON' if cfg.compress_prose else 'OFF'})")
     proxy_status = f"running on :{OPTIMIZE_DEFAULT_PORT}" if proxy_running else "not running"
     print(f"  Proxy:     {proxy_status}")
     print(f"  Config:    ~/.superlocalmemory/optimize.json  (version {cfg.config_version})")

{superlocalmemory-3.6.9 → superlocalmemory-3.6.11}/src/superlocalmemory/cli/setup_wizard.py

@@ -32,6 +32,8 @@ _SLM_HOME = Path(os.environ.get("SL_MEMORY_PATH", Path.home() / ".superlocalmemo
 _SETUP_MARKER = _SLM_HOME / ".setup-complete"
 _EMBED_MODEL = "nomic-ai/nomic-embed-text-v1.5"
 _RERANKER_MODEL = "cross-encoder/ms-marco-MiniLM-L-12-v2"
+# v3.6.10: compulsory LLMLingua-2 prose compression model (~560MB, aggressive mode).
+_COMPRESSOR_MODEL = "microsoft/llmlingua-2-xlm-roberta-large-meetingbank"
 
 
 # ---------------------------------------------------------------------------
@@ -178,6 +180,49 @@ def _download_reranker(model_name: str) -> bool:
         return False
 
 
+def _download_compressor(model_name: str) -> bool:
+    """Download the LLMLingua-2 prose compression model (v3.6.10).
+
+    Mirrors _download_reranker: a subprocess forces the HF download with visible
+    progress. Fail-open — a network hiccup must NOT break setup; the model also
+    lazy-downloads on first use in prose_llmlingua.py.
+    """
+    print(f"\n  Downloading compression model: {model_name}")
+    print(f"  (LLMLingua-2 prose compressor, ~560MB — aggressive mode only)\n")
+
+    script = (
+        "from llmlingua import PromptCompressor; "
+        f"PromptCompressor(model_name='{model_name}', use_llmlingua2=True, "
+        "device_map='cpu'); "
+        "print('OK')"
+    )
+
+    try:
+        result = subprocess.run(
+            [sys.executable, "-c", script],
+            timeout=900,  # 560MB on a slow link can exceed 5 min
+            capture_output=False,
+            text=True,
+            env={
+                **os.environ,
+                "CUDA_VISIBLE_DEVICES": "",
+                "TOKENIZERS_PARALLELISM": "false",
+                "TORCH_DEVICE": "cpu",
+            },
+        )
+        if result.returncode == 0:
+            print(f"  ✓ Compression model ready")
+            return True
+        print(f"  ✗ Compression model download failed (will lazy-download on first use)")
+        return False
+    except ImportError:
+        print(f"  ⚠ llmlingua not installed — compression model will download on first use")
+        return False
+    except Exception as exc:
+        print(f"  ✗ Compression model error: {exc}")
+        return False
+
+
 # ---------------------------------------------------------------------------
 # Verification
 # ---------------------------------------------------------------------------
@@ -393,6 +438,10 @@ def run_wizard(auto: bool = False) -> None:
     else:
         _download_reranker(_RERANKER_MODEL)
 
+    print()
+    print("─── Step 4c/10: Download Compression Model (LLMLingua-2) ───")
+    _download_compressor(_COMPRESSOR_MODEL)
+
     # -- Step 5: Daemon Configuration (v3.4.3) --
     print()
     print("─── Step 5/10: Daemon Configuration ───")