superlocalmemory 2.6.0 → 2.7.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (46) hide show
  1. package/CHANGELOG.md +167 -1803
  2. package/README.md +212 -397
  3. package/bin/slm +179 -3
  4. package/bin/superlocalmemoryv2:learning +4 -0
  5. package/bin/superlocalmemoryv2:patterns +4 -0
  6. package/docs/ACCESSIBILITY.md +291 -0
  7. package/docs/ARCHITECTURE.md +12 -6
  8. package/docs/FRAMEWORK-INTEGRATIONS.md +300 -0
  9. package/docs/MCP-MANUAL-SETUP.md +14 -4
  10. package/install.sh +99 -3
  11. package/mcp_server.py +291 -1
  12. package/package.json +2 -1
  13. package/requirements-learning.txt +12 -0
  14. package/scripts/verify-v27.sh +233 -0
  15. package/skills/slm-show-patterns/SKILL.md +224 -0
  16. package/src/learning/__init__.py +201 -0
  17. package/src/learning/adaptive_ranker.py +826 -0
  18. package/src/learning/cross_project_aggregator.py +866 -0
  19. package/src/learning/engagement_tracker.py +638 -0
  20. package/src/learning/feature_extractor.py +461 -0
  21. package/src/learning/feedback_collector.py +690 -0
  22. package/src/learning/learning_db.py +842 -0
  23. package/src/learning/project_context_manager.py +582 -0
  24. package/src/learning/source_quality_scorer.py +685 -0
  25. package/src/learning/synthetic_bootstrap.py +1047 -0
  26. package/src/learning/tests/__init__.py +0 -0
  27. package/src/learning/tests/test_adaptive_ranker.py +328 -0
  28. package/src/learning/tests/test_aggregator.py +309 -0
  29. package/src/learning/tests/test_feedback_collector.py +295 -0
  30. package/src/learning/tests/test_learning_db.py +606 -0
  31. package/src/learning/tests/test_project_context.py +296 -0
  32. package/src/learning/tests/test_source_quality.py +355 -0
  33. package/src/learning/tests/test_synthetic_bootstrap.py +433 -0
  34. package/src/learning/tests/test_workflow_miner.py +322 -0
  35. package/src/learning/workflow_pattern_miner.py +665 -0
  36. package/ui/index.html +346 -13
  37. package/ui/js/clusters.js +90 -1
  38. package/ui/js/graph-core.js +445 -0
  39. package/ui/js/graph-cytoscape-monolithic-backup.js +1168 -0
  40. package/ui/js/graph-cytoscape.js +1168 -0
  41. package/ui/js/graph-d3-backup.js +32 -0
  42. package/ui/js/graph-filters.js +220 -0
  43. package/ui/js/graph-interactions.js +354 -0
  44. package/ui/js/graph-ui.js +214 -0
  45. package/ui/js/memories.js +52 -0
  46. package/ui/js/modal.js +104 -1
package/README.md CHANGED
@@ -30,9 +30,8 @@
30
30
  <p align="center">
31
31
  <a href="https://superlocalmemory.com"><strong>superlocalmemory.com</strong></a> •
32
32
  <a href="#-quick-start">Quick Start</a> •
33
- <a href="#-why-superlocalemory">Why This?</a> •
33
+ <a href="#-why-superlocalmemory">Why This?</a> •
34
34
  <a href="#-features">Features</a> •
35
- <a href="#-vs-alternatives">vs Alternatives</a> •
36
35
  <a href="#-documentation">Docs</a> •
37
36
  <a href="https://github.com/varun369/SuperLocalMemoryV2/issues">Issues</a>
38
37
  </p>
@@ -45,77 +44,106 @@
45
44
 
46
45
  ---
47
46
 
48
- ## NEW: v2.6Security Hardening & Performance
47
+ ## What's New in v2.7"Your AI Learns You"
49
48
 
50
- > **SuperLocalMemory is now production-hardened with trust enforcement, rate limiting, and accelerated graph building.**
49
+ **SuperLocalMemory now learns your patterns, adapts to your workflow, and personalizes recall — all 100% locally on your machine.** No cloud. No LLM. Your behavioral data never leaves your device.
51
50
 
52
- | What's New in v2.6 | Why It Matters |
53
- |---------------------|----------------|
54
- | **Trust Enforcement** | Agents with trust below 0.3 are blocked from write/delete — Bayesian scoring now actively protects your memory. |
55
- | **Profile Isolation** | Memory profiles are fully sandboxed — no cross-profile data leakage. |
56
- | **Rate Limiting** | Protects against memory flooding and spam from misbehaving agents. |
57
- | **SSRF Protection** | Webhook dispatcher validates URLs to prevent server-side request forgery. |
58
- | **HNSW-Accelerated Graphs** | Knowledge graph edge building uses HNSW index for faster construction at scale. |
59
- | **Hybrid Search Engine** | Combined semantic + FTS5 + graph retrieval for maximum accuracy. |
51
+ ### Adaptive Learning System
60
52
 
61
- **v2.5 highlights (included):** Real-time event stream, WAL-mode concurrent writes, agent tracking, memory provenance, 28 API endpoints.
53
+ Your memory system evolves with you through three learning layers:
62
54
 
63
- **Upgrade:** `npm install -g superlocalmemory@latest`
55
+ | Layer | What It Learns | How |
56
+ |-------|---------------|-----|
57
+ | **Tech Preferences** | "You prefer FastAPI over Django" (83% confidence) | Cross-project frequency analysis with Bayesian scoring |
58
+ | **Project Context** | Detects your active project from 4 signals | Path analysis, tags, profile, content clustering |
59
+ | **Workflow Patterns** | "You typically: docs → architecture → code → test" | Time-weighted sliding-window sequence mining |
64
60
 
65
- **Dashboard:** `python3 ~/.claude-memory/ui_server.py` then open `http://localhost:8765`
61
+ ### Three-Phase Adaptive Ranking
66
62
 
67
- [Interactive Architecture Diagram](https://superlocalmemory.com/architecture.html) | [Architecture Doc](docs/ARCHITECTURE-V2.5.md) | [Full Changelog](CHANGELOG.md)
63
+ Recall results get smarter over time automatically:
68
64
 
69
- ---
65
+ 1. **Phase 1 (Baseline):** Standard search — same as v2.6
66
+ 2. **Phase 2 (Rule-Based):** After ~20 feedback signals — boosts results matching your preferences
67
+ 3. **Phase 3 (ML Ranking):** After ~200 signals — LightGBM LambdaRank re-ranks with 9 personalized features
70
68
 
71
- ## NEW: Framework Integrations (v2.5.1)
69
+ ### Privacy by Design — GDPR Compliant
72
70
 
73
- Use SuperLocalMemory as a memory backend in your LangChain and LlamaIndex applications — 100% local, zero cloud.
71
+ | Concern | SuperLocalMemory v2.7 | Cloud-Based Alternatives |
72
+ |---------|----------------------|--------------------------|
73
+ | **Where is learning data?** | `~/.claude-memory/learning.db` on YOUR machine | Their servers, their terms |
74
+ | **Who processes your behavior?** | Local gradient boosting (no LLM, no GPU) | Cloud LLMs process your data |
75
+ | **Right to erasure (GDPR Art. 17)?** | `slm learning reset` — one command, instant | Submit a request, wait weeks |
76
+ | **Data portability?** | Copy the SQLite file | Vendor lock-in |
77
+ | **Telemetry?** | Zero. Absolutely none. | Usage analytics, behavior tracking |
74
78
 
75
- ### LangChain
79
+ **Your learning data is stored separately from your memories.** Delete `learning.db` and your memories are untouched. Delete `memory.db` and your learning patterns are untouched. Full data sovereignty.
76
80
 
77
- ```bash
78
- pip install langchain-superlocalmemory
79
- ```
81
+ ### Research-Backed Architecture
80
82
 
81
- ```python
82
- from langchain_superlocalmemory import SuperLocalMemoryChatMessageHistory
83
- from langchain_core.runnables.history import RunnableWithMessageHistory
83
+ Every component is grounded in peer-reviewed research, adapted for local-first operation:
84
84
 
85
- history = SuperLocalMemoryChatMessageHistory(session_id="my-session")
86
- # Messages persist across sessions, stored locally in ~/.claude-memory/memory.db
87
- ```
85
+ | Component | Research Basis |
86
+ |-----------|---------------|
87
+ | Two-stage retrieval pipeline | BM25 → re-ranker (eKNOW 2025) |
88
+ | Adaptive cold-start ranking | Hierarchical meta-learning (LREC 2024) |
89
+ | Time-weighted sequence mining | TSW-PrefixSpan (IEEE 2020) |
90
+ | Bayesian confidence scoring | MACLA (arXiv:2512.18950) |
91
+ | LightGBM LambdaRank | Pairwise ranking (Burges 2010, MO-LightGBM SIGIR 2025) |
92
+ | Privacy-preserving feedback | Zero-communication design — stronger than differential privacy (ADPMF, IPM 2024) |
88
93
 
89
- ### LlamaIndex
94
+ ### New MCP Tools
90
95
 
91
- ```bash
92
- pip install llama-index-storage-chat-store-superlocalmemory
93
- ```
96
+ | Tool | Purpose |
97
+ |------|---------|
98
+ | `memory_used` | Tell the AI which recalled memories were useful — trains the ranking model |
99
+ | `get_learned_patterns` | See what the system has learned about your preferences |
100
+ | `correct_pattern` | Fix a wrong pattern — your correction overrides with maximum confidence |
94
101
 
95
- ```python
96
- from llama_index.storage.chat_store.superlocalmemory import SuperLocalMemoryChatStore
97
- from llama_index.core.memory import ChatMemoryBuffer
102
+ ### New CLI Commands
98
103
 
99
- chat_store = SuperLocalMemoryChatStore()
100
- memory = ChatMemoryBuffer.from_defaults(chat_store=chat_store, chat_store_key="user-1")
104
+ ```bash
105
+ slm useful 42 87 # Mark memories as useful (ranking feedback)
106
+ slm patterns list # See learned tech preferences
107
+ slm learning status # Learning system diagnostics
108
+ slm learning reset # Delete all behavioral data (memories preserved)
109
+ slm engagement # Local engagement health metrics
101
110
  ```
102
111
 
103
- [LangChain Guide](https://github.com/varun369/SuperLocalMemoryV2/wiki/LangChain-Integration) | [LlamaIndex Guide](https://github.com/varun369/SuperLocalMemoryV2/wiki/LlamaIndex-Integration)
112
+ **Upgrade:** `npm install -g superlocalmemory@latest` Learning dependencies install automatically.
113
+
114
+ [Learning System Guide →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Learning-System) | [Upgrade Guide →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Upgrading-to-v2.7) | [Full Changelog](CHANGELOG.md)
104
115
 
105
116
  ---
106
117
 
107
- ## Install in One Command
118
+ <details>
119
+ <summary><strong>Previous: v2.6.5 — Interactive Knowledge Graph</strong></summary>
108
120
 
109
- ```bash
110
- npm install -g superlocalmemory
111
- ```
121
+ - Fully interactive visualization with zoom, pan, click-to-explore (Cytoscape.js)
122
+ - 6 layout algorithms, smart cluster filtering, 10,000+ node performance
123
+ - Mobile & accessibility support: touch gestures, keyboard nav, screen reader
112
124
 
113
- Or clone manually:
114
- ```bash
115
- git clone https://github.com/varun369/SuperLocalMemoryV2.git && cd SuperLocalMemoryV2 && ./install.sh
116
- ```
125
+ </details>
117
126
 
118
- Both methods auto-detect and configure **17+ IDEs and AI tools** — Cursor, VS Code/Copilot, Codex, Claude, Windsurf, Gemini CLI, JetBrains, and more.
127
+ <details>
128
+ <summary><strong>Previous: v2.6 — Security & Scale</strong></summary>
129
+
130
+ ## What's New in v2.6
131
+
132
+ SuperLocalMemory is now **production-hardened** with security, performance, and scale improvements:
133
+
134
+ - **Trust Enforcement** — Bayesian scoring actively protects your memory. Agents with trust below 0.3 are blocked from write/delete operations.
135
+ - **Profile Isolation** — Memory profiles fully sandboxed. Zero cross-profile data leakage.
136
+ - **Rate Limiting** — Protects against memory flooding from misbehaving agents.
137
+ - **HNSW-Accelerated Graphs** — Knowledge graph edge building uses HNSW index for faster construction at scale.
138
+ - **Hybrid Search Engine** — Combined semantic + FTS5 + graph retrieval for maximum accuracy.
139
+
140
+ **v2.5 highlights (included):** Real-time event stream, WAL-mode concurrent writes, agent tracking, memory provenance, 28 API endpoints.
141
+
142
+ **Upgrade:** `npm install -g superlocalmemory@latest`
143
+
144
+ [Interactive Architecture Diagram](https://superlocalmemory.com/architecture.html) | [Architecture Doc](docs/ARCHITECTURE-V2.5.md) | [Full Changelog](CHANGELOG.md)
145
+
146
+ </details>
119
147
 
120
148
  ---
121
149
 
@@ -135,6 +163,8 @@ You: *sighs and explains everything again*
135
163
  - Previous decisions
136
164
  - Debugging history
137
165
 
166
+ ---
167
+
138
168
  ## The Solution
139
169
 
140
170
  ```bash
@@ -155,26 +185,21 @@ superlocalmemoryv2:recall "auth bug"
155
185
 
156
186
  ## 🚀 Quick Start
157
187
 
158
- ### npm (Recommended — All Platforms)
188
+ ### Install (One Command)
189
+
159
190
  ```bash
160
191
  npm install -g superlocalmemory
161
192
  ```
162
193
 
163
- ### Mac/Linux (Manual)
194
+ Or clone manually:
164
195
  ```bash
165
- git clone https://github.com/varun369/SuperLocalMemoryV2.git
166
- cd SuperLocalMemoryV2
167
- ./install.sh
196
+ git clone https://github.com/varun369/SuperLocalMemoryV2.git && cd SuperLocalMemoryV2 && ./install.sh
168
197
  ```
169
198
 
170
- ### Windows (PowerShell)
171
- ```powershell
172
- git clone https://github.com/varun369/SuperLocalMemoryV2.git
173
- cd SuperLocalMemoryV2
174
- .\install.ps1
175
- ```
199
+ Both methods auto-detect and configure **17+ IDEs and AI tools** — Cursor, VS Code/Copilot, Codex, Claude, Windsurf, Gemini CLI, JetBrains, and more.
176
200
 
177
201
  ### Verify Installation
202
+
178
203
  ```bash
179
204
  superlocalmemoryv2:status
180
205
  # ✓ Database: OK (0 memories)
@@ -184,181 +209,107 @@ superlocalmemoryv2:status
184
209
 
185
210
  **That's it.** No Docker. No API keys. No cloud accounts. No configuration.
186
211
 
187
- ### Updating to Latest Version
212
+ ### Launch Dashboard
188
213
 
189
- **npm users:**
190
214
  ```bash
191
- # Update to latest version
192
- npm update -g superlocalmemory
193
-
194
- # Or force latest
195
- npm install -g superlocalmemory@latest
196
-
197
- # Install specific version
198
- npm install -g superlocalmemory@latest
199
- ```
200
-
201
- **Manual install users:**
202
- ```bash
203
- cd SuperLocalMemoryV2
204
- git pull origin main
205
- ./install.sh # Mac/Linux
206
- # or
207
- .\install.ps1 # Windows
208
- ```
209
-
210
- **Your data is safe:** Updates preserve your database and all memories.
211
-
212
- ### Start the Visualization Dashboard
213
-
214
- ```bash
215
- # Launch the interactive web UI
215
+ # Start the interactive web UI
216
216
  python3 ~/.claude-memory/ui_server.py
217
217
 
218
218
  # Opens at http://localhost:8765
219
- # Features: Timeline view, search explorer, graph visualization
219
+ # Features: Timeline, search, interactive graph, statistics
220
220
  ```
221
221
 
222
222
  ---
223
223
 
224
- ## 🎨 Visualization Dashboard
225
-
226
- **NEW in v2.2.0:** Interactive web-based dashboard for exploring your memories visually.
227
-
228
- ### Features
229
-
230
- | Feature | Description |
231
- |---------|-------------|
232
- | **📈 Timeline View** | See your memories chronologically with importance indicators |
233
- | **🔍 Search Explorer** | Real-time semantic search with score visualization |
234
- | **🕸️ Graph Visualization** | Interactive knowledge graph with clusters and relationships |
235
- | **📊 Statistics Dashboard** | Memory trends, tag clouds, pattern insights |
236
- | **🎯 Advanced Filters** | Filter by tags, importance, date range, clusters |
237
-
238
- ### Quick Tour
224
+ ## 💡 Why SuperLocalMemory?
239
225
 
240
- ```bash
241
- # 1. Start dashboard
242
- python ~/.claude-memory/ui_server.py
226
+ ### For Developers Who Use AI Daily
243
227
 
244
- # 2. Navigate to http://localhost:8765
228
+ | Scenario | Without Memory | With SuperLocalMemory |
229
+ |----------|---------------|----------------------|
230
+ | New Claude session | Re-explain entire project | `recall "project context"` → instant context |
231
+ | Debugging | "We tried X last week..." starts over | Knowledge graph shows related past fixes |
232
+ | Code preferences | "I prefer React..." every time | Pattern learning knows your style |
233
+ | Multi-project | Context constantly bleeds | Separate profiles per project |
245
234
 
246
- # 3. Explore your memories:
247
- # - Timeline: See memories over time
248
- # - Search: Find with semantic scoring
249
- # - Graph: Visualize relationships
250
- # - Stats: Analyze patterns
251
- ```
235
+ ### Built on 2026 Research
252
236
 
253
- **[[Complete Dashboard Guide →|Visualization-Dashboard]]**
237
+ Not another simple key-value store. SuperLocalMemory implements **cutting-edge memory architecture** backed by peer-reviewed research:
254
238
 
255
- ---
239
+ - **PageIndex** (Meta AI) → Hierarchical memory organization
240
+ - **GraphRAG** (Microsoft) → Knowledge graph with auto-clustering
241
+ - **xMemory** (Stanford) → Identity pattern learning
242
+ - **A-RAG** → Multi-level retrieval with context awareness
243
+ - **LambdaRank** (Burges 2010, MO-LightGBM SIGIR 2025) → Adaptive re-ranking *(v2.7)*
244
+ - **TSW-PrefixSpan** (IEEE 2020) → Time-weighted workflow pattern mining *(v2.7)*
245
+ - **MACLA** (arXiv:2512.18950) → Bayesian temporal confidence scoring *(v2.7)*
246
+ - **FCS** (LREC 2024) → Hierarchical cold-start mitigation *(v2.7)*
256
247
 
257
- ### New in v2.4.1: Hierarchical Clustering, Community Summaries & Auto-Backup
248
+ **The only open-source implementation combining all eight approaches entirely locally.**
258
249
 
259
- | Feature | Description |
260
- |---------|-------------|
261
- | **Hierarchical Leiden** | Recursive community detection — clusters within clusters up to 3 levels. "Python" → "FastAPI" → "Auth patterns" |
262
- | **Community Summaries** | TF-IDF structured reports per cluster: key topics, projects, categories at a glance |
263
- | **MACLA Confidence** | Bayesian Beta-Binomial scoring (arXiv:2512.18950) — calibrated confidence, not raw frequency |
264
- | **Auto-Backup** | Configurable SQLite backups with retention policies, restore from any backup via CLI |
265
- | **Profile UI** | Create, switch, delete profiles from the web dashboard — full isolation per context |
266
- | **Profile Isolation** | All API endpoints (graph, clusters, patterns, timeline) scoped to active profile |
250
+ [See research citations →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Research-Foundations)
267
251
 
268
252
  ---
269
253
 
270
- ## 🔍 Advanced Search
271
-
272
- SuperLocalMemory V2.2.0 implements **hybrid search** combining multiple strategies for maximum accuracy.
273
-
274
- ### Search Strategies
275
-
276
- | Strategy | Method | Best For |
277
- |----------|--------|----------|
278
- | **Semantic Search** | TF-IDF vectors + cosine similarity | Conceptual queries ("authentication patterns") |
279
- | **Full-Text Search** | SQLite FTS5 with ranking | Exact phrases ("JWT tokens expire") |
280
- | **Graph-Enhanced** | Knowledge graph traversal | Related concepts ("show auth-related") |
281
- | **Hybrid Mode** | All three combined | General queries (default) |
282
-
283
- ### Search Examples
284
-
285
- ```bash
286
- # Semantic: finds conceptually similar
287
- slm recall "security best practices"
288
- # Matches: "JWT implementation", "OAuth flow", "CSRF protection"
254
+ ## Features
289
255
 
290
- # Exact: finds literal text
291
- slm recall "PostgreSQL 15"
292
- # Matches: exactly "PostgreSQL 15"
256
+ ### Multi-Layer Memory Architecture
293
257
 
294
- # Graph: finds related via clusters
295
- slm recall "authentication" --use-graph
296
- # Matches: JWT, OAuth, sessions (via "Auth & Security" cluster)
258
+ **[View Interactive Architecture Diagram](https://superlocalmemory.com/architecture.html)** Click any layer for details, research references, and file paths.
297
259
 
298
- # Hybrid: best of all worlds (default)
299
- slm recall "API design patterns"
300
- # Combines semantic + exact + graph for optimal results
260
+ ```
261
+ ┌─────────────────────────────────────────────────────────────┐
262
+ │ Layer 9: VISUALIZATION (v2.2+) │
263
+ │ Interactive dashboard: timeline, graph explorer, analytics │
264
+ ├─────────────────────────────────────────────────────────────┤
265
+ │ Layer 8: HYBRID SEARCH (v2.2+) │
266
+ │ Combines: Semantic + FTS5 + Graph traversal │
267
+ ├─────────────────────────────────────────────────────────────┤
268
+ │ Layer 7: UNIVERSAL ACCESS │
269
+ │ MCP + Skills + CLI (works everywhere) │
270
+ │ 17+ IDEs with single database │
271
+ ├─────────────────────────────────────────────────────────────┤
272
+ │ Layer 6: MCP INTEGRATION │
273
+ │ Model Context Protocol: 12 tools, 6 resources, 2 prompts │
274
+ │ Auto-configured for Cursor, Windsurf, Claude │
275
+ ├─────────────────────────────────────────────────────────────┤
276
+ │ Layer 5½: ADAPTIVE LEARNING (v2.7 — NEW) │
277
+ │ Three-layer learning: tech prefs + project context + flow │
278
+ │ LightGBM LambdaRank re-ranking (fully local, no cloud) │
279
+ │ Research: eKNOW 2025, MACLA, TSW-PrefixSpan, LREC 2024 │
280
+ ├─────────────────────────────────────────────────────────────┤
281
+ │ Layer 5: SKILLS LAYER │
282
+ │ 7 universal slash-commands for AI assistants │
283
+ │ Compatible with Claude Code, Continue, Cody │
284
+ ├─────────────────────────────────────────────────────────────┤
285
+ │ Layer 4: PATTERN LEARNING + MACLA │
286
+ │ Bayesian confidence scoring (arXiv:2512.18950) │
287
+ │ "You prefer React over Vue" (73% confidence) │
288
+ ├─────────────────────────────────────────────────────────────┤
289
+ │ Layer 3: KNOWLEDGE GRAPH + HIERARCHICAL CLUSTERING │
290
+ │ Recursive Leiden algorithm: "Python" → "FastAPI" → "Auth" │
291
+ │ Community summaries with TF-IDF structured reports │
292
+ ├─────────────────────────────────────────────────────────────┤
293
+ │ Layer 2: HIERARCHICAL INDEX │
294
+ │ Tree structure for fast navigation │
295
+ │ O(log n) lookups instead of O(n) scans │
296
+ ├─────────────────────────────────────────────────────────────┤
297
+ │ Layer 1: RAW STORAGE │
298
+ │ SQLite + Full-text search + TF-IDF vectors │
299
+ │ Compression: 60-96% space savings │
300
+ └─────────────────────────────────────────────────────────────┘
301
301
  ```
302
302
 
303
- ### Measured Search Latency
304
-
305
- | Database Size | Median | P95 | P99 |
306
- |---------------|--------|-----|-----|
307
- | 100 memories | **10.6ms** | 14.9ms | 15.8ms |
308
- | 500 memories | **65.2ms** | 101.7ms | 112.5ms |
309
- | 1,000 memories | **124.3ms** | 190.1ms | 219.5ms |
310
-
311
- For typical personal databases (under 500 memories), search returns faster than you blink. [Full benchmarks →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Performance-Benchmarks)
312
-
313
- ---
314
-
315
- ## ⚡ Measured Performance
316
-
317
- All numbers measured on real hardware (Apple M4 Pro, 24GB RAM). No estimates — real benchmarks.
318
-
319
- ### Search Speed
320
-
321
- | Database Size | Median Latency | P95 Latency |
322
- |---------------|----------------|-------------|
323
- | 100 memories | **10.6ms** | 14.9ms |
324
- | 500 memories | **65.2ms** | 101.7ms |
325
- | 1,000 memories | **124.3ms** | 190.1ms |
326
-
327
- For typical personal use (under 500 memories), search results return faster than you blink.
328
-
329
- ### Concurrent Writes — Zero Errors
330
-
331
- | Scenario | Writes/sec | Errors |
332
- |----------|------------|--------|
333
- | 1 AI tool writing | **204/sec** | 0 |
334
- | 2 AI tools simultaneously | **220/sec** | 0 |
335
- | 5 AI tools simultaneously | **130/sec** | 0 |
336
- | 10 AI tools simultaneously | **25/sec** | 0 |
337
-
338
- WAL mode + serialized write queue = zero "database is locked" errors, ever.
339
-
340
- ### Storage
341
-
342
- 10,000 memories = **13.6 MB** on disk (~1.9 KB per memory). Your entire AI memory history takes less space than a photo.
343
-
344
- ### Trust Defense
345
-
346
- Bayesian trust scoring achieves **perfect separation** (trust gap = 1.0) between honest and malicious agents. Detects "sleeper" attacks with 74.7% trust drop. Zero false positives.
347
-
348
- ### Graph Construction
349
-
350
- | Memories | Build Time |
351
- |----------|-----------|
352
- | 100 | 0.28s |
353
- | 1,000 | 10.6s |
354
-
355
- Leiden clustering discovers 6-7 natural topic communities automatically.
356
-
357
- > **Graph Scaling:** Knowledge graph features work best with up to 10,000 memories. For larger databases, the system uses intelligent sampling (most recent + highest importance memories) for graph construction. Core search and memory storage have no upper limit.
358
-
359
- > **LoCoMo benchmark results coming soon** — evaluation against the standardized [LoCoMo](https://snap-research.github.io/locomo/) long-conversation memory benchmark (Snap Research, ACL 2024).
303
+ ### Key Capabilities
360
304
 
361
- [Full benchmark details →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Performance-Benchmarks)
305
+ - **[Adaptive Learning System](https://github.com/varun369/SuperLocalMemoryV2/wiki/Learning-System)** — Learns your tech preferences, workflow patterns, and project context. Personalizes recall ranking using local ML (LightGBM). Zero cloud dependency. *New in v2.7*
306
+ - **[Knowledge Graphs](https://github.com/varun369/SuperLocalMemoryV2/wiki/Knowledge-Graph)** — Automatic relationship discovery. Interactive visualization with zoom, pan, click.
307
+ - **[Pattern Learning](https://github.com/varun369/SuperLocalMemoryV2/wiki/Pattern-Learning)** — Learns your coding preferences and style automatically.
308
+ - **[Multi-Profile Support](https://github.com/varun369/SuperLocalMemoryV2/wiki/Using-Memory-Profiles)** — Isolated contexts for work, personal, clients. Zero context bleeding.
309
+ - **[Hybrid Search](https://github.com/varun369/SuperLocalMemoryV2/wiki/Advanced-Search)** — Semantic + FTS5 + Graph retrieval combined for maximum accuracy.
310
+ - **[Visualization Dashboard](https://github.com/varun369/SuperLocalMemoryV2/wiki/Visualization-Dashboard)** — Web UI for timeline, search, graph exploration, analytics.
311
+ - **[Framework Integrations](docs/FRAMEWORK-INTEGRATIONS.md)** — Use with LangChain and LlamaIndex applications.
312
+ - **[Real-Time Events](https://github.com/varun369/SuperLocalMemoryV2/wiki/Real-Time-Event-System)** — Live notifications via SSE/WebSocket/Webhooks when memories change.
362
313
 
363
314
  ---
364
315
 
@@ -381,79 +332,29 @@ Leiden clustering discovers 6-7 natural topic communities automatically.
381
332
  | **Gemini CLI** | ✅ MCP + Skills | Native MCP + skills |
382
333
  | **JetBrains IDEs** | ✅ MCP | Via AI Assistant settings |
383
334
  | **Zed Editor** | ✅ MCP | Native MCP tools |
384
- | **OpenCode** | ✅ MCP | Native MCP tools |
385
- | **Perplexity** | ✅ MCP | Native MCP tools |
386
- | **Antigravity** | ✅ MCP + Skills | Native MCP tools |
387
- | **ChatGPT** | ✅ MCP Connector | `search()` + `fetch()` via HTTP tunnel |
388
335
  | **Aider** | ✅ Smart Wrapper | `aider-smart` with context |
389
336
  | **Any Terminal** | ✅ Universal CLI | `slm remember "content"` |
390
337
 
391
338
  ### Three Ways to Access
392
339
 
393
- 1. **MCP (Model Context Protocol)** - Auto-configured for Cursor, Windsurf, Claude Desktop
340
+ 1. **MCP (Model Context Protocol)** Auto-configured for Cursor, Windsurf, Claude Desktop
394
341
  - AI assistants get natural access to your memory
395
342
  - No manual commands needed
396
343
  - "Remember that we use FastAPI" just works
397
344
 
398
- 2. **Skills & Commands** - For Claude Code, Continue.dev, Cody
345
+ 2. **Skills & Commands** For Claude Code, Continue.dev, Cody
399
346
  - `/superlocalmemoryv2:remember` in Claude Code
400
347
  - `/slm-remember` in Continue.dev and Cody
401
348
  - Familiar slash command interface
402
349
 
403
- 3. **Universal CLI** - Works in any terminal or script
350
+ 3. **Universal CLI** Works in any terminal or script
404
351
  - `slm remember "content"` - Simple, clean syntax
405
352
  - `slm recall "query"` - Search from anywhere
406
353
  - `aider-smart` - Aider with auto-context injection
407
354
 
408
355
  **All three methods use the SAME local database.** No data duplication, no conflicts.
409
356
 
410
- ### Auto-Detection
411
-
412
- Installation automatically detects and configures:
413
- - Existing IDEs (Cursor, Windsurf, VS Code)
414
- - Installed tools (Aider, Continue, Cody)
415
- - Shell environment (bash, zsh)
416
-
417
- **Zero manual configuration required.** It just works.
418
-
419
- ### Manual Setup for Other Apps
420
-
421
- Want to use SuperLocalMemory in ChatGPT, Perplexity, Zed, or other MCP-compatible tools?
422
-
423
- **📘 Complete setup guide:** [docs/MCP-MANUAL-SETUP.md](docs/MCP-MANUAL-SETUP.md)
424
-
425
- Covers:
426
- - ChatGPT Desktop - Add via Settings → MCP
427
- - Perplexity - Configure via app settings
428
- - Zed Editor - JSON configuration
429
- - Cody - VS Code/JetBrains setup
430
- - Custom MCP clients - Python/HTTP integration
431
-
432
- All tools connect to the **same local database** - no data duplication.
433
-
434
- ---
435
-
436
- ## 💡 Why SuperLocalMemory?
437
-
438
- ### For Developers Who Use AI Daily
439
-
440
- | Scenario | Without Memory | With SuperLocalMemory |
441
- |----------|---------------|----------------------|
442
- | New Claude session | Re-explain entire project | `recall "project context"` → instant context |
443
- | Debugging | "We tried X last week..." starts over | Knowledge graph shows related past fixes |
444
- | Code preferences | "I prefer React..." every time | Pattern learning knows your style |
445
- | Multi-project | Context constantly bleeds | Separate profiles per project |
446
-
447
- ### Built on 2026 Research
448
-
449
- Not another simple key-value store. SuperLocalMemory implements **cutting-edge memory architecture**:
450
-
451
- - **PageIndex** (Meta AI) → Hierarchical memory organization
452
- - **GraphRAG** (Microsoft) → Knowledge graph with auto-clustering
453
- - **xMemory** (Stanford) → Identity pattern learning
454
- - **A-RAG** → Multi-level retrieval with context awareness
455
-
456
- **The only open-source implementation combining all four approaches.**
357
+ [Complete setup guide for all tools →](docs/MCP-MANUAL-SETUP.md)
457
358
 
458
359
  ---
459
360
 
@@ -470,150 +371,72 @@ Not another simple key-value store. SuperLocalMemory implements **cutting-edge m
470
371
  | **Letta/MemGPT** | Self-hosted (complex) | TBD | Requires significant setup |
471
372
  | **SuperLocalMemory V2** | **Unlimited** | **$0 forever** | **Nothing.** |
472
373
 
473
- ### Feature Comparison (What Actually Matters)
374
+ ### What Actually Matters
474
375
 
475
376
  | Feature | Mem0 | Zep | Khoj | Letta | **SuperLocalMemory V2** |
476
377
  |---------|------|-----|------|-------|------------------------|
477
378
  | **Works in Cursor** | Cloud Only | ❌ | ❌ | ❌ | ✅ **Local** |
478
379
  | **Works in Windsurf** | Cloud Only | ❌ | ❌ | ❌ | ✅ **Local** |
479
380
  | **Works in VS Code** | 3rd Party | ❌ | Partial | ❌ | ✅ **Native** |
480
- | **Works in Claude** | ❌ | ❌ | ❌ | ❌ | ✅ |
481
- | **Works with Aider** | ❌ | ❌ | ❌ | ❌ | ✅ |
482
381
  | **Universal CLI** | ❌ | ❌ | ❌ | ❌ | ✅ |
483
- | **7-Layer Universal Architecture** | ❌ | ❌ | ❌ | ❌ | ✅ |
382
+ | **Multi-Layer Architecture** | ❌ | ❌ | ❌ | ❌ | ✅ |
484
383
  | **Pattern Learning** | ❌ | ❌ | ❌ | ❌ | ✅ |
485
- | **Multi-Profile Support** | | ❌ | ❌ | Partial | ✅ |
384
+ | **Adaptive ML Ranking** | Cloud LLM | ❌ | ❌ | | ✅ **Local ML** |
486
385
  | **Knowledge Graphs** | ✅ | ✅ | ❌ | ❌ | ✅ |
487
386
  | **100% Local** | ❌ | ❌ | Partial | Partial | ✅ |
387
+ | **GDPR by Design** | ❌ | ❌ | ❌ | ❌ | ✅ |
488
388
  | **Zero Setup** | ❌ | ❌ | ❌ | ❌ | ✅ |
489
- | **Progressive Compression** | ❌ | ❌ | ❌ | ❌ | ✅ |
490
389
  | **Completely Free** | Limited | Limited | Partial | ✅ | ✅ |
491
390
 
492
391
  **SuperLocalMemory V2 is the ONLY solution that:**
392
+ - ✅ **Learns and adapts** locally — no cloud LLM needed for personalization
493
393
  - ✅ Works across 17+ IDEs and CLI tools
494
394
  - ✅ Remains 100% local (no cloud dependencies)
395
+ - ✅ GDPR Article 17 compliant — one-command data erasure
495
396
  - ✅ Completely free with unlimited memories
496
397
 
497
398
  [See full competitive analysis →](docs/COMPETITIVE-ANALYSIS.md)
498
399
 
499
400
  ---
500
401
 
501
- ## Features
502
-
503
- ### Multi-Layer Memory Architecture
504
-
505
- **[View Interactive Architecture Diagram](https://superlocalmemory.com/architecture.html)** — Click any layer for details, research references, and file paths.
506
-
507
- ```
508
- ┌─────────────────────────────────────────────────────────────┐
509
- │ Layer 9: VISUALIZATION (NEW v2.2.0) │
510
- │ Interactive dashboard: timeline, search, graph explorer │
511
- │ Real-time analytics and visual insights │
512
- ├─────────────────────────────────────────────────────────────┤
513
- │ Layer 8: HYBRID SEARCH (NEW v2.2.0) │
514
- │ Combines: Semantic + FTS5 + Graph traversal │
515
- │ 80ms response time with maximum accuracy │
516
- ├─────────────────────────────────────────────────────────────┤
517
- │ Layer 7: UNIVERSAL ACCESS │
518
- │ MCP + Skills + CLI (works everywhere) │
519
- │ 17+ IDEs with single database │
520
- ├─────────────────────────────────────────────────────────────┤
521
- │ Layer 6: MCP INTEGRATION │
522
- │ Model Context Protocol: 6 tools, 4 resources, 2 prompts │
523
- │ Auto-configured for Cursor, Windsurf, Claude │
524
- ├─────────────────────────────────────────────────────────────┤
525
- │ Layer 5: SKILLS LAYER │
526
- │ 6 universal slash-commands for AI assistants │
527
- │ Compatible with Claude Code, Continue, Cody │
528
- ├─────────────────────────────────────────────────────────────┤
529
- │ Layer 4: PATTERN LEARNING + MACLA (v2.4.0) │
530
- │ Bayesian Beta-Binomial confidence (arXiv:2512.18950) │
531
- │ "You prefer React over Vue" (73% confidence) │
532
- ├─────────────────────────────────────────────────────────────┤
533
- │ Layer 3: KNOWLEDGE GRAPH + HIERARCHICAL LEIDEN (v2.4.1) │
534
- │ Recursive clustering: "Python" → "FastAPI" → "Auth" │
535
- │ Community summaries + TF-IDF structured reports │
536
- ├─────────────────────────────────────────────────────────────┤
537
- │ Layer 2: HIERARCHICAL INDEX │
538
- │ Tree structure for fast navigation │
539
- │ O(log n) lookups instead of O(n) scans │
540
- ├─────────────────────────────────────────────────────────────┤
541
- │ Layer 1: RAW STORAGE │
542
- │ SQLite + Full-text search + TF-IDF vectors │
543
- │ Compression: 60-96% space savings │
544
- └─────────────────────────────────────────────────────────────┘
545
- ```
546
-
547
- ### Knowledge Graph (It's Magic)
548
-
549
- ```bash
550
- # Build the graph from your memories
551
- python ~/.claude-memory/graph_engine.py build
552
-
553
- # Output:
554
- # ✓ Processed 47 memories
555
- # ✓ Created 12 clusters:
556
- # - "Authentication & Tokens" (8 memories)
557
- # - "Performance Optimization" (6 memories)
558
- # - "React Components" (11 memories)
559
- # - "Database Queries" (5 memories)
560
- # ...
561
- ```
402
+ ## Measured Performance
562
403
 
563
- **The graph automatically discovers relationships.** Ask "what relates to auth?" and get JWT, session management, token refresheven if you never tagged them together.
404
+ All numbers measured on real hardware (Apple M4 Pro, 24GB RAM). No estimatesreal benchmarks.
564
405
 
565
- ### Pattern Learning (It Knows You)
406
+ ### Search Speed
566
407
 
567
- ```bash
568
- # Learn patterns from your memories
569
- python ~/.claude-memory/pattern_learner.py update
570
-
571
- # Get your coding identity
572
- python ~/.claude-memory/pattern_learner.py context 0.5
573
-
574
- # Output:
575
- # Your Coding Identity:
576
- # - Framework preference: React (73% confidence)
577
- # - Style: Performance over readability (58% confidence)
578
- # - Testing: Jest + React Testing Library (65% confidence)
579
- # - API style: REST over GraphQL (81% confidence)
580
- ```
408
+ | Database Size | Median Latency | P95 Latency |
409
+ |---------------|----------------|-------------|
410
+ | 100 memories | **10.6ms** | 14.9ms |
411
+ | 500 memories | **65.2ms** | 101.7ms |
412
+ | 1,000 memories | **124.3ms** | 190.1ms |
581
413
 
582
- **Your AI assistant can now match your preferences automatically.**
414
+ For typical personal use (under 500 memories), search results return faster than you blink.
583
415
 
584
- **MACLA Confidence Scoring (v2.4.0):** Confidence uses a Bayesian Beta-Binomial posterior (Forouzandeh et al., [arXiv:2512.18950](https://arxiv.org/abs/2512.18950)). Pattern-specific priors, log-scaled competition, recency bonus. Range: 0.0–0.95 (hard cap prevents overconfidence).
416
+ ### Concurrent Writes Zero Errors
585
417
 
586
- ### Multi-Profile Support
418
+ | Scenario | Writes/sec | Errors |
419
+ |----------|------------|--------|
420
+ | 1 AI tool writing | **204/sec** | 0 |
421
+ | 2 AI tools simultaneously | **220/sec** | 0 |
422
+ | 5 AI tools simultaneously | **130/sec** | 0 |
587
423
 
588
- ```bash
589
- # Work profile
590
- superlocalmemoryv2:profile create work --description "Day job"
591
- superlocalmemoryv2:profile switch work
424
+ WAL mode + serialized write queue = zero "database is locked" errors, ever.
592
425
 
593
- # Personal projects
594
- superlocalmemoryv2:profile create personal
595
- superlocalmemoryv2:profile switch personal
426
+ ### Storage
596
427
 
597
- # Client projects (completely isolated)
598
- superlocalmemoryv2:profile create client-acme
599
- ```
428
+ 10,000 memories = **13.6 MB** on disk (~1.9 KB per memory). Your entire AI memory history takes less space than a photo.
600
429
 
601
- **Each profile has isolated memories, graphs, and patterns.** No context bleeding.
430
+ ### Graph Construction
602
431
 
603
- ---
432
+ | Memories | Build Time |
433
+ |----------|-----------|
434
+ | 100 | 0.28s |
435
+ | 1,000 | 10.6s |
604
436
 
605
- ## 📖 Documentation
437
+ Leiden clustering discovers 6-7 natural topic communities automatically.
606
438
 
607
- | Guide | Description |
608
- |-------|-------------|
609
- | [Quick Start](https://github.com/varun369/SuperLocalMemoryV2/wiki/Quick-Start-Tutorial) | Get running in 5 minutes |
610
- | [Installation](https://github.com/varun369/SuperLocalMemoryV2/wiki/Installation) | Detailed setup instructions |
611
- | [Visualization Dashboard](https://github.com/varun369/SuperLocalMemoryV2/wiki/Visualization-Dashboard) | Interactive web UI guide (NEW v2.2.0) |
612
- | [CLI Reference](docs/CLI-COMMANDS-REFERENCE.md) | All commands explained |
613
- | [Knowledge Graph](docs/GRAPH-ENGINE.md) | How clustering works |
614
- | [Pattern Learning](docs/PATTERN-LEARNING.md) | Identity extraction |
615
- | [Profiles Guide](docs/PROFILES-GUIDE.md) | Multi-context management |
616
- | [API Reference](docs/API-REFERENCE.md) | Python API documentation |
439
+ [Full benchmark details →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Performance-Benchmarks)
617
440
 
618
441
  ---
619
442
 
@@ -632,40 +455,33 @@ superlocalmemoryv2:profile create <name> # New profile
632
455
  superlocalmemoryv2:profile switch <name> # Switch context
633
456
 
634
457
  # Knowledge Graph
635
- python ~/.claude-memory/graph_engine.py build # Build graph (+ hierarchical + summaries)
458
+ python ~/.claude-memory/graph_engine.py build # Build graph
636
459
  python ~/.claude-memory/graph_engine.py stats # View clusters
637
- python ~/.claude-memory/graph_engine.py related --id 5 # Find related
638
- python ~/.claude-memory/graph_engine.py hierarchical # Sub-cluster large communities
639
- python ~/.claude-memory/graph_engine.py summaries # Generate cluster summaries
640
460
 
641
461
  # Pattern Learning
642
462
  python ~/.claude-memory/pattern_learner.py update # Learn patterns
643
463
  python ~/.claude-memory/pattern_learner.py context 0.5 # Get identity
644
464
 
645
- # Auto-Backup (v2.4.0)
646
- python ~/.claude-memory/auto_backup.py backup # Manual backup
647
- python ~/.claude-memory/auto_backup.py list # List backups
648
- python ~/.claude-memory/auto_backup.py status # Backup status
649
-
650
- # Reset (Use with caution!)
651
- superlocalmemoryv2:reset soft # Clear memories
652
- superlocalmemoryv2:reset hard --confirm # Nuclear option
465
+ # Visualization Dashboard
466
+ python ~/.claude-memory/ui_server.py # Launch web UI
653
467
  ```
654
468
 
655
- ---
469
+ [Complete CLI reference →](docs/CLI-COMMANDS-REFERENCE.md)
656
470
 
657
- ## 📊 Performance at a Glance
471
+ ---
658
472
 
659
- | Metric | Measured Result |
660
- |--------|----------------|
661
- | **Search latency** | **10.6ms** median (100 memories) |
662
- | **Concurrent writes** | **220/sec** with 2 agents, zero errors |
663
- | **Storage** | **1.9 KB** per memory at scale (13.6 MB for 10K) |
664
- | **Trust defense** | **1.0** trust gap (perfect separation) |
665
- | **Graph build** | **0.28s** for 100 memories |
666
- | **Search quality** | **MRR 0.90** (first result correct 9/10 times) |
473
+ ## 📖 Documentation
667
474
 
668
- [Full benchmark details →](https://github.com/varun369/SuperLocalMemoryV2/wiki/Performance-Benchmarks)
475
+ | Guide | Description |
476
+ |-------|-------------|
477
+ | [Quick Start](https://github.com/varun369/SuperLocalMemoryV2/wiki/Quick-Start-Tutorial) | Get running in 5 minutes |
478
+ | [Installation](https://github.com/varun369/SuperLocalMemoryV2/wiki/Installation) | Detailed setup instructions |
479
+ | [Visualization Dashboard](https://github.com/varun369/SuperLocalMemoryV2/wiki/Visualization-Dashboard) | Interactive web UI guide |
480
+ | [Interactive Graph](https://github.com/varun369/SuperLocalMemoryV2/wiki/Using-Interactive-Graph) | Graph exploration guide (NEW v2.6.5) |
481
+ | [Framework Integrations](docs/FRAMEWORK-INTEGRATIONS.md) | LangChain & LlamaIndex setup |
482
+ | [Knowledge Graph](docs/GRAPH-ENGINE.md) | How clustering works |
483
+ | [Pattern Learning](docs/PATTERN-LEARNING.md) | Identity extraction |
484
+ | [API Reference](docs/API-REFERENCE.md) | Python API documentation |
669
485
 
670
486
  ---
671
487
 
@@ -675,9 +491,8 @@ We welcome contributions! See [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines.
675
491
 
676
492
  **Areas for contribution:**
677
493
  - Additional pattern categories
678
- - Graph visualization UI
679
- - Integration with more AI assistants
680
494
  - Performance optimizations
495
+ - Integration with more AI assistants
681
496
  - Documentation improvements
682
497
 
683
498
  ---