superlocalmemory 2.7.6 → 2.8.1

package/CHANGELOG.md

@@ -16,10 +16,41 @@ SuperLocalMemory V2 - Intelligent local memory system for AI coding assistants.
 
 ---
 
+## [2.8.0] - 2026-02-26
+
+**Release Type:** Major Feature Release — "Memory That Manages Itself"
+
+SuperLocalMemory now manages its own memory lifecycle, learns from action outcomes, and provides enterprise-grade compliance — all 100% locally on your machine.
+
+### Added
+- **Memory Lifecycle Management** — Memories automatically organize themselves over time based on usage patterns, keeping your memory system fast and relevant
+- **Behavioral Learning** — The system learns what works by tracking action outcomes, extracting success patterns, and transferring knowledge across projects
+- **Enterprise Compliance** — Full access control, immutable audit trails, and retention policy management for GDPR, HIPAA, and EU AI Act
+- **6 New MCP Tools** — `report_outcome`, `get_lifecycle_status`, `set_retention_policy`, `compact_memories`, `get_behavioral_patterns`, `audit_trail`
+- **Improved Search** — Lifecycle-aware recall that automatically promotes relevant memories and filters stale ones
+- **Performance Optimized** — Real-time lifecycle management and access control
+
+### Changed
+- Enhanced ranking algorithm with additional signals for improved relevance
+- Improved search ranking using multiple relevance factors
+- Search results include lifecycle state information
+
+### Fixed
+- Configurable storage limits prevent unbounded memory growth
+
+---
+
+## [2.7.6] - 2026-02-22
+
+### Improved
+- Documentation organization and navigation
+
+---
+
 ## [2.7.4] - 2026-02-16
 
 ### Added
-- Per-profile learning — each profile has its own preferences and feedback
+- Per-profile learning — each profile learns its own preferences independently
 - Thumbs up/down and pin feedback on memory cards
 - Learning data management in Settings (backup + reset)
 - "What We Learned" summary card in Learning tab
@@ -28,7 +59,6 @@ SuperLocalMemory V2 - Intelligent local memory system for AI coding assistants.
 - Smarter learning from your natural usage patterns
 - Recall results improve automatically over time
 - Privacy notice for all learning features
-- Learning and backup databases protected together
 - All dashboard tabs refresh on profile switch
 
 ---
@@ -40,17 +70,14 @@ SuperLocalMemory V2 - Intelligent local memory system for AI coding assistants.
 - Improved search result relevance across all access methods
 - Better error handling for optional components
 
-### Fixed
-- Corrected outdated performance references in documentation
-
 ---
 
 ## [2.7.1] - 2026-02-16
 
 ### Added
-- **Learning Dashboard Tab** — New "Learning" tab in the web dashboard showing ranking phase, tech preferences, workflow patterns, source quality, engagement health, and privacy controls
-- **Learning API Routes** — `/api/learning/status`, `/api/learning/reset`, `/api/learning/retrain` endpoints for the dashboard
-- **One-click Reset** — Reset all learning data directly from the dashboard UI
+- **Learning Dashboard Tab** — View your ranking phase, preferences, workflow patterns, and privacy controls
+- **Learning API** — Endpoints for dashboard learning features
+- **One-click Reset** — Reset all learning data directly from the dashboard
 
 ---
 
@@ -58,55 +85,30 @@ SuperLocalMemory V2 - Intelligent local memory system for AI coding assistants.
 
 **Release Type:** Major Feature Release — "Your AI Learns You"
 
-SuperLocalMemory now learns your patterns, adapts to your workflow, and personalizes recall. All processing happens 100% locally — your behavioral data never leaves your machine. GDPR Article 17 compliant by design.
+SuperLocalMemory now learns your patterns, adapts to your workflow, and personalizes recall. All processing happens 100% locally — your behavioral data never leaves your machine.
 
 ### Added
-- **Adaptive Learning System** — Three-layer learning architecture that detects tech preferences, project context, and workflow patterns across all your projects
-- **Personalized Recall Ranking** — Search results re-ranked using learned patterns. Three-phase adaptive system: baseline → rule-based → ML (LightGBM LambdaRank)
-- **Synthetic Bootstrap** — ML model works from day 1 by bootstrapping from existing memory patterns. No cold-start degradation.
-- **Multi-Channel Feedback** — Tell the system which memories were useful via MCP (`memory_used`), CLI (`slm useful`), or dashboard clicks
-- **Source Quality Scoring** — Learns which tools produce the most useful memories using Beta-Binomial Bayesian scoring
-- **Workflow Pattern Detection** — Detects your coding workflow sequences (e.g., docs → architecture → code → test) using time-weighted sliding-window mining
-- **Local Engagement Metrics** — Track memory system health locally with zero telemetry (`slm engagement`)
-- **Separate Learning Database** — Behavioral data in `learning.db`, isolated from `memory.db`. One-command erasure: `slm learning reset`
-- **3 New MCP Tools** — `memory_used` (feedback signal), `get_learned_patterns` (transparency), `correct_pattern` (user control)
-- **2 New MCP Resources** — `memory://learning/status`, `memory://engagement`
-- **New CLI Commands** — `slm useful`, `slm learning status/retrain/reset`, `slm engagement`, `slm patterns correct`
-- **New Skill** — `slm-show-patterns` for viewing learned preferences in Claude Code and compatible tools
-- **Auto Python Installation** — `install.sh` now auto-installs Python 3 on macOS (Homebrew/Xcode) and Linux (apt/dnf) for new users
-- **319 Tests** — 229 unit tests + 13 E2E + 14 regression + 19 fresh-install + 42 edge-case tests
-
-### Research Foundations
-- Two-stage BM25 → re-ranker pipeline (eKNOW 2025)
-- LightGBM LambdaRank pairwise ranking (Burges 2010, MO-LightGBM SIGIR 2025)
-- Three-phase cold-start mitigation (LREC 2024)
-- Time-weighted sequence mining (TSW-PrefixSpan, IEEE 2020)
-- Bayesian temporal confidence (MACLA, arXiv:2512.18950)
-- Privacy-preserving zero-communication feedback design
-
-### Changed
-- **MCP Tools** — Now 12 tools (was 9), 6 resources (was 4), 2 prompts
-- **Skills** — Now 7 universal skills (was 6)
-- **install.sh** — Auto-installs Python if missing, installs learning deps automatically
-- **DMG Installer** — Updated to v2.7.0 with learning modules
-
-### Dependencies (Optional)
-- `lightgbm>=4.0.0` — ML ranking (auto-installed, graceful fallback if unavailable)
-- `scipy>=1.9.0` — Statistical functions (auto-installed, graceful fallback if unavailable)
-
-### Performance
-- Re-ranking adds <15ms latency to recall queries
-- Learning DB typically <1MB for 1,000 memories
-- Bootstrap model trains in <30 seconds for 1,000 memories
-- All BM1-BM6 benchmarks: no regression >10%
+- **Adaptive Learning System** — Detects your tech preferences, project context, and workflow patterns across all your projects
+- **Personalized Recall** — Search results automatically re-ranked based on your learned preferences. Gets smarter over time.
+- **Zero Cold-Start** — Personalization works from day 1 using your existing memory patterns
+- **Multi-Channel Feedback** — Tell the system which memories were useful via MCP, CLI, or dashboard
+- **Source Quality Scoring** — Learns which tools produce the most useful memories
+- **Workflow Detection** — Recognizes your coding workflow sequences and adapts retrieval accordingly
+- **Engagement Metrics** — Track memory system health locally with zero telemetry
+- **Isolated Learning Data** — Behavioral data stored separately from memories. One-command erasure for full GDPR compliance.
+- **3 New MCP Tools** — Feedback signal, pattern transparency, and user correction
+- **2 New MCP Resources** — Learning status and engagement metrics
+- **New CLI Commands** — Learning management, engagement tracking, pattern correction
+- **New Skill** — View learned preferences in Claude Code and compatible tools
+- **Auto Python Installation** — Installer now auto-detects and installs Python for new users
 
 ---
 
 ## [2.6.5] - 2026-02-16
 
 ### Added
-- **Interactive Knowledge Graph** - Fully interactive visualization with zoom, pan, and click-to-explore capabilities
-- **Mobile & Accessibility Support** - Touch gestures, keyboard navigation, and screen reader compatibility
+- **Interactive Knowledge Graph** — Fully interactive visualization with zoom, pan, and click-to-explore
+- **Mobile & Accessibility Support** — Touch gestures, keyboard navigation, and screen reader compatibility
 
 ---
 
@@ -115,27 +117,21 @@ SuperLocalMemory now learns your patterns, adapts to your workflow, and personal
 **Release Type:** Security Hardening & Scalability — "Battle-Tested"
 
 ### Added
-- **Rate Limiting** - 100 writes/min and 300 reads/min per IP (stdlib-only, no dependencies)
-- **API Key Authentication** - Optional API key auth via `~/.claude-memory/api_key` file
-- **CI Workflow** - GitHub Actions test pipeline across Python 3.8, 3.10, and 3.12
-- **Trust Enforcement** - Agents below 0.3 trust score blocked from write/delete
-- **HNSW Vector Index** - O(log n) search with graceful TF-IDF fallback
-- **Hybrid Search** - BM25 + Graph + TF-IDF fusion via `SLM_HYBRID_SEARCH=true`
-- **SSRF Protection** - Webhook URLs validated against private IP ranges
-
-### Changed
-- **Graph cap raised to 10,000 memories** (was 5,000) with intelligent random sampling
-- **Profile isolation hardened** - All queries enforce `WHERE profile = ?` filtering
-- **Bounded write queue** - Max 1,000 pending operations (was unbounded)
-- **TF-IDF optimization** - Skip rebuild when memory count changes <5%
-- **Error sanitization** - Internal paths and table names stripped from 15 error sites
-- **Connection pool capped** - Max 50 read connections
-
-### Fixed
-- Replaced bare `except:` clauses with specific exception types in hybrid_search.py and cache_manager.py
+- **Rate Limiting** — Protection against abuse with configurable thresholds
+- **API Key Authentication** — Optional authentication for API access
+- **CI Workflow** — Automated testing across multiple Python versions
+- **Trust Enforcement** — Untrusted agents blocked from write and delete operations
+- **Advanced Search Index** — Faster search at scale with graceful fallback
+- **Hybrid Search** — Combined search across multiple retrieval methods
+- **SSRF Protection** — Webhook URLs validated against malicious targets
 
-### Performance
-See [wiki Performance Benchmarks](https://superlocalmemory.com/wiki/Performance-Benchmarks) for measured data.
+### Improved
+- Higher memory graph capacity with intelligent sampling
+- Hardened profile isolation across all queries
+- Bounded resource usage under high load
+- Optimized index rebuilds for large databases
+- Sanitized error messages — no internal details leaked
+- Capped resource pools for stability
 
 ---
 
@@ -143,12 +139,10 @@ See [wiki Performance Benchmarks](https://superlocalmemory.com/wiki/Performance-
 
 **Release Type:** Framework Integration — "Plugged Into the Ecosystem"
 
-SuperLocalMemory is now a first-class memory backend for LangChain and LlamaIndex — the two largest AI/LLM frameworks.
-
 ### Added
-- **LangChain Integration** - `langchain-superlocalmemory` package for persistent chat history
-- **LlamaIndex Integration** - `llama-index-storage-chat-store-superlocalmemory` for ChatMemoryBuffer
-- **Session isolation** - Framework memories tagged separately, never appear in normal `slm recall`
+- **LangChain Integration** — Persistent chat history for LangChain applications
+- **LlamaIndex Integration** — Chat memory storage for LlamaIndex
+- **Session Isolation** — Framework memories tagged separately from normal recall
 
 ---
 
@@ -159,44 +153,34 @@ SuperLocalMemory is now a first-class memory backend for LangChain and LlamaInde
 SuperLocalMemory transforms from passive storage to active coordination layer. Every memory operation now triggers real-time events.
 
 ### Added
-- **DbConnectionManager** - SQLite WAL mode, write queue, connection pool (fixes "database is locked")
-- **Event Bus** - Real-time SSE/WebSocket/Webhook broadcasting with tiered retention (48h/14d/30d)
-- **Subscription Manager** - Durable + ephemeral subscriptions with event filters
-- **Webhook Dispatcher** - HTTP POST delivery with exponential backoff retry
-- **Agent Registry** - Track connected AI agents (protocol, write/recall counters, last seen)
-- **Provenance Tracker** - Track memory origin (created_by, source_protocol, trust_score, lineage)
-- **Trust Scorer** - Bayesian trust signal collection (silent in v2.5, enforced in v2.6)
-- **Dashboard: Live Events tab** - Real-time event stream with filters and stats
-- **Dashboard: Agents tab** - Connected agents table with trust scores and protocol badges
-
-### Changed
-- **memory_store_v2.py** - Replaced 15 direct `sqlite3.connect()` calls with DbConnectionManager
-- **mcp_server.py** - Replaced 9 per-call instantiations with shared singleton
-- **ui_server.py** - Refactored from 2008-line monolith to 194-line app shell + 9 route modules
-- **ui/app.js** - Split from 1588-line monolith to 13 modular files
+- **Reliable Concurrent Access** — No more "database is locked" errors under multi-agent workloads
+- **Real-Time Events** — Live event broadcasting across all connected tools
+- **Subscriptions** — Durable and ephemeral event subscriptions with filters
+- **Webhook Delivery** — HTTP notifications with automatic retry on failure
+- **Agent Registry** — Track connected AI agents with protocol and activity monitoring
+- **Memory Provenance** — Track who created or modified each memory, and from which tool
+- **Trust Scoring** — Behavioral trust signals collected per agent
+- **Dashboard: Live Events** — Real-time event stream with filters and stats
+- **Dashboard: Agents** — Connected agents table with trust scores and protocol badges
 
-### Testing
-- 63 pytest tests + 27 e2e tests + 15 fresh-DB edge cases + 17 backward-compat tests
+### Improved
+- Refactored core modules for reliability and performance
+- Dashboard modernized with modular architecture
 
 ---
 
 ## [2.4.2] - 2026-02-11
 
-**Release Type:** Bug Fix
-
 ### Fixed
-- Profile isolation bug in UI dashboard - Graph stats now filter by active profile
+- Profile isolation bug in dashboard — graph stats now filter by active profile
 
 ---
 
 ## [2.4.1] - 2026-02-11
 
-**Release Type:** Hierarchical Clustering & Documentation
-
 ### Added
-- **Hierarchical Leiden clustering** - Large clusters auto-subdivided up to 3 levels deep
-- **Community summaries** - TF-IDF structured reports for every cluster
-- Schema migration for `summary`, `parent_cluster_id`, `depth` columns
+- **Hierarchical Clustering** — Large knowledge clusters auto-subdivided for finer-grained topic discovery
+- **Cluster Summaries** — Structured topic reports for every cluster in the knowledge graph
 
 ---
 
@@ -205,12 +189,12 @@ SuperLocalMemory transforms from passive storage to active coordination layer. E
 **Release Type:** Profile System & Intelligence
 
 ### Added
-- **Column-based memory profiles** - Single DB with `profile` column, instant switching via `profiles.json`
-- **Auto-backup system** - Configurable interval, retention policy, one-click backup from UI
-- **MACLA confidence scorer** - Beta-Binomial Bayesian posterior (arXiv:2512.18950)
-- **UI: Profile Management** - Create, switch, delete profiles from dashboard
-- **UI: Settings tab** - Auto-backup config, history, profile management
-- **UI: Column sorting** - Click headers in Memories table
+- **Memory Profiles** — Single database, multiple profiles. Switch instantly from any IDE or CLI.
+- **Auto-Backup** — Configurable automatic backups with retention policy
+- **Confidence Scoring** — Statistical confidence tracking for learned patterns
+- **Profile Management UI** — Create, switch, and delete profiles from the dashboard
+- **Settings Tab** — Backup configuration, history, and profile management
+- **Column Sorting** — Click headers to sort in Memories table
 
 ---
 
@@ -218,22 +202,22 @@ SuperLocalMemory transforms from passive storage to active coordination layer. E
 
 ### Added
 - `--full` flag to show complete memory content without truncation
-- Smart truncation: <5000 chars shown in full, ≥5000 chars truncated to 2000 chars
+- Smart truncation for large memories
 
 ### Fixed
-- CLI bug: `get` command now uses correct `get_by_id()` method
+- CLI `get` command now retrieves memories correctly
 
 ---
 
 ## [2.3.5] - 2026-02-09
 
 ### Added
-- **ChatGPT Connector Support** - `search(query)` and `fetch(id)` MCP tools
-- **Streamable HTTP transport** - `slm serve --transport streamable-http`
-- **UI enhancements** - Memory detail modal, dark mode, export buttons, search score bars
+- **ChatGPT Connector** — Search and fetch memories from ChatGPT via MCP
+- **Streamable HTTP Transport** — Additional transport option for MCP connections
+- **Dashboard Enhancements** — Memory detail modal, dark mode, export, search score visualization
 
 ### Fixed
-- XSS vulnerability via inline onclick replaced with safe event delegation
+- Security improvement in dashboard event handling
 
 ---
 
@@ -244,72 +228,53 @@ SuperLocalMemory transforms from passive storage to active coordination layer. E
 SuperLocalMemory now works across 16+ IDEs and CLI tools.
 
 ### Added
-- **MCP configs** - Auto-detection for Cursor, Windsurf, Claude Desktop, Continue.dev, Codex, Copilot, Gemini, JetBrains
-- **Universal CLI wrapper** - `slm` command works in any terminal
-- **Skills installer expansion** - Cursor, VS Code/Copilot auto-configured
-- **Tool annotations** - `readOnlyHint`, `destructiveHint`, `openWorldHint` for all MCP tools
+- **Auto-Configuration** — Automatic setup for Cursor, Windsurf, Claude Desktop, Continue.dev, Codex, Copilot, Gemini, JetBrains
+- **Universal CLI** — `slm` command works in any terminal
+- **Skills Installer** — One-command setup for supported editors
+- **Tool Annotations** — Read-only, destructive, and open-world hints for all MCP tools
 
 ---
 
 ## [2.2.0] - 2026-02-07
 
-**Release Type:** Feature Release (Optional Search Components)
+**Release Type:** Feature Release — Advanced Search
 
 ### Added
-- **BM25 Search Engine** - Okapi BM25 with <30ms search for 1K memories
-- **Query Optimizer** - Spell correction, query expansion, technical term preservation
-- **Cache Manager** - LRU cache with TTL, <0.1ms cache hit overhead
-- **Hybrid Search System** - BM25 + TF-IDF + Graph fusion, <50ms for 1K memories
-- **HNSW Index** - Sub-10ms search for 10K memories (optional: `pip install hnswlib`)
-- **Embedding Engine** - Local semantic embeddings with GPU acceleration (optional: `pip install sentence-transformers`)
-- **Modular Requirements** - Separate files: `requirements-ui.txt`, `requirements-search.txt`, `requirements-full.txt`
-- **Installation Verification** - `verify-install.sh` script for comprehensive health checks
+- **Advanced Search** — Faster, more accurate search with multiple retrieval strategies
+- **Query Optimization** — Spell correction, query expansion, and technical term preservation
+- **Search Caching** — Frequently-used queries return near-instantly
+- **Combined Search** — Results fused from multiple search methods for better relevance
+- **Fast Vector Search** — Sub-10ms search at scale (optional)
+- **Local Embeddings** — Semantic search with GPU acceleration (optional)
+- **Modular Installation** — Install only what you need: core, UI, search, or everything
 
 ---
 
 ## [2.1.0-universal] - 2026-02-07
 
-**Release Type:** Major Feature Release - Universal Integration
+**Release Type:** Major Feature Release — Universal Integration
 
 ### Added
-- **6 Universal Skills** - remember, recall, list-recent, status, build-graph, switch-profile
-- **MCP Server** - 6 tools, 4 resources, 2 prompts for native IDE integration
-- **6-layer Attribution Protection** - Source headers, docs, database metadata, runtime banners, license, digital signature
-- **11+ IDE Support** - Cursor, Windsurf, Claude Desktop, Continue.dev, Cody, Aider, ChatGPT, Perplexity, Zed, OpenCode, Antigravity
-
-### Documentation
-- `docs/MCP-MANUAL-SETUP.md` - Manual setup guide for 8+ additional IDEs
-- `docs/MCP-TROUBLESHOOTING.md` - Debugging guide with 20+ common issues
-- `docs/UNIVERSAL-INTEGRATION.md` - Complete universal strategy (15,000+ words)
+- **6 Universal Skills** — remember, recall, list-recent, status, build-graph, switch-profile
+- **MCP Server** — Native IDE integration with tools, resources, and prompts
+- **Attribution Protection** — Multi-layer protection ensuring proper credit
+- **11+ IDE Support** — Cursor, Windsurf, Claude Desktop, Continue.dev, Cody, Aider, ChatGPT, Perplexity, Zed, OpenCode, Antigravity
 
 ---
 
 ## [2.0.0] - 2026-02-05
 
-### Initial Release - Complete Rewrite
+### Initial Release — Complete Rewrite
 
 SuperLocalMemory V2 represents a complete architectural rewrite with intelligent knowledge graphs, pattern learning, and enhanced organization.
 
 ### Added
-- **4-Layer Architecture** - Enhanced Storage, Hierarchical Index, Knowledge Graph, Pattern Learning
-- **TF-IDF Entity Extraction** - Automatic entity discovery with frequency weighting
-- **Leiden Clustering** - Community detection for automatic thematic grouping
-- **Pattern Learning** - Multi-dimensional analysis (frameworks, languages, architecture, security, coding style)
-- **Compression System** - Progressive summarization (Tier 1: 0%, Tier 2: 60%, Tier 3: 96%)
-- **Profile Management** - Multi-profile support with isolated databases
-
-### Performance
-- Improved search performance over V1 (see Performance Benchmarks)
-- 60-96% storage reduction with compression
-
-### Research Foundation
-Built on GraphRAG (Microsoft), PageIndex (VectifyAI), MemoryBank (AAAI 2024), A-RAG
-
----
-
-## Archive
-
-See [CHANGELOG-ARCHIVE.md](CHANGELOG-ARCHIVE.md) for detailed release notes from v2.0.0 through v2.4.x.
+- **4-Layer Architecture** — Storage, Hierarchical Index, Knowledge Graph, Pattern Learning
+- **Automatic Entity Extraction** — Discovers key topics and concepts from your memories
+- **Intelligent Clustering** — Automatic thematic grouping of related memories
+- **Pattern Learning** — Tracks your preferences across frameworks, languages, architecture, security, and coding style
+- **Storage Optimization** — Progressive compression reduces storage by up to 96%
+- **Profile Management** — Multi-profile support with isolated data
 
 ---
 
@@ -320,7 +285,7 @@ We use [Semantic Versioning](https://semver.org/):
 - **MINOR:** New features (backward compatible, e.g., 2.0.0 → 2.1.0)
 - **PATCH:** Bug fixes (backward compatible, e.g., 2.1.0 → 2.1.1)
 
-**Current Version:** v2.6.5
+**Current Version:** v2.8.0
 **Website:** [superlocalmemory.com](https://superlocalmemory.com)
 **npm:** `npm install -g superlocalmemory`