memorymaster 3.12.0__tar.gz → 3.13.0__tar.gz

{memorymaster-3.12.0 → memorymaster-3.13.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: memorymaster
-Version: 3.12.0
+Version: 3.13.0
 Summary: Production-grade memory reliability system for AI coding agents. Lifecycle-managed claims with citations, conflict detection, steward governance, and MCP integration.
 Author: wolverin0
 License: MIT
@@ -50,9 +50,9 @@ Lifecycle-managed claims with citations, conflict detection, steward governance,
 
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
 [![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
-[![Tests](https://img.shields.io/badge/tests-1029-green.svg)]()
-[![MCP Tools](https://img.shields.io/badge/MCP%20tools-22-purple.svg)]()
-[![CLI Commands](https://img.shields.io/badge/CLI%20commands-64-orange.svg)]()
+[![Tests](https://img.shields.io/badge/tests-1953-green.svg)]()
+[![MCP Tools](https://img.shields.io/badge/MCP%20tools-24-purple.svg)]()
+[![CLI Commands](https://img.shields.io/badge/CLI%20commands-86-orange.svg)]()
 [![PyPI](https://img.shields.io/pypi/v/memorymaster.svg)](https://pypi.org/project/memorymaster/)
 
 MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptions, and unsafe disclosure**. It gives Claude Code, Codex, and any MCP-compatible agent persistent, verifiable memory with a full claim lifecycle, citation tracking, conflict detection, and human-in-the-loop governance.
@@ -66,7 +66,7 @@ MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptio
 │                        Agent Runtime                            │
 │  (Claude Code / Codex / any MCP-compatible agent)               │
 └────────────┬────────────────────────────────┬───────────────────┘
-             │ MCP (22 tools)                 │ CLI (64 commands)
+             │ MCP (24 tools)                 │ CLI (86 commands)
              v                                v
 ┌─────────────────────────────────────────────────────────────────┐
 │                      MemoryMaster Core                          │
@@ -94,7 +94,8 @@ MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptio
 - **Steward governance**: multi-probe validators (filesystem, format, citation, semantic, tool) with proposal review
 - **Conflict resolution**: 5-tier auto (confidence > freshness > citations > LLM > manual)
 - **Auto-redaction** at ingest: JWT, GitHub tokens, Bearer, AWS keys, SSH keys, custom patterns
-- **LLM Wiki**: compiled-truth + append-only timeline articles with progressive-disclosure frontmatter
+- **LLM Wiki**: compiled-truth + append-only timeline articles with progressive-disclosure frontmatter, `explored: true|false` operator-review marker, and inline `> [!contradiction]` Obsidian callouts
+- **Atlas Inbox V1** (new in v3.13.0): WhatsApp ingestion → source/evidence/action proposal lifecycle → Super-Productivity export. Versioned API/CLI contract for downstream consumers (LifeAgent, etc.) — see [`docs/atlas-api-contract-v1.md`](docs/atlas-api-contract-v1.md). Real provider adapters (`OpenAIWhisperTranscriptionProvider`, `TesseractOcrProvider`) behind `Protocol`s; mock providers stay default.
 - **Dual backend**: SQLite (zero-config) and Postgres (full feature parity with pgvector)
 - **Dream Bridge** for bidirectional sync with Claude Code's Auto Dream
 - **7-hook stack**: recall, classify, validate-wiki, session-start, auto-ingest, precompact, steward-cron

{memorymaster-3.12.0 → memorymaster-3.13.0}/README.md

@@ -6,9 +6,9 @@ Lifecycle-managed claims with citations, conflict detection, steward governance,
 
 [![License: MIT](https://img.shields.io/badge/License-MIT-blue.svg)](LICENSE)
 [![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
-[![Tests](https://img.shields.io/badge/tests-1029-green.svg)]()
-[![MCP Tools](https://img.shields.io/badge/MCP%20tools-22-purple.svg)]()
-[![CLI Commands](https://img.shields.io/badge/CLI%20commands-64-orange.svg)]()
+[![Tests](https://img.shields.io/badge/tests-1953-green.svg)]()
+[![MCP Tools](https://img.shields.io/badge/MCP%20tools-24-purple.svg)]()
+[![CLI Commands](https://img.shields.io/badge/CLI%20commands-86-orange.svg)]()
 [![PyPI](https://img.shields.io/pypi/v/memorymaster.svg)](https://pypi.org/project/memorymaster/)
 
 MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptions, and unsafe disclosure**. It gives Claude Code, Codex, and any MCP-compatible agent persistent, verifiable memory with a full claim lifecycle, citation tracking, conflict detection, and human-in-the-loop governance.
@@ -22,7 +22,7 @@ MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptio
 │                        Agent Runtime                            │
 │  (Claude Code / Codex / any MCP-compatible agent)               │
 └────────────┬────────────────────────────────┬───────────────────┘
-             │ MCP (22 tools)                 │ CLI (64 commands)
+             │ MCP (24 tools)                 │ CLI (86 commands)
              v                                v
 ┌─────────────────────────────────────────────────────────────────┐
 │                      MemoryMaster Core                          │
@@ -50,7 +50,8 @@ MemoryMaster prevents the #1 problem with agent memory: **drift, stale assumptio
 - **Steward governance**: multi-probe validators (filesystem, format, citation, semantic, tool) with proposal review
 - **Conflict resolution**: 5-tier auto (confidence > freshness > citations > LLM > manual)
 - **Auto-redaction** at ingest: JWT, GitHub tokens, Bearer, AWS keys, SSH keys, custom patterns
-- **LLM Wiki**: compiled-truth + append-only timeline articles with progressive-disclosure frontmatter
+- **LLM Wiki**: compiled-truth + append-only timeline articles with progressive-disclosure frontmatter, `explored: true|false` operator-review marker, and inline `> [!contradiction]` Obsidian callouts
+- **Atlas Inbox V1** (new in v3.13.0): WhatsApp ingestion → source/evidence/action proposal lifecycle → Super-Productivity export. Versioned API/CLI contract for downstream consumers (LifeAgent, etc.) — see [`docs/atlas-api-contract-v1.md`](docs/atlas-api-contract-v1.md). Real provider adapters (`OpenAIWhisperTranscriptionProvider`, `TesseractOcrProvider`) behind `Protocol`s; mock providers stay default.
 - **Dual backend**: SQLite (zero-config) and Postgres (full feature parity with pgvector)
 - **Dream Bridge** for bidirectional sync with Claude Code's Auto Dream
 - **7-hook stack**: recall, classify, validate-wiki, session-start, auto-ingest, precompact, steward-cron

{memorymaster-3.12.0 → memorymaster-3.13.0}/memorymaster/_storage_schema.py

@@ -52,6 +52,151 @@ class _SchemaMixin:
             "CREATE INDEX IF NOT EXISTS idx_embeddings_updated_at ON claim_embeddings(updated_at)"
         )
 
+    @staticmethod
+    def _ensure_atlas_source_schema(conn: sqlite3.Connection) -> None:
+        """Ensure Atlas Inbox external source/evidence/action proposal tables exist.
+
+        Critical ordering (forward-migration aware):
+          1. CREATE TABLE IF NOT EXISTS — idempotent on existing tables
+             but does NOT add new columns to pre-existing tables.
+          2. ALTER TABLE ADD COLUMN — forward-migrate columns added in
+             later versions (idempotent via duplicate-column catch).
+          3. CREATE INDEX IF NOT EXISTS — runs LAST, after columns are
+             guaranteed to exist on both fresh and stale DBs.
+
+        Bug history: in v1.5.0, the index-on-new-column statements were
+        in the same executescript as CREATE TABLE, which fired BEFORE
+        the ALTER. On a stale Atlas DB (pre-sensitivity), CREATE INDEX
+        ON source_items(sensitivity) failed with 'no such column'. v1.5.1
+        splits the script and runs ALTER between the table and index
+        phases. See PR #27 / claim mm-ce8b.
+        """
+        # Phase 1: tables (idempotent — IF NOT EXISTS)
+        conn.executescript(
+            """
+            CREATE TABLE IF NOT EXISTS external_sources (
+                id INTEGER PRIMARY KEY AUTOINCREMENT,
+                source_type TEXT NOT NULL,
+                display_name TEXT NOT NULL,
+                config_json TEXT,
+                created_at TEXT NOT NULL,
+                updated_at TEXT NOT NULL,
+                UNIQUE (source_type, display_name)
+            );
+
+            CREATE TABLE IF NOT EXISTS source_items (
+                id INTEGER PRIMARY KEY AUTOINCREMENT,
+                source_id INTEGER NOT NULL,
+                source_item_id TEXT NOT NULL,
+                item_type TEXT NOT NULL,
+                chat_id TEXT,
+                sender_id TEXT,
+                sender_name TEXT,
+                occurred_at TEXT,
+                text TEXT,
+                payload_json TEXT,
+                content_hash TEXT,
+                sensitivity TEXT CHECK (sensitivity IS NULL OR sensitivity IN ('none','low','medium','high','redacted')),
+                created_at TEXT NOT NULL,
+                updated_at TEXT NOT NULL,
+                FOREIGN KEY (source_id) REFERENCES external_sources(id) ON DELETE CASCADE,
+                UNIQUE (source_id, source_item_id)
+            );
+
+            CREATE TABLE IF NOT EXISTS evidence_items (
+                id INTEGER PRIMARY KEY AUTOINCREMENT,
+                source_item_id INTEGER NOT NULL,
+                evidence_type TEXT NOT NULL,
+                text TEXT,
+                media_path TEXT,
+                provider TEXT,
+                confidence REAL CHECK (confidence IS NULL OR (confidence >= 0.0 AND confidence <= 1.0)),
+                payload_json TEXT,
+                sensitivity TEXT CHECK (sensitivity IS NULL OR sensitivity IN ('none','low','medium','high','redacted')),
+                created_at TEXT NOT NULL,
+                FOREIGN KEY (source_item_id) REFERENCES source_items(id) ON DELETE CASCADE
+            );
+
+            CREATE TABLE IF NOT EXISTS action_proposals (
+                id INTEGER PRIMARY KEY AUTOINCREMENT,
+                proposal_type TEXT NOT NULL,
+                title TEXT NOT NULL,
+                description TEXT,
+                source_item_id INTEGER,
+                evidence_item_id INTEGER,
+                claim_id INTEGER,
+                suggested_due_at TEXT,
+                destination TEXT NOT NULL DEFAULT 'manual',
+                status TEXT NOT NULL DEFAULT 'candidate'
+                    CHECK (status IN ('candidate', 'approved', 'rejected', 'exported', 'failed')),
+                confidence REAL NOT NULL DEFAULT 0.5 CHECK (confidence >= 0.0 AND confidence <= 1.0),
+                payload_json TEXT,
+                exported_at TEXT,
+                external_ref TEXT,
+                idempotency_key TEXT,
+                created_at TEXT NOT NULL,
+                updated_at TEXT NOT NULL,
+                FOREIGN KEY (source_item_id) REFERENCES source_items(id) ON DELETE SET NULL,
+                FOREIGN KEY (evidence_item_id) REFERENCES evidence_items(id) ON DELETE SET NULL,
+                FOREIGN KEY (claim_id) REFERENCES claims(id) ON DELETE SET NULL
+            );
+
+            CREATE TABLE IF NOT EXISTS media_retry_queue (
+                id INTEGER PRIMARY KEY AUTOINCREMENT,
+                source_item_id INTEGER NOT NULL,
+                media_key TEXT NOT NULL,
+                chat_id TEXT,
+                media_type TEXT,
+                media_path TEXT,
+                media_url TEXT,
+                status TEXT NOT NULL DEFAULT 'pending'
+                    CHECK (status IN ('pending', 'retrying', 'expired', 'done', 'failed')),
+                attempt_count INTEGER NOT NULL DEFAULT 0,
+                last_http_status INTEGER,
+                last_error TEXT,
+                next_attempt_time TEXT,
+                created_at TEXT NOT NULL,
+                updated_at TEXT NOT NULL,
+                FOREIGN KEY (source_item_id) REFERENCES source_items(id) ON DELETE CASCADE,
+                UNIQUE (source_item_id, media_key)
+            );
+            """
+        )
+
+        # Phase 2: forward-migrate columns added in later versions.
+        # Pattern matches _ensure_claim_idempotency_schema. MUST run BEFORE
+        # any indexes that reference these columns (otherwise stale DBs
+        # fail with 'no such column').
+        for table in ("source_items", "evidence_items"):
+            try:
+                conn.execute(f"ALTER TABLE {table} ADD COLUMN sensitivity TEXT")
+            except sqlite3.OperationalError as exc:
+                if "duplicate column name" not in str(exc).lower():
+                    raise
+
+        # Phase 3: indexes (now safe — all columns guaranteed to exist).
+        conn.executescript(
+            """
+            CREATE INDEX IF NOT EXISTS idx_external_sources_type ON external_sources(source_type);
+            CREATE INDEX IF NOT EXISTS idx_source_items_source_id ON source_items(source_id);
+            CREATE INDEX IF NOT EXISTS idx_source_items_chat_id ON source_items(chat_id);
+            CREATE INDEX IF NOT EXISTS idx_source_items_occurred_at ON source_items(occurred_at);
+            CREATE INDEX IF NOT EXISTS idx_source_items_content_hash ON source_items(content_hash);
+            CREATE INDEX IF NOT EXISTS idx_evidence_items_source_item_id ON evidence_items(source_item_id);
+            CREATE INDEX IF NOT EXISTS idx_evidence_items_type ON evidence_items(evidence_type);
+            CREATE INDEX IF NOT EXISTS idx_action_proposals_status ON action_proposals(status);
+            CREATE INDEX IF NOT EXISTS idx_action_proposals_destination ON action_proposals(destination);
+            CREATE UNIQUE INDEX IF NOT EXISTS idx_action_proposals_idempotency_key
+                ON action_proposals(idempotency_key)
+                WHERE idempotency_key IS NOT NULL;
+            CREATE INDEX IF NOT EXISTS idx_source_items_sensitivity ON source_items(sensitivity);
+            CREATE INDEX IF NOT EXISTS idx_evidence_items_sensitivity ON evidence_items(sensitivity);
+            CREATE INDEX IF NOT EXISTS idx_media_retry_status ON media_retry_queue(status);
+            CREATE INDEX IF NOT EXISTS idx_media_retry_next_attempt ON media_retry_queue(next_attempt_time);
+            CREATE INDEX IF NOT EXISTS idx_media_retry_source_item ON media_retry_queue(source_item_id);
+            """
+        )
+
 
     @staticmethod
     def _ensure_claim_idempotency_schema(conn: sqlite3.Connection) -> None: