ltcai 4.0.0 → 4.1.0

package/docs/V4_DIGITAL_BRAIN_RECOVERY.md

@@ -5,22 +5,43 @@
 > completed analysis. **Update this file before ending any phase and before any
 > likely session/context/usage limit.**
 >
-> Last updated: 2026-06-12 — RELEASE CANDIDATE PREPARED (Phase D complete; awaiting human review)
+> Last updated: 2026-06-12 — v4.1.0 frontend/desktop rebuild RC; Remaining Gaps remain empty
 
 ---
 
-## 0. RC STATUS (final)
-
-**v4.0.0 release candidate is on `origin/feat/v4-digital-brain`.**
-Validation: 571 unit tests pass · ruff clean · check:python 186 modules ·
-lint_v3 all checks · installed-wheel smoke (19 modules from clean venv) ·
-release artifacts validated (wheel + sdist + npm tgz, 2.0MB).
-NO merge, NO tag, NO publish — awaiting review.
-Remaining gaps (labeled in FEATURE_STATUS.md §v4.0.0 + RELEASE_NOTES_v4.0.0.md):
-T3d decomposition/v2-flip, T7c async engine, T6 remainder (UUIDs/policy/
-invitations/SQLite state), T9 remainder (legacy deletion + parity views,
-login, i18n, T9b surfaces), pptx history rewrite (owner), consent-gated
-embedder provisioning. All contracts live in docs/V4_IMPLEMENTATION_PLAN.md.
+## 0. RC STATUS (v4.1.0 RC)
+
+**v4.1.0 replaces the frontend implementation and desktop shell on top of
+`main @ v4.0.1`; implementation gaps remain empty.**
+Latest implementation milestone: `/app` is now a React + TypeScript + Vite SPA
+with TanStack Query, Zustand, generated OpenAPI client usage, Cytoscape.js
+Brain graph, React Flow Act graph, Tailwind CSS, and local shadcn-style
+primitives. Tauri 2.0 is the primary desktop shell; Electron is fallback only.
+The existing FastAPI backend, Brain Core, storage architecture, and
+agent/workflow runtime remain the source of truth.
+The v4.1.0 RC process builds and validates local artifacts only. It does not
+publish to PyPI, npm Registry, VS Code Marketplace, Open VSX, or production
+deployment targets.
+v4.1.0 validation completed: OpenAPI generation (308 paths), Python compile,
+ruff, 585 unit tests, 9 live integration tests, frontend lint/no-CDN/API
+compatibility, TypeScript build, 12 Playwright visual/offline tests, Tauri
+cargo check, Tauri `.app` + DMG build, Electron fallback syntax/version check,
+Python wheel/sdist build, npm tgz build, VSIX build, release artifact
+validation, wheel smoke, and npm pack dry-run all passed. See
+`docs/V4_1_VALIDATION_REPORT.md`.
+Remaining implementation gaps: **none**.
+Owner-only blockers: pptx history rewrite (requires force-push/owner decision)
+and consent-gated production embedder provisioning (silent default download is
+not permitted).
+
+## Remaining Gaps
+
+None. v4.1.0 closes the frontend/desktop rebuild on top of the already-empty
+v4.0.1 gap list: legacy static v3 frontend assets are removed, `/app` is served
+from `static/app`, Brain/Ask/Capture/Act/Library/System cover the existing
+capability surface, and every visible control either calls an existing backend
+API or presents an honest unavailable/error state. Owner-only blockers above
+are intentionally not implementation gaps.
 
 ## 1. Program Charter (from the user's v4.0.0 directive)
 
@@ -55,7 +76,7 @@ chat-history import added; garden = watched source; T9b UI track added;
 T7 owns workflow_engine.py + realtime.py with suspension/reconciliation
 specs; tracks run strictly serially). Review record:
 `docs/v4-audit/v4_design_review.json`.
-**Phase C (Implementation) — T1 COMPLETE; next: T2 (Packaging & app factory).**
+**Phase C (Implementation) — COMPLETE on main. Remaining implementation gaps are empty.**
 
 Track log (update at every track boundary):
 - **T2 DONE** (commit `5e8aa1b`, 74 files). Agent did ~90% then died on a
@@ -98,10 +119,15 @@ Track log (update at every track boundary):
     mark_superseded(). Suite 507.
   - **T3e DONE**: docs/kg-schema.md rewritten to match code (false API
     claims removed; FTS5/scope/temporal documented).
-  - RESEQUENCING DECISION: T3d (decomposition + write-mastering flip) is
-    agent-scale and limit-blocked until ~17:30 KST; T4 sub-units proceed
-    inline meanwhile — safe because T4 rewires *callers* onto public store
-    APIs which T3d preserves (suite-green gate).
+  - **T3d DONE**: `knowledge_graph.py` is now a root compatibility shim;
+    implementation moved under `latticeai/brain/` (`store`, `schema`,
+    `projection`, `write_master`, `discovery`, `ingest`, `provenance`,
+    `documents`, `retrieval`), with every module under 1,500 lines. v2 is
+    the authoritative write door; legacy tables are maintained as the
+    compatibility projection. Startup creates a one-time pre-flip SQLite
+    backup for existing graph data, stamps `PRAGMA user_version=4`, refuses
+    newer DB formats, and preserves legacy read/import compatibility.
+    Focused KG validation: 43 passed.
 - **T4.1 DONE** (commits `427d6a3` + `a2a1445`): chat (app_factory
   save_to_history), MCP (/mcp/call knowledge_graph_ingest), and uploads
   (upload_service) all route through IngestionPipeline — new
@@ -164,6 +190,16 @@ Track log (update at every track boundary):
   accept allowed_workspaces; search router scopes via _ScopedSearchService
   proxy + PLATFORM.allowed_scopes; ContextAssembler hybrid seam scoped per
   user. Legacy NULL rows machine-visible (documented). Suite 564.
+- **T6-remainder DONE**: users now carry stable `user:<uuid>` identities
+  with non-destructive `users.json` migration; sessions store UUID subjects
+  while preserving email compatibility; workspace memberships/owners and KG
+  identity columns migrate from email strings to UUIDs. `core/policy.py` is the
+  enforced role/capability map behind admin dependencies and `/admin/roles`.
+  Invitations are real local tokens (create/list/accept/expire) and accepted
+  workspace invites add UUID-keyed members. Workspace OS state imports once from
+  JSON into the same `knowledge_graph.sqlite`, mirrors JSON for compatibility,
+  writes transactionally, and no longer truncates durable history collections.
+  Suite: 583.
 - **T7d DONE** (commit 235f9b6): latticeai/services/triggers.py —
   interval scheduler (missed-while-down → recorded skip events, no
   catch-up) + brain_event triggers via visible post_tool hook on
@@ -171,29 +207,31 @@ Track log (update at every track boundary):
   status; started in app factory w/ idempotent hook registration. Suite 569.
 - **T7e DONE** (commit 014ca91): custom registry agents executable
   (config actually loaded; honest skip in simulation).
+- **T7c DONE**: `latticeai/services/run_executor.py` owns durable asyncio
+  server-loop tasks for agent/workflow runs. `/agents/api/run` and workflow
+  definition runs now persist queued rows, execute sync orchestrator/tool work
+  via `asyncio.to_thread`, update the same run row through running/final states,
+  publish progress through the existing realtime SSE feed, support cooperative
+  cancellation, and reconcile orphaned active runs to `interrupted` at startup
+  while preserving `awaiting_approval` pause cursors. `RealtimeBus.publish` is
+  thread-safe via subscriber-loop `call_soon_threadsafe`. Suite: 579.
 - **T9-canvas DONE** (commit 2fee077): force-directed canvas explorer
   (graph-canvas.js + Explore rewire; visual spec updated).
 - **T9-IA DONE** (commit 972d34c): brain-first nav (Brain/Ask/Capture/
   Act/Library/System); knowledge-graph is the default landing route.
-- **PHASE D DECISION**: moving to T10 RC prep. REMAINING GAPS (honest,
-  labeled, not faked): T3d brain decomposition + v2 write-mastering flip;
-  T7c async run engine/cancellation/SSE/startup reconciliation; T6
-  remainder (user UUIDs, enforced policy module, invitations, workspace
-  SQLite state); T9 remainder (legacy page deletion + parity views, login
-  rebuild, artifact ungitting, i18n, T9b approval/network/trace surfaces).
-  All have full contracts in docs/V4_IMPLEMENTATION_PLAN.md + amendments.
+- **T9 REMAINDER DONE**: legacy static pages and scripts deleted; legacy GET
+  routes redirect into `/app`; parity views added for account/profile,
+  workspaces/org members/invitations/activation, snapshots/time-machine with
+  merge-restore, activity/presence, run approvals/cancellation, workflow
+  trigger configuration/status, Brain Network pairing/push, chat context trace,
+  and KG provenance coverage. en/ko i18n runtime backs routes, shell, and new
+  parity views; `scripts/lint_v3.mjs` gates it. Visual coverage moved to the
+  v3 surface and legacy-page specs were retired.
 - T9-canvas agent left static/v3/js/views/graph-canvas.js (509 lines,
   node --check passes) but NEVER rewired knowledge-graph.js — file kept
   uncommitted in tree; integration outstanding.
-- NOTE: T3d + T9-canvas agents died instantly on session limits THREE times
-  (latest reset 4:10am KST)
-  (next reset 23:00 KST); both tasks remain queued with full contracts in
-  this file + the plan.
-  - **T3d** (agent task after limits reset 17:30 KST): latticeai/brain/
-    decomposition (store/discovery/ingest/provenance/documents/extraction,
-    ≤1,500 lines/module, no mixin god-object) + v2 write-mastering flip
-    (backup-first, re-entrant migrator keyed on data state, downgrade
-    marker via PRAGMA user_version, equivalence scoped to pre-flip data).
+- NOTE: The old T3d queue is closed. T9 parity surfaces remain active with
+  full contracts in this file + the plan.
   - **T3e**: docs/kg-schema.md regenerated from enums.
   - graph_curator decision moved to T4.
 - **T9 PARTIAL — vendoring half DONE** (commit `aa613ae`, parallel-safe per
@@ -201,9 +239,7 @@ Track log (update at every track boundary):
   Tabler icons, chart.js, marked.js vendored under static/vendor);
   --lt3-on-accent token added; sw.js rebuilt around the v3 manifest;
   lint_v3.mjs now mechanically enforces token/inline-style/CDN rules;
-  6 guard tests. REMAINING T9: canvas graph port (item 2), IA regroup (1),
-  legacy deletion + redirects (3, needs parity views), login rebuild,
-  artifact ungitting, i18n, T9b surfaces (after T7/T8).
+  6 guard tests. Closed later by T9-canvas, T9-IA, and T9 remainder.
 - **T1 DONE** (commits `1cddc67` frontend + `c574eb6` backend). All 7 items:
   by-id snapshot/memory authz via new WorkspaceService.authorize_record_read/
   authorize_memory_delete; /workspace/os leak removed (workspace_count
@@ -249,8 +285,9 @@ the canonical Phase A record.**
      services, 27 API routers + `server_app.py` at 1,554 lines). Legacy root
      modules ~6,720 lines incl. `knowledge_graph.py` **4,633 lines**,
      `kg_schema.py` 521, `llm_router.py` 775, `mcp_registry.py` 791.
-   - Frontend: `/app` v3 SPA (`static/v3/`, 22 views, token-native) is primary;
-     legacy static HTML pages (`static/*.html`) still shipped in parallel.
+   - Frontend: `/app` v3 SPA (`static/v3/`, token-native) is primary; legacy
+     static HTML pages were later removed and compatibility routes redirect
+     into `/app`.
    - Repo root clutter: ~30 `ltcai-*.tgz` tarballs, `ltcai-0.3.1/` extracted copy,
      logs, `chat_history.json`, 15MB pptx — most likely untracked; verify with
      `git ls-files` before cleaning.
@@ -495,15 +532,28 @@ retained for context only:
 
 ## 11. Branch Status
 
-- `feat/v4-digital-brain` exists locally, based on main @ 5889195 (v3.6.0).
-- Not yet pushed to origin. No implementation commits yet.
+- `main` contains the v4 implementation through T9 remainder closure and is
+  pushed to `origin/main` at every verified milestone.
+- No tag, package publish, release upload, production deployment, force-push, or
+  history rewrite has been performed.
 
 ## 12. Validation Status
 
-- main baseline: 455 unit pass / 9 pre-existing integration failures
-  (ConnectError, need live server). Nothing run on the branch yet beyond this.
+- Full unit suite: `.venv/bin/python -m pytest tests/unit -q` → **585 passed,
+  2 warnings**.
+- Focused T9 tests: `tests/unit/test_workspace_os.py`,
+  `tests/unit/test_static_release_hygiene.py`, and `tests/visual/v3.spec.js`
+  passed after the parity/legacy-retirement changes.
+- Static and code gates: `.venv/bin/python -m ruff check .`,
+  `.venv/bin/python scripts/check_python.py`, `npm run lint`,
+  `npm run build:assets`, and `node --check` on changed/new v3 JS passed.
+- Build/package gates: `.venv/bin/python -m build`,
+  `.venv/bin/python scripts/wheel_smoke.py`, and `npm pack --dry-run` passed.
 
 ## 13. Files Modified (branch vs main)
 
-- `docs/V4_DIGITAL_BRAIN_RECOVERY.md` (this file) — NEW.
-- (none else yet)
+- T9 remainder changed backend compatibility redirects and SPA-facing APIs,
+  Workspace OS snapshot restore, v3 shell/routing/store/i18n/API modules, new
+  parity views, asset manifests, package/static inclusion rules, unit and visual
+  tests, mocks, release/status documentation, and removed retired legacy static
+  pages/scripts/CSS/tests.

package/docs/kg-schema.md

@@ -205,8 +205,12 @@ provenance(source_type, source_uri, content_hash, captured_at, modified_at,
 `knowledge_graph.KnowledgeGraphStore` 가 열릴 때 v2 스키마를 생성/치유하고
 (`kg_schema.KGStoreV2.init_schema` — 추가 컬럼은 `ALTER` 로 in-place 치유,
 edges_v2 식별자 변경은 create→copy→swap 으로 재구축), legacy 데이터를
-v2 로 백필한다. 기존 `nodes` / `edges` 테이블은 건드리지 않는다 — v4 의
-write-mastering 전환(T3d) 전까지 legacy 가 쓰기 마스터다.
+v2 로 백필한다. 기존 `nodes` / `edges` 테이블은 삭제하지 않는다. v4 에서는
+`nodes_v2` / `edges_v2` 가 쓰기 마스터이며, legacy 테이블은 이전 import/API
+소비자를 위한 compatibility projection 으로 같은 트랜잭션에서 갱신된다.
+기존 그래프 데이터가 있는 DB는 전환 전 `backups/*.pre-v2-write-master.*.sqlite`
+스냅샷을 한 번 생성하고, `PRAGMA user_version=4` 와 `kg_meta.db_format_version=4`
+를 기록한다. 더 높은 포맷의 DB는 fail-closed 로 열리지 않는다.
 
 ---
 

package/docs/spec-vs-impl.md

@@ -9,7 +9,7 @@
 
 | 약속 | 목표 (PPT) | 현재 (repo) | 갭 |
 |------|-----------|-------------|----|
-| Cross-Platform Parity | Win·macOS·Linux·iOS·Android, 같은 디자인 토큰·컴포넌트 | Web(static) + VSCode ext + Telegram (브라우저 어디서나) | 네이티브 데스크탑/모바일 셸 없음 (PWA 부분 지원) |
+| Cross-Platform Parity | Win·macOS·Linux·iOS·Android, 같은 디자인 토큰·컴포넌트 | `/app` SPA + VSCode ext + Telegram (브라우저 어디서나) | 네이티브 데스크탑/모바일 셸 없음 (PWA 부분 지원) |
 | Zero-Config Auto Setup | PROBE → RECOMMEND → INSTALL → VERIFY → PRESET, 90초 내 | `LTCAI doctor` (의존성만 체크 = PROBE의 일부) | GPU/RAM 프로빙, 추천, 설치, 벤치마크, 프리셋 미구현 |
 | Everything is a Graph | 10 노드 타입 / 12 엣지 타입 / 임베딩 / 신뢰도+증거 | nodes·edges·chunks 테이블 + 한글 동사 엣지(EDGE_VERB) | 명시 enum·embedding·confidence/evidence·owner 결손 |
 
@@ -20,7 +20,7 @@
 PPT 명세는 "한 코드·다섯 화면" — Shared Core(Design Tokens, UI Components, Business Logic, AI/Graph Core) 위에서 Tauri(데스크탑) / Capacitor·RN(모바일) 렌더러가 같은 결과를 낸다.
 
 **현재 구현**
-- `static/chat.html`, `static/graph.html`, `static/admin.html`, `static/account.html` 4개 HTML — `static/css/tokens.css` 단일 토큰을 공유 (v2.2.1)
+- `static/v3/` `/app` SPA — 단일 토큰과 컴포넌트를 공유하며 legacy HTML 페이지는 v4에서 삭제됨
 - `vscode-extension/` — TypeScript VSCode 통합
 - `static/manifest.json` + `static/sw.js` — PWA 부분 지원 (iOS/Android 홈 화면 추가는 됨)
 - `telegram_bot.py` — Telegram 미러
@@ -28,11 +28,11 @@ PPT 명세는 "한 코드·다섯 화면" — Shared Core(Design Tokens, UI Comp
 **갭**
 - 데스크탑 네이티브 셸 (Tauri) 미구현
 - 모바일 네이티브 (Capacitor / RN) 미구현
-- 다국어(i18n) 시스템화 안 됨 (HTML에 한글 하드코딩)
+- `/app` SPA i18n(en/ko) 런타임은 구현됨; 네이티브 데스크탑/모바일 셸은 아직 없음
 
 **보강 결과물 (완료, v2.2.1)**
-- `static/css/tokens.css` — 4개 HTML이 공유하는 단일 진실 토큰 (`:root` = 라이트, `[data-lt-theme="dark"]` = 다크)
-- `static/css/responsive.css` + `static/scripts/ux.js` — 반응형 레이아웃 / 라이트·다크 토글 + OS 감지 + 지속화
+- `static/css/tokens.css` + `static/v3/css/` — `/app` SPA가 공유하는 단일 진실 토큰
+- `static/v3/js/core/store.js` + `shell.js` — 반응형 레이아웃 / 라이트·다크 토글 + OS 감지 + 지속화
 - 로드맵: `apps/desktop/` (Tauri 셸) · `apps/mobile/` (Capacitor 셸) 차후 단계
 
 ---
@@ -103,9 +103,9 @@ chunks ( id, source_node, text, metadata_json, created_at )
 | **PPT 명세** | `#FFFFFF` 또는 `#0B0B16` | `#6E4AE6` Lattice 보라 |
 
 **보강 결과물 (완료, v2.2.1)**
-- `static/css/tokens.css` — 단일 토큰을 모든 화면이 공유. `:root` 가 라이트 값,
+- `static/css/tokens.css` — 단일 토큰을 `/app` 화면이 공유. `:root` 가 라이트 값,
   `[data-lt-theme="dark"]` 가 다크 값을 정의하는 단일 진실 소스
-- 라이트/다크 토글 + OS 다크모드 감지 + 지속화는 `static/scripts/ux.js` 가 담당
+- 라이트/다크 토글 + OS 다크모드 감지 + 지속화는 `static/v3/js/core/store.js` 와 `shell.js` 가 담당
 
 ---
 
@@ -115,10 +115,10 @@ PPT 화면 1, 13 (login, security) 에 한국어 / Microsoft Entra ID / Okta SSO
 
 **현재**
 - `server.py` 의 `/auth/sso` 엔드포인트 존재 (architecture.md 언급) — Entra/Okta 둘 다 명시되어 있는지 확인 필요
-- 다국어 — HTML 하드코딩 (`lang="ko"`)
+- 다국어 — `/app` SPA en/ko 런타임(`static/v3/js/core/i18n.js`)과 언어 선택이 구현됨
 
 **갭 / 다음 단계**
-- i18n 사전 (`static/i18n/{ko,en,ja}.json`) 추출 → PPT 명세 그대로 토큰화
+- i18n 사전 런타임은 `static/v3/js/core/i18n.js` 로 구현됨; 추가 언어는 이 사전에 확장
 
 ---
 
@@ -127,7 +127,7 @@ PPT 화면 1, 13 (login, security) 에 한국어 / Microsoft Entra ID / Okta SSO
 | 순위 | 파일 | 무엇 |
 |------|------|------|
 | 1 | `docs/kg-schema.md`, `kg_schema.py` | KG 스키마 정식화 (10 노드 · 12 엣지 · embedding · confidence) |
-| 2 | `static/css/tokens.css` (+ `responsive.css`, `ux.js`) | 디자인 토큰 통합 + 라이트/다크 — v2.2.1 완료 |
+| 2 | `static/css/tokens.css` + `static/v3/` | 디자인 토큰 통합 + 라이트/다크 + en/ko i18n |
 | 3 | `auto_setup.py` | OS 프로빙 + 모델 추천 + 설치 어댑터 |
 | 4 | `docs/architecture.md` 보강 | 위 변경 반영 |
 | 5 | (차후) `apps/desktop`, `apps/mobile` 스캐폴딩 | Tauri/Capacitor |

package/frontend/index.html

@@ -0,0 +1,24 @@
+<!doctype html>
+<html lang="en">
+  <head>
+    <meta charset="UTF-8" />
+    <meta name="viewport" content="width=device-width, initial-scale=1.0, viewport-fit=cover" />
+    <meta name="color-scheme" content="dark light" />
+    <title>Lattice AI · Digital Brain</title>
+    <link rel="manifest" href="/manifest.json" />
+    <link rel="icon" type="image/png" sizes="32x32" href="/icons/favicon-32.png" />
+    <script>
+      (function () {
+        try {
+          var theme = localStorage.getItem("lattice.theme");
+          if (theme === "light" || theme === "dark") document.documentElement.dataset.theme = theme;
+        } catch (e) {}
+      })();
+    </script>
+  </head>
+  <body>
+    <div id="root"></div>
+    <noscript>Lattice AI requires JavaScript for the local Digital Brain desktop shell.</noscript>
+    <script type="module" src="/src/main.tsx"></script>
+  </body>
+</html>