ltcai 12.2.1 → 12.3.0

package/README.md

@@ -12,7 +12,7 @@
 [![CD Status](https://github.com/TaeSooPark-PTS/LatticeAI/actions/workflows/publish.yml/badge.svg)](https://github.com/TaeSooPark-PTS/LatticeAI/actions/workflows/publish.yml)
 [![License](https://img.shields.io/badge/license-MIT-green)](LICENSE)
 
-![v12.2.1 Living Brain walkthrough](output/release/v12.2.1/gifs/v12.2.1-living-brain-walkthrough.gif)
+![v12.3.0 Living Brain walkthrough](output/release/v12.3.0/gifs/v12.3.0-living-brain-walkthrough.gif)
 
 Lattice AI is a Digital Brain that lives on your computer. Chat, files,
 folders, notes, and web pages all land in one knowledge graph you own.
@@ -42,19 +42,19 @@ LTCAI                    # then open http://127.0.0.1:4825/app
 
 | | | |
 | --- | --- | --- |
-| ![Login](output/release/v12.2.1/screenshots/01-login.png) | ![Model install](output/release/v12.2.1/screenshots/03-install-load-progress.png) | ![Model library](output/release/v12.2.1/screenshots/07-model-library.png) |
+| ![Login](output/release/v12.3.0/screenshots/01-login.png) | ![Model install](output/release/v12.3.0/screenshots/03-install-load-progress.png) | ![Model library](output/release/v12.3.0/screenshots/07-model-library.png) |
 
 Screenshot index:
-[output/release/v12.2.1/SCREENSHOT_INDEX.md](output/release/v12.2.1/SCREENSHOT_INDEX.md)
+[output/release/v12.3.0/SCREENSHOT_INDEX.md](output/release/v12.3.0/SCREENSHOT_INDEX.md)
 
 ## What you can do
 
 | | |
 | --- | --- |
-| **See your Brain's story in time** — a growth curve, an activity heatmap, and each day's story ![Brain Chronicle](output/release/v12.2.1/screenshots/13-chronicle.png) | **Chat with a Brain that remembers** — every conversation grows durable, source-linked memory ![Brain Chat](output/release/v12.2.1/screenshots/04-brain-chat-home.png) |
-| **See how knowledge connects** — a real relationship graph, not a file list ![Memory Graph](output/release/v12.2.1/screenshots/05-memory-graph.png) | **Capture anything** — files, whole folders, notes, screenshots, web pages ![Capture](output/release/v12.2.1/screenshots/06-capture.png) |
-| **Automate with review** — agent changes become proposals you approve first ![Review Center](output/release/v12.2.1/screenshots/12-review-center.png) | **Pick a model in one click** — recommended local models for your hardware ![Recommended Models](output/release/v12.2.1/screenshots/02-recommended-models.png) |
-| **Watch a file become memory** — three named steps, not a pipeline diagram ![Material to memory](output/release/v12.2.1/screenshots/11-knowledge-journey.png) | **Say how much it may do alone** — one dial in plain words ![Settings](output/release/v12.2.1/screenshots/08-system.png) |
+| **See your Brain's story in time** — a growth curve, an activity heatmap, and each day's story ![Brain Chronicle](output/release/v12.3.0/screenshots/13-chronicle.png) | **Chat with a Brain that remembers** — every conversation grows durable, source-linked memory ![Brain Chat](output/release/v12.3.0/screenshots/04-brain-chat-home.png) |
+| **See how knowledge connects** — a real relationship graph, not a file list ![Memory Graph](output/release/v12.3.0/screenshots/05-memory-graph.png) | **Capture anything** — files, whole folders, notes, screenshots, web pages ![Capture](output/release/v12.3.0/screenshots/06-capture.png) |
+| **Automate with review** — agent changes become proposals you approve first ![Review Center](output/release/v12.3.0/screenshots/12-review-center.png) | **Pick a model in one click** — recommended local models for your hardware ![Recommended Models](output/release/v12.3.0/screenshots/02-recommended-models.png) |
+| **Watch a file become memory** — three named steps, not a pipeline diagram ![Material to memory](output/release/v12.3.0/screenshots/11-knowledge-journey.png) | **Say how much it may do alone** — one dial in plain words ![Settings](output/release/v12.3.0/screenshots/08-system.png) |
 
 ## Why this is yours
 
@@ -70,36 +70,42 @@ Screenshot index:
 
 ## Current Release
 
-The current release is **12.2.1 — True Count**:
-
-Search, skip, watch, and small-model answers now count what is actually
-there instead of dumping, rehashing, or pretending. The door is still
-**422 operations / 41 families** over a **20-route worker**. Cloud is
-still optional and the default is still local.
-
-- **Search does not dump the Brain.** A warm HNSW query is `COUNT(*)`
-  then, if needed, the missing vectors only. Writes stay on one
-  `GraphWriter`.
-- **A touch is a stamp, not a re-ingest.** Same bytes with a new mtime
-  restamp provenance so the next scan skips by stamp.
-- **A vanished watched file leaves the graph.** Disk is never deleted.
-- **A thin summary is filled from the file that was read**, or held for
-  review — never marked done with empty words.
-- **MCP tools stay in the compact nine-row list.** `api_key` cloud
-  verifies with a live `GET /models` (no billed completion). Hash
-  search is named as hash, with a path to a meaning model.
+The current release is **12.3.0 — Live Wire**:
+
+Model catalog routes, GGUF quantization tags, small-model tool/MCP calling,
+and HTML generation/inspection/download are verified end-to-end against live
+repositories and a loaded local model. The door is still **422 operations /
+41 families** over a **20-route worker**. Cloud is still optional and the
+default is still local.
+
+- **Verified Hugging Face GGUF tags & routes.** `ggml-org/gemma-4-*-GGUF`
+  uses `Q4_0`, `ggml-org/gpt-oss-20b-GGUF` uses `MXFP4`, and `Qwen3.5-9B` /
+  `Qwen3.6-35B-A3B` GGUF routes are wired across `ollama`, `lmstudio`, and
+  `llamacpp`.
+- **Auxiliary GGUF filtering, `--mmproj` companion load, and shard checks.**
+  `mmproj-`/`mtp-`/`dflash-`/`eagle3-`/`imatrix` GGUFs are excluded from
+  primary weight selection, companion `mmproj-*.gguf` files are downloaded
+  for `llama-server`, and `model.safetensors.index.json` shards are verified.
+- **Small-model tool calling & MCP calling hardening.** Expanded
+  `KNOWN_ACTIONS`, stringified `arguments` recovery, OpenAI `tool_calls`
+  array unwrapping, fenced HTML/code block salvage, and `adopt_named_args`
+  in `perform_action`.
+- **HTML structure inspection & RFC 5987 UTF-8 download.**
+  `POST /tools/inspect_html` extracts `title`, `links`, `scripts`,
+  `stylesheets`, `images`, `forms`, and `headings`; `GET /tools/download`
+  decodes UTF-8 paths and sends `filename*=UTF-8''...`.
 
 Release notes live in [docs/releases/](docs/releases/). This version:
-[docs/releases/RELEASE_NOTES_v12.2.1.md](docs/releases/RELEASE_NOTES_v12.2.1.md).
+[docs/releases/RELEASE_NOTES_v12.3.0.md](docs/releases/RELEASE_NOTES_v12.3.0.md).
 Guide: [RELEASE.md](RELEASE.md) · History: [docs/CHANGELOG.md](docs/CHANGELOG.md).
 
-Expected artifacts for 12.2.1 must use exact filenames:
+Expected artifacts for 12.3.0 must use exact filenames:
 
-- `dist/ltcai-12.2.1-py3-none-any.whl`
-- `dist/ltcai-12.2.1.tar.gz`
-- `ltcai-12.2.1.tgz`
-- `dist/ltcai-12.2.1.vsix`
-- `src-tauri/target/release/bundle/dmg/Lattice AI_12.2.1_aarch64.dmg`
+- `dist/ltcai-12.3.0-py3-none-any.whl`
+- `dist/ltcai-12.3.0.tar.gz`
+- `ltcai-12.3.0.tgz`
+- `dist/ltcai-12.3.0.vsix`
+- `src-tauri/target/release/bundle/dmg/Lattice AI_12.3.0_aarch64.dmg`
 
 Do not use wildcard artifact uploads. Package registry publishing remains owner-run.
 
@@ -170,7 +176,7 @@ Validation via `npm run lint`, `npm run test:unit`, `npm run test:visual`.
   pending-only, no Self-Model refiner, `delete_node` leaving `PART_OF`,
   review events silent without an owner, KG-api ingest text-only, two
   store cycles per review mutation) are listed with their reasons in
-  [docs/releases/RELEASE_NOTES_v12.2.1.md](docs/releases/RELEASE_NOTES_v12.2.1.md)
+  [docs/releases/RELEASE_NOTES_v12.3.0.md](docs/releases/RELEASE_NOTES_v12.3.0.md)
   and prioritized in [docs/ROADMAP.md](docs/ROADMAP.md).
 
 ## Release History
@@ -182,6 +188,7 @@ same boundary. Earlier notes live in [docs/releases/](docs/releases/).
 
 | Version | Theme |
 | --- | --- |
+| 12.3.0 | Live Wire |
 | 12.2.1 | True Count |
 | 12.2.0 | Small Voice |
 | 12.1.0 | Fast Path |

package/docs/CHANGELOG.md

@@ -4,6 +4,40 @@ The top entry is either the current unreleased main-branch work or the current
 release line. Older entries are historical and may describe behavior as it
 existed at that release.
 
+## [12.3.0] - 2026-10-19 — Live Wire
+
+### Added
+- Full HTML structure parser in `POST /tools/inspect_html`: extracts `title`,
+  `links`, `scripts`, `stylesheets`, `images`, `forms`, and `headings`
+  (`h1`–`h6`) with `MAX_FILE_BYTES` enforcement.
+- RFC 5987 `filename*=UTF-8''...` `Content-Disposition` attachment headers and
+  UTF-8 percent-decoding in `GET /tools/download`.
+- Verified GGUF routing for `mlx-community/Qwen3.5-9B-MLX-4bit`
+  (`unsloth/Qwen3.5-9B-GGUF`) and `mlx-community/Qwen3.6-35B-A3B-4bit`
+  (`ggml-org/Qwen3.6-35B-A3B-GGUF`) across `ollama`, `lmstudio`, and `llamacpp`.
+- Companion `mmproj-*.gguf` download and `--mmproj` flag in
+  `ensure_llamacpp_server`, plus `is_auxiliary_gguf` filtering (`mmproj-`,
+  `mtp-`, `dflash-`, `eagle3-`, `imatrix`) and `_shards_complete` verification
+  for `model.safetensors.index.json`.
+- Small-model tool/MCP calling tolerances in `lattice-agent`: expanded
+  `KNOWN_ACTIONS`, stringified `arguments` recovery (trailing comma, truncation,
+  Python dict literal), OpenAI `tool_calls` array unwrapping, fenced HTML/code
+  block salvage for `write_file`/`local_write`, and `adopt_named_args` in
+  `perform_action`.
+
+### Changed
+- `_gguf_routes` now accepts per-repository `ollama_tag` (`Q4_0` for
+  `ggml-org/gemma-4-*-GGUF`, `MXFP4` for `ggml-org/gpt-oss-20b-GGUF`).
+- Cloud and local provider defaults updated to current models (`grok-4.6`,
+  `Qwen/Qwen3.6-27B`, `qwen/qwen3.6-35b-a3b`, `x-ai/grok-4.6`,
+  `hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_0`, `google/gemma-4-12B-it`).
+
+### Fixed
+- Removed nonexistent `mlx-community/bge-m3` from `LOCAL_MLX_MODELS` while
+  retaining `bge-m3` in `OLLAMA_EMBEDDING_MODELS`.
+- Fixed Latin-1 byte-to-char corruption on non-ASCII percent-encoded paths in
+  `/tools/download`.
+
 ## [12.2.1] - 2026-08-29 — True Count
 
 ### Added

package/docs/COMMUNITY_AND_PLUGINS.md

@@ -1,6 +1,6 @@
 # Community And Plugins
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 LatticeAI defines the path from a strong local-first framework (8.4.0
 action-aware baseline, 8.5.0 registry+DI hardening, 8.6.0 capture/navigation

package/docs/DEVELOPMENT.md

@@ -3,7 +3,7 @@
 > **Status: canonical** — current contributor guidance, kept in sync with the
 > current release.
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 This document is the contributor onboarding path: how to boot the tree, where
 a change belongs, which gates will go red, and the house rules that keep the
@@ -80,7 +80,7 @@ worker interpreter with `LTCAI_PYTHON` when both exist.
 `rust/target/release/lattice-host`, then `rust/target/debug/lattice-host`. If
 none exist it runs `cargo build -p lattice-host` (debug). A stale
 `rust/target/release/lattice-host` wins over a current debug binary — pin or
-rebuild (`cargo build -p lattice-host --release`) if `-V` is not 12.2.1.
+rebuild (`cargo build -p lattice-host --release`) if `-V` is not 12.3.0.
 
 Do not run `npm start` and `npm run dev` on the same port. The worker
 entrypoint defaults to `LATTICEAI_PORT` or **4825**, the same port as the
@@ -237,7 +237,7 @@ in `rust/`.
 Markdown) and `scripts/check_doc_status.mjs` (every relative link under the
 root canonical docs and `docs/**`). A red line is a broken relative path —
 fix the href or put the file where the href says. Canonical docs (this one
-included) must carry `Current release: **12.2.1 — …**` matching
+included) must carry `Current release: **12.3.0 — …**` matching
 `package.json`; do not bump that marker here ahead of the release lane.
 `npm run docs:check-current` is the release-set version pin
 ([`scripts/check_current_release_docs.mjs`](../scripts/check_current_release_docs.mjs)).
@@ -248,7 +248,7 @@ changelog entries that mention old versions stay.
 ### Release-evidence binding
 
 `scripts/check_release_evidence_bound.mjs` (lint member 9) checks that
-`output/release/v12.2.1/SCREENSHOT_INDEX.md` still names the live
+`output/release/v12.3.0/SCREENSHOT_INDEX.md` still names the live
 `static/app/asset-manifest.json` digest and the visual mock-server
 fingerprint. It exists so a later `npm run build:assets` cannot ship
 screenshots of an older UI, and so a mock-server edit cannot leave the
@@ -317,19 +317,19 @@ For user-facing, API, runtime, release, or packaging changes, check:
   appears
 
 The release-docs lane owns README / ARCHITECTURE / FEATURE_STATUS version
-bumps. Do not move this file's `Current release` marker off 12.2.1 ahead of
+bumps. Do not move this file's `Current release` marker off 12.3.0 ahead of
 that lane.
 
 Release/publish examples must use exact target-version filenames. Do not
 document wildcard artifact upload commands.
 
-For 12.2.1 release work, exact artifacts are:
+For 12.3.0 release work, exact artifacts are:
 
-- `dist/ltcai-12.2.1-py3-none-any.whl`
-- `dist/ltcai-12.2.1.tar.gz`
-- `ltcai-12.2.1.tgz`
-- `dist/ltcai-12.2.1.vsix`
-- `src-tauri/target/release/bundle/dmg/Lattice AI_12.2.1_aarch64.dmg`
+- `dist/ltcai-12.3.0-py3-none-any.whl`
+- `dist/ltcai-12.3.0.tar.gz`
+- `ltcai-12.3.0.tgz`
+- `dist/ltcai-12.3.0.vsix`
+- `src-tauri/target/release/bundle/dmg/Lattice AI_12.3.0_aarch64.dmg`
 
 The dmg is ad-hoc signed (effectively unsigned); `npm run release:validate`
 checks the names and presence, not a Developer ID signature.

package/docs/ONBOARDING.md

@@ -1,6 +1,6 @@
 # Lattice AI Onboarding
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 The first-run goal is a five-minute path from "I opened the app" to "my Brain
 has a source, a question, and proof." This page is the product contract behind

package/docs/OPERATIONS.md

@@ -1,4 +1,4 @@
-# Lattice AI — Operations Guide (v12.2.1)
+# Lattice AI — Operations Guide (v12.3.0)
 
 > **Status: canonical** — kept in sync with the current release. Storage layout
 > below reflects the SQLite live Brain store and workspace scoping, not the

package/docs/ROADMAP.md

@@ -3,7 +3,7 @@
 > **Status: reference** — point-in-time inventory, redated at v12.0.0. Not a
 > canonical current-release document; version gates do not bind it.
 
-As of **2026-08-29**, against the 12.2.1 — True Count tree. The rows below
+As of **2026-10-19**, against the 12.3.0 — Live Wire tree. The rows below
 were gathered against 11.9.0 and re-checked when 12.0.0 shipped; what that
 release closed is marked closed rather than deleted, so the ledger still
 shows what was owed.

package/docs/TRUST_MODEL.md

@@ -1,6 +1,6 @@
 # Lattice AI Trust Model
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 Lattice AI is local-first, explicit about external communication, and honest
 when a capability is unavailable.

package/docs/WHY_LATTICE.md

@@ -1,6 +1,6 @@
 # Why Lattice AI Exists
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 **Lattice AI is a local-first Digital Brain that keeps your knowledge durable
 across any AI model.**

package/docs/kg-schema.md

@@ -1,6 +1,6 @@
 # Knowledge Graph Schema
 
-Current release: **12.2.1 — True Count**.
+Current release: **12.3.0 — Live Wire**.
 
 명세 출처: `lattice_ai_full_spec.pptx` 슬라이드 20·21·22
 구현: `lattice_brain/graph/schema.py`

package/lattice_brain/__init__.py

@@ -31,7 +31,7 @@ from .multimodal import (
     transcribe_audio,
 )
 
-__version__ = "12.2.1"
+__version__ = "12.3.0"
 
 __all__ = [
     "AudioFacts",

package/latticeai/__init__.py

@@ -1,3 +1,3 @@
 """Lattice AI - modular server package."""
 
-__version__ = "12.2.1"
+__version__ = "12.3.0"

package/latticeai/core/embedding_providers/autodetect.py

@@ -58,7 +58,6 @@ LOCAL_MLX_MODELS: Tuple[Tuple[str, int, bool], ...] = (
     ("mlx-community/multilingual-e5-large-mlx", 1024, True),
     ("mlx-community/snowflake-arctic-embed-l-v2.0-8bit", 1024, False),
     ("mlx-community/embeddinggemma-300m-4bit", 768, False),
-    ("mlx-community/bge-m3", 1024, False),
 )
 
 #: Ollama model names that are embedders rather than chat models.

package/latticeai/core/model_compat.py

@@ -256,7 +256,7 @@ def _gemma4_runtime_candidates(raw_model_id: str) -> List[Dict[str, Any]]:
         {
             "engine": "ollama",
             "runtime": "Ollama GGUF",
-            "load_id": "ollama:hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_K_M",
+            "load_id": "ollama:hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_0",
             "available": None,
             "role": "gguf_local_server",
         },
@@ -354,7 +354,7 @@ def model_runtime_compatibility(model_id: str, engine: Optional[str] = None) ->
             ],
             "alternatives": [
                 {"id": "mlx-community/gemma-4-26b-a4b-it-4bit", "name": "Gemma 4 26B A4B", "engine": "local_mlx"},
-                {"id": "ollama:hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_K_M", "name": "Gemma 4 12B GGUF", "engine": "ollama"},
+                {"id": "ollama:hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_0", "name": "Gemma 4 12B GGUF", "engine": "ollama"},
                 {"id": "lmstudio:ggml-org/gemma-4-12B-it-GGUF", "name": "Gemma 4 12B GGUF", "engine": "lmstudio"},
             ],
             "action": "Runtime update needed",

package/latticeai/models/model_providers.py

@@ -27,29 +27,28 @@ OPENAI_COMPATIBLE_PROVIDERS = {
     "together": {
         "env_key": "TOGETHER_API_KEY",
         "base_url": "https://api.together.xyz/v1",
-        "default_model": "Qwen/Qwen3-VL-32B-Instruct",
+        "default_model": "Qwen/Qwen3.6-27B",
     },
     "xai": {
         "env_key": "XAI_API_KEY",
         "base_url": "https://api.x.ai/v1",
         # ``grok-beta`` was xAI's 2024 preview id and has been decommissioned;
-        # a request naming it now 404s at the provider. ``grok-4.5`` is the
-        # current flagship on api.x.ai and is multimodal, which is also why the
-        # separate ``grok-vision-beta`` row below is gone rather than renamed.
-        "default_model": "grok-4.5",
+        # a request naming it now 404s at the provider. ``grok-4.6`` is the
+        # current flagship on api.x.ai and matches the Rust cloud adapter.
+        "default_model": "grok-4.6",
     },
     "ollama": {
         "env_key": "OLLAMA_API_KEY",
         "base_url_env": "OLLAMA_BASE_URL",
         "base_url": "http://localhost:11434/v1",
-        "default_model": "hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_K_M",
+        "default_model": "hf.co/ggml-org/gemma-4-12B-it-GGUF:Q4_0",
         "api_key_fallback": "ollama",
     },
     "vllm": {
         "env_key": "VLLM_API_KEY",
         "base_url_env": "VLLM_BASE_URL",
         "base_url": "http://localhost:8000/v1",
-        "default_model": "Qwen/Qwen3-VL-8B-Instruct",
+        "default_model": "google/gemma-4-12B-it",
         "api_key_fallback": "vllm",
     },
     "lmstudio": {
@@ -85,9 +84,9 @@ PROVIDER_MODEL_CATALOG = {
         {"id": "anthropic/claude-opus-4.7", "name": "Claude Opus 4.7 via OpenRouter", "family": "Claude"},
         {"id": "anthropic/claude-sonnet-4.6", "name": "Claude Sonnet 4.6 via OpenRouter", "family": "Claude"},
         {"id": "anthropic/claude-haiku-4.5", "name": "Claude Haiku 4.5 via OpenRouter", "family": "Claude"},
-        {"id": "qwen/qwen3-vl-235b-a22b-instruct", "name": "Qwen3-VL 235B A22B via OpenRouter", "family": "Qwen"},
+        {"id": "qwen/qwen3.6-35b-a3b", "name": "Qwen3.6 35B A3B via OpenRouter", "family": "Qwen"},
         {"id": "google/gemma-4-12b-it", "name": "Gemma 4 12B via OpenRouter", "family": "Gemma"},
-        {"id": "x-ai/grok-4.5", "name": "Grok 4.5 via OpenRouter", "family": "Grok"},
+        {"id": "x-ai/grok-4.6", "name": "Grok 4.6 via OpenRouter", "family": "Grok"},
         {"id": "meta-llama/llama-4-scout-17b-16e-instruct", "name": "Llama 4 Scout via OpenRouter", "family": "Llama"},
         {"id": "google/gemini-2.5-flash", "name": "Gemini 2.5 Flash via OpenRouter", "family": "Gemini"},
     ],
@@ -95,7 +94,7 @@ PROVIDER_MODEL_CATALOG = {
         {"id": "meta-llama/llama-4-scout-17b-16e-instruct", "name": "Llama 4 Scout", "family": "Llama"},
     ],
     "together": [
-        {"id": "Qwen/Qwen3-VL-32B-Instruct", "name": "Qwen3-VL 32B", "family": "Qwen"},
+        {"id": "Qwen/Qwen3.6-27B", "name": "Qwen3.6 27B", "family": "Qwen"},
         {"id": "google/gemma-4-12b-it", "name": "Gemma 4 12B", "family": "Gemma"},
         {"id": "meta-llama/Llama-4-Scout-17B-16E-Instruct", "name": "Llama 4 Scout", "family": "Llama"},
     ],
@@ -105,7 +104,7 @@ PROVIDER_MODEL_CATALOG = {
         # (grok-beta / grok-vision-beta) are not carried as fallbacks: a model
         # the provider no longer serves is not compatibility, it is a 404 the
         # user has to discover for themselves.
-        {"id": "grok-4.5", "name": "Grok 4.5", "family": "Grok"},
+        {"id": "grok-4.6", "name": "Grok 4.6", "family": "Grok"},
     ],
 }
 

package/latticeai/services/architecture_readiness.py

@@ -19,7 +19,7 @@ from dataclasses import dataclass
 from pathlib import Path
 from typing import Any, Dict, List
 
-ARCHITECTURE_VERSION_TARGET = "12.2.1"
+ARCHITECTURE_VERSION_TARGET = "12.3.0"
 
 PREFERRED_REFACTORING_ORDER = [
     "agent-runtime",

package/latticeai/services/model_capability_registry.py

@@ -300,7 +300,7 @@ _REGISTRY: List[ModelCapability] = [
         architecture="qwen3_5",
         download_size_gb=5.98,
         quantization="4bit",
-        provider_hints=["local_mlx", "vllm"],
+        provider_hints=["local_mlx", "ollama", "vllm", "lmstudio", "llamacpp"],
         download_strategy="hf_hub",
         load_strategy="mlx_vlm",
         hardware=HardwareProfile(
@@ -381,7 +381,7 @@ _REGISTRY: List[ModelCapability] = [
         architecture="qwen3_5_moe",
         download_size_gb=20.43,
         quantization="4bit",
-        provider_hints=["local_mlx", "vllm"],
+        provider_hints=["local_mlx", "ollama", "vllm", "lmstudio", "llamacpp"],
         download_strategy="hf_hub",
         load_strategy="mlx_vlm",
         hardware=HardwareProfile(

package/latticeai/services/model_catalog.py

@@ -102,11 +102,17 @@ ENGINE_MODEL_CATALOG: Dict[str, List[Dict[str, Any]]] = {}
 # gated — the download could never succeed without Hub credentials.
 
 
-def _gguf_routes(mlx_repo: str, gguf_repo: str, hf_repo: str) -> Dict[str, str]:
+def _gguf_routes(
+    mlx_repo: str,
+    gguf_repo: str,
+    hf_repo: str,
+    *,
+    ollama_tag: str = "Q4_K_M",
+) -> Dict[str, str]:
     """One model's engine map: MLX weights, a GGUF repo, and the upstream HF repo."""
     return {
         "local_mlx": mlx_repo,
-        "ollama": f"hf.co/{gguf_repo}:Q4_K_M",
+        "ollama": f"hf.co/{gguf_repo}:{ollama_tag}",
         "vllm": hf_repo,
         "lmstudio": gguf_repo,
         "llamacpp": gguf_repo,
@@ -119,36 +125,38 @@ _ENGINE_ROUTES: Dict[str, Dict[str, str]] = {
     ),
     "mlx-community/gemma-4-e2b-it-4bit": _gguf_routes(
         "mlx-community/gemma-4-e2b-it-4bit", "ggml-org/gemma-4-E2B-it-GGUF", "google/gemma-4-E2B-it",
+        ollama_tag="Q4_0",
     ),
     "mlx-community/gemma-4-e4b-it-4bit": _gguf_routes(
         "mlx-community/gemma-4-e4b-it-4bit", "ggml-org/gemma-4-E4B-it-GGUF", "google/gemma-4-E4B-it",
+        ollama_tag="Q4_0",
     ),
     "mlx-community/gemma-4-12B-it-4bit": _gguf_routes(
         "mlx-community/gemma-4-12B-it-4bit", "ggml-org/gemma-4-12B-it-GGUF", "google/gemma-4-12B-it",
+        ollama_tag="Q4_0",
     ),
     "mlx-community/gemma-4-26b-a4b-it-4bit": _gguf_routes(
         "mlx-community/gemma-4-26b-a4b-it-4bit", "ggml-org/gemma-4-26B-A4B-it-GGUF",
         "google/gemma-4-26B-A4B-it",
+        ollama_tag="Q4_0",
     ),
     "mlx-community/gemma-4-31b-it-4bit": _gguf_routes(
         "mlx-community/gemma-4-31b-it-4bit", "ggml-org/gemma-4-31B-it-GGUF", "google/gemma-4-31B-it",
+        ollama_tag="Q4_0",
     ),
     "mlx-community/Qwen3.6-27B-4bit": _gguf_routes(
         "mlx-community/Qwen3.6-27B-4bit", "ggml-org/Qwen3.6-27B-GGUF", "Qwen/Qwen3.6-27B",
     ),
     "mlx-community/gpt-oss-20b-MXFP4-Q8": _gguf_routes(
         "mlx-community/gpt-oss-20b-MXFP4-Q8", "ggml-org/gpt-oss-20b-GGUF", "openai/gpt-oss-20b",
+        ollama_tag="MXFP4",
+    ),
+    "mlx-community/Qwen3.5-9B-MLX-4bit": _gguf_routes(
+        "mlx-community/Qwen3.5-9B-MLX-4bit", "unsloth/Qwen3.5-9B-GGUF", "Qwen/Qwen3.5-9B",
+    ),
+    "mlx-community/Qwen3.6-35B-A3B-4bit": _gguf_routes(
+        "mlx-community/Qwen3.6-35B-A3B-4bit", "ggml-org/Qwen3.6-35B-A3B-GGUF", "Qwen/Qwen3.6-35B-A3B",
     ),
-    # No community GGUF build verified for these two, so they offer the MLX
-    # weights and the upstream repo only rather than a route that would 404.
-    "mlx-community/Qwen3.5-9B-MLX-4bit": {
-        "local_mlx": "mlx-community/Qwen3.5-9B-MLX-4bit",
-        "vllm": "Qwen/Qwen3.5-9B",
-    },
-    "mlx-community/Qwen3.6-35B-A3B-4bit": {
-        "local_mlx": "mlx-community/Qwen3.6-35B-A3B-4bit",
-        "vllm": "Qwen/Qwen3.6-35B-A3B",
-    },
 }
 
 # Names people actually type that are not the repo's own short name. Kept

package/latticeai/services/model_engines.py

@@ -332,6 +332,10 @@ def ensure_llamacpp_server(model_name: str) -> None:
         hf_model_dir,
         hf_model_ready,
     )
+    from latticeai.services.model_runtime.download import (
+        GGUF_QUANT_PREFERENCE,
+        is_auxiliary_gguf,
+    )
 
     served_models = get_openai_compatible_server_models("llamacpp")
     if model_name in served_models:
@@ -347,23 +351,31 @@ def ensure_llamacpp_server(model_name: str) -> None:
         download_hf_model(model_name, "llamacpp")
 
     gguf_files = sorted(hf_model_dir(model_name).rglob("*.gguf"))
-    if not gguf_files:
+    primary_ggufs = [p for p in gguf_files if not is_auxiliary_gguf(p.name)]
+    if not primary_ggufs:
         raise ModelRuntimeError(status_code=500, detail="다운로드된 GGUF 파일을 찾지 못했습니다.")
 
-    preferred = next((p for p in gguf_files if "q4_k_m" in p.name.lower()), None)
-    model_file = preferred or gguf_files[0]
+    preferred = next(
+        (p for pref in GGUF_QUANT_PREFERENCE for p in primary_ggufs if pref in p.name.lower()),
+        None,
+    )
+    model_file = preferred or primary_ggufs[0]
+    command = [
+        "llama-server",
+        "-m",
+        str(model_file),
+        "--alias",
+        model_name,
+        "--host",
+        "127.0.0.1",
+        "--port",
+        "8080",
+    ]
+    mmprojs = [p for p in gguf_files if p.name.lower().startswith("mmproj-")]
+    if mmprojs:
+        command.extend(["--mmproj", str(mmprojs[0])])
     LOCAL_SERVER_PROCESSES["llamacpp"] = subprocess.Popen(
-        [
-            "llama-server",
-            "-m",
-            str(model_file),
-            "--alias",
-            model_name,
-            "--host",
-            "127.0.0.1",
-            "--port",
-            "8080",
-        ],
+        command,
         stdout=subprocess.DEVNULL,
         stderr=subprocess.DEVNULL,
         start_new_session=True,