@zosmaai/pi-llm-wiki 0.12.0 → 0.12.2

package/CHANGELOG.md

@@ -13,6 +13,7 @@
   - **17 more tests** (`test/ambient-gate.test.ts`): project-vault resolution (own vault, ancestor walk, `WIKI_HOME`, personal-vault exclusion), the host-dependent default and its explicit override, the composed gate across four project states, and the reminder gate — including that a closed gate does not bank turns, so opening it later is not an instant nag, and that `display: false` is not a substitute because it still injects into model context.
 
 ### Fixed
+- **`/wiki-model` picker ignored typing on long lists** (Issue #218): printable keys were forwarded to `SelectList`, which only handles arrows/enter/esc, so finding `anthropic/claude-haiku` still meant paging. A visible `Input` above the editor-dock list now filters with a case-insensitive substring on `label` and `value` (`SelectList.setFilter` is prefix-on-value and would miss `haiku`). Empty query restores the full list; no matches uses SelectList's no-match row; Esc still cancels immediately. Persist and scriptable args are unchanged.
 - **MCP server failed to start on `@modelcontextprotocol/server` 2.0.0** (Issue #128): `mcp/index.ts` imported `StdioServerTransport` from the package root, but SDK 2.0.0 (published 2026-07-27) moved that export to the `./stdio` subpath, so `node dist/mcp/index.js` died with `SyntaxError: The requested module '@modelcontextprotocol/server' does not provide an export named 'StdioServerTransport'` before the transport ever connected. The declared range `^2.0.0-alpha.2` is a caret range over a prerelease, so it permits `2.0.0`: every fresh consumer install resolved the stable SDK against the pre-stable import, while `pnpm-lock.yaml` pinned the `2.0.0-alpha.2` floor — so `test/mcp-package.test.ts`, which does spawn the published command and complete the stdio handshake, only ever exercised the alpha where the root export still existed. Fixed by importing `StdioServerTransport` from `@modelcontextprotocol/server/stdio` (the `./stdio` subpath does not exist in `2.0.0-alpha.2`, so the range, the lockfile and the import move together), raising the range to `^2.0.0`, and refreshing the lockfile so the existing smoke test now runs against the SDK consumers actually get.
 - **Packaged MCP server was never exercised with consumer-resolved dependencies**: a new `packaged-mcp-consumer` CI job packs the tarball, installs it into a directory with **no lockfile**, prints the resolved SDK version, and runs `scripts/mcp-smoke.mjs` — the stdio handshake (`initialize` → `tools/list`) — against that install. This closes the whole class of failure behind Issue #128: a dependency range that resolves differently for consumers than for this repo's lockfile can no longer break the published server undetected.
 - **README documented a standalone MCP command that ships no JavaScript** (Issue #129): all ten READMEs pointed MCP clients at `node node_modules/@zosmaai/pi-llm-wiki/mcp/index.js`, but the published `mcp/` directory contains only TypeScript (`index.ts`, `exec.ts`, `operations.ts`), so the documented command failed with `MODULE_NOT_FOUND` — independently of any dependency-resolution problem. The runnable entry is `dist/mcp/index.js`, which the package's own `pi.mcpservers` manifest already declared correctly. Every README now documents that path and adds an `mcpServers` config block for `.mcp.json` / `claude_desktop_config.json` using **absolute** paths, because MCP clients spawn the command without a shell: a `~` in `args` or `env` is passed through literally and the server fails to start behind a generic connection error. A new `test/package-structure.test.ts` case derives the expected path from `pi.mcpservers` — the same command `test/mcp-package.test.ts` spawns and handshakes with — and asserts every documented `…/mcp/index.js` occurrence in every README resolves to it, so docs cannot drift from the runnable entry point again.

package/README.md

@@ -127,6 +127,7 @@ The result is a wiki that **compounds** as you capture sources, ask questions, a
 | `wiki_status` | Show counts, source states, and recent activity |
 | `wiki_observe` | Record timestamped, searchable observations from the current session (decisions, findings, constraints) — later distilled into pages |
 | `wiki_rebuild_meta` | Force a full metadata rebuild (registry, backlinks, index, log) |
+| `wiki_reindex` | Rebuild/repair the generated QMD search index at `meta/qmd` (lexical is model-free; vectors may download ~2 GB) |
 | `wiki_reindex_embeddings` | Refresh semantic embeddings for new or stale pages (no-op if no embedding provider is configured) |
 | `wiki_log_event` | Append a structured event to the wiki activity log |
 | `wiki_watch` | Print a `crontab` line for automatic wiki updates (daily / weekly / hourly) — does not install it |
@@ -582,6 +583,13 @@ Thanks to everyone who has contributed! This list is regenerated automatically b
                     <sub><b>PrestaLab</b></sub>
                 </a>
             </td>
+            <td align="center">
+                <a href="https://github.com/wooksong">
+                    <img src="https://avatars.githubusercontent.com/u/2772376?v=4" width="64;" alt="wooksong"/>
+                    <br />
+                    <sub><b>wooksong</b></sub>
+                </a>
+            </td>
             <td align="center">
                 <a href="https://github.com/xcsf">
                     <img src="https://avatars.githubusercontent.com/u/43439835?v=4" width="64;" alt="xcsf"/>
@@ -589,6 +597,8 @@ Thanks to everyone who has contributed! This list is regenerated automatically b
                     <sub><b>xcsf</b></sub>
                 </a>
             </td>
+		</tr>
+		<tr>
             <td align="center">
                 <a href="https://github.com/danielnaab">
                     <img src="https://avatars.githubusercontent.com/u/136512?v=4" width="64;" alt="danielnaab"/>
@@ -596,20 +606,18 @@ Thanks to everyone who has contributed! This list is regenerated automatically b
                     <sub><b>Daniel Naab</b></sub>
                 </a>
             </td>
-		</tr>
-		<tr>
             <td align="center">
-                <a href="https://github.com/deestax">
-                    <img src="https://avatars.githubusercontent.com/u/152369481?v=4" width="64;" alt="deestax"/>
+                <a href="https://github.com/mdmayfield">
+                    <img src="https://avatars.githubusercontent.com/u/26154258?v=4" width="64;" alt="mdmayfield"/>
                     <br />
-                    <sub><b>Superdao</b></sub>
+                    <sub><b>Matt Mayfield</b></sub>
                 </a>
             </td>
             <td align="center">
-                <a href="https://github.com/wooksong">
-                    <img src="https://avatars.githubusercontent.com/u/2772376?v=4" width="64;" alt="wooksong"/>
+                <a href="https://github.com/deestax">
+                    <img src="https://avatars.githubusercontent.com/u/152369481?v=4" width="64;" alt="deestax"/>
                     <br />
-                    <sub><b>wooksong</b></sub>
+                    <sub><b>Superdao</b></sub>
                 </a>
             </td>
             <td align="center">

package/dist/extensions/llm-wiki/lib/bootstrap.js

@@ -1,3 +1,4 @@
+import { randomUUID } from "node:crypto";
 import { existsSync, writeFileSync } from "node:fs";
 import { join } from "node:path";
 import { appendEvent, rebuildMetadata } from "./metadata.js";
@@ -64,6 +65,7 @@ export function bootstrapVault(paths, input) {
         topic: input.topic,
         created: existing.created ?? fmtDate(),
         version: existing.version ?? "1.0",
+        vault_id: existing.vault_id ?? randomUUID(),
         ...(created ? { knowledge_format: "okf-0.2" } : {}),
     };
     ensureVaultStructure(paths);

package/dist/extensions/llm-wiki/lib/indexing.js

@@ -24,6 +24,7 @@
  */
 import { reindexEmbeddings, resolveEmbedder } from "./embeddings.js";
 import { rebuildMetadataLight } from "./metadata.js";
+import { invalidateQmdAfterProjectionFailure, reindexQmdVault } from "./qmd-indexing.js";
 /** Promise of the current background pass, keyed by vault root. */
 const inflight = new Map();
 /** Vault roots with writes awaiting a (re)build. */
@@ -54,8 +55,30 @@ export function scheduleReindex(runtime, ctx, paths) {
             while (dirty.has(root)) {
                 dirty.delete(root);
                 const projection = rebuildMetadataLight(paths);
-                if (!projection.ok)
+                if (!projection.ok) {
+                    // Generated QMD search state is repairable and must not fail the
+                    // authoritative write. On a projection failure, only invalidate unsafe
+                    // QMD entries (never index valid additions).
+                    try {
+                        await invalidateQmdAfterProjectionFailure(paths);
+                    }
+                    catch {
+                        // Best-effort safety pass; a busy/transient lock must not abort the
+                        // metadata drain loop.
+                    }
                     continue;
+                }
+                try {
+                    // Post-projection lexical QMD pass. Model-free and repairable.
+                    await reindexQmdVault(paths, {
+                        scope: "changed",
+                        components: ["lexical"],
+                        force: false,
+                    });
+                }
+                catch {
+                    // Generated search indexing is repairable and must not fail the write.
+                }
                 // Refresh embeddings only after metadata is consistent. Stale-aware and
                 // a no-op unless an embedder is configured.
                 runtime.ensureConfig(root);

package/dist/extensions/llm-wiki/lib/ingest-worker.js

@@ -388,7 +388,7 @@ Rules:
  * synthesis.
  */
 export async function runIngestSynthesis(args) {
-    const { model, apiKey, headers, paths, sourceId, manifest, extracted, maxChars, signal, synthesisLanguage, synthesisMaxTokens, wikilinkValidation, } = args;
+    const { model, apiKey, headers, streamFn, env, paths, sourceId, manifest, extracted, maxChars, signal, synthesisLanguage, synthesisMaxTokens, wikilinkValidation, } = args;
     const content = extracted.slice(0, maxChars ?? 24_000);
     if (!content.trim())
         return undefined;
@@ -422,6 +422,8 @@ export async function runIngestSynthesis(args) {
         model,
         apiKey,
         headers,
+        streamFn,
+        env,
         systemPrompt,
         userPrompt,
         tools: [commitTool],

package/dist/extensions/llm-wiki/lib/knowledge-document.js

@@ -383,7 +383,14 @@ export function serializeKnowledgeDocument(document) {
     const body = document.body.replace(/\r\n?/g, "\n").replace(/\n*$/, "");
     return body ? `---\n${yaml}---\n\n${body}\n` : `---\n${yaml}---\n`;
 }
-/** Escape wikilink alias pipes so generated content remains valid in Markdown tables. */
+const TABLE_ROW = /^\s*\|.*\|\s*$/;
+/** Escape wikilink alias pipes only inside Markdown table rows.
+ *
+ * A bare `|` inside `[[target|alias]]` would be read as a table cell
+ * delimiter when the row renders, so table rows need the pipe escaped as
+ * `[[target\|alias]]`. Prose, lists, headings, and fenced code keep their
+ * pipes literal, so the written file stays valid for external readers
+ * (Obsidian, VS Code Wiki Links) that don't understand the escaped form. */
 function escapeWikilinkAliasPipes(body) {
     let inFence = false;
     return body
@@ -395,7 +402,9 @@ function escapeWikilinkAliasPipes(body) {
         }
         if (inFence)
             return line;
-        return line.replace(/\[\[([^\]\n]*?)(?<!\\)\|([^\]\n]*?)\]\]/g, "[[$1\\|$2]]");
+        return TABLE_ROW.test(line)
+            ? line.replace(/\[\[([^\]\n]*?)(?<!\\)\|([^\]\n]*?)\]\]/g, "[[$1\\|$2]]")
+            : line;
     })
         .join("\n");
 }

package/dist/extensions/llm-wiki/lib/knowledge-links.js

@@ -7,21 +7,56 @@ function diag(severity, code, path, message) {
 function normalizeWikilinkTarget(target) {
     return target.trim().replace(/\\$/, "");
 }
+// Blank out code spans, fenced/indented code blocks, and raw HTML (the same
+// node types the link walk skips), preserving length so offsets stay valid.
+function maskCodeRegions(tree, body) {
+    if (!tree)
+        return body;
+    const ranges = [];
+    function visit(node) {
+        const position = node
+            .position;
+        if (node.type === "inlineCode" || node.type === "code" || node.type === "html") {
+            if (position)
+                ranges.push([position.start.offset, position.end.offset]);
+        }
+        if ("children" in node && Array.isArray(node.children)) {
+            for (const child of node.children) {
+                visit(child);
+            }
+        }
+    }
+    visit(tree);
+    if (ranges.length === 0)
+        return body;
+    const chars = body.split("");
+    for (const [start, end] of ranges) {
+        for (let i = start; i < end && i < chars.length; i++) {
+            if (i >= 0)
+                chars[i] = " ";
+        }
+    }
+    return chars.join("");
+}
 export function extractKnowledgeLinks(body) {
     const markdown = [];
     const wikilinks = [];
-    // Extract legacy wikilinks. A table-safe alias uses an escaped pipe: [[target\\|alias]].
-    for (const match of body.matchAll(/\[\[([^\]|]+)(?:\|[^\]]*)?\]\]/g)) {
-        wikilinks.push({ target: normalizeWikilinkTarget(match[1]), offset: match.index ?? 0 });
-    }
     // Parse with CommonMark AST
-    let tree;
+    let tree = null;
     try {
         tree = fromMarkdown(body);
     }
     catch {
-        return { markdown, wikilinks };
+        tree = null;
     }
+    // Extract legacy wikilinks. A table-safe alias uses an escaped pipe: [[target\\|alias]].
+    // Scan the code-masked body so [[...]] inside code is not a real link.
+    const scanBody = maskCodeRegions(tree, body);
+    for (const match of scanBody.matchAll(/\[\[([^\]|]+)(?:\|[^\]]*)?\]\]/g)) {
+        wikilinks.push({ target: normalizeWikilinkTarget(match[1]), offset: match.index ?? 0 });
+    }
+    if (!tree)
+        return { markdown, wikilinks };
     // Build definition map (case-insensitive)
     const defs = new Map();
     function collectDefs(node) {

package/dist/extensions/llm-wiki/lib/model-command.js

@@ -1,4 +1,4 @@
-import { Container, matchesKey, SelectList, Spacer, Text, } from "@earendil-works/pi-tui";
+import { Container, getKeybindings, Input, SelectList, Spacer, Text, } from "@earendil-works/pi-tui";
 import { parseModelRef, persistTaskModel } from "./task-config.js";
 /** Words that clear the override and revert to the session model. */
 const CLEAR_WORDS = new Set(["session", "default", "reset", "clear", "none", "unset"]);
@@ -53,29 +53,66 @@ function buildPickerItems(pool, currentRef) {
     }
     return { items, selectedIndex };
 }
+/** Case-insensitive substring on label/value. Not SelectList.setFilter (prefix-on-value). */
+function itemMatchesQuery(item, query) {
+    if (!query)
+        return true;
+    const needle = query.toLowerCase();
+    return item.label.toLowerCase().includes(needle) || item.value.toLowerCase().includes(needle);
+}
 /** Editor-dock picker; `ui.custom` without overlay replaces the input slot like `/model`. */
 class ModelPickerScreen extends Container {
+    allItems;
+    listTheme;
+    search;
     list;
     doneFn;
     closed = false;
     constructor(title, items, selectedIndex, theme, done) {
         super();
+        this.allItems = items;
+        this.listTheme = buildSelectTheme(theme);
         this.doneFn = done;
         this.addChild(new Text(title, 0, 0));
         this.addChild(new Spacer(1));
-        this.list = new SelectList(items, Math.min(MAX_VISIBLE, Math.max(items.length, 1)), buildSelectTheme(theme));
-        this.list.setSelectedIndex(selectedIndex);
-        this.list.onSelect = (item) => this.finish(item.value);
-        this.list.onCancel = () => this.finish(undefined);
+        this.search = new Input();
+        this.search.focused = true;
+        this.addChild(this.search);
+        this.list = this.makeList(items, selectedIndex);
         this.addChild(this.list);
     }
     handleInput(data) {
-        // matchesKey covers kitty CSI-u Esc; SelectList cancel is the fallback.
-        if (matchesKey(data, "escape")) {
+        const kb = getKeybindings();
+        if (kb.matches(data, "tui.select.up") ||
+            kb.matches(data, "tui.select.down") ||
+            kb.matches(data, "tui.select.confirm")) {
+            this.list.handleInput(data);
+            return;
+        }
+        // tui.select.cancel defaults to escape + ctrl+c and the kitty CSI-u Esc
+        // form, so one keybinding check covers every cancel keypath (no hardcoded Esc,
+        // so a remapped binding is honored).
+        if (kb.matches(data, "tui.select.cancel")) {
             this.finish(undefined);
             return;
         }
-        this.list.handleInput(data);
+        this.search.handleInput(data);
+        this.applyFilter();
+    }
+    makeList(items, selectedIndex) {
+        const list = new SelectList(items, Math.min(MAX_VISIBLE, Math.max(items.length, 1)), this.listTheme);
+        list.setSelectedIndex(selectedIndex);
+        list.onSelect = (item) => this.finish(item.value);
+        list.onCancel = () => this.finish(undefined);
+        return list;
+    }
+    applyFilter() {
+        const filtered = this.allItems.filter((item) => itemMatchesQuery(item, this.search.getValue()));
+        const previous = this.list.getSelectedItem()?.value;
+        const selectedIndex = Math.max(0, filtered.findIndex((item) => item.value === previous));
+        this.removeChild(this.list);
+        this.list = this.makeList(filtered, selectedIndex);
+        this.addChild(this.list);
     }
     finish(result) {
         if (this.closed)