@fitchmultz/pi-subagents 0.44.4 → 0.44.6

package/CHANGELOG.md

@@ -1,5 +1,21 @@
 # Changelog
 
+## [0.44.6] - 2026-10-09
+
+### Fixed
+- Keep full Agents pages available for long native histories by sharing bounded configuration results across rows and repeated queries. Committed publication, source generations and exact terminal/time/leaf boundaries invalidate reuse; strict errors and source integrity checks remain unchanged.
+- Restrict scoped saved-text search to eligible records before aggregating matches, retaining the complete corpus for global relevance scores, cross-field word matching, phrases, attempt boundaries and pagination.
+- Publish one settled-freshness notification for unchanged history census work instead of one per run/source. Real commits, canonical failures and source error/recovery observations still notify; polling, census and watches remain active.
+
+## [0.44.5] - 2026-10-08
+
+### Added
+- Optional loopback-only mTLS Intercom HTTPS bridge over SSH reverse forwarding, with certificate-bound remote peer identity, bounded messaging/inbox API, metadata audit logs, remote CLI, and credential issue/rotation/revocation tooling. The same-machine broker and extension startup remain unchanged.
+
+### Fixed
+- Keep supervisor-question tool results bounded: page compact question/answer previews without repeating frozen launch metadata or native attempt baselines. Full question, interview and immutable answer files remain available; answering, cancellation and revival retain their original durable contracts.
+- Keep the history worker's cost per child append proportional to the new bytes. It used to re-hash every indexed byte of a linked session on each change, so a live child writing to a source of several hundred megabytes held the worker at full CPU for hours. Each check now re-hashes the last indexed line. Replacement, truncation and in-place rewrites of that line still start a new generation, and detail reads still verify their record digests. Indexes from earlier releases are verified in full once and then switch to the bounded check without re-indexing.
+
 ## [0.44.4] - 2026-10-04
 
 ### Added

package/README.md

@@ -450,6 +450,8 @@ The files in `prompts/` document common workflows without registering additional
 
 ## Bundled intercom
 
+For a remote agent on Linux, the optional [secure remote bridge](docs/intercom-bridge.md) provides a loopback-only mTLS HTTPS API over an SSH reverse forward. It registers a certificate-bound peer such as `grok-bot` and permits only messaging operations; the private Unix broker socket remains local. The guide includes setup, remote commands, credential rotation and revocation.
+
 The same `pi-subagents` install registers the intercom extension and skill. `load_intercom({})` exposes the full peer tool explicitly; actionable peer inbound and recovered reply needs also expose it before use. Presence, passive breadcrumbs, routine subagent notices, and human messages answered in chat do not. Broker presence and delivery continue even with the schema hidden. Managed children get a private coordination channel back to the parent Pi session unless an explicit agent extension allowlist excludes it. See [the intercom guide](docs/intercom.md) for direct peer messaging, keyboard UI, tool actions, configuration, and broker details.
 
 If you previously installed the standalone package, remove that old settings entry once to avoid loading two intercom extensions:
@@ -489,6 +491,8 @@ agent_runs({ action: "stop", id: "<run-id>" })
 
 Resume the **same saved supervisor session**, even from another cwd, to recover its questions. A different session does not silently adopt them. Ordinary `intercom` replies also save the answer while the live waiter is connected. After supervisor/broker restart, prefer `agent_runs` questions/answer; a nudge is guidance, not an answer to a blocking question.
 
+`questions` returns 20 compact summaries by default (use `limit: 1–100` and `details.questionList.nextOffset` as `offset`), with unresolved questions first. Filter by run `id`, child `index`, or exact `questionId`. Question and answer previews are capped at 2,048 characters; truncation is marked. Read `questionPath` for the complete question, structured interview and saved launch contract, or `answerPath` for the exact immutable answer. These files remain unchanged by browsing; repeated tool results do not copy launch metadata or native attempt baselines. If questions change while paging, restart at offset 0 or look up the exact question ID.
+
 Answers are saved once. Repeating the same answer does not start duplicate work; conflicting answers are rejected without replacing the original. A live child reads the saved answer; an exited child resumes from its saved session in a new run, retaining the original acceptance contract. An answer receipt is not execution completion. `stop` cancels outstanding questions and aborts a live waiter using its saved run identity, including after a parent restart.
 
 If an answer launch was interrupted before a continuation existed, the reply gives an explicit `continue` recovery call. It refuses to restart when launch evidence is uncertain; inspect the advertised continuation first. Questions, answers, launch contracts, and results live under `${PI_CODING_AGENT_DIR:-~/.pi/agent}/sessions/subagent-runs/<run-id>/`, separate from temporary logs. Ownership and review use native parent `subagent-run` entries; pending intercom delivery is journaled in that same saved Pi session. Temporary cleanup does not erase these records, but deleting saved sessions or metadata removes their recovery data. Pending questions are not age-cleaned.

package/dist/extension/build-info.js

@@ -1 +1 @@
-export const EXTENSION_BUILD = Object.freeze({"version":"0.44.4","sha256":"70cf79892f3600ce1b581e43a1c14995924dead0a6cd30f032cb939b3a7d8d8c"});
+export const EXTENSION_BUILD = Object.freeze({"version":"0.44.6","sha256":"e9a0bfe1bf57b2b67e3b32c6f449996dadf8bc897fe2577eea3d919158b40466"});

package/dist/extension/compact-tools.js

@@ -60,7 +60,7 @@ export function registerCompactSubagentTools(pi, options) {
         name: "agent_runs",
         defaultActive: false,
         label: "Agent Runs",
-        description: `List ${childSafe ? "only this child's directly owned" : "your delegated"} runs across working directories (questions/failures, then live work, then unreviewed results; 20 per page). Filter globally by agent/state/text, sort, and page with the returned cursor. history reads 100 bounded native-entry previews; search finds saved visible text using words or quoted phrases, not operators or prefixes. Browse freshness is not completion or delivery proof. Inspect concise results, paths and continuations; full:true includes the full task/configuration. Answer durable questions, nudge, stop, continue, or save parent-only review. Review notes are not sent to children; put actionable instructions in continue/nudge. Inspect/review/nudge never restart finished work. Continue/answer can launch a saved child; async:false waits for its actual result. Saved continuations keep settings unless agent selects a current profile; model overrides win. Live guidance never mutates model or acceptance. profiles lists roles, sources, context and model/thinking/fallback defaults. History survives reload.`,
+        description: `List ${childSafe ? "only this child's directly owned" : "your delegated"} runs across working directories (questions/failures, then live work, then unreviewed results; 20 per page). Filter globally by agent/state/text, sort, and page with the returned cursor. history reads 100 bounded native-entry previews; search finds saved visible text using words or quoted phrases, not operators or prefixes. questions pages 20 compact previews (offset/limit); questionId selects one, and questionPath/answerPath retain full records. Browse freshness is not completion or delivery proof. Inspect concise results, paths and continuations; full:true includes the full task/configuration. Answer durable questions, nudge, stop, continue, or save parent-only review. Review notes are not sent to children; put actionable instructions in continue/nudge. Inspect/review/nudge never restart finished work. Continue/answer can launch a saved child; async:false waits for its actual result. Saved continuations keep settings unless agent selects a current profile; model overrides win. Live guidance never mutates model or acceptance. profiles lists roles, sources, context and model/thinking/fallback defaults. History survives reload.`,
         parameters: AgentRunsParams,
         async execute(id, params, signal, onUpdate, ctx) {
             const normalized = normalizeEverydayParams(params, true);

package/dist/extension/schemas.js

@@ -255,13 +255,13 @@ const HistoryQueryFields = {
 export const AgentRunsValidationParams = Type.Object({
     action: Type.Enum(["list", "inspect", "history", "search", "nudge", "stop", "continue", "profiles", "questions", "answer", "review"], { type: "string" }),
     id: Type.Optional(Type.String({ minLength: 1, description: "Run ID or unambiguous prefix." })),
-    questionId: Type.Optional(Type.String({ minLength: 1, description: "Durable supervisor question ID for answer." })),
+    questionId: Type.Optional(Type.String({ minLength: 1, description: "Durable supervisor question ID for exact questions lookup or answer." })),
     async: Type.Optional(Type.Boolean({ description: "Continue/answer: false waits for the actual continuation result." })),
     index: Type.Optional(Type.Integer({ minimum: 0, description: "Child index for a multi-child run." })),
     message: Type.Optional(Type.String({ minLength: 1, description: "Guidance, follow-up, answer, or optional parent-only review note. Review notes are not sent to the child; put actionable instructions in continue/nudge. Only continue/answer can start a saved child." })),
     decision: Type.Optional(Type.Enum(["accepted", "needs_changes"], { type: "string", description: "Parent-only review outcome; not sent to the child. Separate from execution and runtime acceptance checks." })),
-    offset: Type.Optional(Type.Integer({ minimum: 0, description: "List offset; history is retained regardless of page size." })),
-    limit: Type.Optional(Type.Integer({ minimum: 1, maximum: 100, description: "Results per list/search/history page (default 20; history 100)." })),
+    offset: Type.Optional(Type.Integer({ minimum: 0, description: "List/questions offset; history is retained regardless of page size." })),
+    limit: Type.Optional(Type.Integer({ minimum: 1, maximum: 100, description: "Results per list/questions/search/history page (default 20; history 100)." })),
     ...HistoryQueryFields,
     full: Type.Optional(Type.Boolean({ description: "Inspect only: include the full task and saved launch configuration. Default is a concise report; stored data is unchanged." })),
     agent: Type.Optional(Type.String({ minLength: 1, description: "List/search: filter by child agent. Continue/answer: adopt this current profile, including model, thinking and fallbacks; a separate model override wins. Otherwise keep saved settings. Required for old runs without a saved profile." })),
@@ -279,8 +279,8 @@ export const AgentRunsValidationParams = Type.Object({
         { if: { properties: { action: { enum: ["review"] } } }, then: requiredObject("decision") },
         { if: { anyOf: [requiredObject("async"), requiredObject("model"), requiredObject("cwd"), requiredObject("output"), requiredObject("acceptance")] }, then: { properties: { action: { enum: ["continue", "answer"] } } } },
         { if: requiredObject("agent"), then: { properties: { action: { enum: ["list", "search", "continue", "answer"] } } } },
-        { if: requiredObject("offset"), then: { properties: { action: { enum: ["list"] } } } },
-        { if: requiredObject("limit"), then: { properties: { action: { enum: ["list", "history", "search"] } } } },
+        { if: requiredObject("offset"), then: { properties: { action: { enum: ["list", "questions"] } } } },
+        { if: requiredObject("limit"), then: { properties: { action: { enum: ["list", "questions", "history", "search"] } } } },
         { if: requiredObject("cursor"), then: { properties: { action: { enum: ["list", "history", "search"] } } } },
         { if: requiredObject("sort"), then: { properties: { action: { enum: ["list", "search"] } } } },
         { not: { anyOf: [requiredObject("cursor", "offset"), requiredObject("cursor", "before")] } },
@@ -313,9 +313,9 @@ export const SubagentParams = Type.Object({
     runId: Type.Optional(Type.String({
         description: "Target run ID; prefer id. Defaults to the most recently active controllable run for interrupt/extend/nudge."
     })),
-    questionId: Type.Optional(Type.String({ minLength: 1, description: "Durable supervisor question ID for answer." })),
+    questionId: AgentRunsValidationParams.properties.questionId,
     decision: Type.Optional(Type.Enum(["accepted", "needs_changes"], { type: "string", description: "Parent-only review decision; not sent to the child. Put actionable instructions in resume/nudge. Does not launch work or change runtime acceptance." })),
-    offset: Type.Optional(Type.Integer({ minimum: 0, description: "Status list offset." })),
+    offset: Type.Optional(Type.Integer({ minimum: 0, description: "Status list/questions offset." })),
     limit: AgentRunsValidationParams.properties.limit,
     ...HistoryQueryFields,
     full: Type.Optional(Type.Boolean({ description: "Exact status only: include the full task and saved launch configuration; default is concise." })),
@@ -390,8 +390,8 @@ export const SubagentParams = Type.Object({
         { if: requiredObject("decision"), then: { ...requiredObject("action"), properties: { action: { enum: ["review"] } } } },
         { if: { ...requiredObject("action"), properties: { action: { enum: ["history"] } } }, then: { anyOf: [requiredObject("id"), requiredObject("runId")] } },
         { if: { ...requiredObject("action"), properties: { action: { enum: ["search"] } } }, then: requiredObject("query") },
-        { if: requiredObject("offset"), then: { ...requiredObject("action"), properties: { action: { enum: ["status"] } } } },
-        { if: requiredObject("limit"), then: { ...requiredObject("action"), properties: { action: { enum: ["status", "history", "search"] } } } },
+        { if: requiredObject("offset"), then: { ...requiredObject("action"), properties: { action: { enum: ["status", "questions"] } } } },
+        { if: requiredObject("limit"), then: { ...requiredObject("action"), properties: { action: { enum: ["status", "questions", "history", "search"] } } } },
         { if: requiredObject("cursor"), then: { ...requiredObject("action"), properties: { action: { enum: ["status", "history", "search"] } } } },
         { if: requiredObject("sort"), then: { ...requiredObject("action"), properties: { action: { enum: ["status", "search"] } } } },
         { if: { allOf: [{ ...requiredObject("action"), properties: { action: { enum: ["search"] } } }, requiredObject("index")] }, then: { anyOf: [requiredObject("id"), requiredObject("runId")] } },

package/dist/history/index.js

@@ -114,6 +114,16 @@ export class SubagentHistoryIndex {
         }
         await this.ready;
     }
+    /** Arms an ordinary deadline only in the continuation that saw the current admission and worker settle, never behind a replacement admission. */
+    async admitted(method, input, signal, timeout) {
+        await this.ensure();
+        const ready = this.ready, child = this.process;
+        await ready;
+        // setOwner() or a restart may have replaced readiness during either await; wait for the replacement.
+        if (!child || ready !== this.ready || child !== this.process)
+            return this.admitted(method, input, signal, timeout);
+        return this.send(method, input, signal, timeout);
+    }
     async setOwner(input) {
         if (this.closed)
             throw new HistoryIndexError("CLOSED", "History index is closed.");
@@ -138,21 +148,17 @@ export class SubagentHistoryIndex {
         if (run.ownerSessionId !== this.owner.ownerSessionId || foreground && foreground.runId !== run.runId)
             throw new HistoryIndexError("OWNERSHIP", "Run does not belong to the current owner.");
         const copy = structuredClone(run), fg = foreground && structuredClone(foreground);
-        await this.send("updateRun", { run: copy, foreground: fg });
+        await this.admitted("updateRun", { run: copy, foreground: fg });
         this.owner.runs = [...this.owner.runs.filter((entry) => entry.runId !== run.runId), copy];
         if (fg)
             this.owner.foregroundRuns = [...(this.owner.foregroundRuns ?? []).filter((entry) => entry.runId !== run.runId), fg];
     }
     async query(method, input) {
-        await this.ensure();
         const { signal, ...wire } = input;
-        return this.send(method, wire, signal);
+        return this.admitted(method, wire, signal);
     }
     /** Tool discovery waits for run metadata only, not transcript backfill. */
-    async needsControls() {
-        await this.ensure();
-        return this.send("needsControls", undefined, undefined, 15_000);
-    }
+    needsControls() { return this.admitted("needsControls", undefined, undefined, 15_000); }
     listRuns(options = {}) { return this.query("listRuns", options); }
     historyPage(input) { return this.query("historyPage", input); }
     search(input) { return this.query("search", input); }
@@ -166,8 +172,7 @@ export class SubagentHistoryIndex {
     async refresh(runId, options = {}) {
         if (!this.closed)
             this.unavailable = undefined;
-        await this.ensure();
-        return this.send("refresh", { runId }, options.signal, 120_000);
+        return this.admitted("refresh", { runId }, options.signal, 120_000);
     }
     onChanged(listener) { this.listeners.add(listener); return () => this.listeners.delete(listener); }
     /** Hard cancellation affects this instance's outstanding work, not native sessions or other indexers. */

package/dist/history/ingest.js

@@ -232,8 +232,13 @@ export class SourceIngest {
     fd;
     initial;
     source;
-    prefix = createHash("sha256");
     recordDigest = createHash("sha256");
+    /** prefix_digest is "start:sha256" of the last indexed line; earlier releases hashed the whole prefix. */
+    legacy = false;
+    expected = null;
+    verified = createHash("sha256");
+    line = createHash("sha256");
+    lineStart = 0;
     verifyAt = 0;
     position;
     frames;
@@ -274,6 +279,11 @@ export class SourceIngest {
             this.headerSeen = source.cursor > 0;
             store.clearUnpublished(source.id);
             store.run("DELETE FROM pending_text");
+            // Appends re-hash only the last indexed line, so live sources cost their new bytes, not their size.
+            const anchor = /^(\d+):([0-9a-f]{64})$/.exec(source.prefix_digest ?? "");
+            this.legacy = !anchor;
+            this.expected = anchor ? anchor[2] : source.prefix_digest;
+            this.verifyAt = this.lineStart = anchor ? Number(anchor[1]) : 0;
             this.phase = !force && source.stamp === stamp(this.initial) ? "done" : source.cursor ? "verify" : "read";
             if (this.phase !== "done")
                 store.run("UPDATE sources SET state='indexing',error=NULL WHERE id=?", source.id);
@@ -294,7 +304,7 @@ export class SourceIngest {
             if (!current || current.generation !== this.source.generation || current.cursor !== this.source.cursor)
                 throw new HistoryIndexError("SOURCE_CHANGED", "Another writer advanced this source; reconcile before replaying.");
             work?.();
-            this.store.run("UPDATE sources SET cursor=?,prefix_digest=?,identity=? WHERE id=?", end, this.prefix.copy().digest("hex"), identity(this.initial), this.id);
+            this.store.run("UPDATE sources SET cursor=?,prefix_digest=?,identity=? WHERE id=?", end, `${this.source.cursor}:${this.recordDigest.copy().digest("hex")}`, identity(this.initial), this.id);
             this.store.bump();
         });
         this.source.cursor = end;
@@ -392,13 +402,25 @@ export class SourceIngest {
             if (count !== bytes.length)
                 throw new Error("Journal truncated during prefix verification.");
             this.store.operations.sourceBytesRead += count;
-            this.prefix.update(bytes);
+            this.verified.update(bytes);
+            if (this.legacy) {
+                // A whole-prefix check also finds the last indexed line, which anchors every later check.
+                const before = this.source.cursor - 2 - this.verifyAt, lf = before < 0 ? -1 : bytes.lastIndexOf(10, before);
+                if (lf < 0)
+                    this.line.update(bytes);
+                else {
+                    this.lineStart = this.verifyAt + lf + 1;
+                    this.line = createHash("sha256").update(bytes.subarray(lf + 1));
+                }
+            }
             this.verifyAt += count;
             if (this.verifyAt === this.source.cursor) {
-                if (this.prefix.copy().digest("hex") !== this.source.prefix_digest) {
+                if (this.verified.digest("hex") !== this.expected) {
                     this.store.resetSource(this.id);
                     throw new HistoryIndexError("SOURCE_CHANGED", "Journal prefix changed; a new physical generation was scheduled.");
                 }
+                if (this.legacy)
+                    this.store.run("UPDATE sources SET prefix_digest=? WHERE id=?", `${this.lineStart}:${this.line.digest("hex")}`, this.id);
                 this.phase = "read";
             }
             return false;
@@ -418,7 +440,6 @@ export class SourceIngest {
         const newline = this.buffer.indexOf(10);
         const bytes = newline < 0 ? this.buffer : this.buffer.subarray(0, newline + 1);
         this.recordDigest.update(bytes);
-        this.prefix.update(bytes);
         this.frames.write(bytes);
         this.text.flush(this.store);
         this.buffer = this.buffer.subarray(bytes.length);

package/dist/history/queries.js

@@ -7,7 +7,9 @@ import { hash, HistoryStore, integer, pageLimit } from "./store.js";
 export class HistoryQueries {
     store;
     info;
+    configurations = new Map();
     constructor(store, info) { this.store = store; this.info = info; }
+    sourcesRemoved() { this.configurations.clear(); }
     cursor(query, keys, offset) {
         return Buffer.from(JSON.stringify({ generation: this.store.generation, owner: this.store.owner, version: this.info().version, query, keys, offset })).toString("base64url");
     }
@@ -120,6 +122,13 @@ export class HistoryQueries {
                 return {};
             throw error;
         }
+        // Only committed source changes invalidate ancestry, not unrelated run projections.
+        // Validate boundaries before reuse; explicit null leaves returned above remain empty.
+        const leafKey = input.leaf === undefined ? null : [typeof input.leaf, String(input.leaf)];
+        const key = JSON.stringify([source.id, source.generation, source.cursor, source.stamp, input.terminalEntryId || null, input.terminalEntryId ? null : input.endedAt ?? null, leafKey, strict]);
+        const cached = this.configurations.get(key);
+        if (cached)
+            return { ...cached };
         const leaf = input.leaf ?? this.store.get(`SELECT id FROM entries WHERE ${boundary.clauses.join(" AND ")} ORDER BY start DESC LIMIT 1`, ...boundary.params)?.id;
         if (!leaf)
             return {};
@@ -139,7 +148,12 @@ export class HistoryQueries {
                 return {};
             throw new HistoryIndexError("MALFORMED_ANCESTRY", "Selected native configuration has cyclic ancestry.");
         }
-        return { ...(facts.model ? { model: facts.model, modelRecordedAt: facts.recorded_at ?? undefined } : {}), ...(facts.thinking ? { thinking: facts.thinking } : {}) };
+        const configuration = { ...(facts.model ? { model: facts.model, modelRecordedAt: facts.recorded_at ?? undefined } : {}), ...(facts.thinking ? { thinking: facts.thinking } : {}) };
+        // Bound memory across arbitrary sources, boundaries and pages. Eviction only recomputes.
+        if (this.configurations.size >= 128)
+            this.configurations.delete(this.configurations.keys().next().value);
+        this.configurations.set(key, configuration);
+        return { ...configuration };
     }
     historyPage(input) {
         const { source } = this.child(input.runId, input.index);
@@ -224,6 +238,12 @@ export class HistoryQueries {
             clauses.push("c.agent=?");
             params.push(input.agent);
         }
+        const joins = "JOIN sources s ON s.id=e.source_id JOIN children c ON c.source_id=s.id LEFT JOIN entries terminal ON terminal.source_id=s.id AND terminal.generation=s.generation AND terminal.id=c.terminal_entry_id AND terminal.published=1";
+        // Scope records before materializing/grouping hits, while bm25 still sees the
+        // complete corpus. Scan each linked source once, not once per continuation.
+        // Attempt boundaries, attribution and seek filtering remain in the final join.
+        const eligible = input.runId || input.agent ? `eligible AS MATERIALIZED (SELECT e.rowid FROM entries e JOIN sources s ON s.id=e.source_id WHERE e.published=1 AND e.generation=s.generation AND e.source_id IN (SELECT c.source_id FROM children c WHERE ${clauses.slice(4).join(" AND ")})),` : "";
+        const eligibleParams = eligible ? params.slice(expression.length) : [];
         // Ordering/filters apply globally before limit. Common terms may still require an FTS
         // scan/sort; the parent enforces a hard deadline by killing this separate process.
         const score = sort === "relevance" ? "matched.score" : "-COALESCE(e.timestamp,0)";
@@ -235,8 +255,8 @@ export class HistoryQueries {
         }
         // Match words across all visible fields/windows of one native record. A quoted
         // phrase remains a single FTS expression, so it cannot span unrelated fields.
-        const rows = this.store.all(`WITH hits AS MATERIALIZED (
-			${expression.map((_term, index) => `SELECT d.id,d.entry_rowid,bm25(corpus) AS score,${index} AS term FROM corpus JOIN documents d ON d.id=corpus.rowid WHERE corpus MATCH ?`).join(" UNION ALL ")}
+        const rows = this.store.all(`WITH ${eligible} hits AS MATERIALIZED (
+			${expression.map((_term, index) => `SELECT d.id,d.entry_rowid,bm25(corpus) AS score,${index} AS term FROM corpus JOIN documents d ON d.id=corpus.rowid WHERE corpus MATCH ?${eligible ? " AND d.entry_rowid IN (SELECT rowid FROM eligible)" : ""}`).join(" UNION ALL ")}
 		), terms AS (
 			SELECT entry_rowid,term,MIN(score) AS score FROM hits GROUP BY entry_rowid,term
 		), matched AS (
@@ -244,7 +264,7 @@ export class HistoryQueries {
 		), excerpts AS (
 			SELECT id,entry_rowid,ROW_NUMBER() OVER (PARTITION BY entry_rowid ORDER BY score,id) AS choice FROM hits
 		)
-		SELECT d.*,${score} AS score,e.*,d.id AS document_id,s.path,s.session_id,c.run_id,c.child_index,c.agent,d.preview AS document_preview FROM matched JOIN excerpts ON excerpts.entry_rowid=matched.entry_rowid AND excerpts.choice=1 JOIN documents d ON d.id=excerpts.id JOIN entries e ON e.rowid=matched.entry_rowid JOIN sources s ON s.id=e.source_id JOIN children c ON c.source_id=s.id LEFT JOIN entries terminal ON terminal.source_id=s.id AND terminal.generation=s.generation AND terminal.id=c.terminal_entry_id AND terminal.published=1 WHERE ${clauses.join(" AND ")} ORDER BY score,d.id,c.run_id,c.child_index LIMIT ?`, ...params, limit + 1);
+		SELECT d.*,${score} AS score,e.*,d.id AS document_id,s.path,s.session_id,c.run_id,c.child_index,c.agent,d.preview AS document_preview FROM matched JOIN excerpts ON excerpts.entry_rowid=matched.entry_rowid AND excerpts.choice=1 JOIN documents d ON d.id=excerpts.id JOIN entries e ON e.rowid=matched.entry_rowid ${joins} WHERE ${clauses.join(" AND ")} ORDER BY score,d.id,c.run_id,c.child_index LIMIT ?`, ...eligibleParams, ...params, limit + 1);
         const more = rows.length > limit, page = rows.slice(0, limit);
         return { ...this.info(), matches: page.map((row) => ({ id: row.document_id, runId: row.run_id, index: row.child_index, agent: row.agent, entryId: row.id, nativeId: row.native_id, sessionId: row.session_id, sessionFile: row.path, timestamp: row.timestamp,
                 ref: { sourceId: row.source_id, generation: row.generation, start: row.start, end: row.end, digest: row.digest }, preview: row.document_preview, field: row.field, textStart: row.text_start, textEnd: row.text_end, score: row.score })),

package/dist/history/worker.js

@@ -2,7 +2,7 @@ import * as fs from "node:fs";
 import * as path from "node:path";
 import { ownedRunView } from "../runs/shared/run-records.js";
 import { acceptanceHumanAction } from "../runs/shared/acceptance-evaluation.js";
-import { getRunMetadataDir, listRunQuestions } from "../runs/shared/supervisor-questions.js";
+import { getRunMetadataDir, listRunQuestions, summarizeSupervisorQuestion } from "../runs/shared/supervisor-questions.js";
 import { HistoryIndexError } from "./types.js";
 import { exactTextDigest, HistoryStore, safeText } from "./store.js";
 import { readCanonicalOutput, readSavedOutput } from "./canonical-result.js";
@@ -18,6 +18,8 @@ const sourceWatchers = new Map();
 const watchIdentities = new WeakMap();
 const watchedSources = new Map();
 let job, scheduled = false, closed = false;
+let sourceObservation;
+let notifiedVersion;
 let retryTimer;
 let runErrors = new Set();
 const barriers = [];
@@ -25,9 +27,21 @@ const controlQueries = [];
 function replyControls(id) {
     send({ id, value: Boolean(store.get("SELECT id FROM runs WHERE attention<4 OR state='live' LIMIT 1")) });
 }
-function send(response) { if (process.connected)
-    process.send(response); }
-function changed() { send({ changed: true }); }
+function send(response) {
+    // The parent can disconnect after process.connected was read; then this and later replies are undeliverable, so stop as on disconnect.
+    if (process.connected)
+        process.send(response, undefined, undefined, (error) => { if (error)
+            shutdown(); });
+}
+function changed(observationChanged = false) {
+    const version = store?.get("SELECT value FROM meta WHERE key='version'").value;
+    // Unchanged census projections need only one final freshness notification.
+    // Non-versioned errors/recovery and real commits still publish immediately.
+    if (observationChanged || version !== notifiedVersion || !hasPending()) {
+        notifiedVersion = version;
+        send({ changed: true });
+    }
+}
 function errorReply(id, error) {
     const code = error instanceof HistoryIndexError ? error.code : "UNAVAILABLE";
     // Parser errors can include fragments from the malformed body. IPC/logs must never carry them.
@@ -41,10 +55,10 @@ function compactView(view) {
     return {
         ...view, task: safeText(view.task, 2048), error: view.error && safeText(view.error), diagnosis: view.diagnosis && safeText(view.diagnosis), recoveryError: view.recoveryError && safeText(view.recoveryError),
         review: view.review && { ...view.review, message: view.review.message && safeText(view.review.message) }, continuations: [],
-        questions: view.questions?.map((question) => ({ questionId: question.questionId, runId: question.runId, ownerSessionId: question.ownerSessionId, ownerTarget: question.ownerTarget,
-            agent: question.agent, index: question.index, childSessionId: question.childSessionId, childTarget: question.childTarget, sessionFile: question.sessionFile,
-            cwd: question.cwd, pid: question.pid, processIdentity: question.processIdentity, createdAt: question.createdAt, reason: question.reason, message: safeText(question.message, 2048), state: question.state,
-            answer: question.answer && { ...question.answer, message: safeText(question.answer.message, 2048) }, delivery: question.delivery, revival: question.revival })),
+        questions: view.questions?.map((question) => {
+            const summary = summarizeSupervisorQuestion(question);
+            return { ...summary, message: safeText(question.message, 2048), answer: summary.answer && { ...summary.answer, message: safeText(question.answer?.message, 2048) } };
+        }),
         children: view.children.map((child) => ({
             agent: child.agent, index: child.index, workflowNodeId: child.workflowNodeId, sessionFile: child.sessionFile, task: child.task && safeText(child.task), label: child.label && safeText(child.label, 256),
             state: child.state, configuration: child.configuration, missingSession: child.missingSession, identityUnavailable: child.identityUnavailable, modelSelection: child.modelSelection,
@@ -187,8 +201,11 @@ function prune(previousSources) {
             store.run("DELETE FROM sources WHERE id=?", source.id);
             removed = true;
         }
-        if (removed)
+        if (removed) {
             store.bump();
+            // A later admission of the same path can recreate source generation 1.
+            queries?.sourcesRemoved();
+        }
     });
 }
 function admit(run) {
@@ -243,6 +260,7 @@ function pump() {
         if (dirtyRuns.size) {
             const id = dirtyRuns.values().next().value;
             dirtyRuns.delete(id);
+            const failed = runErrors.has(id);
             installWatches(id);
             const previousSources = store.all("SELECT source_id FROM children WHERE run_id=? AND source_id IS NOT NULL", id).map((child) => child.source_id);
             try {
@@ -261,7 +279,7 @@ function pump() {
                 if (child.source_id !== job?.id)
                     dirtySources.set(child.source_id, dirtySources.get(child.source_id) ?? false);
             installWatches(id);
-            changed();
+            changed(failed !== runErrors.has(id));
         }
         else if (job) {
             if (job.step()) {
@@ -269,7 +287,8 @@ function pump() {
                 if (source)
                     watchSources(path.dirname(source.path));
                 job = undefined;
-                changed();
+                changed(source?.state !== sourceObservation?.state || source?.error !== sourceObservation?.error);
+                sourceObservation = undefined;
             }
         }
         else if (dirtySources.size) {
@@ -278,6 +297,7 @@ function pump() {
             const source = store.source(id);
             if (source) {
                 activeSource = id;
+                sourceObservation = source;
                 job = new SourceIngest(store, source, force);
             }
         }
@@ -298,8 +318,11 @@ function pump() {
             else
                 store.run("UPDATE sources SET state='error',error=?,checked_at=? WHERE id=?", "Linked native conversation could not be indexed.", Date.now(), id);
         }
-        if (!(error instanceof HistoryIndexError && error.code === "INDEX_BUSY"))
-            changed();
+        if (!(error instanceof HistoryIndexError && error.code === "INDEX_BUSY")) {
+            const source = id ? store.source(id) : undefined;
+            changed(Boolean(source && (source.state !== sourceObservation?.state || source.error !== sourceObservation?.error)));
+        }
+        sourceObservation = undefined;
     }
     activeSource = undefined;
     finishBarriers();
@@ -324,6 +347,8 @@ function clear() {
     retryTimer = undefined;
     job?.close();
     job = undefined;
+    sourceObservation = undefined;
+    notifiedVersion = undefined;
     for (const watcher of watchers.values())
         watcher.close();
     watchers.clear();
@@ -458,4 +483,5 @@ async function handle(request) {
     }
 }
 process.on("message", (request) => { void handle(request); });
-process.on("disconnect", () => { closed = true; clearInterval(timer); clear(); process.exit(0); });
+function shutdown() { closed = true; clearInterval(timer); clear(); process.exit(0); }
+process.on("disconnect", shutdown);