@wirecat/cli-core 0.497.0 → 0.499.0

package/CHANGELOG.md

@@ -5,6 +5,53 @@ Notable changes to `@wirecat/cli-core` (`@wirecat/cli-messaging` up to 0.261.0,
 minor version may break callers, and says how under "Changed — may break callers". `pnpm docs:check` checks the
 shape of this file.
 
+## Unreleased
+
+## 0.499.0 — 31.10.2026
+
+### Added
+
+- **`decodeChannels(bytes)` in `@wirecat/cli-core/speech` returns every channel of a recording:**
+  `{ channels: Pcm[], mixed }`. A phone call recorded in stereo keeps one speaker per channel, and `decodeAudio`
+  keeps only the first, so the other speaker was lost. `decodeAudio` is unchanged and now exported too. Opus,
+  Vorbis, FLAC and MP3 keep their channels apart; a format only ffmpeg reads arrives as one channel with
+  `mixed: true`, so a caller can tell a mixed-down call from a mono one.
+- **OpenAI transcription: `transcribeOpenAI(pcm, { apiKey, model, languages, prompt, keywords })`.** It sends one
+  channel to OpenAI's `/audio/transcriptions` (`gpt-transcribe` by default, `languages[]` and `keywords[]` as
+  repeated fields, no SDK) and answers `[{ start, end, text }]` in seconds: one piece per stretch of speech the
+  voice detector found, each sent alone, so two channels merge into a dialogue by `start`. Two stretches the
+  detector split only because speech ran past 20 seconds stay one piece. `gpt-transcribe` gives no timestamps, so
+  the times are the detector's: about 0.1–0.3 s late at the start and 0.5–0.8 s late at the end, and very quiet
+  speech is missed, as it is locally. `bundle: true` trades the turns for fewer requests: up to ten minutes
+  (`LONGEST_REQUEST_SECONDS`) in one. It needs the voice detector file that comes with any speech model
+  (`models download`), except bundled audio of up to ten minutes. A 429 or a server error is tried again, waiting
+  as long as `Retry-After` asks; errors carry `auth.failed` (401), `access.denied` (403, which OpenAI also answers
+  for an unsupported country), `transcription.quota-exhausted` (credit, spend or usage limit; never retried),
+  `transcription.no-key`, `transcription.too-large`, `provider.rate-limited` or `provider.unavailable`, and never
+  the key. A keyword with `<`, `>` or a line break is refused before sending.
+- **`recognizeLocalPieces(model, pcm)` gives the same timed pieces from a local model**, one per stretch of speech
+  the voice detector cut.
+- **`transcribeWith: "openai"` sends voice messages to OpenAI**, with the key `models keys set openai` or
+  `OPENAI_API_KEY` holds and the model in the profile's `transcribeModel` (`gpt-transcribe` when unset). Only when
+  named: `auto` never sends audio off the machine, and a read-only process refuses. A transcript heard this way is
+  kept as `openai:<model>`.
+- **Meeting transcription keeps who spoke.** `MeetingRecognitionSegment.speaker` (trimmed; `null` is none) is stored
+  as the row's speaker, and segments of different speakers may overlap — two people on a call talk over each
+  other. One speaker's own segments still may not, and segments without a speaker are checked as before. A
+  transcript whose `recognition.engine` is `openai` is stored as `openai/<model>`, format `openai-transcription`;
+  local transcripts keep `local/<engine>/<model>` exactly.
+
+### Changed — may break callers
+
+- **An unknown `transcribeWith` in a profile now refuses to transcribe** with `validation_error`, naming the four
+  values. Before, any value other than `local` silently meant asking the messenger first. `models list` and
+  `models download` still read such a profile. Set it to `auto`, `messenger`, `local` or `openai`.
+
+### Fixed
+
+- **`runs list` with nothing recorded no longer says a run is kept only with `--record`.** Every command that does
+  its work is kept by default; `record: false` in the config keeps failures only, and `--no-record` keeps nothing.
+
 ## 0.497.0 — 31.10.2026
 
 ### Added
@@ -95,6 +142,12 @@ shape of this file.
 
 - **`NoteQuery.refs` checks a list of notes against a query, and `NoteHit.at` is the time `date:` read.**
 
+### Added
+
+- **`chatCoverage` and `ChatCoverage` are exported from `@wirecat/cli-core/services`, and `coverageGaps` from
+  `@wirecat/cli-core/cli`.** A CLI can now pass `ports.coverage` to `gatherProjectEvidence` and build `missing` and
+  `next` for chats held in part, as cli-core's own agenda and search do.
+
 ## 0.495.0 — 31.10.2026
 
 ### Changed — may break callers

package/dist/calendar/mcp/index.d.ts

@@ -10,13 +10,13 @@ export declare const calendarTools: ({
     inputSchema: {
         type: string;
         properties: {
+            limit?: undefined;
             account_id: {
                 type: string;
                 minimum: number;
             };
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
         } | {
             account_id: {
@@ -38,9 +38,9 @@ export declare const calendarTools: ({
             };
             event?: undefined;
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event: {
                 type: string;
                 minLength: number;
@@ -50,9 +50,9 @@ export declare const calendarTools: ({
                 minimum: number;
             };
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
             account_id?: undefined;
         };
@@ -71,13 +71,13 @@ export declare const calendarTools: ({
     inputSchema: {
         type: string;
         properties: {
+            limit?: undefined;
             account_id: {
                 type: string;
                 minimum: number;
             };
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
         } | {
             account_id: {
@@ -99,9 +99,9 @@ export declare const calendarTools: ({
             };
             event?: undefined;
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event: {
                 type: string;
                 minLength: number;
@@ -111,9 +111,9 @@ export declare const calendarTools: ({
                 minimum: number;
             };
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
             account_id?: undefined;
         };
@@ -132,13 +132,13 @@ export declare const calendarTools: ({
     inputSchema: {
         type: string;
         properties: {
+            limit?: undefined;
             account_id: {
                 type: string;
                 minimum: number;
             };
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
         } | {
             account_id: {
@@ -160,9 +160,9 @@ export declare const calendarTools: ({
             };
             event?: undefined;
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event: {
                 type: string;
                 minLength: number;
@@ -172,9 +172,9 @@ export declare const calendarTools: ({
                 minimum: number;
             };
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
             account_id?: undefined;
         };
@@ -193,13 +193,13 @@ export declare const calendarTools: ({
     inputSchema: {
         type: string;
         properties: {
+            limit?: undefined;
             account_id: {
                 type: string;
                 minimum: number;
             };
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
         } | {
             account_id: {
@@ -221,9 +221,9 @@ export declare const calendarTools: ({
             };
             event?: undefined;
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event: {
                 type: string;
                 minLength: number;
@@ -233,9 +233,9 @@ export declare const calendarTools: ({
                 minimum: number;
             };
         } | {
+            limit?: undefined;
             words?: undefined;
             timezone?: undefined;
-            limit?: undefined;
             event?: undefined;
             account_id?: undefined;
         };

package/dist/cli/index.d.ts

@@ -96,7 +96,7 @@ export { httpTokenFile, type McpEnvironment, type McpHost, serverEntry } from ".
 export { type MessageItem, messageItem, type ReadMessage } from "./messenger/message-items.js";
 export { type ModeProblem, type PrivateFiles, privateFiles, withSqliteSidecars } from "./messenger/private-files.js";
 export { buildReport as buildDoctorReport, type Report as DoctorReport, type ReportContext as DoctorReportContext, reportFileName as doctorReportFileName, } from "./messenger/report.js";
-export { allAnswer, allHitItem, type HitItem, type MessageHitItem, messageHitItem, type NoteHitItem, noteHitItem, } from "./messenger/search-answers.js";
+export { allAnswer, allHitItem, coverageGaps, type HitItem, type MessageHitItem, messageHitItem, type NoteHitItem, noteHitItem, } from "./messenger/search-answers.js";
 export { SEARCHES_QUERY } from "./messenger/searches-command.js";
 export { servingProfiles } from "./messenger/serve-command.js";
 export { DAY_MS, FIRST_FETCH_MS, type MemberFetches, memberFetches } from "./messenger/serve-members.js";

package/dist/cli/index.js

@@ -87,7 +87,7 @@ export { httpTokenFile, serverEntry } from "./messenger/mcp-command.js";
 export { messageItem } from "./messenger/message-items.js";
 export { privateFiles, withSqliteSidecars } from "./messenger/private-files.js";
 export { buildReport as buildDoctorReport, reportFileName as doctorReportFileName, } from "./messenger/report.js";
-export { allAnswer, allHitItem, messageHitItem, noteHitItem, } from "./messenger/search-answers.js";
+export { allAnswer, allHitItem, coverageGaps, messageHitItem, noteHitItem, } from "./messenger/search-answers.js";
 export { SEARCHES_QUERY } from "./messenger/searches-command.js";
 export { servingProfiles } from "./messenger/serve-command.js";
 export { DAY_MS, FIRST_FETCH_MS, memberFetches } from "./messenger/serve-members.js";

package/dist/cli/messenger/hearing-command.js

@@ -23,7 +23,7 @@ export const hearForCommand = async (context, messenger, messages, transcribe, m
         const hearing = await hearVoices(messenger, messages, kept, transcribe && !offline
             ? {
                 choice: {
-                    ...choose(messenger, context.settings, model === undefined ? {} : { model }, context.env),
+                    ...choose(messenger, context.settings, model === undefined ? {} : { model }, context.env, context.keyring),
                     ...(context.recognizer ? { open: context.recognizer } : {}),
                 },
                 connect: connect ?? ((work) => context.withMessenger(work)),

package/dist/cli/messenger/models-command.js

@@ -89,7 +89,7 @@ const downloadAudioModel = async (command, messenger, id) => {
         finally {
             recognizer.free();
         }
-        const chosen = choose(messenger, context.settings, {}, context.env).model.id;
+        const chosen = choose(messenger, context.settings, {}, context.env, context.keyring).model.id;
         renderAnswer(command, context, itemOf(audioItem(model, directory, chosen)), downloaded);
     }, { unbounded: true });
 };
@@ -174,7 +174,7 @@ export const modelsCommand = (messenger) => {
             const rerankers = kinds === undefined || kinds === "reranker"
                 ? RERANK_MODELS.filter((model) => id === undefined || model.id === id)
                 : [];
-            const chosen = audioModels.length > 0 ? choose(messenger, context.settings, {}, context.env).model.id : "";
+            const chosen = audioModels.length > 0 ? choose(messenger, context.settings, {}, context.env, context.keyring).model.id : "";
             const catalogue = [
                 ...audioModels.map((model) => audioItem(model, modelsDirectory(context.env), chosen)),
                 ...textModels.map((model) => textItem(model, textModelsDirectory(context.env))),

package/dist/cli/messenger/transcribe-command.js

@@ -1,7 +1,8 @@
 import { annotate } from "@wirecat/cli-base/commands";
 import { openKept } from "../../speech/hearing.js";
 import { isInstalled } from "../../speech/install.js";
-import { choose, hearLocally, hearOnline, notDownloaded } from "../../speech/transcribe.js";
+import { choose, heardVia, hearLocally, hearOnline, keptSource, notDownloaded, } from "../../speech/transcribe.js";
+import { environmentOf } from "../context.js";
 import { REMOTE_READ } from "../effects.js";
 import { renderAnswer } from "../envelope.js";
 import { messengerContext } from "./context.js";
@@ -22,10 +23,13 @@ export const transcribeSubcommand = (messages, messenger) => annotate(messages.c
     .action(async function (chat, messageId) {
     const context = messengerContext(this, messenger);
     const choice = {
-        ...choose(messenger, context.settings, this.opts(), context.env),
+        ...choose(messenger, context.settings, this.opts(), context.env, context.keyring),
         ...(context.recognizer ? { open: context.recognizer } : {}),
+        ...signalOf(this),
     };
-    // Before connecting: a missing model should not cost a login.
+    // Before connecting: a missing model or OpenAI key should not cost a login.
+    if (choice.refusal)
+        throw choice.refusal;
     if (choice.with === "local" && !isInstalled(choice.model, choice.directory)) {
         throw notDownloaded(messenger, choice.model);
     }
@@ -51,17 +55,17 @@ export const transcribeSubcommand = (messages, messenger) => annotate(messages.c
         return [resolved, undefined, await hearOnline(messenger, connection, resolved, id, choice, read)];
     });
     const heard = before
-        ? {
-            messageId: id,
-            text: before.text,
-            pending: false,
-            ...(before.source === messenger.provider ? { via: before.source } : { via: "local", model: before.source }),
-        }
+        ? { messageId: id, text: before.text, pending: false, ...heardVia(before.source, messenger.provider) }
         : online instanceof Uint8Array
             ? await hearLocally(online, id, choice)
             : online;
     if (!heard.pending && !before) {
-        await withKept((kept) => kept.keep({ chatId, messageId: id }, heard.text, heard.model ?? heard.via));
+        await withKept((kept) => kept.keep({ chatId, messageId: id }, heard.text, keptSource(heard)));
     }
     renderAnswer(this, context, heardAnswer(heard, chatId), () => `${heard.text}\n`);
 });
+const signalOf = (command) => {
+    const { signal, commandSignal } = environmentOf(command);
+    const signals = [signal, commandSignal].filter((one) => one !== undefined);
+    return signals.length ? { signal: AbortSignal.any(signals) } : {};
+};

package/dist/cli/runs/command.js

@@ -41,7 +41,8 @@ export const runsCommand = (app) => {
             args: words.length ? { query: typedQuery(words) } : {},
         }));
         if (runs.length === 0)
-            renderer.note("nothing recorded — a run is kept with `--record`, or when it fails");
+            renderer.note("nothing recorded — a command that does its work is kept unless the config says `record: false` (then only " +
+                "failures) or it ran with `--no-record`");
     });
     annotate(command.command("show"), {
         examples: [`${app.command} runs show run-101`],

package/dist/errors/reasons.d.ts

@@ -7,7 +7,7 @@ export declare const REASONS: ErrorReason[];
  * Detail keys an error from this package may carry, until each is registered on its own reason. Not `cause`:
  * that can hold a provider's or SQLite's raw text.
  */
-export declare const DETAILS: readonly ["contracts", "calendars", "allowed", "alternative", "arguments", "at", "available", "batch", "budget", "built", "candidates", "chat", "chat_id", "cli", "complete", "emitted_bytes", "exact", "forum", "guide", "hint", "id", "index", "kind", "limit", "limit_source", "max_bytes", "model", "name", "operation_id", "operation_ids", "text_limit", "store_refused_in", "partial_output", "path", "permission", "person_ids", "previous_chat_id", "profiles", "provider_error", "provider", "recovery", "reference", "remembered", "retry_at", "runtime", "saved", "scheduled_for", "script", "sent", "sent_count", "settlement_failed", "span", "sqlite", "stage", "standing", "state", "stderr", "term", "total", "upgraded", "wanted"];
+export declare const DETAILS: readonly ["contracts", "calendars", "allowed", "alternative", "arguments", "at", "available", "batch", "budget", "built", "candidates", "chat", "chat_id", "cli", "complete", "emitted_bytes", "exact", "forum", "guide", "hint", "id", "index", "kind", "limit", "limit_source", "max_bytes", "model", "name", "operation_id", "operation_ids", "text_limit", "store_refused_in", "partial_output", "path", "permission", "person_ids", "previous_chat_id", "profiles", "provider_error", "provider", "recovery", "reference", "remembered", "retry_at", "retry_after_ms", "runtime", "saved", "scheduled_for", "script", "sent", "sent_count", "settlement_failed", "span", "sqlite", "stage", "standing", "state", "stderr", "term", "total", "upgraded", "wanted"];
 /** What a CLI adds to the shared registry: its own reasons, and the detail keys its adapters raise. */
 export interface AppErrors {
     reasons?: readonly ErrorReason[];

package/dist/errors/reasons.js

@@ -88,6 +88,13 @@ const OTHERS = [
     validation("memory.evidence-required", "a memory needs its evidence"),
     validation("memory.scope-required", "a memory needs its scope"),
     ["model.not-downloaded", "not_found", "the model is not downloaded on this machine"],
+    ["transcription.no-key", "authentication_error", "no OpenAI key is set for transcription"],
+    validation("transcription.too-large", "the audio is over the transcription provider's size limit"),
+    [
+        "transcription.quota-exhausted",
+        "permission_error",
+        "the transcription provider account has no credit or limit left",
+    ],
     validation("name.invalid", "the name is not valid"),
     validation("output.choose-fields", "at a terminal, --json names the fields it prints"),
     validation("output.one-object", "a report is one JSON object; --jsonl streams lists only"),
@@ -201,6 +208,7 @@ export const DETAILS = [
     "reference",
     "remembered",
     "retry_at",
+    "retry_after_ms",
     "runtime",
     "saved",
     "scheduled_for",

package/dist/meetings/transcription.d.ts

@@ -19,6 +19,11 @@ export interface MeetingRecognitionSegment {
     startMs: number;
     endMs: number;
     text: string;
+    /**
+     * Who spoke, when the source knows — a channel of a two-channel call. Speakers may overlap; one speaker may not.
+     * Trimmed; `null` is no speaker.
+     */
+    speaker?: string | null;
 }
 export interface MeetingTranscriptionContext {
     maxBytes: number;

package/dist/meetings/transcription.js

@@ -11,6 +11,8 @@ const identifier = (value) => {
         throw new CliError("validation_error", "transcription identifiers must be bounded nonempty strings");
     return value;
 };
+/** Recognized off this machine: the stored source names the provider rather than `local/`. */
+const REMOTE_ENGINES = new Set(["openai"]);
 const cancelled = (signal) => {
     if (signal?.aborted) {
         if (signal.reason instanceof CliError)
@@ -64,21 +66,33 @@ export const transcribeMeeting = async (source, store, target, options = {}) =>
     const outcome = await dispatchMeetingMutation(mutation, async () => {
         const rows = [];
         let textBytes = 0;
-        let end = 0;
+        let start = 0;
+        const ends = new Map();
         let provided = 0;
         for await (const segment of source.segments(media, context)) {
             cancelled(context.signal);
             provided++;
+            const given = segment.speaker ?? undefined;
+            if (given !== undefined &&
+                (typeof given !== "string" || !given.trim() || given.length > 200 || /[\0\r\n]/.test(given)))
+                throw new CliError("invalid_response", "invalid recognition segment speaker");
+            const speaker = given?.trim();
+            // Without speakers, nothing may overlap; with them, only one speaker's own segments may not.
+            const overlapping = speaker === undefined
+                ? [...ends.values()].reduce((latest, end) => Math.max(latest, end), 0)
+                : Math.max(ends.get(undefined) ?? 0, ends.get(speaker) ?? 0);
             if (provided > maxSegments ||
                 !Number.isSafeInteger(segment.startMs) ||
                 !Number.isSafeInteger(segment.endMs) ||
-                segment.startMs < end ||
+                segment.startMs < start ||
+                segment.startMs < overlapping ||
                 segment.endMs <= segment.startMs ||
                 segment.endMs > media.durationMs ||
                 typeof segment.text !== "string" ||
                 segment.text.includes("\0"))
                 throw new CliError("invalid_response", "invalid or excessive recognition segments");
-            end = segment.endMs;
+            start = segment.startMs;
+            ends.set(speaker, Math.max(ends.get(speaker) ?? 0, segment.endMs));
             const text = segment.text.trim();
             if (text.length > maxTextBytes - textBytes)
                 throw new CliError("validation_error", "transcript exceeds its byte limit");
@@ -90,7 +104,7 @@ export const transcribeMeeting = async (source, store, target, options = {}) =>
                     position: rows.length,
                     startMs: segment.startMs,
                     endMs: segment.endMs,
-                    speakerName: null,
+                    speakerName: speaker ?? null,
                     text,
                     normalizedText: null,
                     metadata: null,
@@ -114,8 +128,15 @@ export const transcribeMeeting = async (source, store, target, options = {}) =>
             now,
             transcripts: [
                 {
-                    source: `local/${encodeURIComponent(media.recognition.engine)}/${encodeURIComponent(media.recognition.model)}`,
-                    format: "local-transcription",
+                    ...(REMOTE_ENGINES.has(media.recognition.engine)
+                        ? {
+                            source: `${encodeURIComponent(media.recognition.engine)}/${encodeURIComponent(media.recognition.model)}`,
+                            format: `${media.recognition.engine}-transcription`,
+                        }
+                        : {
+                            source: `local/${encodeURIComponent(media.recognition.engine)}/${encodeURIComponent(media.recognition.model)}`,
+                            format: "local-transcription",
+                        }),
                     language: null,
                     contentHash: hash,
                     externalCreatedAt: null,

package/dist/services/index.d.ts

@@ -1,4 +1,5 @@
 import { type BotCheckService } from "../botcheck/service.js";
+export { type ChatCoverage, chatCoverage } from "./chat-coverage.js";
 export type { ContextEvidenceItem, ContextEvidencePage, ContextEvidenceReader, ContextEvidenceRequest, ContextEvidenceSender, ContextIndex, ContextReadLimits, ContextReadUsage, ContextRecordReader, ContextSource, ScopedContextEvidenceReader, } from "./context-evidence.js";
 export { contextEvidenceFingerprint, createContextEvidenceReader } from "./context-evidence.js";
 export { excerpt } from "./excerpt.js";

package/dist/services/index.js

@@ -1,4 +1,5 @@
 import { botCheckService } from "../botcheck/service.js";
+export { chatCoverage } from "./chat-coverage.js";
 export { contextEvidenceFingerprint, createContextEvidenceReader } from "./context-evidence.js";
 export { excerpt } from "./excerpt.js";
 export { archiveMedia, checkMediaArchive } from "./media-archive.js";

package/dist/speech/decode.d.ts

@@ -13,9 +13,19 @@ export declare const formatOf: (bytes: Uint8Array) => Format;
  * the GPL. From a file rather than a pipe: an MP4 whose index sits at the end cannot be read from a pipe.
  */
 export declare const runFfmpeg: Ffmpeg;
+export interface DecodedChannels {
+    channels: Pcm[];
+    /** True when ffmpeg read the file: whatever channels it had arrive mixed into one, so one speaker per channel is lost. */
+    mixed: boolean;
+}
+/**
+ * Every channel the file has, one `Pcm` each: a phone call recorded in stereo keeps one speaker per channel.
+ * Only the bundled decoders keep channels apart; what ffmpeg reads arrives mixed down to one, and says so.
+ */
+export declare const decodeChannels: (bytes: Uint8Array, ffmpeg?: Ffmpeg) => Promise<DecodedChannels>;
 /**
  * Opus, Vorbis, FLAC and MP3 by the bundled decoders; anything else, or what one of them could not read, by ffmpeg
- * when the machine has it. The bundled decoder's error wins: it names the file's own problem.
+ * when the machine has it. The bundled decoder's error wins: it names the file's own problem. The first channel only.
  */
 export declare const decodeAudio: (bytes: Uint8Array, ffmpeg?: Ffmpeg) => Promise<Pcm>;
 export {};

package/dist/speech/decode.js

@@ -33,11 +33,10 @@ export const formatOf = (bytes) => {
         return "mp3";
     return "other";
 };
-const firstChannel = (decoded) => {
-    const samples = decoded.channelData[0];
-    if (!samples || decoded.samplesDecoded === 0)
+const everyChannel = (decoded) => {
+    if (!decoded.channelData[0] || decoded.samplesDecoded === 0)
         throw new CliError("validation_error", "no audio in that file");
-    return { samples, rate: decoded.sampleRate };
+    return decoded.channelData.map((samples) => ({ samples, rate: decoded.sampleRate }));
 };
 /**
  * Found from cli-core's own place and imported by URL, so a CLI's bundler leaves the decoder whole: bundled, it looks
@@ -49,7 +48,7 @@ const decodeVorbis = async (bytes) => {
     const decoder = new OggVorbisDecoder();
     await decoder.ready;
     try {
-        return firstChannel(await decoder.decodeFile(bytes));
+        return everyChannel(await decoder.decodeFile(bytes));
     }
     finally {
         decoder.free();
@@ -60,7 +59,7 @@ const decodeFlac = async (bytes) => {
     const decoder = new FLACDecoder();
     await decoder.ready;
     try {
-        return firstChannel(await decoder.decodeFile(bytes));
+        return everyChannel(await decoder.decodeFile(bytes));
     }
     finally {
         decoder.free();
@@ -71,7 +70,7 @@ const decodeMp3 = async (bytes) => {
     const decoder = new MPEGDecoder();
     await decoder.ready;
     try {
-        return firstChannel(decoder.decode(bytes));
+        return everyChannel(decoder.decode(bytes));
     }
     finally {
         decoder.free();
@@ -147,18 +146,24 @@ const BUNDLED = {
     flac: decodeFlac,
     mp3: decodeMp3,
 };
+const tooLong = (pcm) => pcm.samples.length / pcm.rate > LONGEST_AUDIO_SECONDS;
 /**
- * Opus, Vorbis, FLAC and MP3 by the bundled decoders; anything else, or what one of them could not read, by ffmpeg
- * when the machine has it. The bundled decoder's error wins: it names the file's own problem.
+ * Every channel the file has, one `Pcm` each: a phone call recorded in stereo keeps one speaker per channel.
+ * Only the bundled decoders keep channels apart; what ffmpeg reads arrives mixed down to one, and says so.
  */
-export const decodeAudio = async (bytes, ffmpeg = runFfmpeg) => {
+export const decodeChannels = async (bytes, ffmpeg = runFfmpeg) => {
     const format = formatOf(bytes);
-    const pcm = format === "other"
-        ? await ffmpeg(bytes)
-        : await BUNDLED[format](bytes).catch((error) => ffmpeg(bytes).catch(() => {
+    const decoded = format === "other"
+        ? { channels: [await ffmpeg(bytes)], mixed: true }
+        : await BUNDLED[format](bytes).then((channels) => ({ channels, mixed: false }), (error) => ffmpeg(bytes).then((pcm) => ({ channels: [pcm], mixed: true }), () => {
             throw error;
         }));
-    if (pcm.samples.length / pcm.rate > LONGEST_AUDIO_SECONDS)
+    if (decoded.channels.some(tooLong))
         throw new CliError("validation_error", `the audio is longer than ${LONGEST_AUDIO_SECONDS / 60} minutes`);
-    return pcm;
+    return decoded;
 };
+/**
+ * Opus, Vorbis, FLAC and MP3 by the bundled decoders; anything else, or what one of them could not read, by ffmpeg
+ * when the machine has it. The bundled decoder's error wins: it names the file's own problem. The first channel only.
+ */
+export const decodeAudio = async (bytes, ffmpeg = runFfmpeg) => (await decodeChannels(bytes, ffmpeg)).channels[0];

package/dist/speech/hearing.d.ts

@@ -1,3 +1,4 @@
+import { type KeyringStore } from "@wirecat/cli-base";
 import type { Missing } from "@wirecat/cli-base/standards";
 import type { Messenger } from "../cli/messenger/context.js";
 import type { Settings } from "../cli/settings.js";
@@ -60,9 +61,10 @@ export declare const spoken: <T extends Message & {
     transcript?: string;
 }>({ transcript, ...message }: T) => Message;
 /** For an MCP tool: the same hearing, over the session's own connection. */
-export declare const hearForTool: (messenger: Messenger, connect: <T>(work: (adapter: MessengerAdapter) => Promise<T>) => Promise<T>, messages: readonly Message[], transcribe: boolean, { settings, env }: {
+export declare const hearForTool: (messenger: Messenger, connect: <T>(work: (adapter: MessengerAdapter) => Promise<T>) => Promise<T>, messages: readonly Message[], transcribe: boolean, { settings, env, keyring, }: {
     settings: Pick<Settings, "configured" | "shared" | "profile">;
     env: NodeJS.ProcessEnv;
+    keyring?: KeyringStore;
 }, model?: string) => Promise<Hearing | undefined>;
 /** Messages with their transcripts; `unheard` as well when `--transcribe` was asked for. */
 export declare const heard: <T extends Message>(messages: readonly T[], hearing: Hearing | undefined) => T[];

package/dist/speech/hearing.js

@@ -1,7 +1,7 @@
 import { CliError } from "@wirecat/cli-base";
 import { recalledAccount } from "../cli/messenger/accounts.js";
 import { openStore } from "../store/store.js";
-import { choose, hearLocally, hearOnline, isAudioFile } from "./transcribe.js";
+import { choose, hearLocally, hearOnline, isAudioFile, keptSource } from "./transcribe.js";
 /** `--model` chooses who hears what `--transcribe` asks for; alone it would quietly do nothing. */
 export const modelWith = (transcribe, model) => {
     if (model !== undefined && transcribe !== true) {
@@ -73,7 +73,7 @@ export const hearVoices = async (messenger, messages, kept, transcribe) => {
             if (heard.pending || heard.text.trim() === "")
                 continue;
             transcripts.set(keyOf(voice), heard.text);
-            await kept.keep(voice, heard.text, heard.model ?? heard.via);
+            await kept.keep(voice, heard.text, keptSource(heard));
         }
         catch (error) {
             problem ??= error instanceof Error ? error.message : String(error);
@@ -92,14 +92,14 @@ export const spoken = ({ transcript, ...message }) => transcript === undefined
     ? message
     : { ...message, text: [message.text, `🎤 ${transcript}`].filter(Boolean).join("\n") };
 /** For an MCP tool: the same hearing, over the session's own connection. */
-export const hearForTool = async (messenger, connect, messages, transcribe, { settings, env }, model) => {
+export const hearForTool = async (messenger, connect, messages, transcribe, { settings, env, keyring, }, model) => {
     if (!messages.some(hasAudio))
         return undefined;
     const kept = await openKept(messenger, settings.profile, env);
     try {
         return await hearVoices(messenger, messages, kept, transcribe
             ? {
-                choice: choose(messenger, settings, model === undefined ? {} : { model }, env),
+                choice: choose(messenger, settings, model === undefined ? {} : { model }, env, keyring),
                 connect,
             }
             : undefined);

package/dist/speech/index.d.ts

@@ -1,3 +1,6 @@
+export { decodeAudio, decodeChannels, type Ffmpeg, type Pcm, runFfmpeg, } from "./decode.js";
 export { type Fetch, install, installedBytes, isInstalled, megabytes, modelPath, modelsDirectory, sharedModelsDirectory, vadPath, } from "./install.js";
-export { type LocalSpeechBackend, type LocalSpeechRecognitionModel, type LocalSpeechRecognizer, type LocalSpeechRecognizerOptions, localSpeechRecognitionModel, openLocalSpeechRecognizer, } from "./local.js";
-export { DEFAULT_ORDER, findModel, MODELS, type ModelFile, orderedModels, type SpeechModel, speechModel, VAD, } from "./models.js";
+export { type LocalSpeechBackend, type LocalSpeechRecognitionModel, type LocalSpeechRecognizer, type LocalSpeechRecognizerOptions, localSpeechRecognitionModel, openLocalSpeechRecognizer, recognizeLocalPieces, } from "./local.js";
+export { DEFAULT_ORDER, findModel, MODELS, type ModelFile, OPENAI_TRANSCRIBE_MODEL, orderedModels, type SpeechModel, speechModel, VAD, } from "./models.js";
+export { LONGEST_REQUEST_SECONDS, type OpenAITranscription, transcribeOpenAI } from "./openai.js";
+export type { TimedText } from "./recognize.js";

package/dist/speech/index.js

@@ -1,3 +1,5 @@
+export { decodeAudio, decodeChannels, runFfmpeg, } from "./decode.js";
 export { install, installedBytes, isInstalled, megabytes, modelPath, modelsDirectory, sharedModelsDirectory, vadPath, } from "./install.js";
-export { localSpeechRecognitionModel, openLocalSpeechRecognizer, } from "./local.js";
-export { DEFAULT_ORDER, findModel, MODELS, orderedModels, speechModel, VAD, } from "./models.js";
+export { localSpeechRecognitionModel, openLocalSpeechRecognizer, recognizeLocalPieces, } from "./local.js";
+export { DEFAULT_ORDER, findModel, MODELS, OPENAI_TRANSCRIBE_MODEL, orderedModels, speechModel, VAD, } from "./models.js";
+export { LONGEST_REQUEST_SECONDS, transcribeOpenAI } from "./openai.js";