@ariaflowagents/livekit-plugin 0.9.0

package/README.md

@@ -0,0 +1,155 @@
+# @ariaflow/livekit-plugin
+
+AriaFlow plugin for [LiveKit Agents](https://docs.livekit.io/agents/) — connects AriaFlow Runtime to LiveKit's voice infrastructure for building production voice agents.
+
+## Features
+
+- **Runtime Adapter** — wraps AriaFlow Runtime as a LiveKit LLM provider (`AriaRuntimeLLMAdapter`)
+- **Voice Sessions** — `AriaFlowVoiceSession` (WebSocket) and `AriaFlowLivekitSession` (LiveKit rooms)
+- **Two-Layer Turn Detection** — Silero VAD + EOU text model + LLM turn markers
+- **Gemini STT/TTS** — Google Gemini Live speech-to-text and text-to-speech
+- **Filler Coordinator** — audio filler management during tool execution
+- **Recording** — session recording with pluggable storage adapters
+- **Codec Utilities** — G.711 (PCMU/PCMA) encode/decode, resampling
+
+## Install
+
+```bash
+bun add @ariaflow/livekit-plugin
+```
+
+Peer dependencies:
+
+```bash
+bun add @livekit/agents @livekit/rtc-node @ariaflowagents/core
+```
+
+## Quick Start
+
+```typescript
+import { WebSocketAgentServer } from '@ariaflow/livekit-plugin-transport-ws';
+import { AriaFlowVoiceSession, TurnDetector } from '@ariaflow/livekit-plugin';
+import { GeminiLiveSTT, GeminiLiveTTS } from '@ariaflow/livekit-plugin/gemini';
+import { Runtime } from '@ariaflowagents/core';
+import { openai } from '@ai-sdk/openai';
+
+const runtime = new Runtime({
+  agents: [{
+    id: 'assistant',
+    name: 'Voice Assistant',
+    model: openai('gpt-4o-mini'),
+    prompt: 'You are a helpful voice assistant.',
+  }],
+  defaultAgentId: 'assistant',
+  defaultModel: openai('gpt-4o-mini'),
+});
+
+// Load turn detection models once at startup
+const detector = new TurnDetector();
+await detector.initialize();
+
+const server = new WebSocketAgentServer({ port: 8080 });
+
+server.onConnection(async (transport) => {
+  const voiceSession = new AriaFlowVoiceSession({
+    runtime,
+    stt: new GeminiLiveSTT(),
+    tts: new GeminiLiveTTS(),
+    vad: detector.vad ?? undefined,
+    turnDetection: detector.eouTurnDetector ?? undefined,
+    turnMarkerConfig: detector.turnMarkerConfig,
+    greeting: 'Hello! How can I help you?',
+  });
+
+  await server.startSession(transport, voiceSession);
+});
+
+await server.listen();
+```
+
+## Turn Detection
+
+The plugin implements a two-layer turn detection system:
+
+**Layer 1: VAD + EOU text model**
+- Silero VAD detects speech boundaries (start/end of speech)
+- EOU (End-of-Utterance) ONNX model predicts whether the transcript looks like a complete turn
+- These run at the audio/STT level inside LiveKit's `AgentSession`
+
+**Layer 2: LLM turn markers**
+- The LLM is instructed to prefix responses with a Unicode marker indicating turn completeness
+- `✓` — user's turn is complete, respond normally
+- `○` — user will likely continue shortly, suppress response
+- `◐` — user needs more time to think, suppress and wait longer
+
+```typescript
+const detector = new TurnDetector({
+  // Disable individual layers:
+  // disableVAD: true,
+  // disableEOU: true,
+
+  // Custom marker config:
+  turnMarkerConfig: {
+    enabled: true,
+    incompleteShortWaitMs: 5000,
+    incompleteLongWaitMs: 10000,
+  },
+});
+await detector.initialize();
+```
+
+## Exports
+
+| Export Path | Contents |
+|-------------|----------|
+| `@ariaflow/livekit-plugin` | Core: sessions, LLM adapter, turn detection, transport, codecs |
+| `@ariaflow/livekit-plugin/gemini` | Gemini Live STT/TTS |
+| `@ariaflow/livekit-plugin/recording` | Recording manager and storage adapters |
+| `@ariaflow/livekit-plugin/codec/g711` | G.711 PCMU/PCMA encode/decode |
+| `@ariaflow/livekit-plugin/utils/resample` | Audio resampling utilities |
+
+## Examples
+
+See [`examples/`](./examples/) for runnable examples:
+
+- **basic_voice_agent.ts** — minimal agent with a tool
+- **multi_agent_handoff.ts** — router + game agent handoff
+- **restaurant_agent.ts** — 4-agent restaurant system
+- **turn_detection_demo.ts** — turn detection configuration
+- **livekit_room_agent.ts** — LiveKit room (WebRTC) agent
+- **livekit_room_with_tools.ts** — room agent with tools
+
+## Changelog
+
+### 0.1.0
+
+**Turn Detection** (RFC-011, RFC-012)
+- Added two-layer turn detection system (`src/turn_detection/`)
+  - `TurnDetector` — orchestrator that loads VAD and EOU models in parallel
+  - `loadSileroVAD()` — process-level singleton loader for Silero VAD with concurrent-call deduplication
+  - `EOUDetector` — standalone port of LiveKit's EOU ONNX model, no `getJobContext()` dependency
+  - `EOUTurnDetectorAdapter` — bridges `EOUDetector` to LiveKit's `_TurnDetector` interface
+  - `detectTurnMarker()` / `stripMarker()` — LLM turn marker detection and stripping
+  - `TURN_MARKER_SYSTEM_PROMPT` — system prompt fragment for LLM marker compliance
+- Modified `AriaRuntimeLLMAdapter` to intercept turn markers in LLM responses when configured
+- Modified `AriaFlowVoiceSession` to accept `turnMarkerConfig` option
+- Modified `AriaFlowLivekitSession` to accept `turnMarkerConfig` option
+- Added dependencies: `@livekit/agents-plugin-silero`, `onnxruntime-node`, `@huggingface/hub`, `@huggingface/transformers`
+
+**Examples**
+- Added `basic_voice_agent.ts` — minimal voice agent with turn detection
+- Added `multi_agent_handoff.ts` — multi-agent routing demo
+- Added `restaurant_agent.ts` — 4-agent restaurant system
+- Added `turn_detection_demo.ts` — turn detection configuration demo
+- Added `livekit_room_with_tools.ts` — room-based agent with tools
+- Updated `livekit_room_agent.ts` — added turn detection, migrated to `ServerOptions`/`defineAgent` API
+
+**Initial Release**
+- `AriaRuntimeLLMAdapter` — wraps AriaFlow Runtime as a LiveKit LLM provider
+- `AriaFlowVoiceSession` — WebSocket-based voice session
+- `AriaFlowLivekitSession` — LiveKit room-based voice session
+- `FillerCoordinator` — audio filler management during tool execution
+- Gemini Live STT/TTS integration
+- Recording with pluggable storage adapters (S3)
+- G.711 codec utilities (PCMU/PCMA)
+- Audio resampling utilities

package/dist/agent/AriaFlowAgent.d.ts

@@ -0,0 +1,11 @@
+import { voice } from '@livekit/agents';
+import type { AriaRuntimeLLMAdapter } from '../llm/AriaRuntimeLLMAdapter.js';
+export interface AriaFlowAgentOptions {
+    greeting?: string | null;
+}
+export declare class AriaFlowAgent extends voice.Agent {
+    #private;
+    constructor(ariaLlm: AriaRuntimeLLMAdapter, opts?: AriaFlowAgentOptions);
+    onEnter(): Promise<void>;
+}
+//# sourceMappingURL=AriaFlowAgent.d.ts.map

package/dist/agent/AriaFlowAgent.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"AriaFlowAgent.d.ts","sourceRoot":"","sources":["../../src/agent/AriaFlowAgent.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,KAAK,EAAE,MAAM,iBAAiB,CAAC;AACxC,OAAO,KAAK,EAAE,qBAAqB,EAAE,MAAM,iCAAiC,CAAC;AAE7E,MAAM,WAAW,oBAAoB;IACnC,QAAQ,CAAC,EAAE,MAAM,GAAG,IAAI,CAAC;CAC1B;AAED,qBAAa,aAAc,SAAQ,KAAK,CAAC,KAAK;;gBAGhC,OAAO,EAAE,qBAAqB,EAAE,IAAI,GAAE,oBAAyB;IASrE,OAAO,IAAI,OAAO,CAAC,IAAI,CAAC;CAW/B"}

package/dist/agent/AriaFlowAgent.js

@@ -0,0 +1,22 @@
+import { voice } from '@livekit/agents';
+export class AriaFlowAgent extends voice.Agent {
+    #opts;
+    constructor(ariaLlm, opts = {}) {
+        super({
+            instructions: 'AriaFlow-managed voice agent',
+            llm: ariaLlm,
+        });
+        this.#opts = opts;
+    }
+    async onEnter() {
+        if (this.#opts.greeting === null) {
+            return;
+        }
+        const greeting = this.#opts.greeting ?? "Hello! I'm your AI assistant. How can I help?";
+        this.session.say(greeting, {
+            allowInterruptions: true,
+            addToChatCtx: false,
+        });
+    }
+}
+//# sourceMappingURL=AriaFlowAgent.js.map

package/dist/agent/AriaFlowAgent.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"AriaFlowAgent.js","sourceRoot":"","sources":["../../src/agent/AriaFlowAgent.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,KAAK,EAAE,MAAM,iBAAiB,CAAC;AAOxC,MAAM,OAAO,aAAc,SAAQ,KAAK,CAAC,KAAK;IAC5C,KAAK,CAAuB;IAE5B,YAAY,OAA8B,EAAE,OAA6B,EAAE;QACzE,KAAK,CAAC;YACJ,YAAY,EAAE,8BAA8B;YAC5C,GAAG,EAAE,OAAO;SACb,CAAC,CAAC;QAEH,IAAI,CAAC,KAAK,GAAG,IAAI,CAAC;IACpB,CAAC;IAED,KAAK,CAAC,OAAO;QACX,IAAI,IAAI,CAAC,KAAK,CAAC,QAAQ,KAAK,IAAI,EAAE,CAAC;YACjC,OAAO;QACT,CAAC;QAED,MAAM,QAAQ,GAAG,IAAI,CAAC,KAAK,CAAC,QAAQ,IAAI,+CAA+C,CAAC;QACxF,IAAI,CAAC,OAAO,CAAC,GAAG,CAAC,QAAQ,EAAE;YACzB,kBAAkB,EAAE,IAAI;YACxB,YAAY,EAAE,KAAK;SACpB,CAAC,CAAC;IACL,CAAC;CACF"}

package/dist/audio_byte_stream.d.ts

@@ -0,0 +1,29 @@
+import { AudioFrame } from './audio_frame.js';
+/**
+ * Accumulates raw PCM bytes and produces AudioFrame objects when enough
+ * data has been buffered for a complete frame.
+ *
+ * This is the primary utility for transport adapters that receive audio
+ * as a continuous byte stream (WebSocket binary messages, RTP packets,
+ * HTTP chunked transfer, etc.).
+ *
+ * The default frame size is 100ms of audio (sampleRate / 10 samples).
+ */
+export declare class AudioByteStream {
+    private sampleRate;
+    private numChannels;
+    private bytesPerFrame;
+    private buf;
+    constructor(sampleRate: number, numChannels: number, samplesPerChannel?: number | null);
+    /**
+     * Write raw PCM bytes. Returns zero or more complete AudioFrame objects.
+     * Incomplete data is buffered internally.
+     */
+    write(data: ArrayBuffer): AudioFrame[];
+    /**
+     * Flush remaining buffered data as a final (potentially short) frame.
+     * Returns empty array if remaining buffer is not sample-aligned.
+     */
+    flush(): AudioFrame[];
+}
+//# sourceMappingURL=audio_byte_stream.d.ts.map

package/dist/audio_byte_stream.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"audio_byte_stream.d.ts","sourceRoot":"","sources":["../src/audio_byte_stream.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,MAAM,kBAAkB,CAAC;AAE9C;;;;;;;;;GASG;AACH,qBAAa,eAAe;IAC1B,OAAO,CAAC,UAAU,CAAS;IAC3B,OAAO,CAAC,WAAW,CAAS;IAC5B,OAAO,CAAC,aAAa,CAAS;IAC9B,OAAO,CAAC,GAAG,CAAY;gBAGrB,UAAU,EAAE,MAAM,EAClB,WAAW,EAAE,MAAM,EACnB,iBAAiB,GAAE,MAAM,GAAG,IAAW;IAazC;;;OAGG;IACH,KAAK,CAAC,IAAI,EAAE,WAAW,GAAG,UAAU,EAAE;IAyBtC;;;OAGG;IACH,KAAK,IAAI,UAAU,EAAE;CAqBtB"}

package/dist/audio_byte_stream.js

@@ -0,0 +1,62 @@
+import { AudioFrame } from './audio_frame.js';
+/**
+ * Accumulates raw PCM bytes and produces AudioFrame objects when enough
+ * data has been buffered for a complete frame.
+ *
+ * This is the primary utility for transport adapters that receive audio
+ * as a continuous byte stream (WebSocket binary messages, RTP packets,
+ * HTTP chunked transfer, etc.).
+ *
+ * The default frame size is 100ms of audio (sampleRate / 10 samples).
+ */
+export class AudioByteStream {
+    sampleRate;
+    numChannels;
+    bytesPerFrame;
+    buf;
+    constructor(sampleRate, numChannels, samplesPerChannel = null) {
+        this.sampleRate = sampleRate;
+        this.numChannels = numChannels;
+        if (samplesPerChannel === null) {
+            samplesPerChannel = Math.floor(sampleRate / 10);
+        }
+        this.bytesPerFrame = numChannels * samplesPerChannel * 2;
+        this.buf = new Int8Array();
+    }
+    /**
+     * Write raw PCM bytes. Returns zero or more complete AudioFrame objects.
+     * Incomplete data is buffered internally.
+     */
+    write(data) {
+        const incoming = new Int8Array(data);
+        const next = new Int8Array(this.buf.length + incoming.length);
+        next.set(this.buf, 0);
+        next.set(incoming, this.buf.length);
+        this.buf = next;
+        const frames = [];
+        while (this.buf.length >= this.bytesPerFrame) {
+            const frameData = this.buf.slice(0, this.bytesPerFrame);
+            this.buf = this.buf.slice(this.bytesPerFrame);
+            frames.push(new AudioFrame(new Int16Array(frameData.buffer), this.sampleRate, this.numChannels, frameData.length / (2 * this.numChannels)));
+        }
+        return frames;
+    }
+    /**
+     * Flush remaining buffered data as a final (potentially short) frame.
+     * Returns empty array if remaining buffer is not sample-aligned.
+     */
+    flush() {
+        if (this.buf.length === 0) {
+            return [];
+        }
+        if (this.buf.length % (2 * this.numChannels) !== 0) {
+            return [];
+        }
+        const frames = [
+            new AudioFrame(new Int16Array(this.buf.buffer), this.sampleRate, this.numChannels, this.buf.length / (2 * this.numChannels)),
+        ];
+        this.buf = new Int8Array();
+        return frames;
+    }
+}
+//# sourceMappingURL=audio_byte_stream.js.map

package/dist/audio_byte_stream.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"audio_byte_stream.js","sourceRoot":"","sources":["../src/audio_byte_stream.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,MAAM,kBAAkB,CAAC;AAE9C;;;;;;;;;GASG;AACH,MAAM,OAAO,eAAe;IAClB,UAAU,CAAS;IACnB,WAAW,CAAS;IACpB,aAAa,CAAS;IACtB,GAAG,CAAY;IAEvB,YACE,UAAkB,EAClB,WAAmB,EACnB,oBAAmC,IAAI;QAEvC,IAAI,CAAC,UAAU,GAAG,UAAU,CAAC;QAC7B,IAAI,CAAC,WAAW,GAAG,WAAW,CAAC;QAE/B,IAAI,iBAAiB,KAAK,IAAI,EAAE,CAAC;YAC/B,iBAAiB,GAAG,IAAI,CAAC,KAAK,CAAC,UAAU,GAAG,EAAE,CAAC,CAAC;QAClD,CAAC;QAED,IAAI,CAAC,aAAa,GAAG,WAAW,GAAG,iBAAiB,GAAG,CAAC,CAAC;QACzD,IAAI,CAAC,GAAG,GAAG,IAAI,SAAS,EAAE,CAAC;IAC7B,CAAC;IAED;;;OAGG;IACH,KAAK,CAAC,IAAiB;QACrB,MAAM,QAAQ,GAAG,IAAI,SAAS,CAAC,IAAI,CAAC,CAAC;QACrC,MAAM,IAAI,GAAG,IAAI,SAAS,CAAC,IAAI,CAAC,GAAG,CAAC,MAAM,GAAG,QAAQ,CAAC,MAAM,CAAC,CAAC;QAC9D,IAAI,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,EAAE,CAAC,CAAC,CAAC;QACtB,IAAI,CAAC,GAAG,CAAC,QAAQ,EAAE,IAAI,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC;QACpC,IAAI,CAAC,GAAG,GAAG,IAAI,CAAC;QAEhB,MAAM,MAAM,GAAiB,EAAE,CAAC;QAChC,OAAO,IAAI,CAAC,GAAG,CAAC,MAAM,IAAI,IAAI,CAAC,aAAa,EAAE,CAAC;YAC7C,MAAM,SAAS,GAAG,IAAI,CAAC,GAAG,CAAC,KAAK,CAAC,CAAC,EAAE,IAAI,CAAC,aAAa,CAAC,CAAC;YACxD,IAAI,CAAC,GAAG,GAAG,IAAI,CAAC,GAAG,CAAC,KAAK,CAAC,IAAI,CAAC,aAAa,CAAC,CAAC;YAE9C,MAAM,CAAC,IAAI,CACT,IAAI,UAAU,CACZ,IAAI,UAAU,CAAC,SAAS,CAAC,MAAM,CAAC,EAChC,IAAI,CAAC,UAAU,EACf,IAAI,CAAC,WAAW,EAChB,SAAS,CAAC,MAAM,GAAG,CAAC,CAAC,GAAG,IAAI,CAAC,WAAW,CAAC,CAC1C,CACF,CAAC;QACJ,CAAC;QAED,OAAO,MAAM,CAAC;IAChB,CAAC;IAED;;;OAGG;IACH,KAAK;QACH,IAAI,IAAI,CAAC,GAAG,CAAC,MAAM,KAAK,CAAC,EAAE,CAAC;YAC1B,OAAO,EAAE,CAAC;QACZ,CAAC;QAED,IAAI,IAAI,CAAC,GAAG,CAAC,MAAM,GAAG,CAAC,CAAC,GAAG,IAAI,CAAC,WAAW,CAAC,KAAK,CAAC,EAAE,CAAC;YACnD,OAAO,EAAE,CAAC;QACZ,CAAC;QAED,MAAM,MAAM,GAAG;YACb,IAAI,UAAU,CACZ,IAAI,UAAU,CAAC,IAAI,CAAC,GAAG,CAAC,MAAM,CAAC,EAC/B,IAAI,CAAC,UAAU,EACf,IAAI,CAAC,WAAW,EAChB,IAAI,CAAC,GAAG,CAAC,MAAM,GAAG,CAAC,CAAC,GAAG,IAAI,CAAC,WAAW,CAAC,CACzC;SACF,CAAC;QAEF,IAAI,CAAC,GAAG,GAAG,IAAI,SAAS,EAAE,CAAC;QAC3B,OAAO,MAAM,CAAC;IAChB,CAAC;CACF"}

package/dist/audio_frame.d.ts

@@ -0,0 +1,2 @@
+export { AudioFrame } from '@livekit/rtc-node';
+//# sourceMappingURL=audio_frame.d.ts.map

package/dist/audio_frame.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"audio_frame.d.ts","sourceRoot":"","sources":["../src/audio_frame.ts"],"names":[],"mappings":"AAIA,OAAO,EAAE,UAAU,EAAE,MAAM,mBAAmB,CAAC"}

package/dist/audio_frame.js

@@ -0,0 +1,6 @@
+// Re-export AudioFrame from @livekit/rtc-node.
+// This single indirection point isolates all downstream packages from the
+// native dependency. When a pure-JS AudioFrame shim is available, only
+// this file needs to change.
+export { AudioFrame } from '@livekit/rtc-node';
+//# sourceMappingURL=audio_frame.js.map

package/dist/audio_frame.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"audio_frame.js","sourceRoot":"","sources":["../src/audio_frame.ts"],"names":[],"mappings":"AAAA,+CAA+C;AAC/C,0EAA0E;AAC1E,uEAAuE;AACvE,6BAA6B;AAC7B,OAAO,EAAE,UAAU,EAAE,MAAM,mBAAmB,CAAC"}

package/dist/codec/g711.d.ts

@@ -0,0 +1,14 @@
+export interface Codec {
+    readonly name: string;
+    readonly payloadType: number;
+    readonly sampleRate: number;
+    readonly channels: number;
+    decode(input: Uint8Array): Int16Array;
+    encode(input: Int16Array): Uint8Array;
+}
+export declare const PCMU: Codec;
+export declare const PCMA: Codec;
+/** Convenience wrappers matching the Twilio transport API surface. */
+export declare function mulawEncodeArray(pcm: Int16Array): Uint8Array;
+export declare function mulawDecodeArray(mulawBytes: Uint8Array): Int16Array;
+//# sourceMappingURL=g711.d.ts.map

package/dist/codec/g711.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"g711.d.ts","sourceRoot":"","sources":["../../src/codec/g711.ts"],"names":[],"mappings":"AAoBA,MAAM,WAAW,KAAK;IACpB,QAAQ,CAAC,IAAI,EAAE,MAAM,CAAC;IACtB,QAAQ,CAAC,WAAW,EAAE,MAAM,CAAC;IAC7B,QAAQ,CAAC,UAAU,EAAE,MAAM,CAAC;IAC5B,QAAQ,CAAC,QAAQ,EAAE,MAAM,CAAC;IAC1B,MAAM,CAAC,KAAK,EAAE,UAAU,GAAG,UAAU,CAAC;IACtC,MAAM,CAAC,KAAK,EAAE,UAAU,GAAG,UAAU,CAAC;CACvC;AAED,eAAO,MAAM,IAAI,EAAE,KAWlB,CAAC;AAEF,eAAO,MAAM,IAAI,EAAE,KAWlB,CAAC;AAEF,sEAAsE;AACtE,wBAAgB,gBAAgB,CAAC,GAAG,EAAE,UAAU,GAAG,UAAU,CAE5D;AAED,wBAAgB,gBAAgB,CAAC,UAAU,EAAE,UAAU,GAAG,UAAU,CAEnE"}

package/dist/codec/g711.js

@@ -0,0 +1,51 @@
+/**
+ * G.711 mu-law and A-law codec (CCITT/ITU-T compliant).
+ *
+ * Delegates to the `alawmulaw` npm package which implements the standard
+ * CCITT G.711 algorithm with BIAS=0x84 (132). This matches the Sun
+ * Microsystems / Columbia University reference implementation exactly
+ * across all 65536 Int16 input values.
+ *
+ * Previous implementation used BIAS=33 (the 14-bit variant mistakenly
+ * applied in 16-bit context), producing 16503 encode mismatches and
+ * 50x worse roundtrip error vs the CCITT reference. See LIBRARY-RESEARCH.md.
+ */
+// `alawmulaw` publishes a CJS/UMD `main` entry and an ESM `module` entry.
+// Node's ESM resolver ignores `module`, so importing from the package root
+// resolves to the CJS bundle and breaks named imports under `tsx`.
+// Import the ESM submodules directly to keep this codec usable in both Node
+// ESM test runners and the existing Bun workspace.
+import * as mulaw from 'alawmulaw/lib/mulaw.js';
+import * as alaw from 'alawmulaw/lib/alaw.js';
+export const PCMU = {
+    name: 'PCMU',
+    payloadType: 0,
+    sampleRate: 8000,
+    channels: 1,
+    decode(input) {
+        return mulaw.decode(input);
+    },
+    encode(input) {
+        return mulaw.encode(input);
+    },
+};
+export const PCMA = {
+    name: 'PCMA',
+    payloadType: 8,
+    sampleRate: 8000,
+    channels: 1,
+    decode(input) {
+        return alaw.decode(input);
+    },
+    encode(input) {
+        return alaw.encode(input);
+    },
+};
+/** Convenience wrappers matching the Twilio transport API surface. */
+export function mulawEncodeArray(pcm) {
+    return PCMU.encode(pcm);
+}
+export function mulawDecodeArray(mulawBytes) {
+    return PCMU.decode(mulawBytes);
+}
+//# sourceMappingURL=g711.js.map

package/dist/codec/g711.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"g711.js","sourceRoot":"","sources":["../../src/codec/g711.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;GAWG;AACH,0EAA0E;AAC1E,2EAA2E;AAC3E,mEAAmE;AACnE,4EAA4E;AAC5E,mDAAmD;AACnD,OAAO,KAAK,KAAK,MAAM,wBAAwB,CAAC;AAChD,OAAO,KAAK,IAAI,MAAM,uBAAuB,CAAC;AAW9C,MAAM,CAAC,MAAM,IAAI,GAAU;IACzB,IAAI,EAAE,MAAM;IACZ,WAAW,EAAE,CAAC;IACd,UAAU,EAAE,IAAI;IAChB,QAAQ,EAAE,CAAC;IACX,MAAM,CAAC,KAAiB;QACtB,OAAO,KAAK,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC;IAC7B,CAAC;IACD,MAAM,CAAC,KAAiB;QACtB,OAAO,KAAK,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC;IAC7B,CAAC;CACF,CAAC;AAEF,MAAM,CAAC,MAAM,IAAI,GAAU;IACzB,IAAI,EAAE,MAAM;IACZ,WAAW,EAAE,CAAC;IACd,UAAU,EAAE,IAAI;IAChB,QAAQ,EAAE,CAAC;IACX,MAAM,CAAC,KAAiB;QACtB,OAAO,IAAI,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC;IAC5B,CAAC;IACD,MAAM,CAAC,KAAiB;QACtB,OAAO,IAAI,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC;IAC5B,CAAC;CACF,CAAC;AAEF,sEAAsE;AACtE,MAAM,UAAU,gBAAgB,CAAC,GAAe;IAC9C,OAAO,IAAI,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC;AAC1B,CAAC;AAED,MAAM,UAAU,gBAAgB,CAAC,UAAsB;IACrD,OAAO,IAAI,CAAC,MAAM,CAAC,UAAU,CAAC,CAAC;AACjC,CAAC"}

package/dist/errors.d.ts

@@ -0,0 +1,14 @@
+export declare class TransportError extends Error {
+    readonly cause?: Error | undefined;
+    constructor(message: string, cause?: Error | undefined);
+}
+export declare class TransportDisconnectedError extends TransportError {
+    constructor(message?: string, cause?: Error);
+}
+export declare class TransportProtocolError extends TransportError {
+    constructor(message: string, cause?: Error);
+}
+export declare class AudioConfigError extends TransportError {
+    constructor(message: string, cause?: Error);
+}
+//# sourceMappingURL=errors.d.ts.map

package/dist/errors.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"errors.d.ts","sourceRoot":"","sources":["../src/errors.ts"],"names":[],"mappings":"AAAA,qBAAa,cAAe,SAAQ,KAAK;aAGrB,KAAK,CAAC,EAAE,KAAK;gBAD7B,OAAO,EAAE,MAAM,EACC,KAAK,CAAC,EAAE,KAAK,YAAA;CAKhC;AAED,qBAAa,0BAA2B,SAAQ,cAAc;gBAChD,OAAO,GAAE,MAAsC,EAAE,KAAK,CAAC,EAAE,KAAK;CAI3E;AAED,qBAAa,sBAAuB,SAAQ,cAAc;gBAC5C,OAAO,EAAE,MAAM,EAAE,KAAK,CAAC,EAAE,KAAK;CAI3C;AAED,qBAAa,gBAAiB,SAAQ,cAAc;gBACtC,OAAO,EAAE,MAAM,EAAE,KAAK,CAAC,EAAE,KAAK;CAI3C"}

package/dist/errors.js

@@ -0,0 +1,27 @@
+export class TransportError extends Error {
+    cause;
+    constructor(message, cause) {
+        super(message);
+        this.cause = cause;
+        this.name = 'TransportError';
+    }
+}
+export class TransportDisconnectedError extends TransportError {
+    constructor(message = 'Transport connection closed', cause) {
+        super(message, cause);
+        this.name = 'TransportDisconnectedError';
+    }
+}
+export class TransportProtocolError extends TransportError {
+    constructor(message, cause) {
+        super(message, cause);
+        this.name = 'TransportProtocolError';
+    }
+}
+export class AudioConfigError extends TransportError {
+    constructor(message, cause) {
+        super(message, cause);
+        this.name = 'AudioConfigError';
+    }
+}
+//# sourceMappingURL=errors.js.map

package/dist/errors.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"errors.js","sourceRoot":"","sources":["../src/errors.ts"],"names":[],"mappings":"AAAA,MAAM,OAAO,cAAe,SAAQ,KAAK;IAGrB;IAFlB,YACE,OAAe,EACC,KAAa;QAE7B,KAAK,CAAC,OAAO,CAAC,CAAC;QAFC,UAAK,GAAL,KAAK,CAAQ;QAG7B,IAAI,CAAC,IAAI,GAAG,gBAAgB,CAAC;IAC/B,CAAC;CACF;AAED,MAAM,OAAO,0BAA2B,SAAQ,cAAc;IAC5D,YAAY,UAAkB,6BAA6B,EAAE,KAAa;QACxE,KAAK,CAAC,OAAO,EAAE,KAAK,CAAC,CAAC;QACtB,IAAI,CAAC,IAAI,GAAG,4BAA4B,CAAC;IAC3C,CAAC;CACF;AAED,MAAM,OAAO,sBAAuB,SAAQ,cAAc;IACxD,YAAY,OAAe,EAAE,KAAa;QACxC,KAAK,CAAC,OAAO,EAAE,KAAK,CAAC,CAAC;QACtB,IAAI,CAAC,IAAI,GAAG,wBAAwB,CAAC;IACvC,CAAC;CACF;AAED,MAAM,OAAO,gBAAiB,SAAQ,cAAc;IAClD,YAAY,OAAe,EAAE,KAAa;QACxC,KAAK,CAAC,OAAO,EAAE,KAAK,CAAC,CAAC;QACtB,IAAI,CAAC,IAAI,GAAG,kBAAkB,CAAC;IACjC,CAAC;CACF"}

package/dist/filler/FillerCoordinator.d.ts

@@ -0,0 +1,7 @@
+import type { voice } from '@livekit/agents';
+export declare class FillerCoordinator {
+    #private;
+    speakFiller(session: voice.AgentSession, filler: string): Promise<void>;
+    waitForActiveFillers(): Promise<void>;
+}
+//# sourceMappingURL=FillerCoordinator.d.ts.map

package/dist/filler/FillerCoordinator.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"FillerCoordinator.d.ts","sourceRoot":"","sources":["../../src/filler/FillerCoordinator.ts"],"names":[],"mappings":"AAAA,OAAO,KAAK,EAAE,KAAK,EAAE,MAAM,iBAAiB,CAAC;AAE7C,qBAAa,iBAAiB;;IAGtB,WAAW,CAAC,OAAO,EAAE,KAAK,CAAC,YAAY,EAAE,MAAM,EAAE,MAAM,GAAG,OAAO,CAAC,IAAI,CAAC;IAuBvE,oBAAoB,IAAI,OAAO,CAAC,IAAI,CAAC;CAO5C"}

package/dist/filler/FillerCoordinator.js

@@ -0,0 +1,29 @@
+export class FillerCoordinator {
+    #activeFillers = new Set();
+    async speakFiller(session, filler) {
+        const text = filler.trim();
+        if (!text) {
+            return;
+        }
+        const handle = session.say(text, {
+            allowInterruptions: true,
+            addToChatCtx: false,
+        });
+        const playout = handle
+            .waitForPlayout()
+            .catch(() => {
+            // Barge-in interruptions are expected and should not fail the pipeline.
+        })
+            .finally(() => {
+            this.#activeFillers.delete(playout);
+        });
+        this.#activeFillers.add(playout);
+    }
+    async waitForActiveFillers() {
+        if (this.#activeFillers.size === 0) {
+            return;
+        }
+        await Promise.allSettled([...this.#activeFillers]);
+    }
+}
+//# sourceMappingURL=FillerCoordinator.js.map

package/dist/filler/FillerCoordinator.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"FillerCoordinator.js","sourceRoot":"","sources":["../../src/filler/FillerCoordinator.ts"],"names":[],"mappings":"AAEA,MAAM,OAAO,iBAAiB;IAC5B,cAAc,GAAuB,IAAI,GAAG,EAAE,CAAC;IAE/C,KAAK,CAAC,WAAW,CAAC,OAA2B,EAAE,MAAc;QAC3D,MAAM,IAAI,GAAG,MAAM,CAAC,IAAI,EAAE,CAAC;QAC3B,IAAI,CAAC,IAAI,EAAE,CAAC;YACV,OAAO;QACT,CAAC;QAED,MAAM,MAAM,GAAG,OAAO,CAAC,GAAG,CAAC,IAAI,EAAE;YAC/B,kBAAkB,EAAE,IAAI;YACxB,YAAY,EAAE,KAAK;SACpB,CAAC,CAAC;QAEH,MAAM,OAAO,GAAG,MAAM;aACnB,cAAc,EAAE;aAChB,KAAK,CAAC,GAAG,EAAE;YACV,wEAAwE;QAC1E,CAAC,CAAC;aACD,OAAO,CAAC,GAAG,EAAE;YACZ,IAAI,CAAC,cAAc,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC;QACtC,CAAC,CAAC,CAAC;QAEL,IAAI,CAAC,cAAc,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC;IACnC,CAAC;IAED,KAAK,CAAC,oBAAoB;QACxB,IAAI,IAAI,CAAC,cAAc,CAAC,IAAI,KAAK,CAAC,EAAE,CAAC;YACnC,OAAO;QACT,CAAC;QAED,MAAM,OAAO,CAAC,UAAU,CAAC,CAAC,GAAG,IAAI,CAAC,cAAc,CAAC,CAAC,CAAC;IACrD,CAAC;CACF"}

package/dist/gemini/filler.d.ts

@@ -0,0 +1,14 @@
+export interface ParsedFillerResponse {
+    transcript: string;
+    filler: string;
+    parsedAsJson: boolean;
+}
+export interface BuildFillerInstructionOptions {
+    baseInstruction?: string;
+    fillerPrompt?: string;
+    fillerMinTranscriptLength: number;
+}
+export declare const DEFAULT_FILLER_PROMPT: string;
+export declare function buildFillerInstruction(opts: BuildFillerInstructionOptions): string;
+export declare function parseFillerResponse(raw: string): ParsedFillerResponse;
+//# sourceMappingURL=filler.d.ts.map

package/dist/gemini/filler.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"filler.d.ts","sourceRoot":"","sources":["../../src/gemini/filler.ts"],"names":[],"mappings":"AAAA,MAAM,WAAW,oBAAoB;IACnC,UAAU,EAAE,MAAM,CAAC;IACnB,MAAM,EAAE,MAAM,CAAC;IACf,YAAY,EAAE,OAAO,CAAC;CACvB;AAED,MAAM,WAAW,6BAA6B;IAC5C,eAAe,CAAC,EAAE,MAAM,CAAC;IACzB,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,yBAAyB,EAAE,MAAM,CAAC;CACnC;AAED,eAAO,MAAM,qBAAqB,QAStB,CAAC;AAEb,wBAAgB,sBAAsB,CAAC,IAAI,EAAE,6BAA6B,GAAG,MAAM,CAWlF;AAED,wBAAgB,mBAAmB,CAAC,GAAG,EAAE,MAAM,GAAG,oBAAoB,CA2BrE"}

package/dist/gemini/filler.js

@@ -0,0 +1,48 @@
+export const DEFAULT_FILLER_PROMPT = [
+    'You are a speech transcription service for a voice assistant.',
+    'Return STRICT JSON only in this schema:',
+    '{"transcript":"<exact user speech>","filler":"<short natural acknowledgement>"}',
+    'Rules for filler:',
+    '- Keep it to one short sentence.',
+    '- Do not invent facts or outcomes.',
+    '- Use empty string for very short replies (yes/no/okay).',
+    '- Keep tone conversational and neutral.',
+].join('\n');
+export function buildFillerInstruction(opts) {
+    const prefix = opts.baseInstruction?.trim();
+    const prompt = (opts.fillerPrompt?.trim() || DEFAULT_FILLER_PROMPT).trim();
+    return [
+        prefix,
+        prompt,
+        `Emit empty filler when transcript length is below ${opts.fillerMinTranscriptLength} characters.`,
+    ]
+        .filter(Boolean)
+        .join('\n\n');
+}
+export function parseFillerResponse(raw) {
+    const text = raw.trim();
+    if (!text) {
+        return { transcript: '', filler: '', parsedAsJson: false };
+    }
+    try {
+        const parsed = JSON.parse(text);
+        const transcript = typeof parsed.transcript === 'string' ? parsed.transcript.trim() : '';
+        const filler = typeof parsed.filler === 'string' ? parsed.filler.trim() : '';
+        if (!transcript) {
+            return { transcript: text, filler: '', parsedAsJson: false };
+        }
+        return {
+            transcript,
+            filler,
+            parsedAsJson: true,
+        };
+    }
+    catch {
+        return {
+            transcript: text,
+            filler: '',
+            parsedAsJson: false,
+        };
+    }
+}
+//# sourceMappingURL=filler.js.map

package/dist/gemini/filler.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"filler.js","sourceRoot":"","sources":["../../src/gemini/filler.ts"],"names":[],"mappings":"AAYA,MAAM,CAAC,MAAM,qBAAqB,GAAG;IACnC,+DAA+D;IAC/D,yCAAyC;IACzC,iFAAiF;IACjF,mBAAmB;IACnB,kCAAkC;IAClC,oCAAoC;IACpC,0DAA0D;IAC1D,yCAAyC;CAC1C,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;AAEb,MAAM,UAAU,sBAAsB,CAAC,IAAmC;IACxE,MAAM,MAAM,GAAG,IAAI,CAAC,eAAe,EAAE,IAAI,EAAE,CAAC;IAC5C,MAAM,MAAM,GAAG,CAAC,IAAI,CAAC,YAAY,EAAE,IAAI,EAAE,IAAI,qBAAqB,CAAC,CAAC,IAAI,EAAE,CAAC;IAE3E,OAAO;QACL,MAAM;QACN,MAAM;QACN,qDAAqD,IAAI,CAAC,yBAAyB,cAAc;KAClG;SACE,MAAM,CAAC,OAAO,CAAC;SACf,IAAI,CAAC,MAAM,CAAC,CAAC;AAClB,CAAC;AAED,MAAM,UAAU,mBAAmB,CAAC,GAAW;IAC7C,MAAM,IAAI,GAAG,GAAG,CAAC,IAAI,EAAE,CAAC;IACxB,IAAI,CAAC,IAAI,EAAE,CAAC;QACV,OAAO,EAAE,UAAU,EAAE,EAAE,EAAE,MAAM,EAAE,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC;IAC7D,CAAC;IAED,IAAI,CAAC;QACH,MAAM,MAAM,GAAG,IAAI,CAAC,KAAK,CAAC,IAAI,CAA+C,CAAC;QAC9E,MAAM,UAAU,GAAG,OAAO,MAAM,CAAC,UAAU,KAAK,QAAQ,CAAC,CAAC,CAAC,MAAM,CAAC,UAAU,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;QACzF,MAAM,MAAM,GAAG,OAAO,MAAM,CAAC,MAAM,KAAK,QAAQ,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,IAAI,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;QAE7E,IAAI,CAAC,UAAU,EAAE,CAAC;YAChB,OAAO,EAAE,UAAU,EAAE,IAAI,EAAE,MAAM,EAAE,EAAE,EAAE,YAAY,EAAE,KAAK,EAAE,CAAC;QAC/D,CAAC;QAED,OAAO;YACL,UAAU;YACV,MAAM;YACN,YAAY,EAAE,IAAI;SACnB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO;YACL,UAAU,EAAE,IAAI;YAChB,MAAM,EAAE,EAAE;YACV,YAAY,EAAE,KAAK;SACpB,CAAC;IACJ,CAAC;AACH,CAAC"}

package/dist/gemini/index.d.ts

@@ -0,0 +1,4 @@
+export { GeminiLiveSTT, GeminiLiveSpeechStream, type GeminiLiveSTTOptions, type GeminiFillerEvent, type GeminiFillerPayload, type GeminiLiveClient, type GeminiLiveSession, } from './stt.js';
+export { GeminiLiveTTS, GeminiLiveSynthesizeStream, GeminiLiveChunkedStream, type GeminiLiveTTSOptions, type GeminiVoice, } from './tts.js';
+export { DEFAULT_FILLER_PROMPT, buildFillerInstruction, parseFillerResponse, type ParsedFillerResponse, type BuildFillerInstructionOptions, } from './filler.js';
+//# sourceMappingURL=index.d.ts.map

package/dist/gemini/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/gemini/index.ts"],"names":[],"mappings":"AAAA,OAAO,EACL,aAAa,EACb,sBAAsB,EACtB,KAAK,oBAAoB,EACzB,KAAK,iBAAiB,EACtB,KAAK,mBAAmB,EACxB,KAAK,gBAAgB,EACrB,KAAK,iBAAiB,GACvB,MAAM,UAAU,CAAC;AAElB,OAAO,EACL,aAAa,EACb,0BAA0B,EAC1B,uBAAuB,EACvB,KAAK,oBAAoB,EACzB,KAAK,WAAW,GACjB,MAAM,UAAU,CAAC;AAElB,OAAO,EACL,qBAAqB,EACrB,sBAAsB,EACtB,mBAAmB,EACnB,KAAK,oBAAoB,EACzB,KAAK,6BAA6B,GACnC,MAAM,aAAa,CAAC"}

package/dist/gemini/index.js

@@ -0,0 +1,4 @@
+export { GeminiLiveSTT, GeminiLiveSpeechStream, } from './stt.js';
+export { GeminiLiveTTS, GeminiLiveSynthesizeStream, GeminiLiveChunkedStream, } from './tts.js';
+export { DEFAULT_FILLER_PROMPT, buildFillerInstruction, parseFillerResponse, } from './filler.js';
+//# sourceMappingURL=index.js.map

package/dist/gemini/index.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.js","sourceRoot":"","sources":["../../src/gemini/index.ts"],"names":[],"mappings":"AAAA,OAAO,EACL,aAAa,EACb,sBAAsB,GAMvB,MAAM,UAAU,CAAC;AAElB,OAAO,EACL,aAAa,EACb,0BAA0B,EAC1B,uBAAuB,GAGxB,MAAM,UAAU,CAAC;AAElB,OAAO,EACL,qBAAqB,EACrB,sBAAsB,EACtB,mBAAmB,GAGpB,MAAM,aAAa,CAAC"}