@convai/web-sdk 1.7.0-beta.0 → 1.7.0-beta.1

package/README.md

@@ -2,7 +2,7 @@
 
 **Real-time conversational AI characters for the web.**
 
-[![npm](https://img.shields.io/badge/npm-1.6.0--beta-blue)](https://www.npmjs.com/package/@convai/web-sdk)
+[![npm](https://img.shields.io/badge/npm-1.7.0-blue)](https://www.npmjs.com/package/@convai/web-sdk)
 [![TypeScript](https://img.shields.io/badge/TypeScript-first-3178C6)](https://www.typescriptlang.org/)
 [![License](https://img.shields.io/badge/license-Apache--2.0-green)](./LICENSE)
 
@@ -10,14 +10,18 @@ TypeScript-first SDK for embedding Convai AI characters into React and vanilla J
 
 ---
 
-## What's new in 1.6.0
+## What's new in 1.7.0
 
-> Currently in beta — `npm install @convai/web-sdk@beta`. Stable 1.6.0 follows.
+- **Character state of mind** — set a temporary generation mood with the `stateOfMind` config option, and change it mid-session with `updateEmotion()` without triggering a response. [Usage below.](#character-state-of-mind)
+- **Send-ahead enabled by default** — NeuroSync lipsync ahead-delivery is now on by default, reversing the 1.6.0 opt-in. Fall back to the legacy paced path with `blendshapeConfig.deliver_chunks_ahead: false`.
+- **Lipsync naturalness pipeline** — modular naturalness processing with a tuned MetaHuman profile.
+- **Adaptive glass widget styling** — `ConvaiWidget` adapts to light and dark backgrounds.
+
+### Previously in 1.6.0
 
 - **Narrative Design template keys** — personalize one narrative graph per session: seed values at connect with the `narrativeTemplateKeys` config option, replace them mid-session with `updateTemplateKeys()`. [Usage below.](#narrative-design-template-keys)
 - **Typed parameterized actions** — `actionResponse` is now typed via the exported `ConvaiAction` / `ActionResponseEvent`, including the `target` of parameterized actions. [Usage below.](#actions)
 - **Vision dynamic context** — camera, screen, canvas, and custom tracks feed unified vision context on WebRTC, with hardened WebSocket vision handling. [Usage below.](#vision-dynamic-context-beta)
-- **Send-ahead disabled by default** — lipsync send-ahead is now opt-in.
 
 ---
 
@@ -26,7 +30,7 @@ TypeScript-first SDK for embedding Convai AI characters into React and vanilla J
 - **React & vanilla JS** — `useConvaiClient` hook, `ConvaiWidget`, and a framework-agnostic core
 - **Real-time audio/video** — full-duplex WebRTC with echo cancellation, camera, and screen share
 - **Lipsync** — ARKit and MetaHuman blendshape streams for facial animation
-- **Emotions** — per-turn emotion detection with intensity scale
+- **Emotions & state of mind** — per-turn emotion detection with intensity scale, plus a settable generation mood
 - **Dynamic context & vision** — inject text state, scene metadata, and LiveKit video frames mid-session
 - **Actions & Narrative Design** — typed action decisions with parameterized targets, named triggers, and per-session template keys
 - **Long-term memory** — persistent cross-session memories scoped to each end user
@@ -101,7 +105,7 @@ Full documentation is at **<a href="https://docs.convai.com/api-docs/plugins-and
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk" target="_blank" rel="noopener noreferrer">Vanilla JS</a>                                    | `ConvaiClient`, `createConvaiWidget`, and audio setup                                              |
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/event-reference" target="_blank" rel="noopener noreferrer">Events</a>                        | Full event reference — `botReady`, `stateChange`, `messagesChange`, `interactionCreated`, and more |
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/dynamic-context" target="_blank" rel="noopener noreferrer">Context Management</a>            | Dynamic context, `updateContext`, file upload, session management                                  |
-| <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/emotions" target="_blank" rel="noopener noreferrer">Emotions</a>                             | Per-turn emotion detection with provider options                                                   |
+| <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/emotions" target="_blank" rel="noopener noreferrer">Emotions</a>                             | Per-turn emotion detection, provider options, and `stateOfMind` / `updateEmotion()`                 |
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk" target="_blank" rel="noopener noreferrer">Lipsync</a>                                       | ARKit / MetaHuman blendshape streams and `BlendshapeQueue` API                                     |
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/actions" target="_blank" rel="noopener noreferrer">Actions</a>                               | Trigger character behaviors and scene actions                                                      |
 | <a href="https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/long-term-memory" target="_blank" rel="noopener noreferrer">Memory</a>                       | Long-term memory scoped to end users                                                               |
@@ -236,6 +240,36 @@ Requires Narrative Design on the character; `updateTemplateKeys` is a full repla
 
 ---
 
+## Character state of mind
+
+Set a temporary generation mood that shapes tone and pacing for the next response. This is separate from `enableEmotion`, which reports the character's detected emotion *after* a turn.
+
+```ts
+const client = new ConvaiClient({
+  apiKey: "...",
+  characterId: "...",
+  stateOfMind: "anticipation",
+});
+
+// Mid-session. Affects the next response; does not trigger one.
+client.updateEmotion("joy");
+client.updateEmotion(null); // clear — "neutral" and "" clear it too
+```
+
+Values are trimmed and lowercased. The runtime value carries into the next connect, including a reconnect; an explicit `stateOfMind` in the connect config takes precedence.
+
+Requires backend support — live on production as of 2026-08-20. On a backend without it, the server replies with an `Unknown message type` error on `serverResponse`. Because `/connect` silently ignores unknown fields, a successful connect alone does not prove `state_of_mind` was applied, so watch the ack:
+
+```ts
+client.on("serverResponse", (r) => {
+  if (r.event_type === "update-emotion" && r.status !== "success") {
+    console.warn("state of mind unsupported by this backend:", r.message);
+  }
+});
+```
+
+---
+
 ## License
 
 Licensed under the [Apache License 2.0](./LICENSE). Copyright 2025 Convai.

package/dist/core/ConvaiClient.d.ts

@@ -1,5 +1,5 @@
 import { Room } from "livekit-client";
-import { ConvaiConfig, ConvaiClientState, ChatMessage, IConvaiClient, AudioControls, VideoControls, ScreenShareControls, DynamicInfo, ContextUpdateOptions, UploadFileOptions, WebSocketSessionFactory, RespondModeUpdateOptions, UpdateSceneMetadataOptions, VisionStatusOptions, VisionTriggerOptions, ConvaiCharacterInstance, UpdateCharacterRosterOptions, CharacterRosterChange } from "./types";
+import { ConvaiConfig, ConvaiClientState, ChatMessage, IConvaiClient, AudioControls, VideoControls, ScreenShareControls, DynamicInfo, ContextUpdateOptions, UploadFileOptions, WebSocketSessionFactory, RespondModeUpdateOptions, UpdateSceneMetadataOptions, VisionStatusOptions, VisionTriggerOptions } from "./types";
 import { EventEmitter } from "./EventEmitter";
 import { BlendshapeQueue } from "./BlendshapeQueue";
 import { MemoryManager } from "./MemoryManager";
@@ -46,7 +46,6 @@ export declare class ConvaiClient extends EventEmitter implements IConvaiClient
     private _apiKey;
     private _authToken;
     private _characterId;
-    private _speakerId;
     private _characterSessionId;
     private _isBotReady;
     private _participantSid;
@@ -57,11 +56,6 @@ export declare class ConvaiClient extends EventEmitter implements IConvaiClient
      * so updateEmotion() called before any config is stored is not lost.
      */
     private _stateOfMind;
-    /** Roster state for multi-character rooms. Empty for single-character sessions. */
-    private _roster;
-    /** Pending setInteractionTarget/updateCharacterRoster commands, keyed by command_id. */
-    private _pendingRosterCommands;
-    private _rosterCommandSeq;
     private _endUserId;
     private _endUserMetadata;
     private _wsSession;
@@ -93,7 +87,6 @@ export declare class ConvaiClient extends EventEmitter implements IConvaiClient
     get apiKey(): string | null;
     get authToken(): string | null;
     get characterId(): string | null;
-    get speakerId(): string | null;
     get room(): Room;
     get chatMessages(): ChatMessage[];
     get userTranscription(): string;
@@ -224,29 +217,6 @@ export declare class ConvaiClient extends EventEmitter implements IConvaiClient
      * This is silent: it affects the next response and does not trigger one.
      */
     updateEmotion(stateOfMind: string | null): void;
-    /** Timeout for a roster command to be acknowledged by the server. */
-    private static readonly ROSTER_COMMAND_TIMEOUT_MS;
-    /**
-     * Correlate interaction-target / character-roster-update acks back to the
-     * promise returned by the method that issued them, and keep roster state and
-     * the two roster events in sync — including for changes we did not initiate.
-     */
-    private _handleRosterServerResponse;
-    /**
-     * Publish a roster command and resolve when its ack arrives.
-     */
-    private _sendRosterCommand;
-    /**
-     * Route subsequent user turns to a different character instance.
-     *
-     * Retries once against the server's authoritative epoch if the routing epoch
-     * was stale, which happens when another participant switched first.
-     */
-    setInteractionTarget(membershipId: string): Promise<ConvaiCharacterInstance>;
-    /**
-     * Add or remove character instances on a live room, without reconnecting.
-     */
-    updateCharacterRoster(options: UpdateCharacterRosterOptions): Promise<CharacterRosterChange>;
     /**
      * Send descriptive scene updates. Use when environment description changes
      * and the bot should know what is visible or nearby. Does not modify action_config.

package/dist/core/ConvaiClient.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"ConvaiClient.d.ts","sourceRoot":"","sources":["../../src/core/ConvaiClient.ts"],"names":[],"mappings":"AAAA,OAAO,EACL,IAAI,EAML,MAAM,gBAAgB,CAAC;AAGxB,OAAO,EACL,YAAY,EACZ,iBAAiB,EACjB,WAAW,EAEX,aAAa,EACb,aAAa,EACb,aAAa,EACb,mBAAmB,EACnB,WAAW,EACX,oBAAoB,EACpB,iBAAiB,EAIjB,uBAAuB,EACvB,wBAAwB,EAExB,0BAA0B,EAC1B,mBAAmB,EACnB,oBAAoB,EAGpB,uBAAuB,EACvB,4BAA4B,EAC5B,qBAAqB,EAEtB,MAAM,SAAS,CAAC;AAMjB,OAAO,EAAE,YAAY,EAAE,MAAM,gBAAgB,CAAC;AAC9C,OAAO,EAAE,eAAe,EAAE,MAAM,mBAAmB,CAAC;AACpD,OAAO,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AA8BhD;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAmCG;AACH,qBAAa,YAAa,SAAQ,YAAa,YAAW,aAAa;IACrE,OAAO,CAAC,KAAK,CAAO;IACpB,OAAO,CAAC,MAAM,CAAoB;IAClC,OAAO,CAAC,eAAe,CAAkC;IACzD,OAAO,CAAC,OAAO,CAAuB;IACtC,OAAO,CAAC,UAAU,CAAuB;IACzC,OAAO,CAAC,YAAY,CAAuB;IAC3C,OAAO,CAAC,UAAU,CAAuB;IACzC,OAAO,CAAC,mBAAmB,CAAuB;IAClD,OAAO,CAAC,WAAW,CAAkB;IACrC,OAAO,CAAC,eAAe,CAAc;IACrC,OAAO,CAAC,cAAc,CAAgB;IACtC,OAAO,CAAC,aAAa,CAA6B;IAClD;;;OAGG;IACH,OAAO,CAAC,YAAY,CAAuB;IAC3C,mFAAmF;IACnF,OAAO,CAAC,OAAO,CAAyB;IACxC,wFAAwF;IACxF,OAAO,CAAC,sBAAsB,CAO1B;IACJ,OAAO,CAAC,iBAAiB,CAAK;IAC9B,OAAO,CAAC,UAAU,CAAuB;IACzC,OAAO,CAAC,gBAAgB,CAAwC;IAChE,OAAO,CAAC,UAAU,CAAkC;IACpD,OAAO,CAAC,gBAAgB,CAAwC;IAChE,OAAO,CAAC,gBAAgB,CAAiB;IACzC,OAAO,CAAC,gBAAgB,CAAkB;IAG1C,OAAO,CAAC,sBAAsB,CAA8C;IAC5E,OAAO,CAAC,wBAAwB,CAA8C;IAC9E,OAAO,CAAC,iBAAiB,CAAuB;IAChD,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,qBAAqB,CAAO;IACpD,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,uBAAuB,CAAU;IAEzD;;;;OAIG;IACH,MAAM,CAAC,0BAA0B,CAAC,OAAO,EAAE,uBAAuB,GAAG,IAAI;IAKzE,OAAO,CAAC,aAAa,CAAe;IACpC,OAAO,CAAC,aAAa,CAAe;IACpC,OAAO,CAAC,mBAAmB,CAAqB;IAChD,OAAO,CAAC,eAAe,CAAiB;IACxC,OAAO,CAAC,uBAAuB,CAAyB;IAGxD,OAAO,CAAC,sBAAsB,CAAa;IAC3C,OAAO,CAAC,sBAAsB,CAAa;IAG3C,OAAO,CAAC,cAAc,CAA8B;gBAExC,MAAM,CAAC,EAAE,YAAY;IAiEjC,IAAI,KAAK,IAAI,iBAAiB,CAE7B;IAED,IAAI,cAAc,IAAI,OAAO,GAAG,OAAO,GAAG,IAAI,CAE7C;IAED,IAAI,MAAM,IAAI,MAAM,GAAG,IAAI,CAE1B;IAED,IAAI,SAAS,IAAI,MAAM,GAAG,IAAI,CAE7B;IAED,IAAI,WAAW,IAAI,MAAM,GAAG,IAAI,CAE/B;IAED,IAAI,SAAS,IAAI,MAAM,GAAG,IAAI,CAE7B;IAED,IAAI,IAAI,IAAI,IAAI,CAEf;IAED,IAAI,YAAY,IAAI,WAAW,EAAE,CAEhC;IAED,IAAI,iBAAiB,IAAI,MAAM,CAE9B;IAED,IAAI,kBAAkB,IAAI,MAAM,GAAG,IAAI,CAEtC;IAED,IAAI,UAAU,IAAI,OAAO,CAExB;IAED,IAAI,aAAa,IAAI,aAAa,CAEjC;IAED,IAAI,aAAa,IAAI,aAAa,CAEjC;IAED,IAAI,mBAAmB,IAAI,mBAAmB,CAE7C;IAED,IAAI,eAAe,IAAI,eAAe,CAErC;IAED,IAAI,qBAAqB,IAAI,MAAM,CAElC;IAED,IAAI,aAAa,IAAI,aAAa,GAAG,IAAI,CAExC;IAED;;OAEG;IACH,OAAO,CAAC,mBAAmB;IA8L3B;;;;OAIG;IACH,OAAO,CAAC,yBAAyB;IASjC;;OAEG;IACH,OAAO,CAAC,WAAW;IAuBnB;;;;OAIG;IACH,OAAO,CAAC,cAAc;IAkBtB;;OAEG;IACH,OAAO,CAAC,gBAAgB;IASxB;;OAEG;IACG,OAAO,CAAC,MAAM,CAAC,EAAE,YAAY,GAAG,OAAO,CAAC,IAAI,CAAC;YA6brC,0CAA0C;IAgBxD;;;;;OAKG;IACH,OAAO,CAAC,0BAA0B;IAgDlC,OAAO,CAAC,yBAAyB;IAWjC;;OAEG;IACG,UAAU,IAAI,OAAO,CAAC,IAAI,CAAC;IA6BjC;;OAEG;IACH,OAAO,CAAC,gBAAgB;IAkBxB;;OAEG;IACG,SAAS,IAAI,OAAO,CAAC,IAAI,CAAC;IAOhC;;OAEG;IACH,YAAY,IAAI,IAAI;IAOpB;;OAEG;IACH,mBAAmB,CAAC,IAAI,EAAE,MAAM,GAAG,IAAI;IAmCvC;;OAEG;IACH,kBAAkB,CAAC,WAAW,CAAC,EAAE,MAAM,EAAE,cAAc,CAAC,EAAE,MAAM,GAAG,IAAI;IA2BvE;;;;OAIG;IACH,OAAO,CAAC,8BAA8B;IAmBtC,OAAO,CAAC,wBAAwB;IAkBhC;;OAEG;IACH,oBAAoB,IAAI,IAAI;IAwB5B;;;;OAIG;IACH,kBAAkB,CAAC,YAAY,EAAE;QAAE,CAAC,GAAG,EAAE,MAAM,GAAG,MAAM,CAAA;KAAE,GAAG,IAAI;IAUjE;;OAEG;IACH,iBAAiB,CAAC,WAAW,EAAE,WAAW,GAAG,IAAI;IASjD;;;;;;;;;;;;;;;;;;;;;;;;;OAyBG;IACH,aAAa,CAAC,OAAO,EAAE,oBAAoB,GAAG,IAAI;IAmClD,YAAY,CAAC,OAAO,GAAE,mBAAwB,GAAG,MAAM,GAAG,IAAI;IAU9D,aAAa,CAAC,OAAO,GAAE,oBAAyB,GAAG,MAAM,GAAG,IAAI;IAkBhE,iBAAiB,CAAC,OAAO,EAAE,wBAAwB,GAAG,MAAM,GAAG,IAAI;IAYnE;;;OAGG;IACH,aAAa,CAAC,WAAW,EAAE,MAAM,GAAG,IAAI,GAAG,IAAI;IAiB/C,qEAAqE;IACrE,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,yBAAyB,CAAS;IAE1D;;;;OAIG;IACH,OAAO,CAAC,2BAA2B;IA6DnC;;OAEG;IACH,OAAO,CAAC,kBAAkB;IA4B1B;;;;;OAKG;IACG,oBAAoB,CACxB,YAAY,EAAE,MAAM,GACnB,OAAO,CAAC,uBAAuB,CAAC;IAkCnC;;OAEG;IACG,qBAAqB,CACzB,OAAO,EAAE,4BAA4B,GACpC,OAAO,CAAC,qBAAqB,CAAC;IAoCjC;;;OAGG;IACH,mBAAmB,CACjB,KAAK,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,WAAW,EAAE,MAAM,CAAA;KAAE,CAAC,EACnD,OAAO,GAAE,0BAA+B,GACvC,IAAI;IAaP,OAAO,CAAC,cAAc;IAOtB,OAAO,CAAC,qBAAqB;IAe7B;;;;;OAKG;IACG,UAAU,CAAC,IAAI,EAAE,IAAI,EAAE,OAAO,GAAE,iBAAsB,GAAG,OAAO,CAAC,IAAI,CAAC;IAgB5E;;OAEG;IACH,SAAS,CAAC,OAAO,EAAE,OAAO,GAAG,IAAI;IAKjC;;OAEG;IACH,SAAS,CAAC,OAAO,EAAE,OAAO,GAAG,IAAI;IAKjC;;;;OAIG;IACH,cAAc,IAAI,IAAI;CAMvB"}
+{"version":3,"file":"ConvaiClient.d.ts","sourceRoot":"","sources":["../../src/core/ConvaiClient.ts"],"names":[],"mappings":"AAAA,OAAO,EACL,IAAI,EAML,MAAM,gBAAgB,CAAC;AAGxB,OAAO,EACL,YAAY,EACZ,iBAAiB,EACjB,WAAW,EAEX,aAAa,EACb,aAAa,EACb,aAAa,EACb,mBAAmB,EACnB,WAAW,EACX,oBAAoB,EACpB,iBAAiB,EAIjB,uBAAuB,EACvB,wBAAwB,EAExB,0BAA0B,EAC1B,mBAAmB,EACnB,oBAAoB,EAGrB,MAAM,SAAS,CAAC;AAMjB,OAAO,EAAE,YAAY,EAAE,MAAM,gBAAgB,CAAC;AAC9C,OAAO,EAAE,eAAe,EAAE,MAAM,mBAAmB,CAAC;AACpD,OAAO,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AA8BhD;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAmCG;AACH,qBAAa,YAAa,SAAQ,YAAa,YAAW,aAAa;IACrE,OAAO,CAAC,KAAK,CAAO;IACpB,OAAO,CAAC,MAAM,CAAoB;IAClC,OAAO,CAAC,eAAe,CAAkC;IACzD,OAAO,CAAC,OAAO,CAAuB;IACtC,OAAO,CAAC,UAAU,CAAuB;IACzC,OAAO,CAAC,YAAY,CAAuB;IAC3C,OAAO,CAAC,mBAAmB,CAAuB;IAClD,OAAO,CAAC,WAAW,CAAkB;IACrC,OAAO,CAAC,eAAe,CAAc;IACrC,OAAO,CAAC,cAAc,CAAgB;IACtC,OAAO,CAAC,aAAa,CAA6B;IAClD;;;OAGG;IACH,OAAO,CAAC,YAAY,CAAuB;IAC3C,OAAO,CAAC,UAAU,CAAuB;IACzC,OAAO,CAAC,gBAAgB,CAAwC;IAChE,OAAO,CAAC,UAAU,CAAkC;IACpD,OAAO,CAAC,gBAAgB,CAAwC;IAChE,OAAO,CAAC,gBAAgB,CAAiB;IACzC,OAAO,CAAC,gBAAgB,CAAkB;IAG1C,OAAO,CAAC,sBAAsB,CAA8C;IAC5E,OAAO,CAAC,wBAAwB,CAA8C;IAC9E,OAAO,CAAC,iBAAiB,CAAuB;IAChD,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,qBAAqB,CAAO;IACpD,OAAO,CAAC,MAAM,CAAC,QAAQ,CAAC,uBAAuB,CAAU;IAEzD;;;;OAIG;IACH,MAAM,CAAC,0BAA0B,CAAC,OAAO,EAAE,uBAAuB,GAAG,IAAI;IAKzE,OAAO,CAAC,aAAa,CAAe;IACpC,OAAO,CAAC,aAAa,CAAe;IACpC,OAAO,CAAC,mBAAmB,CAAqB;IAChD,OAAO,CAAC,eAAe,CAAiB;IACxC,OAAO,CAAC,uBAAuB,CAAyB;IAGxD,OAAO,CAAC,sBAAsB,CAAa;IAC3C,OAAO,CAAC,sBAAsB,CAAa;IAG3C,OAAO,CAAC,cAAc,CAA8B;gBAExC,MAAM,CAAC,EAAE,YAAY;IA+DjC,IAAI,KAAK,IAAI,iBAAiB,CAE7B;IAED,IAAI,cAAc,IAAI,OAAO,GAAG,OAAO,GAAG,IAAI,CAE7C;IAED,IAAI,MAAM,IAAI,MAAM,GAAG,IAAI,CAE1B;IAED,IAAI,SAAS,IAAI,MAAM,GAAG,IAAI,CAE7B;IAED,IAAI,WAAW,IAAI,MAAM,GAAG,IAAI,CAE/B;IAED,IAAI,IAAI,IAAI,IAAI,CAEf;IAED,IAAI,YAAY,IAAI,WAAW,EAAE,CAEhC;IAED,IAAI,iBAAiB,IAAI,MAAM,CAE9B;IAED,IAAI,kBAAkB,IAAI,MAAM,GAAG,IAAI,CAEtC;IAED,IAAI,UAAU,IAAI,OAAO,CAExB;IAED,IAAI,aAAa,IAAI,aAAa,CAEjC;IAED,IAAI,aAAa,IAAI,aAAa,CAEjC;IAED,IAAI,mBAAmB,IAAI,mBAAmB,CAE7C;IAED,IAAI,eAAe,IAAI,eAAe,CAErC;IAED,IAAI,qBAAqB,IAAI,MAAM,CAElC;IAED,IAAI,aAAa,IAAI,aAAa,GAAG,IAAI,CAExC;IAED;;OAEG;IACH,OAAO,CAAC,mBAAmB;IAqL3B;;;;OAIG;IACH,OAAO,CAAC,yBAAyB;IASjC;;OAEG;IACH,OAAO,CAAC,WAAW;IAuBnB;;;;OAIG;IACH,OAAO,CAAC,cAAc;IActB;;OAEG;IACH,OAAO,CAAC,gBAAgB;IASxB;;OAEG;IACG,OAAO,CAAC,MAAM,CAAC,EAAE,YAAY,GAAG,OAAO,CAAC,IAAI,CAAC;YAyZrC,0CAA0C;IAgBxD;;;;;OAKG;IACH,OAAO,CAAC,0BAA0B;IAgDlC,OAAO,CAAC,yBAAyB;IAWjC;;OAEG;IACG,UAAU,IAAI,OAAO,CAAC,IAAI,CAAC;IA6BjC;;OAEG;IACH,OAAO,CAAC,gBAAgB;IAiBxB;;OAEG;IACG,SAAS,IAAI,OAAO,CAAC,IAAI,CAAC;IAOhC;;OAEG;IACH,YAAY,IAAI,IAAI;IAOpB;;OAEG;IACH,mBAAmB,CAAC,IAAI,EAAE,MAAM,GAAG,IAAI;IAmCvC;;OAEG;IACH,kBAAkB,CAAC,WAAW,CAAC,EAAE,MAAM,EAAE,cAAc,CAAC,EAAE,MAAM,GAAG,IAAI;IA2BvE;;;;OAIG;IACH,OAAO,CAAC,8BAA8B;IAmBtC,OAAO,CAAC,wBAAwB;IAkBhC;;OAEG;IACH,oBAAoB,IAAI,IAAI;IAwB5B;;;;OAIG;IACH,kBAAkB,CAAC,YAAY,EAAE;QAAE,CAAC,GAAG,EAAE,MAAM,GAAG,MAAM,CAAA;KAAE,GAAG,IAAI;IAUjE;;OAEG;IACH,iBAAiB,CAAC,WAAW,EAAE,WAAW,GAAG,IAAI;IASjD;;;;;;;;;;;;;;;;;;;;;;;;;OAyBG;IACH,aAAa,CAAC,OAAO,EAAE,oBAAoB,GAAG,IAAI;IAmClD,YAAY,CAAC,OAAO,GAAE,mBAAwB,GAAG,MAAM,GAAG,IAAI;IAU9D,aAAa,CAAC,OAAO,GAAE,oBAAyB,GAAG,MAAM,GAAG,IAAI;IAkBhE,iBAAiB,CAAC,OAAO,EAAE,wBAAwB,GAAG,MAAM,GAAG,IAAI;IAYnE;;;OAGG;IACH,aAAa,CAAC,WAAW,EAAE,MAAM,GAAG,IAAI,GAAG,IAAI;IAiB/C;;;OAGG;IACH,mBAAmB,CACjB,KAAK,EAAE,KAAK,CAAC;QAAE,IAAI,EAAE,MAAM,CAAC;QAAC,WAAW,EAAE,MAAM,CAAA;KAAE,CAAC,EACnD,OAAO,GAAE,0BAA+B,GACvC,IAAI;IAaP,OAAO,CAAC,cAAc;IAOtB,OAAO,CAAC,qBAAqB;IAe7B;;;;;OAKG;IACG,UAAU,CAAC,IAAI,EAAE,IAAI,EAAE,OAAO,GAAE,iBAAsB,GAAG,OAAO,CAAC,IAAI,CAAC;IAgB5E;;OAEG;IACH,SAAS,CAAC,OAAO,EAAE,OAAO,GAAG,IAAI;IAKjC;;OAEG;IACH,SAAS,CAAC,OAAO,EAAE,OAAO,GAAG,IAAI;IAKjC;;;;OAIG;IACH,cAAc,IAAI,IAAI;CAMvB"}

package/dist/core/ConvaiClient.js

@@ -5,7 +5,7 @@ import { AudioManager } from "./AudioManager";
 import { VideoManager } from "./VideoManager";
 import { ScreenShareManager } from "./ScreenShareManager";
 import { MessageHandler } from "./MessageHandler";
-import { CharacterRoster } from "./CharacterRoster";
+import { SDK_VERSION } from "../version";
 import { EventEmitter } from "./EventEmitter";
 import { MemoryManager } from "./MemoryManager";
 import { ConnectionStateHandler } from "./ConnectionStateHandler";
@@ -79,7 +79,6 @@ export class ConvaiClient extends EventEmitter {
         this._apiKey = null;
         this._authToken = null;
         this._characterId = null;
-        this._speakerId = null;
         this._characterSessionId = "-1";
         this._isBotReady = false;
         this._participantSid = "";
@@ -89,11 +88,6 @@ export class ConvaiClient extends EventEmitter {
          * so updateEmotion() called before any config is stored is not lost.
          */
         this._stateOfMind = null;
-        /** Roster state for multi-character rooms. Empty for single-character sessions. */
-        this._roster = new CharacterRoster();
-        /** Pending setInteractionTarget/updateCharacterRoster commands, keyed by command_id. */
-        this._pendingRosterCommands = new Map();
-        this._rosterCommandSeq = 0;
         this._endUserId = null;
         this._endUserMetadata = null;
         this._wsSession = null;
@@ -130,8 +124,6 @@ export class ConvaiClient extends EventEmitter {
             endUserId: null,
             endUserMetadata: null,
             metrics: [],
-            characters: [],
-            activeMembershipId: null,
             disconnectReason: null,
         };
         // Default audio settings for optimal interruption handling
@@ -174,9 +166,6 @@ export class ConvaiClient extends EventEmitter {
     get characterId() {
         return this._characterId;
     }
-    get speakerId() {
-        return this._speakerId;
-    }
     get room() {
         return this._room;
     }
@@ -220,15 +209,7 @@ export class ConvaiClient extends EventEmitter {
         });
         this._room.on(RoomEvent.ConnectionStateChanged, this._connectionStateHandler.handleConnectionStateChanged.bind(this._connectionStateHandler));
         // Message handler events
-        this._messageHandler.on("botReady", (about) => {
-            // Each character instance sends its own bot-ready. Feed the roster
-            // before the de-dupe below, which only guards the consumer-facing event.
-            if (this._roster.applyBotReady(about)) {
-                this.updateState({
-                    characters: this._roster.characters,
-                    activeMembershipId: this._roster.activeMembershipId,
-                });
-            }
+        this._messageHandler.on("botReady", () => {
             // Server may send multiple bot-ready frames (one per client-ready
             // we retried). Only surface the first to consumers per connect.
             if (this._isBotReady) {
@@ -348,7 +329,6 @@ export class ConvaiClient extends EventEmitter {
             this.emit("actionResponse", data);
         });
         this._messageHandler.on("serverResponse", (response) => {
-            this._handleRosterServerResponse(response);
             this.emit("serverResponse", response);
         });
         this._messageHandler.on("interactionCreated", (data) => {
@@ -397,12 +377,8 @@ export class ConvaiClient extends EventEmitter {
      * For LiveKit: publishes via the data channel.
      * For WebSocket: sends via PipecatClient.sendClientMessage (wrapped in {t,d} envelope).
      */
-    publishMessage(type, data, id) {
-        // Roster commands are correlated by a top-level `id`, which the server
-        // echoes back as extras.command_id. interaction-target REJECTS a message
-        // without it (code "invalid_command") even when the same value is present
-        // inside `data`, so the envelope field is not optional for those.
-        const message = id ? { id, type, data } : { type, data };
+    publishMessage(type, data) {
+        const message = { type, data };
         if (this._activeTransport === "websocket" && this._wsSession?.isConnected) {
             this._wsSession.sendMessage(type, data);
         }
@@ -446,33 +422,15 @@ export class ConvaiClient extends EventEmitter {
         this._messageHandler.setRtviMessageLogging(this._logRtviMessages);
         const hasApiKey = Boolean(configWithDefaults.apiKey);
         const hasAuthToken = Boolean(configWithDefaults.authToken);
-        const characterList = configWithDefaults.characters ?? [];
-        const hasCharacterList = characterList.length > 0;
-        if (!hasApiKey && !hasAuthToken) {
+        if ((!hasApiKey && !hasAuthToken) || !configWithDefaults.characterId) {
             throw new Error("Either apiKey or authToken is required, and characterId is required");
         }
-        // Exactly one of characterId / characters — the server takes either shape,
-        // but silently ignores unknown fields, so catch the ambiguity here.
-        if (!hasCharacterList && !configWithDefaults.characterId) {
-            throw new Error("Either apiKey or authToken is required, and characterId is required");
-        }
-        if (hasCharacterList && configWithDefaults.characterId) {
-            throw new Error("Pass either characterId or characters, not both");
-        }
-        if (hasCharacterList && characterList.some((c) => !c?.characterId)) {
-            throw new Error("Every entry in characters requires a characterId");
-        }
         this.updateState({ isConnecting: true });
         try {
             // Store connection config
             this._apiKey = configWithDefaults.apiKey ?? null;
             this._authToken = configWithDefaults.authToken ?? null;
-            this._characterId =
-                configWithDefaults.characterId ??
-                    characterList[0]?.characterId ??
-                    null;
-            this._roster.reset();
-            // Resolve speaker ID based on endUserId
+            this._characterId = configWithDefaults.characterId;
             // Determine connection type based on enableVideo
             const connType = configWithDefaults.enableVideo ? "video" : "audio";
             this._connectionType = connType;
@@ -488,13 +446,7 @@ export class ConvaiClient extends EventEmitter {
             this._stateOfMind = stateOfMind;
             const characterSessionIdToSend = configWithDefaults.characterSessionId ?? this._characterSessionId;
             const requestBody = {
-                ...(hasCharacterList
-                    ? {
-                        characters: characterList.map((c) => ({
-                            character_id: c.characterId,
-                        })),
-                    }
-                    : { character_id: configWithDefaults.characterId }),
+                character_id: configWithDefaults.characterId,
                 ...(stateOfMind ? { state_of_mind: stateOfMind } : {}),
                 ...(configWithDefaults.endUserId && {
                     end_user_id: configWithDefaults.endUserId,
@@ -563,7 +515,7 @@ export class ConvaiClient extends EventEmitter {
                 invocation_metadata: {
                     source: configWithDefaults.invocationMetadata?.source ?? "web_sdk",
                     client_version: configWithDefaults.invocationMetadata?.clientVersion ??
-                        "1.6.0-beta.0",
+                        SDK_VERSION,
                     ...(configWithDefaults.invocationMetadata?.extraMetadata && {
                         extra_metadata: configWithDefaults.invocationMetadata.extraMetadata,
                     }),
@@ -621,14 +573,6 @@ export class ConvaiClient extends EventEmitter {
                     characterSessionId: connectionData.character_session_id,
                 };
             }
-            // Seed the roster before the transport comes up, so the first bot-ready
-            // and any early roster change already have instances to match against.
-            if (this._roster.applyConnectResponse(connectionData)) {
-                this.updateState({
-                    characters: this._roster.characters,
-                    activeMembershipId: this._roster.activeMembershipId,
-                });
-            }
             if (connectionData.end_user_id) {
                 this._endUserId = connectionData.end_user_id;
             }
@@ -911,7 +855,6 @@ export class ConvaiClient extends EventEmitter {
         this._apiKey = null;
         this._authToken = null;
         this._characterId = null;
-        this._speakerId = null;
         this._endUserId = null;
         this._endUserMetadata = null;
         this._memoryManager = null; // Clear memory manager on disconnect
@@ -1187,139 +1130,6 @@ export class ConvaiClient extends EventEmitter {
             participant_sid: this._participantSid || this._room.localParticipant?.sid,
         });
     }
-    /**
-     * Correlate interaction-target / character-roster-update acks back to the
-     * promise returned by the method that issued them, and keep roster state and
-     * the two roster events in sync — including for changes we did not initiate.
-     */
-    _handleRosterServerResponse(response) {
-        const { event_type: eventType, extras } = response;
-        if (eventType !== "interaction-target" &&
-            eventType !== "character-roster-update") {
-            return;
-        }
-        // Always adopt the server's epochs, including from errors — a
-        // stale_route_epoch rejection carries the authoritative value.
-        const commandId = extras?.command_id;
-        const pending = commandId
-            ? this._pendingRosterCommands.get(commandId)
-            : undefined;
-        if (response.status === "error") {
-            this._roster.adoptEpochs(extras ?? null);
-            this.updateState({
-                characters: this._roster.characters,
-                activeMembershipId: this._roster.activeMembershipId,
-            });
-            if (pending && commandId) {
-                this._pendingRosterCommands.delete(commandId);
-                clearTimeout(pending.timer);
-                pending.reject(Object.assign(new Error(response.message ?? `${eventType} was rejected by the server`), { code: extras?.code ?? null, extras: extras ?? null }));
-            }
-            return;
-        }
-        let result;
-        if (eventType === "interaction-target") {
-            result = this._roster.applyInteractionTarget(extras ?? null);
-            this.updateState({
-                characters: this._roster.characters,
-                activeMembershipId: this._roster.activeMembershipId,
-            });
-            if (result)
-                this.emit("activeCharacterChange", result);
-        }
-        else {
-            result = this._roster.applyRosterUpdate(extras ?? null);
-            this.updateState({
-                characters: this._roster.characters,
-                activeMembershipId: this._roster.activeMembershipId,
-            });
-            if (result)
-                this.emit("rosterChange", result);
-        }
-        if (pending && commandId) {
-            this._pendingRosterCommands.delete(commandId);
-            clearTimeout(pending.timer);
-            pending.resolve(result);
-        }
-    }
-    /**
-     * Publish a roster command and resolve when its ack arrives.
-     */
-    _sendRosterCommand(type, build) {
-        if (!this.isTransportReady()) {
-            return Promise.reject(new Error(`Cannot send ${type}: not connected`));
-        }
-        if (!this._roster.isMultiCharacter) {
-            return Promise.reject(new Error(`Cannot send ${type}: this session was not created with a characters array`));
-        }
-        const commandId = `${type}-${++this._rosterCommandSeq}`;
-        return new Promise((resolve, reject) => {
-            const timer = setTimeout(() => {
-                this._pendingRosterCommands.delete(commandId);
-                reject(new Error(`${type} timed out waiting for a server response`));
-            }, ConvaiClient.ROSTER_COMMAND_TIMEOUT_MS);
-            this._pendingRosterCommands.set(commandId, { resolve, reject, timer });
-            this.publishMessage(type, build(commandId), commandId);
-        });
-    }
-    /**
-     * Route subsequent user turns to a different character instance.
-     *
-     * Retries once against the server's authoritative epoch if the routing epoch
-     * was stale, which happens when another participant switched first.
-     */
-    async setInteractionTarget(membershipId) {
-        if (!membershipId) {
-            throw new Error("setInteractionTarget requires a membershipId");
-        }
-        if (this._roster.isMultiCharacter && !this._roster.find(membershipId)) {
-            throw new Error(`Unknown membershipId "${membershipId}". Address instances by membershipId, not characterId.`);
-        }
-        const send = () => this._sendRosterCommand("interaction-target", (commandId) => this._roster.buildInteractionTarget(membershipId, commandId));
-        try {
-            await send();
-        }
-        catch (error) {
-            const code = error?.code;
-            if (code !== "stale_route_epoch")
-                throw error;
-            // The roster adopted the server's epoch when the error came in, so a
-            // single retry is now fenced correctly.
-            await send();
-        }
-        const instance = this._roster.find(membershipId);
-        if (!instance) {
-            throw new Error(`interaction-target succeeded but membership "${membershipId}" is not in the roster`);
-        }
-        return instance;
-    }
-    /**
-     * Add or remove character instances on a live room, without reconnecting.
-     */
-    async updateCharacterRoster(options) {
-        const add = options?.add ?? [];
-        const remove = options?.remove ?? [];
-        if (add.length === 0 && remove.length === 0) {
-            throw new Error("updateCharacterRoster requires at least one add or remove");
-        }
-        if (add.some((c) => !c?.characterId)) {
-            throw new Error("Every entry in add requires a characterId");
-        }
-        // The server rejects removing the active instance without a replacement
-        // (`replacement_target_required`), and rejects one that is not ready yet
-        // (`replacement_target_unavailable`). Choose a ready survivor by default.
-        const active = this._roster.activeMembershipId;
-        const effective = !options.replacementTarget && active && remove.includes(active)
-            ? { ...options, replacementTarget: this._roster.pickReplacement(remove) }
-            : options;
-        const result = (await this._sendRosterCommand("character-roster-update", (commandId) => this._roster.buildRosterUpdate(effective, commandId)));
-        // A success ack that moved nothing still resolves; report the roster as-is.
-        return (result ?? {
-            added: [],
-            removed: [],
-            characters: this._roster.characters,
-        });
-    }
     /**
      * Send descriptive scene updates. Use when environment description changes
      * and the bot should know what is visible or nearby. Does not modify action_config.
@@ -1405,6 +1215,4 @@ export class ConvaiClient extends EventEmitter {
 }
 ConvaiClient.CLIENT_READY_RETRY_MS = 500;
 ConvaiClient.CLIENT_READY_TIMEOUT_MS = 45000;
-/** Timeout for a roster command to be acknowledged by the server. */
-ConvaiClient.ROSTER_COMMAND_TIMEOUT_MS = 10000;
 //# sourceMappingURL=ConvaiClient.js.map