@vellumai/assistant 0.4.23 → 0.4.26

package/src/config/bundled-skills/twilio-setup/SKILL.md

@@ -215,44 +215,36 @@ Confirm:
 
 Tell the user: **"Twilio is configured. Your assistant's phone number is {phoneNumber}. This number is used for both voice calls and SMS messaging."**
 
-## Step 5.5: Guardian Verification (SMS and Voice)
+## Step 5.5: Guardian Verification (Voice)
 
-Now link the user's phone number as the trusted guardian for SMS and/or voice channels. Tell the user: "Now let's verify your guardian identity. This links your phone number as the trusted guardian for messaging and calls."
+Now link the user's phone number as the trusted voice guardian. Tell the user: "Now let's verify your guardian identity for voice. This links your phone number so the assistant can verify inbound callers."
 
 Load the **guardian-verify-setup** skill to handle the verification flow:
 
 - Call `skill_load` with `skill: "guardian-verify-setup"` to load the dependency skill.
 
-The guardian-verify-setup skill manages the full outbound verification flow for **one channel at a time** (sms, voice, or telegram). Each invocation handles:
+When invoking the skill, indicate the channel is `voice`. The guardian-verify-setup skill manages the full outbound verification flow, including:
 
 - Collecting the user's phone number as the destination (accepts any common format -- the API normalizes to E.164)
-- Starting the outbound verification session via the gateway endpoint `POST /v1/integrations/guardian/outbound/start`
-- For **SMS**: sending a 6-digit code to the phone number that the user must reply with from the SMS channel
-- For **voice**: calling the phone number and providing a code for the user to enter via their phone's keypad
+- Starting the outbound verification session via the gateway endpoint `POST /v1/integrations/guardian/outbound/start` with `channel: "voice"`
+- Calling the phone number and providing a code for the user to enter via their phone's keypad
+- Proactively polling for completion (voice auto-check) so the user gets instant confirmation
 - Checking guardian status to confirm the binding was created
 - Handling resend, cancel, and error cases
 
-**If the user wants to verify both SMS and voice**, load the skill twice -- once for SMS and once for voice. Each channel requires its own separate verification session.
+Tell the user: _"I've loaded the guardian verification guide. It will walk you through linking your phone number as the trusted voice guardian."_
 
-Tell the user: _"I've loaded the guardian verification guide. It will walk you through linking your phone number as the trusted guardian. We'll verify one channel at a time."_
-
-After the guardian-verify-setup skill completes verification for a channel, load it again for the next channel if needed. Once all desired channels are verified (or the user skips), continue to Step 6.
+After the guardian-verify-setup skill completes (or the user skips), continue to Step 6.
 
 **Note:** Guardian verification is optional but recommended. If the user declines or wants to skip, proceed to Step 6 without blocking.
 
-To re-check guardian status later, query the channel(s) that were verified:
+To re-check guardian status later:
 
 ```bash
-# Check SMS guardian status
-curl -s "$INTERNAL_GATEWAY_BASE_URL/v1/integrations/guardian/status?channel=sms" \
-  -H "Authorization: Bearer $GATEWAY_AUTH_TOKEN"
-# Check voice guardian status
 curl -s "$INTERNAL_GATEWAY_BASE_URL/v1/integrations/guardian/status?channel=voice" \
   -H "Authorization: Bearer $GATEWAY_AUTH_TOKEN"
 ```
 
-Check the status for whichever channel(s) the user actually verified (SMS, voice, or both). Report the guardian verification result per channel: **"Guardian identity — SMS: {verified | not configured}, Voice: {verified | not configured}."**
-
 ## Step 6: Enable Features
 
 Now that Twilio is configured, the user can enable the features that depend on it:

package/src/config/bundled-skills/voice-setup/SKILL.md

@@ -9,7 +9,7 @@ You are helping the user set up and troubleshoot voice features (push-to-talk, w
 
 ## Available Tools
 
-- `voice_config_update` — Change any voice setting (PTT key, wake word enabled/keyword/timeout)
+- `voice_config_update` — Change any voice setting (PTT key, wake word enabled/keyword/timeout, TTS voice ID)
 - `open_system_settings` — Open macOS System Settings to a specific privacy pane
 - `navigate_settings_tab` — Open the Vellum settings panel to the Voice tab
 - `credential_store` — Collect API keys securely (for ElevenLabs TTS)
@@ -66,6 +66,41 @@ Ask if they want high-quality text-to-speech voices via ElevenLabs (optional —
 2. Use `credential_store` with `action: "prompt"`, `service: "elevenlabs"`, `field: "api_key"` to show a secure input dialog.
 3. After the key is stored, confirm success.
 
+#### Choose an ElevenLabs voice
+
+After storing the API key, let the user pick their preferred voice. The shared config key `elevenlabs.voiceId` controls the voice for **both** in-app TTS and phone calls (defaulting to Rachel).
+
+Check the current voice:
+
+```bash
+vellum config get elevenlabs.voiceId
+```
+
+Ask the user if they want to change their TTS voice. If yes, use `voice_config_update` with `setting: "tts_voice_id"` and the chosen voice ID. This writes to both the config file (`elevenlabs.voiceId`) and pushes to the macOS app via IPC in one call.
+
+Common choices from the curated ElevenLabs list:
+- **Rachel** (`21m00Tcm4TlvDq8ikWAM`) — Calm, warm, conversational (default)
+- **Sarah** (`EXAVITQu4vr4xnSDxMaL`) — Soft, young, approachable
+- **Charlotte** (`XB0fDUnXU5powFXDhCwa`) — Warm, Swedish-accented
+- **Josh** (`TxGEqnHWrfWFTfGW9XjX`) — Deep, young, clear
+- **Adam** (`pNInz6obpgDQGcFmaJgB`) — Deep, middle-aged, professional
+
+If the user wants to browse more voices, they can search at https://elevenlabs.io/voice-library or use the ElevenLabs API with their key.
+
+#### Sync with phone calls
+
+After setting the voice, check whether phone calls are configured:
+
+```bash
+vellum config get calls.enabled
+```
+
+**If phone calls are enabled** (`calls.enabled` is `true`):
+- Tell the user their phone calls will automatically use the same voice they just chose, since both in-app TTS and phone calls read from `elevenlabs.voiceId`.
+
+**If phone calls are not yet configured** (`calls.enabled` is `false` or not set):
+- Tell the user: "When you set up phone calls later, they'll automatically use the same voice for a consistent experience."
+
 ### 5. Verification
 
 After setup is complete:

package/src/config/bundled-skills/voice-setup/icon.svg

@@ -0,0 +1,20 @@
+<svg viewBox="0 0 16 16" xmlns="http://www.w3.org/2000/svg">
+  <rect x="7" y="1" width="2" height="2" fill="#4A90E2"/>
+  <rect x="6" y="3" width="4" height="1" fill="#4A90E2"/>
+  <rect x="5" y="4" width="6" height="1" fill="#7B68EE"/>
+  <rect x="4" y="5" width="8" height="1" fill="#7B68EE"/>
+  <rect x="4" y="6" width="8" height="1" fill="#4A90E2"/>
+  <rect x="5" y="7" width="6" height="1" fill="#4A90E2"/>
+  <rect x="6" y="8" width="4" height="1" fill="#7B68EE"/>
+  <rect x="7" y="9" width="2" height="1" fill="#7B68EE"/>
+  <rect x="3" y="10" width="2" height="4" fill="#50C878"/>
+  <rect x="4" y="10" width="1" height="1" fill="#50C878"/>
+  <rect x="5" y="11" width="1" height="1" fill="#50C878"/>
+  <rect x="11" y="10" width="2" height="4" fill="#E74C3C"/>
+  <rect x="10" y="10" width="1" height="1" fill="#E74C3C"/>
+  <rect x="9" y="11" width="1" height="1" fill="#E74C3C"/>
+  <rect x="6" y="11" width="4" height="1" fill="#FFD700"/>
+  <rect x="5" y="12" width="6" height="1" fill="#FFD700"/>
+  <rect x="4" y="13" width="8" height="1" fill="#FFD700"/>
+  <rect x="7" y="14" width="2" height="2" fill="#4A90E2"/>
+</svg>

package/src/config/calls-schema.ts

@@ -1,7 +1,6 @@
 import { z } from 'zod';
 
 const VALID_CALL_PROVIDERS = ['twilio'] as const;
-const VALID_CALL_VOICE_MODES = ['twilio_standard', 'twilio_elevenlabs_tts', 'elevenlabs_agent'] as const;
 export const VALID_CALLER_IDENTITY_MODES = ['assistant_number', 'user_number'] as const;
 const VALID_CALL_TRANSCRIPTION_PROVIDERS = ['Deepgram', 'Google'] as const;
 
@@ -20,51 +19,7 @@ export const CallsSafetyConfigSchema = z.object({
     .default([]),
 });
 
-export const CallsElevenLabsConfigSchema = z.object({
-  voiceId: z
-    .string({ error: 'calls.voice.elevenlabs.voiceId must be a string' })
-    .default(''),
-  voiceModelId: z
-    .string({ error: 'calls.voice.elevenlabs.voiceModelId must be a string' })
-    .default(''),
-  speed: z
-    .number({ error: 'calls.voice.elevenlabs.speed must be a number' })
-    .min(0.7, 'calls.voice.elevenlabs.speed must be >= 0.7')
-    .max(1.2, 'calls.voice.elevenlabs.speed must be <= 1.2')
-    .default(1.0),
-  stability: z
-    .number({ error: 'calls.voice.elevenlabs.stability must be a number' })
-    .min(0, 'calls.voice.elevenlabs.stability must be >= 0')
-    .max(1, 'calls.voice.elevenlabs.stability must be <= 1')
-    .default(0.5),
-  similarityBoost: z
-    .number({ error: 'calls.voice.elevenlabs.similarityBoost must be a number' })
-    .min(0, 'calls.voice.elevenlabs.similarityBoost must be >= 0')
-    .max(1, 'calls.voice.elevenlabs.similarityBoost must be <= 1')
-    .default(0.75),
-  useSpeakerBoost: z
-    .boolean({ error: 'calls.voice.elevenlabs.useSpeakerBoost must be a boolean' })
-    .default(true),
-  agentId: z
-    .string({ error: 'calls.voice.elevenlabs.agentId must be a string' })
-    .default(''),
-  apiBaseUrl: z
-    .string({ error: 'calls.voice.elevenlabs.apiBaseUrl must be a string' })
-    .default('https://api.elevenlabs.io'),
-  registerCallTimeoutMs: z
-    .number({ error: 'calls.voice.elevenlabs.registerCallTimeoutMs must be a number' })
-    .int('calls.voice.elevenlabs.registerCallTimeoutMs must be an integer')
-    .min(1000, 'calls.voice.elevenlabs.registerCallTimeoutMs must be >= 1000')
-    .max(15000, 'calls.voice.elevenlabs.registerCallTimeoutMs must be <= 15000')
-    .default(5000),
-});
-
 export const CallsVoiceConfigSchema = z.object({
-  mode: z
-    .enum(VALID_CALL_VOICE_MODES, {
-      error: `calls.voice.mode must be one of: ${VALID_CALL_VOICE_MODES.join(', ')}`,
-    })
-    .default('twilio_standard'),
   language: z
     .string({ error: 'calls.voice.language must be a string' })
     .default('en-US'),
@@ -73,10 +28,6 @@ export const CallsVoiceConfigSchema = z.object({
       error: `calls.voice.transcriptionProvider must be one of: ${VALID_CALL_TRANSCRIPTION_PROVIDERS.join(', ')}`,
     })
     .default('Deepgram'),
-  fallbackToStandardOnError: z
-    .boolean({ error: 'calls.voice.fallbackToStandardOnError must be a boolean' })
-    .default(true),
-  elevenlabs: CallsElevenLabsConfigSchema.default(CallsElevenLabsConfigSchema.parse({})),
 });
 
 export const CallerIdentityConfigSchema = z.object({
@@ -142,7 +93,7 @@ export const CallsConfigSchema = z.object({
     .int('calls.guardianWaitUpdateInitialIntervalMs must be an integer')
     .min(1000, 'calls.guardianWaitUpdateInitialIntervalMs must be >= 1000')
     .max(60_000, 'calls.guardianWaitUpdateInitialIntervalMs must be at most 60000')
-    .default(5000),
+    .default(15_000),
   guardianWaitUpdateInitialWindowMs: z
     .number({ error: 'calls.guardianWaitUpdateInitialWindowMs must be a number' })
     .int('calls.guardianWaitUpdateInitialWindowMs must be an integer')
@@ -154,13 +105,13 @@ export const CallsConfigSchema = z.object({
     .int('calls.guardianWaitUpdateSteadyMinIntervalMs must be an integer')
     .min(1000, 'calls.guardianWaitUpdateSteadyMinIntervalMs must be >= 1000')
     .max(60_000, 'calls.guardianWaitUpdateSteadyMinIntervalMs must be at most 60000')
-    .default(7000),
+    .default(20_000),
   guardianWaitUpdateSteadyMaxIntervalMs: z
     .number({ error: 'calls.guardianWaitUpdateSteadyMaxIntervalMs must be a number' })
     .int('calls.guardianWaitUpdateSteadyMaxIntervalMs must be an integer')
     .min(1000, 'calls.guardianWaitUpdateSteadyMaxIntervalMs must be >= 1000')
     .max(60_000, 'calls.guardianWaitUpdateSteadyMaxIntervalMs must be at most 60000')
-    .default(10_000),
+    .default(30_000),
   disclosure: CallsDisclosureConfigSchema.default(CallsDisclosureConfigSchema.parse({})),
   safety: CallsSafetyConfigSchema.default(CallsSafetyConfigSchema.parse({})),
   voice: CallsVoiceConfigSchema.default(CallsVoiceConfigSchema.parse({})),
@@ -175,6 +126,5 @@ export type CallsConfig = z.infer<typeof CallsConfigSchema>;
 export type CallsDisclosureConfig = z.infer<typeof CallsDisclosureConfigSchema>;
 export type CallsSafetyConfig = z.infer<typeof CallsSafetyConfigSchema>;
 export type CallsVoiceConfig = z.infer<typeof CallsVoiceConfigSchema>;
-export type CallsElevenLabsConfig = z.infer<typeof CallsElevenLabsConfigSchema>;
 export type CallerIdentityConfig = z.infer<typeof CallerIdentityConfigSchema>;
 export type CallsVerificationConfig = z.infer<typeof CallsVerificationConfigSchema>;

package/src/config/elevenlabs-schema.ts

@@ -0,0 +1,33 @@
+import { z } from 'zod';
+
+// Default ElevenLabs voice — "Rachel" (calm, warm, conversational).
+// Used by both in-app TTS and phone calls (via Twilio ConversationRelay).
+// Mirrored in: clients/macos/.../OpenAIVoiceService.swift (defaultVoiceId)
+export const DEFAULT_ELEVENLABS_VOICE_ID = '21m00Tcm4TlvDq8ikWAM';
+
+export const ElevenLabsConfigSchema = z.object({
+  voiceId: z
+    .string({ error: 'elevenlabs.voiceId must be a string' })
+    .min(1, 'elevenlabs.voiceId must not be empty')
+    .default(DEFAULT_ELEVENLABS_VOICE_ID),
+  voiceModelId: z
+    .string({ error: 'elevenlabs.voiceModelId must be a string' })
+    .default(''),
+  speed: z
+    .number({ error: 'elevenlabs.speed must be a number' })
+    .min(0.7, 'elevenlabs.speed must be >= 0.7')
+    .max(1.2, 'elevenlabs.speed must be <= 1.2')
+    .default(1.0),
+  stability: z
+    .number({ error: 'elevenlabs.stability must be a number' })
+    .min(0, 'elevenlabs.stability must be >= 0')
+    .max(1, 'elevenlabs.stability must be <= 1')
+    .default(0.5),
+  similarityBoost: z
+    .number({ error: 'elevenlabs.similarityBoost must be a number' })
+    .min(0, 'elevenlabs.similarityBoost must be >= 0')
+    .max(1, 'elevenlabs.similarityBoost must be <= 1')
+    .default(0.75),
+});
+
+export type ElevenLabsConfig = z.infer<typeof ElevenLabsConfigSchema>;