dsh-live-voice 0.2.0 → 0.2.1

package/CHANGELOG.md

@@ -2,6 +2,23 @@
 
 All notable changes to DSH Live Voice are documented in this file.
 
+## [0.2.1] - 2026-09-19
+
+### Documentation
+
+- Reframe the README around the local-first, hands-free experience, including continuous conversations, spoken structured questions, voice commands, and behavior across chat navigation.
+- Expand package and README discovery keywords for hands-free voice, conversational AI, spoken prompts, Qwen3 speech engines, and Apple Silicon.
+
+### Changes
+
+- Update existing development dependencies.
+
+### Bug Fixes
+
+- Persist microphone enabled or muted state as a global preference and propagate settings changes to every active voice controller. New controllers now inherit the saved microphone state, and capability information is refreshed after synchronized settings changes.
+- Keep microphone, conversation, and Speak controls available when DSH omits the legacy `uiSession.pendingInteractions` store. Structured-question voice handling remains inactive when that optional store is unavailable.
+- Add regression coverage for global microphone-state normalization and for mounting voice controls without the legacy pending-interaction store.
+
 ## [0.2.0] - Unreleased
 
 ### Release Changes
@@ -68,7 +85,8 @@ This release expands conversation control, audio routing, speech filtering, and
 - Support browser speech synthesis and native macOS `say` output.
 - Add Live Voice controls, Whisper settings, build and browser-preview scripts, and an initial test suite.
 
-[0.2.0]: https://github.com/victorwads/dsh-live-voice/compare/v0.1.0...HEAD
+[0.2.1]: https://github.com/victorwads/dsh-live-voice/compare/v0.2.0...HEAD
+[0.2.0]: https://github.com/victorwads/dsh-live-voice/compare/v0.1.0...v0.2.0
 [0.1.0]: https://github.com/victorwads/dsh-live-voice/compare/v0.0.2...v0.1.0
 [0.0.2]: https://github.com/victorwads/dsh-live-voice/compare/v0.0.1-alpha.1...v0.0.2
 [0.0.1-alpha.1]: https://github.com/victorwads/dsh-live-voice/tree/v0.0.1-alpha.1

package/README.md

@@ -4,9 +4,9 @@
 [![dsh.pub registry status](https://dsh.pub/api/badges/victorwads/dsh-live-voice.svg)](https://dsh.pub/en/plugins/dsh-live-voice/)
 [![license](https://img.shields.io/badge/license-GPL--3.0--only-blue)](LICENSE)
 
-**Local-first speech recognition, voice output, and continuous voice conversations for DSH.**
+**Local-first, hands-free voice conversations for DSH — speak, listen, answer prompts, and keep working without touching the computer.**
 
-DSH Live Voice coordinates the microphone, composer, assistant messages, and speech output in one plugin — without letting listening and speaking compete with each other.
+DSH Live Voice coordinates the microphone, composer, assistant messages, structured questions, and speech output in one plugin — without letting listening and speaking compete with each other. Once voice conversation mode is running, DSH can narrate responses and questions, capture your spoken answers, and continue the conversation while your hands stay free.
 
 ## Install
 
@@ -29,7 +29,10 @@ A heartfelt thank you to [GooDAnDReaDY](https://github.com/GooDAnDReaDY) for [ds
 | | Capability |
 |---|---|
 | 🎙️ | Voice typing directly into the DSH composer |
-| 💬 | Continuous voice conversations with automatic assistant speech |
+| 👐 | Hands-free conversations: speak, hear responses, and continue without touching the computer |
+| ❓ | Spoken DSH structured questions with automatic capture and submission of your answer |
+| 💬 | Continuous voice conversations that stay active while you navigate between chats |
+| 🗣️ | Configurable voice commands for sending, queueing, clearing, muting, resuming, stopping speech, and ending a conversation |
 | 🧠 | Browser SpeechRecognition, local loopback whisper.cpp, or Qwen3-ASR on Apple MLX |
 | 🔊 | Browser speech synthesis, native macOS `say`, or Qwen3-TTS on Apple MLX |
 | ⏱️ | Manual or automatic sending after configurable silence |
@@ -40,6 +43,18 @@ A heartfelt thank you to [GooDAnDReaDY](https://github.com/GooDAnDReaDY) for [ds
 | 🔈 | Play individual assistant messages on demand |
 | 🏠 | Whisper audio reaches the local server only through the authenticated DSH host |
 
+## Hands-free experience
+
+Start voice conversation mode and choose an automatic delivery mode to keep a conversation moving without returning to the keyboard. DSH Live Voice can:
+
+1. Listen for your next message and deliver it after the configured silence period.
+2. Read assistant responses aloud as they arrive.
+3. Narrate DSH structured questions, listen for your next spoken response, and submit it as a custom answer.
+4. Keep voice conversation mode active when you move between chats until you explicitly end it.
+5. Accept configurable spoken commands for common conversation controls.
+
+The hands-free experience coordinates speech input and output locally when you select local engines. The DSH language model itself may still be remote.
+
 ## Conversation flow
 
 The assistant never starts automatic playback while you are speaking. If a response is already waiting — including another assistant message — it waits until you finish and the configured continuous-silence delay has passed.
@@ -108,4 +123,4 @@ When a compatible Qwen3 speech API is already running on the DSH host, choose **
 
 ## Keywords
 
-`dsh`, `dsh-plugin`, `deepseek-harness`, `local-first`, `local-voice`, `voice-assistant`, `voice-conversation`, `continuous-conversation`, `voice-dictation`, `speech-to-text`, `text-to-speech`, `speech-recognition`, `speech-synthesis`, `stt`, `tts`, `whisper`, `whisper-cpp`, `web-speech-api`, `macos-say`, `turn-taking`, `voice-interruption`, `silence-detection`
+`dsh`, `dsh-plugin`, `deepseek-harness`, `local-first`, `local-voice`, `hands-free`, `hands-free-ai`, `hands-free-assistant`, `voice-control`, `voice-commands`, `voice-assistant`, `voice-conversation`, `conversational-ai`, `continuous-conversation`, `voice-dictation`, `spoken-prompts`, `speech-to-text`, `text-to-speech`, `speech-recognition`, `speech-synthesis`, `stt`, `tts`, `whisper`, `whisper-cpp`, `qwen3-asr`, `qwen3-tts`, `mlx`, `apple-silicon`, `web-speech-api`, `macos-say`, `turn-taking`, `voice-interruption`, `silence-detection`

package/lib/client.js

@@ -114,6 +114,7 @@ var defaultSettings = Object.freeze({
   recognitionProcessLocally: true,
   recognitionAutoInstall: true,
   voiceDetectionPreset: "natural",
+  microphoneEnabled: true,
   announceAssistantMessages: true,
   interruptSpeechOnUserMessage: false,
   sendingMode: "manual",
@@ -149,6 +150,7 @@ function normalizeSettings(value) {
     recognitionProcessLocally: typeof source.recognitionProcessLocally === "boolean" ? source.recognitionProcessLocally : defaultSettings.recognitionProcessLocally,
     recognitionAutoInstall: typeof source.recognitionAutoInstall === "boolean" ? source.recognitionAutoInstall : defaultSettings.recognitionAutoInstall,
     voiceDetectionPreset: Object.hasOwn(voiceDetectionPresets, source.voiceDetectionPreset) ? source.voiceDetectionPreset : defaultSettings.voiceDetectionPreset,
+    microphoneEnabled: typeof source.microphoneEnabled === "boolean" ? source.microphoneEnabled : defaultSettings.microphoneEnabled,
     announceAssistantMessages: typeof source.announceAssistantMessages === "boolean" ? source.announceAssistantMessages : defaultSettings.announceAssistantMessages,
     interruptSpeechOnUserMessage: typeof source.interruptSpeechOnUserMessage === "boolean" ? source.interruptSpeechOnUserMessage : defaultSettings.interruptSpeechOnUserMessage,
     sendingMode: source.sendingMode === "automatic" ? "queue" : ["manual", "queue", "steer"].includes(source.sendingMode) ? source.sendingMode : defaultSettings.sendingMode,
@@ -271,7 +273,7 @@ var VoiceCoordinator = class {
       conversation: false,
       listening: false,
       recognizing: false,
-      muted: false,
+      muted: normalizeSettings(settings).microphoneEnabled === false,
       speaking: false,
       paused: false,
       starting: false,
@@ -338,7 +340,12 @@ var VoiceCoordinator = class {
       autoInstallLocalPack: settings.recognitionAutoInstall,
       voiceDetectionPreset: settings.voiceDetectionPreset
     });
-    this.patch({ settings, error: null });
+    this.patch({
+      settings,
+      muted: settings.microphoneEnabled === false,
+      recognizing: settings.microphoneEnabled === false ? false : this.snapshot.recognizing,
+      error: null
+    });
     if (settings.sendingMode === "manual") this.cancelAutoSend();
     if (Object.hasOwn(next, "announceAssistantMessages") && !settings.announceAssistantMessages) {
       this.queue = [];
@@ -401,16 +408,17 @@ var VoiceCoordinator = class {
     return this.startListening(true);
   }
   muteListening() {
-    if (!this.snapshot.settings.voiceCommandsEnabled) return this.stopListening();
     this.cancelAutoSend();
     this.composer.setDraft(this.transcript.update(this.composer.getDraft(), "", true));
     this.transcript.reset();
-    this.patch({ muted: true, recognizing: false });
+    this.updateSettings({ microphoneEnabled: false });
+    if (!this.snapshot.settings.voiceCommandsEnabled) return this.stopListening();
   }
   resumeListeningInput() {
+    this.transcript.reset();
+    this.updateSettings({ microphoneEnabled: true });
     if (this.snapshot.listening || this.snapshot.starting) {
-      this.transcript.reset();
-      this.patch({ muted: false, recognizing: false });
+      this.patch({ recognizing: false });
       return;
     }
     return this.startListening(this.snapshot.conversation);
@@ -3244,7 +3252,7 @@ function apply(ctx) {
     });
     const pendingInteractions = ctx.uiSession.pendingInteractions;
     const refreshPendingQuestion = (baseline = false) => {
-      if (disposed || entry.closed) return;
+      if (disposed || entry.closed || !pendingInteractions) return;
       const interaction = pendingInteractions.getSnapshot().get(sessionId);
       const key2 = interaction?.kind === "question" ? interaction.key : null;
       if (!key2 || entry.questionCapture && entry.questionCapture.interaction.key !== key2) {
@@ -3264,22 +3272,28 @@ function apply(ctx) {
         run(controller, controller.speak(text, key2));
       }
     };
-    refreshPendingQuestion(true);
-    entry.unsubscribePendingQuestion = pendingInteractions.subscribe(refreshPendingQuestion);
+    if (pendingInteractions) {
+      refreshPendingQuestion(true);
+      entry.unsubscribePendingQuestion = pendingInteractions.subscribe(refreshPendingQuestion);
+    }
     const update = controller.updateSettings.bind(controller);
-    controller.updateSettings = (next) => {
-      if (disposed || entry.closed) return;
+    entry.applySettings = (next) => {
       update(next);
       engineBrowser.lang = controller.getSnapshot().settings.lang;
       engineQwen.lang = controller.getSnapshot().settings.lang;
+      run(controller, controller.refreshCapabilities());
+    };
+    controller.updateSettings = (next) => {
+      if (disposed || entry.closed) return;
+      entry.applySettings(next);
+      const settings2 = controller.getSnapshot().settings;
       try {
-        localStorage.setItem(
-          "dsh-live-voice.settings",
-          JSON.stringify(controller.getSnapshot().settings)
-        );
+        localStorage.setItem("dsh-live-voice.settings", JSON.stringify(settings2));
       } catch {
       }
-      run(controller, controller.refreshCapabilities());
+      for (const other of controllers.values()) {
+        if (other !== entry && !other.closed) other.applySettings(settings2);
+      }
     };
     for (const method of ["stopListening", "cancelDictation", "endConversation", "stopSpeech"]) {
       const original = controller[method].bind(controller);
@@ -3419,7 +3433,7 @@ function apply(ctx) {
           if (entry.closed) continue;
           if (entry.controller.getSnapshot().settings.recognitionEngine !== settings2.recognitionEngine)
             entry.controller.replaceRecognition(recognitionFor(settings2, entry.controller.meter));
-          entry.controller.updateSettings(settings2);
+          entry.applySettings(settings2);
           run(entry.controller, entry.controller.refreshCapabilities());
         }
       };

package/lib/server.js

@@ -460,6 +460,7 @@ var defaultSettings = Object.freeze({
   recognitionProcessLocally: true,
   recognitionAutoInstall: true,
   voiceDetectionPreset: "natural",
+  microphoneEnabled: true,
   announceAssistantMessages: true,
   interruptSpeechOnUserMessage: false,
   sendingMode: "manual",

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "dsh-live-voice",
-  "version": "0.2.0",
+  "version": "0.2.1",
   "type": "module",
   "scripts": {
     "typecheck": "tsc --noEmit",
@@ -20,10 +20,17 @@
     "deepseek-harness",
     "local-first",
     "local-voice",
+    "hands-free",
+    "hands-free-ai",
+    "hands-free-assistant",
+    "voice-control",
+    "voice-commands",
     "voice-assistant",
     "voice-conversation",
+    "conversational-ai",
     "continuous-conversation",
     "voice-dictation",
+    "spoken-prompts",
     "speech-to-text",
     "text-to-speech",
     "speech-recognition",
@@ -68,16 +75,16 @@
     "url": "git+https://github.com/victorwads/dsh-live-voice.git"
   },
   "devDependencies": {
-    "@types/node": "^26.5.1",
-    "@types/react": "^19.3.0",
-    "@types/react-dom": "^19.3.0",
-    "esbuild": "^0.28.2",
-    "jsdom": "^30.0.1",
-    "playwright-core": "^1.63.0",
-    "prettier": "3.9.6",
-    "react": "^19.3.0",
-    "react-dom": "^19.3.0",
-    "typescript": "^7.0.2"
+    "@types/node": "26.6.2",
+    "@types/react": "19.3.0",
+    "@types/react-dom": "19.3.0",
+    "esbuild": "0.28.2",
+    "jsdom": "30.1.0",
+    "playwright-core": "1.63.0",
+    "prettier": "3.9.8",
+    "react": "19.3.0",
+    "react-dom": "19.3.0",
+    "typescript": "7.0.2"
   },
   "main": "./lib/server.js",
   "exports": {

package/src/client/index.ts

@@ -172,9 +172,11 @@ export function apply(ctx) {
       refresh();
       for (const listener of entry.chatListeners) listener();
     });
+    // DSH 0.1.6 may omit this legacy store. Keep the remaining voice controls
+    // available while structured-question integration is unavailable.
     const pendingInteractions = ctx.uiSession.pendingInteractions;
     const refreshPendingQuestion = (baseline = false) => {
-      if (disposed || entry.closed) return;
+      if (disposed || entry.closed || !pendingInteractions) return;
       const interaction = pendingInteractions.getSnapshot().get(sessionId);
       const key = interaction?.kind === 'question' ? interaction.key : null;
       if (!key || (entry.questionCapture && entry.questionCapture.interaction.key !== key)) {
@@ -194,21 +196,27 @@ export function apply(ctx) {
         run(controller, controller.speak(text, key));
       }
     };
-    refreshPendingQuestion(true);
-    entry.unsubscribePendingQuestion = pendingInteractions.subscribe(refreshPendingQuestion);
+    if (pendingInteractions) {
+      refreshPendingQuestion(true);
+      entry.unsubscribePendingQuestion = pendingInteractions.subscribe(refreshPendingQuestion);
+    }
     const update = controller.updateSettings.bind(controller);
-    controller.updateSettings = (next) => {
-      if (disposed || entry.closed) return;
+    entry.applySettings = (next) => {
       update(next);
       engineBrowser.lang = controller.getSnapshot().settings.lang;
       engineQwen.lang = controller.getSnapshot().settings.lang;
+      run(controller, controller.refreshCapabilities());
+    };
+    controller.updateSettings = (next) => {
+      if (disposed || entry.closed) return;
+      entry.applySettings(next);
+      const settings = controller.getSnapshot().settings;
       try {
-        localStorage.setItem(
-          'dsh-live-voice.settings',
-          JSON.stringify(controller.getSnapshot().settings),
-        );
+        localStorage.setItem('dsh-live-voice.settings', JSON.stringify(settings));
       } catch {}
-      run(controller, controller.refreshCapabilities());
+      for (const other of controllers.values()) {
+        if (other !== entry && !other.closed) other.applySettings(settings);
+      }
     };
     // Cancel only this entry's queued acquisition. Global cancellation here would
     // invalidate a newer session while its predecessor is being unmounted.
@@ -364,7 +372,7 @@ export function apply(ctx) {
             entry.controller.getSnapshot().settings.recognitionEngine !== settings.recognitionEngine
           )
             entry.controller.replaceRecognition(recognitionFor(settings, entry.controller.meter));
-          entry.controller.updateSettings(settings);
+          entry.applySettings(settings);
           run(entry.controller, entry.controller.refreshCapabilities());
         }
       };

package/src/core/coordinator.ts

@@ -46,7 +46,7 @@ export class VoiceCoordinator {
       conversation: false,
       listening: false,
       recognizing: false,
-      muted: false,
+      muted: normalizeSettings(settings).microphoneEnabled === false,
       speaking: false,
       paused: false,
       starting: false,
@@ -116,7 +116,12 @@ export class VoiceCoordinator {
       autoInstallLocalPack: settings.recognitionAutoInstall,
       voiceDetectionPreset: settings.voiceDetectionPreset,
     });
-    this.patch({ settings, error: null });
+    this.patch({
+      settings,
+      muted: settings.microphoneEnabled === false,
+      recognizing: settings.microphoneEnabled === false ? false : this.snapshot.recognizing,
+      error: null,
+    });
     if (settings.sendingMode === 'manual') this.cancelAutoSend();
     if (Object.hasOwn(next, 'announceAssistantMessages') && !settings.announceAssistantMessages) {
       this.queue = [];
@@ -185,16 +190,17 @@ export class VoiceCoordinator {
     return this.startListening(true);
   }
   muteListening() {
-    if (!this.snapshot.settings.voiceCommandsEnabled) return this.stopListening();
     this.cancelAutoSend();
     this.composer.setDraft(this.transcript.update(this.composer.getDraft(), '', true));
     this.transcript.reset();
-    this.patch({ muted: true, recognizing: false });
+    this.updateSettings({ microphoneEnabled: false });
+    if (!this.snapshot.settings.voiceCommandsEnabled) return this.stopListening();
   }
   resumeListeningInput() {
+    this.transcript.reset();
+    this.updateSettings({ microphoneEnabled: true });
     if (this.snapshot.listening || this.snapshot.starting) {
-      this.transcript.reset();
-      this.patch({ muted: false, recognizing: false });
+      this.patch({ recognizing: false });
       return;
     }
     return this.startListening(this.snapshot.conversation);

package/src/core/settings.ts

@@ -36,6 +36,7 @@ export const defaultSettings = Object.freeze({
   recognitionProcessLocally: true,
   recognitionAutoInstall: true,
   voiceDetectionPreset: 'natural',
+  microphoneEnabled: true,
   announceAssistantMessages: true,
   interruptSpeechOnUserMessage: false,
   sendingMode: 'manual',
@@ -93,6 +94,10 @@ export function normalizeSettings(value) {
     voiceDetectionPreset: Object.hasOwn(voiceDetectionPresets, source.voiceDetectionPreset)
       ? source.voiceDetectionPreset
       : defaultSettings.voiceDetectionPreset,
+    microphoneEnabled:
+      typeof source.microphoneEnabled === 'boolean'
+        ? source.microphoneEnabled
+        : defaultSettings.microphoneEnabled,
     announceAssistantMessages:
       typeof source.announceAssistantMessages === 'boolean'
         ? source.announceAssistantMessages