dsh-agentic-pet 0.3.2 → 0.4.1

package/README.md

@@ -9,7 +9,7 @@ English | [中文](README.zh.md)
 
 ## Summary
 
-`dsh-agentic-pet` is a desktop-pet plugin for the [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) ecosystem: the pet lives on your desktop as a transparent always-on-top window, follows your agent sessions (idle / thinking / working / error), races the web GUI to answer approvals and user questions (first answer wins), collects a per-pet touch-affection ledger, and exposes expressive tools (`pet_say`, `pet_do`, `pet_digest`, `pet_interactions`, `pet_state`) so the model can speak and act through the pet. Multiple pet implementations can run side by side — a directory registry (`~/.dsh/pet-http.d/`) discovers every live pet and routes state, interactions, and ledgers per pet.
+`dsh-agentic-pet` is a desktop-pet plugin for the [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) ecosystem: the pet lives on your desktop as a transparent always-on-top window, follows your agent sessions (idle / thinking / working / error), races the web GUI to answer approvals and user questions (first answer wins), collects a per-pet touch-affection ledger, and exposes expressive tools (`pet_say`, `pet_do`, `pet_digest`, `pet_interactions`, `pet_state`) so the model can speak and act through the pet. Spoken lines can be read aloud through [BreezeBlue](https://breezeblue.ai) TTS — the carrier synthesizes each `/say` text and delivers bubble and voice as one event; synthesis failure or timeout degrades to visual-only (configure it in the desktop settings page). Multiple pet implementations can run side by side — a directory registry (`~/.dsh/pet-http.d/`) discovers every live pet and routes state, interactions, and ledgers per pet.
 
 The pet itself is a dumb display with zero dsh knowledge. Everything that understands the runtime — event convergence, interaction waterfalls, multi-pet routing, the model tools — lives in the plugin's driver, and the pet only implements a small local HTTP control interface. Any pet implementation that speaks the same HTTP contract can be adopted without changing this plugin.
 
@@ -40,13 +40,28 @@ The TypeScript build still runs inside the dsh monorepo workspace (the bundled `
 
 1. In the monorepo: `pnpm run build` (plugin `lib/`) and `pnpm --filter @deepseek-ai/dsh-pet run build` (carrier `lib/` + `dist-renderer/`).
 2. Here: `scripts\sync-from-monorepo.cmd` — mirrors sources and build outputs into this repo.
-3. Commit here, then `npm publish` (assets package first; see [dsh-pet-assets/PUBLISH.md](../dsh-pet-assets/PUBLISH.md) for the release manual).
+3. Commit here, then publish from here (see [Releasing](#releasing); the assets package goes first, manual in [dsh-pet-assets/PUBLISH.md](../dsh-pet-assets/PUBLISH.md)).
 
 Tests: `npx vitest run tests/registry-service.spec.ts` runs self-contained (needs only `cordis` and `vitest`); the full suite including `tests/pet-app.spec.ts` runs in the monorepo workspace.
 
+## Releasing
+
+`package.json`'s `version` is owned by this repo: `scripts\sync-from-monorepo.cmd` mirrors every other manifest field and keeps it. The monorepo copy carries the workspace version (`0.2.1-rc.3`), so a plain mirror copy used to rewrite the published number — which is why npm `0.4.0` had no commit and no tag carrying it.
+
+```bash
+node scripts\release.mjs 0.4.1 --dry-run   # preflight and pack listing, nothing published
+node scripts\release.mjs 0.4.1             # publish, commit "chore(release): 0.4.1", tag v0.4.1
+git push --follow-tags
+```
+
+The script refuses to publish unless the working tree is clean, the version exceeds the current one, tag `v<version>` is absent, the build artifacts are present, and `lib/` carries exactly one bundle chunk (`tsdown` runs with `clean:false`, so a stale `service-*.js` would ship). A failed publish restores `package.json`, so the tree never claims a version that did not ship. A prerelease version (`x.y.z-rc.N`) publishes under `--tag rc`.
+
+Every published version is reachable as tag `v<version>` — the tag, not the manifest, is what answers "what is on npm". Version in the tree therefore always equals the last *published* version.
+
 ## Documentation
 
 - Control-plane contract (the frozen consumer API every pet implementation speaks): see the multi-pet guide in the project documentation.
+- Say-side TTS (BreezeBlue voice-over) design notes: `docs/tts.md` in the monorepo workspace (`packages/bundle/pet-app`).
 - Known limitations and design notes live in the repo wiki and the project's engineering docs.
 
 

package/README.zh.md

@@ -9,7 +9,7 @@ kind: "package-bundle"
 
 ## 简介
 
-`dsh-agentic-pet` 是 [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) 生态的桌面宠物插件：宠物以透明置顶窗常驻桌面，跟随 agent 会话状态（idle / thinking / working / error），与 web 界面竞速应答审批与提问（先答者赢），维护每宠独立的触摸好感账本，并向模型暴露表达工具（`pet_say`、`pet_do`、`pet_digest`、`pet_interactions`、`pet_state`）——模型可以借宠物说话、做动作、感知被触摸。多只宠物实现可以并存：目录注册表（`~/.dsh/pet-http.d/`）发现全部在线宠物，状态、交互、账本按宠路由。
+`dsh-agentic-pet` 是 [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) 生态的桌面宠物插件：宠物以透明置顶窗常驻桌面，跟随 agent 会话状态（idle / thinking / working / error），与 web 界面竞速应答审批与提问（先答者赢），维护每宠独立的触摸好感账本，并向模型暴露表达工具（`pet_say`、`pet_do`、`pet_digest`、`pet_interactions`、`pet_state`）——模型可以借宠物说话、做动作、感知被触摸。说话内容可通过 [BreezeBlue](https://breezeblue.ai) TTS 朗读——carrier 侧合成每条 `/say` 文本，语音就绪后与气泡同时下发；合成失败或超时静默降级为只显示（桌面设置页可配）。多只宠物实现可以并存：目录注册表（`~/.dsh/pet-http.d/`）发现全部在线宠物，状态、交互、账本按宠路由。
 
 宠物本身是零 DSH 知识的纯显示端。理解运行时的一切——事件收敛、交互瀑布、多宠路由、模型工具——都在插件的 driver 里，宠物只实现一个小型本地 HTTP 控制接口。任何讲同一 HTTP 契约的宠物实现都能被采纳，插件零改动。
 
@@ -40,13 +40,28 @@ TypeScript 构建仍在 dsh monorepo workspace 内进行（被打包的 `@deepse
 
 1. monorepo 内：`pnpm run build`（插件 `lib/`）与 `pnpm --filter @deepseek-ai/dsh-pet run build`（载体 `lib/` + `dist-renderer/`）。
 2. 本仓库：`scripts\sync-from-monorepo.cmd`——把源码与构建产物镜像进本仓库。
-3. 本仓库提交，然后 `npm publish`（先素材包后插件包；发布手册见 [dsh-pet-assets/PUBLISH.md](../dsh-pet-assets/PUBLISH.md)）。
+3. 本仓库提交，然后在本仓库发布（见下文「发布」；先素材包后插件包，手册见 [dsh-pet-assets/PUBLISH.md](../dsh-pet-assets/PUBLISH.md)）。
 
 测试：`npx vitest run tests/registry-service.spec.ts` 自持可跑（只需 `cordis` 与 `vitest`）；含 `tests/pet-app.spec.ts` 的全量测试在 monorepo workspace 内跑。
 
+## 发布
+
+`package.json` 的 `version` 归本仓库所有：`scripts\sync-from-monorepo.cmd` 镜像其余所有字段、只保留它。monorepo 那份带的是 workspace 版本（`0.2.1-rc.3`），早先的整文件覆盖会把已发布的版本号改掉——npm 上的 `0.4.0` 因此没有对应的 commit 与 tag。
+
+```bash
+node scripts\release.mjs 0.4.1 --dry-run   # 预检 + 打包清单，不发布
+node scripts\release.mjs 0.4.1             # 发布，提交 "chore(release): 0.4.1"，打 tag v0.4.1
+git push --follow-tags
+```
+
+以下任一条件不满足，脚本拒绝发布：工作树干净、新版本号大于当前值、tag `v<版本>` 不存在、构建产物齐备、`lib/` 里只有一个 bundle chunk（`tsdown` 用 `clean:false`，残留的旧 `service-*.js` 会被打进包）。发布失败会自动还原 `package.json`，工作树不会停留在一个并未发布的版本号上。预发布版本（`x.y.z-rc.N`）以 `--tag rc` 发布。
+
+每个已发布版本都能用 tag `v<版本>` 定位——回答"npm 上是什么"的是 tag，不是清单。因此仓库里的版本号恒等于**最后已发布**的版本。
+
 ## 文档
 
 - 控制面契约（所有宠物实现共同讲述的冻结消费方 API）见项目文档的多宠指南。
+- 说话朗读（BreezeBlue TTS）设计笔记见 monorepo 工作区的 `packages/bundle/pet-app/docs/tts.md`。
 - 已知边界与设计笔记见仓库 wiki 与项目工程文档。
 
 

package/carrier/dist-renderer/assets/{index-C61Q_dyJ.js → index-BMH7auTh.js}

@@ -1 +1 @@
-(function(){let e=document.createElement(`link`).relList;if(e&&e.supports&&e.supports(`modulepreload`))return;for(let e of document.querySelectorAll(`link[rel="modulepreload"]`))n(e);new MutationObserver(e=>{for(let t of e)if(t.type===`childList`)for(let e of t.addedNodes)e.tagName===`LINK`&&e.rel===`modulepreload`&&n(e)}).observe(document,{childList:!0,subtree:!0});function t(e){let t={};return e.integrity&&(t.integrity=e.integrity),e.referrerPolicy&&(t.referrerPolicy=e.referrerPolicy),t.credentials=e.crossOrigin===`use-credentials`?`include`:e.crossOrigin===`anonymous`?`omit`:`same-origin`,t}function n(e){if(e.ep)return;e.ep=!0;let n=t(e);fetch(e.href,n)}})();var e=`whale`,t=globalThis,n={idle:[{dir:`idle`,file:`待机呼吸休闲`}],thinking:[{dir:`random`,file:`深度思考碎碎念`}],working:[{dir:`random`,file:`工作状态-忙碌点按`},{dir:`random`,file:`写代码`},{dir:`random`,file:`原地敲击桌面互动`}],waiting:[{dir:`turn`,file:`东张西望`}],error:[{dir:`random`,file:`被吓一跳`}],celebrate:[{dir:`click`,file:`点击回应-开心跃动`}],touch:[{dir:`click`,file:`点击回应-开心跃动`},{dir:`click`,file:`点击回应-元气挥手`},{dir:`click`,file:`点击回应-害羞惊讶`},{dir:`click`,file:`点击回应-傲娇生气`},{dir:`click`,file:`点击回应-挠痒咯咯笑`}]},r=new Set([`深度思考碎碎念`,`工作状态-忙碌点按`,`写代码`,`原地敲击桌面互动`,`被吓一跳`]);function i(e){let t=document.querySelector(e);if(t===null)throw Error(`pet renderer: missing element ${e}`);return t}var a=i(`#video`);a.addEventListener(`error`,()=>{console.error(`[pet-video] source failed: ${a.src} ${String(a.error?.message??``)}`)});var o=i(`#stage`),s=i(`#bubble`);function c(t){let r=n[t];if(r===void 0)throw Error(`pet renderer: unknown animation ${t}`);let i=r[Math.floor(Math.random()*r.length)]??r[0];return`pet-asset:///${e}/videos/${i.dir}/${encodeURIComponent(i.file)}.webm`}function l(e,t){let n=t.getContext(`webgl`,{alpha:!0,premultipliedAlpha:!1});if(n===null){t.replaceWith(e),e.style.display=`block`;return}let r=(e,t)=>{let r=n.createShader(e);if(r===null)throw Error(`pet renderer: shader allocation failed`);if(n.shaderSource(r,t),n.compileShader(r),!n.getShaderParameter(r,n.COMPILE_STATUS))throw Error(`pet renderer: shader compile failed: ${String(n.getShaderInfoLog(r))}`);return r},i=n.createProgram();if(i===null)throw Error(`pet renderer: program allocation failed`);if(n.attachShader(i,r(n.VERTEX_SHADER,`attribute vec2 p; varying vec2 v;void main(){ v = vec2(p.x * 0.5 + 0.5, 0.5 - p.y * 0.5); gl_Position = vec4(p, 0.0, 1.0); }`)),n.attachShader(i,r(n.FRAGMENT_SHADER,`precision highp float; varying vec2 v; uniform sampler2D t;void main(){ gl_FragColor = texture2D(t, v); }`)),n.linkProgram(i),!n.getProgramParameter(i,n.LINK_STATUS))throw Error(`pet renderer: program link failed: ${String(n.getProgramInfoLog(i))}`);n.useProgram(i);let a=n.createBuffer();n.bindBuffer(n.ARRAY_BUFFER,a),n.bufferData(n.ARRAY_BUFFER,new Float32Array([-1,-1,1,-1,-1,1,1,1]),n.STATIC_DRAW);let o=n.getAttribLocation(i,`p`);n.enableVertexAttribArray(o),n.vertexAttribPointer(o,2,n.FLOAT,!1,0,0);let s=n.createTexture();n.bindTexture(n.TEXTURE_2D,s),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_WRAP_S,n.CLAMP_TO_EDGE),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_WRAP_T,n.CLAMP_TO_EDGE),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_MIN_FILTER,n.LINEAR),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_MAG_FILTER,n.LINEAR),n.enable(n.BLEND),n.blendFunc(n.SRC_ALPHA,n.ONE_MINUS_SRC_ALPHA),n.clearColor(0,0,0,0);let c=()=>{e.readyState<2||e.videoWidth===0||((t.width!==e.videoWidth||t.height!==e.videoHeight)&&(t.width=e.videoWidth,t.height=e.videoHeight),n.viewport(0,0,t.width,t.height),n.texImage2D(n.TEXTURE_2D,0,n.RGBA,n.RGBA,n.UNSIGNED_BYTE,e),n.clear(n.COLOR_BUFFER_BIT),n.drawArrays(n.TRIANGLE_STRIP,0,4))},l=e,u=()=>{typeof l.requestVideoFrameCallback==`function`?l.requestVideoFrameCallback(()=>{c(),u()}):requestAnimationFrame(()=>{c(),u()})};u()}var u=`idle`,d=null,f=0;function p(e){let t=c(e);a.src!==t&&(a.src=t,a.loop=e!==`celebrate`,a.play().catch(()=>{}))}function m(){p(Date.now()<f?`error`:d===null?u===`working`?`working`:u:`waiting`),T(),U()}function h(e){if(u===e)return;let t=u===`working`&&e===`idle`;if(u=e,e!==`idle`&&x!==void 0&&(clearTimeout(x),x=void 0),t){g(`celebrate`);return}m()}function g(e,t){_(n[e]?.[0]??{dir:`click`,file:e},t)}function _(n,r){let i=`pet-asset:///${e}/videos/${n.dir}/${encodeURIComponent(n.file)}.webm`;if(a.src===i)return;C=!0;let o=()=>{a.onended=null,a.onerror=null,C=!1,t.petDesktop?.reportActionDone({action:n.file,durationMs:Number.isFinite(a.duration)?Math.round(a.duration*1e3):void 0,...r===void 0?{}:{requestId:r}}),m()};a.onended=o,a.onerror=o,a.loop=!1,a.src=i,a.play().catch(()=>{})}function v(){f=Date.now()+6e3,m(),setTimeout(m,6100)}var y=new Map;t.petDesktop?.onCatalog?.(e=>{let t=e.actions;if(Array.isArray(t)){y.clear();for(let e of t){let t=e;typeof t.id==`string`&&typeof t.dir==`string`&&typeof t.file==`string`&&y.set(t.id,{dir:t.dir,file:t.file})}T()}});var b={enabled:!1,gapMinutes:10},x,S,C=!1;function w(){return[...y.values()].filter(e=>e.dir===`random`&&!r.has(e.file)&&e.file!==S)}function T(){x===void 0&&(!b.enabled||u!==`idle`||d!==null||Date.now()<f||w().length!==0&&(x=setTimeout(()=>{if(x=void 0,!b.enabled||u!==`idle`||d!==null||C||Date.now()<f){T();return}let e=w(),t=e[Math.floor(Math.random()*e.length)];t!==void 0&&(S=t.file,_(t))},Math.max(1,b.gapMinutes)*6e4)))}var E=new Map;function D(){s.hidden=!0,s.replaceChildren(),t.petDesktop?.setBubbleVisible(!1)}function O(e){if(e===void 0||typeof e==`string`)return e;let t=navigator.languages??[navigator.language];for(let n of t){let t=e[n.split(`-`)[0]??``];if(typeof t==`string`)return t}return typeof e.en==`string`?e.en:void 0}function k(e,n){s.replaceChildren();let r=document.createElement(`p`);r.className=`bubble-title`,r.textContent=e.toolName===void 0||e.toolName===``?`请求执行`:`请求执行：${e.toolName}`;let i=document.createElement(`p`);i.className=`bubble-detail`,i.textContent=O(e.displayReason)??e.reason??``;let a=document.createElement(`div`);a.className=`bubble-actions`;let o=document.createElement(`button`);o.className=`bubble-button primary`,o.textContent=`允许`,o.addEventListener(`click`,()=>{D(),n(`allowed-once`)});let c=document.createElement(`button`);c.className=`bubble-button danger`,c.textContent=`拒绝`,c.addEventListener(`click`,()=>{D(),n(`rejected`)}),a.append(o,c),s.append(r,i,a),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m()}function A(e,n){E.clear(),s.replaceChildren();for(let t of e){E.set(t.id,[]);let r=document.createElement(`p`);r.className=`bubble-question`;let i=O(t.question)??``,a=O(t.header);r.textContent=a===void 0||a===``?i:`${a} · ${i}`,s.append(r);let o=O(t.detail);if(o!==void 0&&o!==``){let e=document.createElement(`p`);e.className=`bubble-detail`,e.textContent=o,s.append(e)}let c=document.createElement(`div`);c.className=`bubble-options`;for(let r of t.options??[]){let i=O(r.label)??``,a=document.createElement(`button`);a.className=`bubble-button`,a.textContent=i;let o=O(r.description);o!==void 0&&(a.title=o),a.addEventListener(`click`,()=>{E.set(t.id,[i]);for(let e of c.children)e.classList.remove(`primary`);a.classList.add(`primary`),e.every(e=>(E.get(e.id)??[]).length>0)&&n({answers:e.map(e=>({id:e.id,selected:E.get(e.id)??[]}))})}),c.append(a)}s.append(c)}s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m()}var j=0,M,N=[];function P(){l(a,o),m()}var F=i(`#pet`);function I(e,t){let n=F.getBoundingClientRect(),r=Math.min(n.width/640,n.height/360),i=640*r,a=360*r,o=(e-n.left-(n.width-i)/2)/r,s=(t-n.top-(n.height-a)/2)/r,c=e=>o>=e[0]&&o<=e[2]&&s>=e[1]&&s<=e[3];return c([185,60,436,195])?`head`:c([212,60,428,330])?`body`:`unknown`}var L=5,R=500,z;function B(e,r){let i=I(e,r),a=n.touch;a!==void 0&&a.length>0&&d===null&&Date.now()>=f&&_(a[Math.floor(Math.random()*a.length)]),z!==void 0&&clearTimeout(z),z=setTimeout(()=>{z=void 0,t.petDesktop?.reportTouch({part:i})},260)}F.addEventListener(`pointerdown`,e=>{if(e.button!==0)return;try{F.setPointerCapture(e.pointerId)}catch{}let n=e.screenX,r=e.screenY,i=Date.now();t.petDesktop?.dragStart(n,r);let a=e=>{t.petDesktop?.dragMove(e.screenX,e.screenY)},o=e=>{F.removeEventListener(`pointermove`,a),F.removeEventListener(`pointerup`,o),F.removeEventListener(`pointercancel`,o),t.petDesktop?.dragEnd(),Math.hypot(e.screenX-n,e.screenY-r)<=L&&Date.now()-i<=R&&B(e.clientX,e.clientY)};F.addEventListener(`pointermove`,a),F.addEventListener(`pointerup`,o),F.addEventListener(`pointercancel`,o)});function V(){if(d!==null||Date.now()<f)return;s.replaceChildren();let e=document.createElement(`div`);e.className=`bubble-chat`;let n=document.createElement(`input`);n.className=`bubble-chat-input`,n.maxLength=2e3,n.placeholder=`和鲸鱼娘说点什么…`;let r=document.createElement(`button`);r.className=`bubble-button primary`,r.textContent=`发送`;let i=document.createElement(`button`);i.className=`bubble-button`,i.textContent=`取消`,i.addEventListener(`click`,()=>{D()});let a=async()=>{let e=n.value.trim();if(e===``||r.disabled)return;r.disabled=!0,n.disabled=!0;let i=await t.petDesktop?.sendChat(e);if(i?.ok===!0){D();return}r.disabled=!1,n.disabled=!1,n.placeholder=i?.reason===`busy`?`上一条还没送达，稍等一下…`:`没发出去，再试一次`,n.focus()};r.addEventListener(`click`,()=>{a()}),n.addEventListener(`keydown`,e=>{e.key===`Enter`?(e.preventDefault(),a()):e.key===`Escape`&&D()}),e.append(n,r,i),s.append(e),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m(),n.focus()}F.addEventListener(`dblclick`,e=>{e.stopPropagation(),z!==void 0&&(clearTimeout(z),z=void 0),V()}),t.petDesktop?.onSay(e=>{if(d!==null||e.text===``)return;s.replaceChildren();let n=document.createElement(`p`);n.className=`bubble-detail`,n.textContent=e.text,s.append(n),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),setTimeout(()=>{d===null&&s.textContent===e.text&&D()},4e3+Math.min(e.text.length*60,4e3))});var H=``,U=()=>{let e=JSON.stringify({state:u,override:d,animation:decodeURIComponent(a.src.split(`/`).pop()??``)});e!==H&&(H=e,t.petDesktop?.reportStatus(JSON.parse(e)))};t.petDesktop?.onState(e=>{let t=e,n=t.autonomy;if(typeof n==`object`&&n){let e=n,t=typeof e.idleAnimation==`boolean`?e.idleAnimation:b.enabled,r=typeof e.gapMinutes==`number`&&Number.isFinite(e.gapMinutes)?Math.min(120,Math.max(1,Math.round(e.gapMinutes))):b.gapMinutes;(t!==b.enabled||r!==b.gapMinutes)&&(b={enabled:t,gapMinutes:r},x!==void 0&&(clearTimeout(x),x=void 0),T())}let r=t.state;r===`idle`||r===`thinking`||r===`working`?h(r):r===`error`&&v()}),t.petDesktop?.onAction(e=>{let t=e,n=t.action,r=typeof t.requestId==`string`?t.requestId:void 0;if(n===`celebrate`)g(`celebrate`,r);else if(n===`error`)v();else if(typeof n==`string`){let e=y.get(n);e!==void 0&&_(e,r)}});function W(){let e=s.querySelector(`.bubble-queue`);if(N.length===0){e?.remove();return}let t=`还有 ${String(N.length)} 个待处理`;if(e!==null){e.textContent=t;return}let n=document.createElement(`p`);n.className=`bubble-queue`,n.textContent=t,s.append(n)}function G(e,n){let r=++j;M=e;let i=n=>{if(r!==j)return;D(),d=null,M=void 0,m(),t.petDesktop?.answerInteraction(e,n);let i=N.shift();i!==void 0&&G(i.id,i.message)};n.kind===`question`?(d=`waiting_question`,m(),A(n.questions??[],i)):(d=`waiting_approval`,m(),k({toolName:n.toolName,reason:n.reason,...n.displayReason===void 0?{}:{displayReason:n.displayReason}},i)),W()}t.petDesktop?.onInteraction(e=>{let t=e,n=t.id;if(typeof n==`string`){if(M!==void 0){N.push({id:n,message:t}),W();return}G(n,t)}}),t.petDesktop?.onInteractionCancel(e=>{let t=N.findIndex(t=>t.id===e.id);if(t!==-1){N.splice(t,1),W();return}if(e.id!==M)return;j+=1,M=void 0,D(),d=null,m();let n=N.shift();n!==void 0&&G(n.id,n.message)}),P();
+(function(){let e=document.createElement(`link`).relList;if(e&&e.supports&&e.supports(`modulepreload`))return;for(let e of document.querySelectorAll(`link[rel="modulepreload"]`))n(e);new MutationObserver(e=>{for(let t of e)if(t.type===`childList`)for(let e of t.addedNodes)e.tagName===`LINK`&&e.rel===`modulepreload`&&n(e)}).observe(document,{childList:!0,subtree:!0});function t(e){let t={};return e.integrity&&(t.integrity=e.integrity),e.referrerPolicy&&(t.referrerPolicy=e.referrerPolicy),t.credentials=e.crossOrigin===`use-credentials`?`include`:e.crossOrigin===`anonymous`?`omit`:`same-origin`,t}function n(e){if(e.ep)return;e.ep=!0;let n=t(e);fetch(e.href,n)}})();var e=`whale`,t=globalThis,n={idle:[{dir:`idle`,file:`待机呼吸休闲`}],thinking:[{dir:`random`,file:`深度思考碎碎念`}],working:[{dir:`random`,file:`工作状态-忙碌点按`},{dir:`random`,file:`写代码`},{dir:`random`,file:`原地敲击桌面互动`}],waiting:[{dir:`turn`,file:`东张西望`}],error:[{dir:`random`,file:`被吓一跳`}],celebrate:[{dir:`click`,file:`点击回应-开心跃动`}],touch:[{dir:`click`,file:`点击回应-开心跃动`},{dir:`click`,file:`点击回应-元气挥手`},{dir:`click`,file:`点击回应-害羞惊讶`},{dir:`click`,file:`点击回应-傲娇生气`},{dir:`click`,file:`点击回应-挠痒咯咯笑`}]},r=new Set([`深度思考碎碎念`,`工作状态-忙碌点按`,`写代码`,`原地敲击桌面互动`,`被吓一跳`]);function i(e){let t=document.querySelector(e);if(t===null)throw Error(`pet renderer: missing element ${e}`);return t}var a=i(`#video`);a.addEventListener(`error`,()=>{console.error(`[pet-video] source failed: ${a.src} ${String(a.error?.message??``)}`)});var o=i(`#stage`),s=i(`#bubble`);function c(t){let r=n[t];if(r===void 0)throw Error(`pet renderer: unknown animation ${t}`);let i=r[Math.floor(Math.random()*r.length)]??r[0];return`pet-asset:///${e}/videos/${i.dir}/${encodeURIComponent(i.file)}.webm`}function l(e,t){let n=t.getContext(`webgl`,{alpha:!0,premultipliedAlpha:!1});if(n===null){t.replaceWith(e),e.style.display=`block`;return}let r=(e,t)=>{let r=n.createShader(e);if(r===null)throw Error(`pet renderer: shader allocation failed`);if(n.shaderSource(r,t),n.compileShader(r),!n.getShaderParameter(r,n.COMPILE_STATUS))throw Error(`pet renderer: shader compile failed: ${String(n.getShaderInfoLog(r))}`);return r},i=n.createProgram();if(i===null)throw Error(`pet renderer: program allocation failed`);if(n.attachShader(i,r(n.VERTEX_SHADER,`attribute vec2 p; varying vec2 v;void main(){ v = vec2(p.x * 0.5 + 0.5, 0.5 - p.y * 0.5); gl_Position = vec4(p, 0.0, 1.0); }`)),n.attachShader(i,r(n.FRAGMENT_SHADER,`precision highp float; varying vec2 v; uniform sampler2D t;void main(){ gl_FragColor = texture2D(t, v); }`)),n.linkProgram(i),!n.getProgramParameter(i,n.LINK_STATUS))throw Error(`pet renderer: program link failed: ${String(n.getProgramInfoLog(i))}`);n.useProgram(i);let a=n.createBuffer();n.bindBuffer(n.ARRAY_BUFFER,a),n.bufferData(n.ARRAY_BUFFER,new Float32Array([-1,-1,1,-1,-1,1,1,1]),n.STATIC_DRAW);let o=n.getAttribLocation(i,`p`);n.enableVertexAttribArray(o),n.vertexAttribPointer(o,2,n.FLOAT,!1,0,0);let s=n.createTexture();n.bindTexture(n.TEXTURE_2D,s),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_WRAP_S,n.CLAMP_TO_EDGE),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_WRAP_T,n.CLAMP_TO_EDGE),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_MIN_FILTER,n.LINEAR),n.texParameteri(n.TEXTURE_2D,n.TEXTURE_MAG_FILTER,n.LINEAR),n.enable(n.BLEND),n.blendFunc(n.SRC_ALPHA,n.ONE_MINUS_SRC_ALPHA),n.clearColor(0,0,0,0);let c=()=>{e.readyState<2||e.videoWidth===0||((t.width!==e.videoWidth||t.height!==e.videoHeight)&&(t.width=e.videoWidth,t.height=e.videoHeight),n.viewport(0,0,t.width,t.height),n.texImage2D(n.TEXTURE_2D,0,n.RGBA,n.RGBA,n.UNSIGNED_BYTE,e),n.clear(n.COLOR_BUFFER_BIT),n.drawArrays(n.TRIANGLE_STRIP,0,4))},l=e,u=()=>{typeof l.requestVideoFrameCallback==`function`?l.requestVideoFrameCallback(()=>{c(),u()}):requestAnimationFrame(()=>{c(),u()})};u()}var u=`idle`,d=null,f=0;function p(e){let t=c(e);a.src!==t&&(a.src=t,a.loop=e!==`celebrate`,a.play().catch(()=>{}))}function m(){p(Date.now()<f?`error`:d===null?u===`working`?`working`:u:`waiting`),T(),Y()}function h(e){if(u===e)return;let t=u===`working`&&e===`idle`;if(u=e,e!==`idle`&&x!==void 0&&(clearTimeout(x),x=void 0),t){g(`celebrate`);return}m()}function g(e,t){_(n[e]?.[0]??{dir:`click`,file:e},t)}function _(n,r){let i=`pet-asset:///${e}/videos/${n.dir}/${encodeURIComponent(n.file)}.webm`;if(a.src===i)return;C=!0;let o=()=>{a.onended=null,a.onerror=null,C=!1,t.petDesktop?.reportActionDone({action:n.file,durationMs:Number.isFinite(a.duration)?Math.round(a.duration*1e3):void 0,...r===void 0?{}:{requestId:r}}),m()};a.onended=o,a.onerror=o,a.loop=!1,a.src=i,a.play().catch(()=>{})}function v(){f=Date.now()+6e3,m(),setTimeout(m,6100)}var y=new Map;t.petDesktop?.onCatalog?.(e=>{let t=e.actions;if(Array.isArray(t)){y.clear();for(let e of t){let t=e;typeof t.id==`string`&&typeof t.dir==`string`&&typeof t.file==`string`&&y.set(t.id,{dir:t.dir,file:t.file})}T()}});var b={enabled:!1,gapMinutes:10},x,S,C=!1;function w(){return[...y.values()].filter(e=>e.dir===`random`&&!r.has(e.file)&&e.file!==S)}function T(){x===void 0&&(!b.enabled||u!==`idle`||d!==null||Date.now()<f||w().length!==0&&(x=setTimeout(()=>{if(x=void 0,!b.enabled||u!==`idle`||d!==null||C||Date.now()<f){T();return}let e=w(),t=e[Math.floor(Math.random()*e.length)];t!==void 0&&(S=t.file,_(t))},Math.max(1,b.gapMinutes)*6e4)))}var E=new Map;function D(){s.hidden=!0,s.replaceChildren(),t.petDesktop?.setBubbleVisible(!1)}function O(e){if(e===void 0||typeof e==`string`)return e;let t=navigator.languages??[navigator.language];for(let n of t){let t=e[n.split(`-`)[0]??``];if(typeof t==`string`)return t}return typeof e.en==`string`?e.en:void 0}function k(e,n){s.replaceChildren();let r=document.createElement(`p`);r.className=`bubble-title`,r.textContent=e.toolName===void 0||e.toolName===``?`请求执行`:`请求执行：${e.toolName}`;let i=document.createElement(`p`);i.className=`bubble-detail`,i.textContent=O(e.displayReason)??e.reason??``;let a=document.createElement(`div`);a.className=`bubble-actions`;let o=document.createElement(`button`);o.className=`bubble-button primary`,o.textContent=`允许`,o.addEventListener(`click`,()=>{D(),n(`allowed-once`)});let c=document.createElement(`button`);c.className=`bubble-button danger`,c.textContent=`拒绝`,c.addEventListener(`click`,()=>{D(),n(`rejected`)}),a.append(o,c),s.append(r,i,a),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m()}function A(e,n){E.clear(),s.replaceChildren();for(let t of e){E.set(t.id,[]);let r=document.createElement(`p`);r.className=`bubble-question`;let i=O(t.question)??``,a=O(t.header);r.textContent=a===void 0||a===``?i:`${a} · ${i}`,s.append(r);let o=O(t.detail);if(o!==void 0&&o!==``){let e=document.createElement(`p`);e.className=`bubble-detail`,e.textContent=o,s.append(e)}let c=document.createElement(`div`);c.className=`bubble-options`;for(let r of t.options??[]){let i=O(r.label)??``,a=document.createElement(`button`);a.className=`bubble-button`,a.textContent=i;let o=O(r.description);o!==void 0&&(a.title=o),a.addEventListener(`click`,()=>{E.set(t.id,[i]);for(let e of c.children)e.classList.remove(`primary`);a.classList.add(`primary`),e.every(e=>(E.get(e.id)??[]).length>0)&&n({answers:e.map(e=>({id:e.id,selected:E.get(e.id)??[]}))})}),c.append(a)}s.append(c)}s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m()}var j=0,M,N=[];function P(){l(a,o),m()}var F=i(`#pet`);function I(e,t){let n=F.getBoundingClientRect(),r=Math.min(n.width/640,n.height/360),i=640*r,a=360*r,o=(e-n.left-(n.width-i)/2)/r,s=(t-n.top-(n.height-a)/2)/r,c=e=>o>=e[0]&&o<=e[2]&&s>=e[1]&&s<=e[3];return c([185,60,436,195])?`head`:c([212,60,428,330])?`body`:`unknown`}var L=5,R=500,z;function B(e,r){let i=I(e,r),a=n.touch;a!==void 0&&a.length>0&&d===null&&Date.now()>=f&&_(a[Math.floor(Math.random()*a.length)]),z!==void 0&&clearTimeout(z),z=setTimeout(()=>{z=void 0,t.petDesktop?.reportTouch({part:i})},260)}F.addEventListener(`pointerdown`,e=>{if(e.button!==0)return;try{F.setPointerCapture(e.pointerId)}catch{}let n=e.screenX,r=e.screenY,i=Date.now();t.petDesktop?.dragStart(n,r);let a=e=>{t.petDesktop?.dragMove(e.screenX,e.screenY)},o=e=>{F.removeEventListener(`pointermove`,a),F.removeEventListener(`pointerup`,o),F.removeEventListener(`pointercancel`,o),t.petDesktop?.dragEnd(),Math.hypot(e.screenX-n,e.screenY-r)<=L&&Date.now()-i<=R&&B(e.clientX,e.clientY)};F.addEventListener(`pointermove`,a),F.addEventListener(`pointerup`,o),F.addEventListener(`pointercancel`,o)});function V(){if(d!==null||Date.now()<f)return;K(),s.replaceChildren();let e=document.createElement(`div`);e.className=`bubble-chat`;let n=document.createElement(`input`);n.className=`bubble-chat-input`,n.maxLength=2e3,n.placeholder=`和鲸鱼娘说点什么…`;let r=document.createElement(`button`);r.className=`bubble-button primary`,r.textContent=`发送`;let i=document.createElement(`button`);i.className=`bubble-button`,i.textContent=`取消`,i.addEventListener(`click`,()=>{D()});let a=async()=>{let e=n.value.trim();if(e===``||r.disabled)return;r.disabled=!0,n.disabled=!0;let i=await t.petDesktop?.sendChat(e);if(i?.ok===!0){D();return}r.disabled=!1,n.disabled=!1,n.placeholder=i?.reason===`busy`?`上一条还没送达，稍等一下…`:`没发出去，再试一次`,n.focus()};r.addEventListener(`click`,()=>{a()}),n.addEventListener(`keydown`,e=>{e.key===`Enter`?(e.preventDefault(),a()):e.key===`Escape`&&D()}),e.append(n,r,i),s.append(e),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),m(),n.focus()}F.addEventListener(`dblclick`,e=>{e.stopPropagation(),z!==void 0&&(clearTimeout(z),z=void 0),V()});var H;function U(e,t){H!==void 0&&clearTimeout(H),H=setTimeout(()=>{H=void 0,d===null&&s.textContent===e&&D()},Math.max(1e3,t))}var W,G;function K(){let e=W;e!==void 0&&!e.paused&&e.pause()}function q(e,t){G!==void 0&&URL.revokeObjectURL(G);let n=W??=new Audio;G=URL.createObjectURL(new Blob([t],{type:`audio/mpeg`})),n.src=G,n.onloadedmetadata=()=>{Number.isFinite(n.duration)&&n.duration>0&&U(e,n.duration*1e3+1500)},n.onended=()=>{d===null&&s.textContent===e&&D()},n.onerror=()=>{},n.play().catch(()=>{})}t.petDesktop?.onSay(e=>{if(d!==null||e.text===``)return;K(),s.replaceChildren();let n=document.createElement(`p`);n.className=`bubble-detail`,n.textContent=e.text,s.append(n),s.hidden=!1,t.petDesktop?.setBubbleVisible(!0),U(e.text,4e3+Math.min(e.text.length*60,4e3));let r=e.audio;r!==void 0&&r.length>0&&q(e.text,r)});var J=``,Y=()=>{let e=JSON.stringify({state:u,override:d,animation:decodeURIComponent(a.src.split(`/`).pop()??``)});e!==J&&(J=e,t.petDesktop?.reportStatus(JSON.parse(e)))};t.petDesktop?.onState(e=>{let t=e,n=t.autonomy;if(typeof n==`object`&&n){let e=n,t=typeof e.idleAnimation==`boolean`?e.idleAnimation:b.enabled,r=typeof e.gapMinutes==`number`&&Number.isFinite(e.gapMinutes)?Math.min(120,Math.max(1,Math.round(e.gapMinutes))):b.gapMinutes;(t!==b.enabled||r!==b.gapMinutes)&&(b={enabled:t,gapMinutes:r},x!==void 0&&(clearTimeout(x),x=void 0),T())}let r=t.state;r===`idle`||r===`thinking`||r===`working`?h(r):r===`error`&&v()}),t.petDesktop?.onAction(e=>{let t=e,n=t.action,r=typeof t.requestId==`string`?t.requestId:void 0;if(n===`celebrate`)g(`celebrate`,r);else if(n===`error`)v();else if(typeof n==`string`){let e=y.get(n);e!==void 0&&_(e,r)}});function X(){let e=s.querySelector(`.bubble-queue`);if(N.length===0){e?.remove();return}let t=`还有 ${String(N.length)} 个待处理`;if(e!==null){e.textContent=t;return}let n=document.createElement(`p`);n.className=`bubble-queue`,n.textContent=t,s.append(n)}function Z(e,n){K();let r=++j;M=e;let i=n=>{if(r!==j)return;D(),d=null,M=void 0,m(),t.petDesktop?.answerInteraction(e,n);let i=N.shift();i!==void 0&&Z(i.id,i.message)};n.kind===`question`?(d=`waiting_question`,m(),A(n.questions??[],i)):(d=`waiting_approval`,m(),k({toolName:n.toolName,reason:n.reason,...n.displayReason===void 0?{}:{displayReason:n.displayReason}},i)),X()}t.petDesktop?.onInteraction(e=>{let t=e,n=t.id;if(typeof n==`string`){if(M!==void 0){N.push({id:n,message:t}),X();return}Z(n,t)}}),t.petDesktop?.onInteractionCancel(e=>{let t=N.findIndex(t=>t.id===e.id);if(t!==-1){N.splice(t,1),X();return}if(e.id!==M)return;j+=1,M=void 0,D(),d=null,m();let n=N.shift();n!==void 0&&Z(n.id,n.message)}),P();

package/carrier/dist-renderer/index.html

@@ -4,7 +4,7 @@
   <meta charset="utf-8" />
   <meta name="viewport" content="width=device-width, initial-scale=1" />
   <title>dsh pet</title>
-  <script type="module" crossorigin src="./assets/index-C61Q_dyJ.js"></script>
+  <script type="module" crossorigin src="./assets/index-BMH7auTh.js"></script>
   <link rel="stylesheet" crossorigin href="./assets/index-BHG2MI7t.css">
 </head>
 <body>

package/carrier/lib/main.js

@@ -22,6 +22,7 @@ import { homedir } from 'node:os';
 import { dirname, join, normalize, resolve, sep } from 'node:path';
 import { fileURLToPath } from 'node:url';
 import { createRequire } from 'node:module';
+import { createSayTts } from "./tts.js";
 const HERE = dirname(fileURLToPath(import.meta.url));
 const PET_PROFILE_NAME = 'pet';
 const ASSET_SCHEME = 'pet-asset';
@@ -110,7 +111,7 @@ process.env.ELECTRON_DISABLE_SECURITY_WARNINGS = 'true';
 import { appendFileSync as __afs } from 'node:fs';
 const __bootLog = (line) => {
     try {
-        __afs('C:/Users/beyondguo/.dsh/carrier-boot.log', `${new Date().toISOString()} ${line}\n`);
+        __afs('C:/Users/beyondguo/.dsh/whale598/carrier-boot.log', `${new Date().toISOString()} ${line}\n`);
     }
     catch { /* ignore */ }
 };
@@ -287,38 +288,44 @@ function spawnHostChild() {
  * The pet-surface locator: pet-app bundles inside a running runtime publish
  * their authenticated root here (the desktop shell keeps its URL in process
  * memory only). A published URL wins over spawning a dedicated profile, so the
- * pet follows whichever live runtime serves /pet/ — the user's desktop when it
+ * pet follows whichever live runtime serves /whale598/ — the user's desktop when it
  * runs, otherwise the last publisher still alive.
  */
 async function readLocatorUrl() {
-    const path = join(process.env.DSH_HOME ?? join(homedir(), '.dsh'), 'pet-surface-url.json');
-    try {
-        const record = JSON.parse(await readFile(path, 'utf8'));
-        if (typeof record.url !== 'string' || record.url === '')
-            return undefined;
-        if (typeof record.pid === 'number') {
-            try {
-                process.kill(record.pid, 0);
+    // whale598/ first (current publisher), then the legacy root copy — the
+    // locator moved with the whale598 consolidation (publishLocator writes the
+    // new path; old copies answer as fallback).
+    const home = process.env.DSH_HOME ?? join(homedir(), '.dsh');
+    for (const path of [join(home, 'whale598', 'pet-surface-url.json'), join(home, 'pet-surface-url.json')]) {
+        try {
+            const record = JSON.parse(await readFile(path, 'utf8'));
+            if (typeof record.url !== 'string' || record.url === '')
+                continue;
+            if (typeof record.pid === 'number') {
+                try {
+                    process.kill(record.pid, 0);
+                }
+                catch {
+                    return undefined;
+                } // publisher gone
             }
-            catch {
-                return undefined;
-            } // publisher gone
+            return record.url;
         }
-        return record.url;
-    }
-    catch {
-        return undefined; // absent or unreadable: no live publisher
+        catch { /* try the next location */ }
     }
+    return undefined;
 }
 /**
- * The pet surface URL for an authenticated web root: path `/pet/` with the
+ * The pet surface URL for an authenticated web root: path `/whale598/` with the
  * token **dropped** — authorizeIndex mints the root cookie from the token and
  * rejects any token-carrying request on a subpath, so the pet page itself is
  * entered cookie-only after the root mint.
  */
 function petSurfaceUrl(authenticated) {
     const parsed = new URL(authenticated);
-    parsed.pathname = '/pet/';
+    // MUST stay in lockstep with the plugin's PET_PATH_PREFIX (/whale598) —
+    // separate builds, so the literal is duplicated here by design.
+    parsed.pathname = '/whale598/';
     parsed.search = '';
     parsed.hash = '';
     return parsed.toString();
@@ -439,6 +446,17 @@ async function main() {
         return;
     }
     const window = createPetWindow();
+    // Say-side TTS: the /say pipeline's audio companion (see tts.ts). It owns
+    // the DELIVERY to the page — bubble alone when synthesis is off, bubble +
+    // voice as one message when the mp3 lands in time. Failures never touch
+    // the bubble beyond showing it alone.
+    const sayTts = createSayTts({
+        home: DSH_HOME,
+        window,
+        deliver: (text, audio) => {
+            window.webContents.send('pet:say', audio === undefined ? { text } : { text, audio });
+        },
+    });
     window.on('resize', () => {
         console.log(`[pet] resized: ${JSON.stringify(window.getBounds())}`);
     });
@@ -465,7 +483,7 @@ async function main() {
     });
     // Connection's token exchange is root-path-only (authorizeIndex admits
     // `/?token=…`, never a subpath): load the authenticated root once to mint
-    // the browser cookie, then enter /pet/ with it. The root load starts the
+    // the browser cookie, then enter /whale598/ with it. The root load starts the
     // Web GUI; the second navigation aborts it, so the web app is at most a
     // flash.
     await window.loadURL(authenticated).catch(() => { });
@@ -881,9 +899,12 @@ async function main() {
             }
             if (url.pathname === '/say') {
                 // Fire-and-forget: the driver says something through the pet; the
-                // bubble self-dismisses and never blocks a turn.
+                // bubble self-dismisses and never blocks a turn. The TTS module owns
+                // the delivery: immediate bubble when synthesis is off, otherwise
+                // bubble + voice as ONE message once the mp3 lands (held ≤ holdMs —
+                // text and voice appear together instead of the voice trailing).
                 const text = typeof body.text === 'string' ? body.text.slice(0, 200) : '';
-                window.webContents.send('pet:say', { text });
+                sayTts.deliver(text);
                 send(200, { ok: true });
                 return;
             }
@@ -979,7 +1000,9 @@ async function main() {
         // swap blindness). The legacy single file keeps being written during the
         // transition so pre-registry readers still see this carrier.
         const manifest = `${JSON.stringify({ port, pid: process.pid, since: Date.now(), pet: 'electron' })}\n`;
-        const registryDir = join(DSH_HOME, 'pet-http.d');
+        // Namespaced under whale598/ (collision avoidance); the driver scans
+        // the legacy pet-http.d/ as a read fallback for older pet builds.
+        const registryDir = join(DSH_HOME, 'whale598', 'pet-http.d');
         try {
             mkdirSync(registryDir, { recursive: true });
         }
@@ -989,8 +1012,7 @@ async function main() {
         const writeManifest = () => {
             void writeFile(join(registryDir, 'electron.json'), manifest, 'utf8')
                 .catch((error) => { console.error('[pet] could not write the registry entry:', String(error)); });
-            void writeFile(join(DSH_HOME, 'pet-http-electron.json'), manifest, 'utf8')
-                .catch(() => { });
+            // legacy 根镜像（pet-http-electron.json）停写：读侧双目录扫描已覆盖
         };
         writeManifest();
         // Re-assert on a cadence so a stale publisher cannot shadow a live pet.
@@ -1021,7 +1043,7 @@ async function main() {
         // find a dead port in pet-http.d/ — stale entries were the "旧端点残留"
         // incident class. Best effort: a killed carrier leaves the file, and the
         // readers' pid+probe validation is the backstop.
-        for (const file of ['pet-http.d/electron.json', 'pet-http-electron.json']) {
+        for (const file of ['whale598/pet-http.d/electron.json', 'pet-http.d/electron.json', 'pet-http-electron.json']) {
             void rm(join(DSH_HOME, file), { force: true }).catch(() => { });
         }
         if (handle === undefined)

package/carrier/lib/preload.js

@@ -18,7 +18,9 @@ contextBridge.exposeInMainWorld('petDesktop', {
     dragStart(screenX, screenY) { ipcRenderer.send('pet:drag-start', screenX, screenY); },
     dragMove(screenX, screenY) { ipcRenderer.send('pet:drag-move', screenX, screenY); },
     dragEnd() { ipcRenderer.send('pet:drag-end'); },
-    /** Control interface (driver's four operations) deliveries from the main process. */
+    /** Control interface (driver's four operations) deliveries from the main
+     * process. `audio` rides along when say-side TTS is configured and the
+     * synthesized mp3 landed in time — the bubble and its voice, one message. */
     onSay(listener) {
         ipcRenderer.on('pet:say', (_event, notice) => { listener(notice); });
     },

package/carrier/lib/tts.js

@@ -0,0 +1,212 @@
+/**
+ * Say-side TTS (BreezeBlue): speech synthesis as the /say bubble's voice.
+ * The control plane hands every spoken text here; this module owns the
+ * DELIVERY to the page — when synthesis is configured it holds the bubble
+ * until the mp3 lands (bounded by `holdMs`, default 3s) and forwards text +
+ * audio as ONE message, so the pet's mouth and voice start together. A
+ * timeout or failure shows the bubble alone and discards the late audio:
+ * the complaint to avoid is a voice trailing seconds behind its text. With
+ * synthesis off, delivery is the immediate bubble — yesterday's behavior.
+ *
+ * Any failure (no key, rate limit, network) degrades to visual-only and
+ * never surfaces to the driver: the /say HTTP response keeps its
+ * fire-and-forget budget, the delivery race runs entirely out-of-band.
+ *
+ * Configuration lives in the shared pet-settings.json (`tts` section, written
+ * by the plugin's settings page) and is read lazily per utterance with an
+ * mtime cache: a saved switch reaches the pet without any push or restart.
+ *
+ * The wire surface is a bare fetch against the BreezeBlue REST endpoint (no
+ * SDK — the carrier carries none): POST /v1/text-to-speech/{voice_id} with
+ * the `xi-api-key` header answers the mp3 bytes directly.
+ */
+import { statSync, readFileSync } from 'node:fs';
+import { join } from 'node:path';
+/** The BreezeBlue TTS endpoint (convert, synchronous mp3). */
+const TTS_URL = 'https://api.breeze.blue/v1/text-to-speech';
+/** Bounded wait for one synthesis round trip; the bubble shows regardless. */
+const REQUEST_TIMEOUT_MS = 20_000;
+/** The bubble's default patience for its voice: the mp3 lands earlier →
+ * bubble + voice go out together at once (this hold is a TIMEOUT ceiling,
+ * never a fixed wait); later → the bubble goes alone and the audio is
+ * discarded, so a voice never trails its text. */
+const DEFAULT_HOLD_MS = 5_000;
+/** A 200-char mp3 is at most ~1.5MB; anything larger is not a say track. */
+const MAX_AUDIO_BYTES = 8_000_000;
+/** Repeating the identical text within this window re-shows the bubble but
+ * does not re-speak (model double-calls should not double-talk). */
+const DEDUPE_MS = 3_000;
+/** After a 429, stay silent until the (capped) Retry-After lapses. */
+const RATE_LIMIT_CAP_S = 300;
+/** Defensive extraction of the settings section: unknown shapes degrade to
+ * "unset" and the pipeline treats the feature as off. */
+function normalizeTts(raw) {
+    if (typeof raw !== 'object' || raw === null)
+        return {};
+    const record = raw;
+    const config = {};
+    if (typeof record.enabled === 'boolean')
+        config.enabled = record.enabled;
+    if (typeof record.apiKey === 'string')
+        config.apiKey = record.apiKey;
+    if (typeof record.voiceId === 'string')
+        config.voiceId = record.voiceId;
+    if (typeof record.modelId === 'string' && record.modelId !== '')
+        config.modelId = record.modelId;
+    if (typeof record.languageCode === 'string' && record.languageCode !== '')
+        config.languageCode = record.languageCode;
+    if (typeof record.speed === 'number' && Number.isFinite(record.speed)) {
+        config.speed = Math.min(2, Math.max(0.5, record.speed));
+    }
+    if (typeof record.volume === 'number' && Number.isFinite(record.volume)) {
+        config.volume = Math.min(2, Math.max(0.01, record.volume));
+    }
+    if (typeof record.holdMs === 'number' && Number.isFinite(record.holdMs)) {
+        config.holdMs = Math.min(8000, Math.max(0, Math.round(record.holdMs)));
+    }
+    return config;
+}
+export function createSayTts(deps) {
+    const log = deps.log ?? ((line) => { console.log(`[pet-tts] ${line}`); });
+    const home = deps.home;
+    // ── config: mtime-cached dual-path read ───────────────────────────────────
+    // whale598/ first, legacy root fallback — the newest of whichever exist.
+    // One stat pair per utterance; the file is re-read only when an mtime
+    // moves, so a settings save lands on the very next say without any push.
+    let cache;
+    let lastConfigEcho = '';
+    const loadConfig = () => {
+        let newest;
+        for (const path of [join(home, 'whale598', 'pet-settings.json'), join(home, 'pet-settings.json')]) {
+            try {
+                const stat = statSync(path);
+                if (newest === undefined || stat.mtimeMs > newest.mtimeMs)
+                    newest = { path, mtimeMs: stat.mtimeMs };
+            }
+            catch { /* absent: try the next path */ }
+        }
+        if (newest === undefined)
+            return {};
+        if (cache !== undefined && cache.path === newest.path && cache.mtimeMs === newest.mtimeMs)
+            return cache.config;
+        try {
+            const parsed = JSON.parse(readFileSync(newest.path, 'utf8'));
+            const config = normalizeTts(parsed?.tts);
+            cache = { ...newest, config };
+            // One line per config CHANGE (never the key itself): the observable
+            // trace for "why is she silent" without a log per utterance.
+            const echo = `config from ${newest.path}: enabled=${String(config.enabled === true)}`
+                + ` key=${config.apiKey ? 'set' : 'unset'} voice=${config.voiceId ?? '-'}`
+                + ` model=${config.modelId ?? 'auto'} speed=${String(config.speed ?? 1)} volume=${String(config.volume ?? 1)}`
+                + ` hold=${String(config.holdMs ?? DEFAULT_HOLD_MS)}ms`;
+            if (echo !== lastConfigEcho) {
+                lastConfigEcho = echo;
+                log(echo);
+            }
+            return config;
+        }
+        catch (error) {
+            log(`pet-settings.json unreadable, TTS stays off: ${error instanceof Error ? error.message : String(error)}`);
+            return {};
+        }
+    };
+    // ── the single voice slot ─────────────────────────────────────────────────
+    // One delivery in flight: a newer deliver() abandons the older one (abort
+    // the fetch, disarm its hold), so bubble and voice always track the newest
+    // say. `settled` makes each delivery one-shot: whoever lands first — audio,
+    // error, or the hold timer — delivers and disarms the others.
+    let generation = 0;
+    let inflight;
+    let lastSpoken;
+    let mutedUntil = 0;
+    const deliver = (text) => {
+        generation += 1;
+        const gen = generation;
+        inflight?.abort();
+        inflight = undefined;
+        const trimmed = text.trim();
+        if (trimmed === '')
+            return;
+        const config = loadConfig();
+        const speakable = config.enabled === true
+            && config.apiKey !== undefined && config.apiKey !== ''
+            && config.voiceId !== undefined && config.voiceId !== ''
+            && Date.now() >= mutedUntil;
+        const dup = lastSpoken !== undefined
+            && lastSpoken.text === trimmed && Date.now() - lastSpoken.at < DEDUPE_MS;
+        if (!speakable || dup) {
+            deps.deliver(trimmed);
+            return;
+        }
+        lastSpoken = { text: trimmed, at: Date.now() };
+        holdAndDeliver(trimmed, config, gen);
+    };
+    /** Race the synthesis against the bubble's patience; the first to land
+     * delivers (audio or alone) and the loser is discarded, never late. */
+    const holdAndDeliver = (text, config, gen) => {
+        const abort = new AbortController();
+        inflight = abort;
+        const holdMs = config.holdMs ?? DEFAULT_HOLD_MS;
+        let settled = false;
+        const finish = (audio) => {
+            if (settled)
+                return;
+            settled = true;
+            clearTimeout(timer);
+            if (inflight === abort)
+                inflight = undefined;
+            if (gen === generation)
+                deps.deliver(text, audio);
+        };
+        const timer = setTimeout(() => finish(), holdMs);
+        void synthesize(text, config, abort).then((audio) => { finish(audio); }, (error) => {
+            // Superseded (our own abort): the newer delivery already owns the
+            // stage — stay silent. A real failure: deliver the bubble NOW
+            // instead of making it wait out the hold.
+            if (!abort.signal.aborted) {
+                log(`say TTS failed: ${error instanceof Error ? error.message : String(error)}`);
+            }
+            finish();
+        });
+    };
+    const synthesize = (text, config, abort) => {
+        const url = new URL(`${TTS_URL}/${encodeURIComponent(config.voiceId ?? '')}`);
+        url.searchParams.set('output_format', 'mp3');
+        const body = { text };
+        if (config.modelId !== undefined)
+            body.model_id = config.modelId;
+        if (config.languageCode !== undefined)
+            body.language_code = config.languageCode;
+        const voiceSettings = {};
+        if (config.speed !== undefined && config.speed !== 1)
+            voiceSettings.speed = config.speed;
+        if (config.volume !== undefined && config.volume !== 1)
+            voiceSettings.volume = config.volume;
+        if (Object.keys(voiceSettings).length > 0)
+            body.voice_settings = voiceSettings;
+        return fetch(url, {
+            method: 'POST',
+            headers: { 'xi-api-key': config.apiKey ?? '', 'content-type': 'application/json' },
+            body: JSON.stringify(body),
+            signal: AbortSignal.any([abort.signal, AbortSignal.timeout(REQUEST_TIMEOUT_MS)]),
+        }).then(async (response) => {
+            if (!response.ok) {
+                const detail = await response.text().catch(() => '');
+                if (response.status === 429) {
+                    const retryAfter = Number(response.headers.get('retry-after'));
+                    const seconds = Number.isFinite(retryAfter) ? Math.min(RATE_LIMIT_CAP_S, Math.max(0, retryAfter)) : 60;
+                    mutedUntil = Date.now() + seconds * 1000;
+                }
+                throw new Error(`BreezeBlue HTTP ${String(response.status)}${detail ? `: ${detail.slice(0, 200)}` : ''}`);
+            }
+            const audio = new Uint8Array(await response.arrayBuffer());
+            if (audio.length === 0)
+                throw new Error('empty audio response');
+            if (audio.length > MAX_AUDIO_BYTES)
+                throw new Error(`audio too large (${String(audio.length)} bytes)`);
+            return audio;
+        });
+    };
+    return { deliver };
+}
+//# sourceMappingURL=tts.js.map