dsh-fish-pet 0.0.0-stage → 0.2.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 dsh-fish-pet contributors
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -1,3 +1,178 @@
-# Temporary Holding Version
+# dsh-fish-pet · 桌面蓝鱼
+
+![dsh-fish-pet](docs/banner.png)
 
-This version is a temporary placeholder for this package. An operational version to replace this has been submitted for review and is awaiting a staged release.
+给 [DeepSeek Harness](https://github.com/deepseek-ai/deepseek-harness) 养一条住在 Windows 桌面上的蓝鱼。
+它不是网页贴图：是一个**逐像素透明的置顶窗口**，用 PowerShell + WinForms 逐帧绘制，还能**听你说话、跟你聊天、用中文语音回你**。
+
+> 个人作品，与 DeepSeek 官方无关。
+
+## 特性
+
+- 桌面常驻：缓慢游动、随机转身、眨眼、吐泡泡、尾巴摆动
+- 交互：拖动换位置、左键喂食、右键菜单（大小 / 回家 / 语音朗读 / 退出）
+- 聊天：输入框打字 → 调 `deepseek-flash` → 气泡回复 + 语音朗读
+- **语音对话**：独立“耳朵”进程用 WASAPI 采集麦克风 → 云端 SenseVoice 识别 → 自动接话
+- 单实例守卫、异常落盘（不弹框）、耳朵掉线自动重启、位置记忆、开机自启
+
+## 环境要求
+
+- Windows 10 / 11
+- PowerShell 5.1（系统自带）
+- Node.js ≥ 22（仅作为 DSH 插件时需要）
+- 麦克风（语音对话需要）
+
+## 安装
+
+### 方式一：作为 DSH 插件
+
+`dsh plugin` 把参数原样转给 pnpm，所以下面几种来源都能用，装完**重启 `dsh web`** 生效。
+
+**① 直接从仓库装（推荐，已验证）**
+
+```powershell
+dsh plugin --profile web add "git+https://gitee.com/adengou/dsh-fish-pet.git"
+```
+
+**② 从本地目录 / 离线 tgz 装**
+
+```powershell
+dsh plugin --profile web add "file:C:/path/to/dsh-fish-pet"
+dsh plugin --profile web add "file:C:/path/to/dsh-fish-pet-0.2.0.tgz"
+```
+
+**③ 从服务器上的 tgz 直链装**（把 tgz 传到 Release / 图床等可直链的地方）
+
+```powershell
+dsh plugin --profile web add "https://你的地址/dsh-fish-pet-0.2.0.tgz"
+```
+
+> 版本要求：DSH `>= 0.2.1-rc.5`。版本不符时插件行会被判不兼容而禁用。
+
+**暂未提供的方式（等发布后可用）**
+
+| 方式 | 命令 | 现状 |
+| --- | --- | --- |
+| GitHub | `dsh plugin --profile web add github:adengou/dsh-fish-pet` | ❌ 仓库尚未同步到 GitHub |
+| npm | `dsh plugin --profile web add dsh-fish-pet` | ❌ 包尚未发布到 npm（名称目前未被占用） |
+
+发布后会在这里补上，并更新本表。
+
+### 方式二：独立运行（不装 DSH 也能用）
+
+```powershell
+wscript.exe assets\start-pet.vbs   # 桌面鱼
+wscript.exe assets\start-ear.vbs   # 云端耳朵（语音对话用）
+```
+
+## 配置密钥（重要）
+
+本仓库**不包含任何密钥**。两个 key 的读取顺序：
+
+| 用途 | 环境变量（优先） | 文件（次选） |
+| --- | --- | --- |
+| 对话模型（DeepSeek） | `DEEPSEEK_API_KEY` | `<数据目录>\deepseek.key` |
+| 语音识别（SiliconFlow） | `SILICONFLOW_API_KEY` | `<数据目录>\siliconflow.key` |
+
+- `<数据目录>` 默认 `%USERPROFILE%\.dsh\fish-pet`
+- 兼容 DSH：DeepSeek key 找不到时还会读 `%USERPROFILE%\.dsh\.credentials.yaml` 的 `DEEPSEEK_API_KEY`
+- 密钥文件已在 `.gitignore` 里，请勿提交
+
+### 快速配置（PowerShell）
+
+```powershell
+mkdir "$env:USERPROFILE\.dsh\fish-pet" -Force
+
+Set-Content "$env:USERPROFILE\.dsh\fish-pet\deepseek.key"    -Value "sk-你的DeepSeek密钥"    -NoNewline
+Set-Content "$env:USERPROFILE\.dsh\fish-pet\siliconflow.key" -Value "sk-你的硅基流动密钥" -NoNewline
+```
+
+注意事项：
+
+- 文件里**只放 key 本身**，一行、不加引号、不加说明文字
+- 用记事本也行：`Win+R` → `%USERPROFILE%\.dsh\fish-pet` → 新建 `deepseek.key` / `siliconflow.key`（注意扩展名别留 `.txt`）
+- 想改用环境变量：`setx DEEPSEEK_API_KEY "sk-..."` 和 `setx SILICONFLOW_API_KEY "sk-..."`，之后重开进程生效
+- 验证：`Get-ChildItem "$env:USERPROFILE\.dsh\fish-pet\*.key" | Select-Object Name, Length`
+
+> ⚠️ 不要把真实 key 写进 README 或任何提交到仓库的文件——仓库是公开的。
+
+### 获取 SiliconFlow key
+
+1. 打开 <https://cloud.siliconflow.cn>，手机号注册登录
+2. 控制台 → API 密钥 → 新建密钥
+3. 写入 `%USERPROFILE%\.dsh\fish-pet\siliconflow.key`，或设为环境变量
+
+### 获取 DeepSeek key
+
+<https://platform.deepseek.com> → API keys。
+
+## 隐私
+
+- 麦克风音频按约 5 秒切片，**上传 SiliconFlow 做识别**；识别出的文字再发 DeepSeek 生成回复
+- 其余数据（位置、日志、密钥）只存本机
+- 不想用语音：别启动 `start-ear.vbs`，只用打字聊天
+
+## 目录结构
+
+```
+dsh-fish-pet/
+├─ lib/index.js              # DSH 插件宿主：拉起/守护桌宠进程
+├─ assets/
+│  ├─ fish-pet.ps1           # 桌宠主体（绘制 + 聊天 + 语音朗读）
+│  ├─ asr-listener.ps1       # 云端耳朵（WASAPI → SiliconFlow）
+│  ├─ start-pet.vbs          # 独立启动器
+│  └─ start-ear.vbs
+├─ cordis.patch.yml          # DSH 插件插入行
+└─ package.json
+```
+
+## 运行数据（`%USERPROFILE%\.dsh\fish-pet\`）
+
+| 文件 | 作用 |
+| --- | --- |
+| `state.json` | 位置 / 大小 |
+| `pet.pid` | 单实例守卫 |
+| `error.log` | 桌宠异常 |
+| `asr.log` | 识别结果（`H`=听到声音，`1`=识别成功） |
+| `asr.level` | 每段麦克风峰值（排查“听不见”先看它） |
+| `asr.err` | 耳朵异常 |
+
+## 常见问题
+
+**叫它没反应？**
+1. 看 `asr.level`：说话时峰值应明显变大；一直是几十说明麦克风没进来
+2. 看 `asr.log`：出现 `H` 说明听到了，出现 `1` 说明识别成功
+3. Windows 设置 → 隐私和安全性 → 麦克风，允许桌面应用访问
+
+**识别不准？**
+- 安静环境、靠近麦克风最好
+- 可调 `asr-listener.ps1` 顶部参数：`-ChunkMs`（片段长度）、`-SilenceGate`（静音门限）
+
+**它会接别人的话？**
+- 它是持续监听的；不想要时停掉 `start-ear.vbs`，或调高 `SilenceGate`
+
+## 开发
+
+纯 PowerShell + WinForms，无第三方依赖。语法检查：
+
+```powershell
+powershell -NoProfile -Command "$e=$null;$t=$null;[void][System.Management.Automation.Language.Parser]::ParseFile('assets\fish-pet.ps1',[ref]$t,[ref]$e);$e"
+```
+
+> 脚本是 UTF-8 **带 BOM**；编辑器保存时保留 BOM，否则 PowerShell 5.1 会按 ANSI 读成乱码。
+
+## 插件配置
+
+```yaml
+- insert:
+    - id: fish-pet
+      name: dsh-fish-pet
+      config:
+        enabled: true   # false 则不启动
+        scale: 1        # 0.5 ~ 2
+        speed: 26       # 5 ~ 120 像素/秒
+```
+
+## 许可
+
+MIT，见 [LICENSE](LICENSE)。

package/assets/asr-listener.ps1

@@ -0,0 +1,146 @@
+# asr-listener.ps1 · 云端耳朵：WASAPI 采集 → WAV → SiliconFlow SenseVoice → 结果落盘
+param([int]$ChunkMs = 6500, [int]$Boost = 1, [int]$SilenceGate = 1200)
+
+$ErrorActionPreference = 'Stop'
+$DataDir = Join-Path $env:USERPROFILE '.dsh\fish-pet'
+if (-not (Test-Path $DataDir)) { New-Item -ItemType Directory -Force -Path $DataDir | Out-Null }
+$OutFile   = Join-Path $DataDir 'asr.log'
+$LevelFile = Join-Path $DataDir 'asr.level'
+$ErrFile   = Join-Path $DataDir 'asr.err'
+$KeyFile   = Join-Path $DataDir 'siliconflow.key'
+
+Add-Type -TypeDefinition @"
+using System;
+using System.Runtime.InteropServices;
+using System.Threading;
+[ComImport, Guid("BCDE0395-E52F-467C-8E3D-C4579291692E")] class MMEnum { }
+[ComImport, Guid("A95664D2-9614-4F35-A746-DE8DB63617E6"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
+interface IMMDeviceEnumerator { int EnumAudioEndpoints(int f, int s, out IntPtr c); int GetDefaultAudioEndpoint(int f, int r, out IMMDevice d); }
+[ComImport, Guid("D666063F-1587-4E43-81F1-B948E807363F"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
+interface IMMDevice { int Activate(ref Guid iid, int ctx, IntPtr p, [MarshalAs(UnmanagedType.IUnknown)] out object o); }
+[ComImport, Guid("1CB9AD4C-DBFA-4c32-B178-C2F568A703B2"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
+interface IAudioClient {
+  int Initialize(int share, int flags, long dur, long period, IntPtr fmt, IntPtr sess);
+  int GetBufferSize(out uint frames); int GetStreamLatency(out long lat); int GetCurrentPadding(out uint pad);
+  int IsFormatSupported(int share, IntPtr fmt, out IntPtr closest); int GetMixFormat(out IntPtr fmt);
+  int GetDevicePeriod(out long def, out long min); int Start(); int Stop(); int Reset(); int SetEventHandle(IntPtr e);
+  int GetService(ref Guid iid, [MarshalAs(UnmanagedType.IUnknown)] out object o);
+}
+[ComImport, Guid("C8ADBD64-E71E-48a0-A4DE-185C395CD317"), InterfaceType(ComInterfaceType.InterfaceIsIUnknown)]
+interface IAudioCaptureClient {
+  int GetBuffer(out IntPtr data, out uint frames, out uint flags, out ulong devpos, out ulong qpc);
+  int ReleaseBuffer(uint frames); int GetNextPacketSize(out uint frames);
+}
+public class Ear {
+  public static byte[] Pcm; public static int Peak; public static int RawPeak;
+  public static bool Record(int ms, int boost, int role) {
+    Peak = 0; Pcm = new byte[0];
+    var en = (IMMDeviceEnumerator)(new MMEnum());
+    IMMDevice dev;
+    if (en.GetDefaultAudioEndpoint(1, role, out dev) != 0) { if (en.GetDefaultAudioEndpoint(1, 0, out dev) != 0) return false; }
+    Guid iid = typeof(IAudioClient).GUID; object o; dev.Activate(ref iid, 1, IntPtr.Zero, out o);
+    var ac = (IAudioClient)o;
+    IntPtr fmt; ac.GetMixFormat(out fmt);
+    int rate = Marshal.ReadInt32(fmt, 4); short ch = Marshal.ReadInt16(fmt, 2);
+    if (ac.Initialize(0, 0, 5000000, 0, fmt, IntPtr.Zero) != 0) return false;
+    Guid ci = typeof(IAudioCaptureClient).GUID; object co; ac.GetService(ref ci, out co);
+    var cc = (IAudioCaptureClient)co;
+    ac.Start();
+    var samples = new System.Collections.Generic.List<float>();
+    var b4 = new byte[4];
+    var end = DateTime.UtcNow.AddMilliseconds(ms);
+    while (DateTime.UtcNow < end) {
+      uint pkt; if (cc.GetNextPacketSize(out pkt) != 0 || pkt == 0) { Thread.Sleep(3); continue; }
+      IntPtr data; uint frames, flags; ulong dp, qp;
+      if (cc.GetBuffer(out data, out frames, out flags, out dp, out qp) != 0) break;
+      int n = (int)frames * ch * 4;
+      for (int i = 0; i + 3 < n; i += 4) {
+        b4[0] = Marshal.ReadByte(data, i); b4[1] = Marshal.ReadByte(data, i+1);
+        b4[2] = Marshal.ReadByte(data, i+2); b4[3] = Marshal.ReadByte(data, i+3);
+        samples.Add(BitConverter.ToSingle(b4, 0));
+      }
+      cc.ReleaseBuffer(frames);
+    }
+    ac.Stop();
+    if (samples.Count < 320) return false;
+    double step = (double)rate / 16000.0;
+    int framesIn = samples.Count / ch;
+    int outCount = (int)(framesIn / step);
+    if (outCount < 160) return false;
+    var tmp = new int[outCount];
+    int maxAbs = 0;
+    for (int i = 0; i < outCount; i++) {
+      int s0 = (int)(i * step);
+      int s1 = (int)Math.Min(framesIn - 1, (i + 1) * step);
+      double sum = 0; int cnt = 0;
+      for (int f = s0; f <= s1; f++) { sum += samples[f * ch]; cnt++; }
+      int v = cnt > 0 ? (int)((sum / cnt) * 32767.0 * boost) : 0;
+      tmp[i] = v; int a = Math.Abs(v); if (a > maxAbs) maxAbs = a;
+    }
+    RawPeak = maxAbs;
+    double gain = 1.0;
+    if (maxAbs > 200) { gain = Math.Min(12.0, 20000.0 / maxAbs); }
+    var outp = new byte[outCount * 2];
+    for (int i = 0; i < outCount; i++) {
+      int v = (int)(tmp[i] * gain);
+      if (v > 32767) v = 32767; if (v < -32768) v = -32768;
+      int a = Math.Abs(v); if (a > Peak) Peak = a;
+      outp[i*2] = (byte)(v & 0xFF); outp[i*2+1] = (byte)((v >> 8) & 0xFF);
+    }
+    Pcm = outp; return true;
+  }
+}
+"@
+
+function Write-Wav([string]$path, [byte[]]$pcm) {
+    $fs = [IO.File]::Open($path, 'Create', 'Write')
+    $bw = New-Object IO.BinaryWriter($fs)
+    $bw.Write([Text.Encoding]::ASCII.GetBytes('RIFF')); $bw.Write([int](36 + $pcm.Length))
+    $bw.Write([Text.Encoding]::ASCII.GetBytes('WAVE')); $bw.Write([Text.Encoding]::ASCII.GetBytes('fmt '))
+    $bw.Write([int]16); $bw.Write([int16]1); $bw.Write([int16]1); $bw.Write([int]16000)
+    $bw.Write([int]32000); $bw.Write([int16]2); $bw.Write([int16]16)
+    $bw.Write([Text.Encoding]::ASCII.GetBytes('data')); $bw.Write([int]$pcm.Length)
+    $bw.Write($pcm); $bw.Close(); $fs.Close()
+}
+
+Add-Content -LiteralPath $OutFile -Value ("# ear(start) pid=" + $PID) -Encoding UTF8
+
+while ($true) {
+    try {
+        # 鱼正在说话时闭麦，避免把它自己的声音听回去
+        if (Test-Path (Join-Path $DataDir 'asr.talking')) { Start-Sleep -Milliseconds 200; continue }
+        $pf = Join-Path $DataDir 'asr.pause'
+        if (Test-Path $pf) {
+            $age = ((Get-Date) - (Get-Item $pf).LastWriteTime).TotalSeconds
+            if ($age -lt 1.2) { Start-Sleep -Milliseconds 200; continue }
+        }
+        $key = $env:SILICONFLOW_API_KEY
+        if (-not $key -and (Test-Path $KeyFile)) { $key = (Get-Content -LiteralPath $KeyFile -Raw -ErrorAction SilentlyContinue) }
+        if ($key) { $key = $key.Trim() }
+        if (-not $key) { Start-Sleep -Seconds 2; continue }
+
+        $ok = [Ear]::Record($ChunkMs, $Boost, 2)
+        if (-not $ok) { Start-Sleep -Milliseconds 300; continue }
+        $peak = [Ear]::Peak
+        $pcm = [Ear]::Pcm
+        $raw = [Ear]::RawPeak
+        Add-Content -LiteralPath $LevelFile -Value ((Get-Date -Format 'HH:mm:ss') + "`traw=" + $raw + "`tpeak=" + $peak) -Encoding UTF8
+        if ($raw -lt $SilenceGate -or $pcm.Length -lt 3200) { Start-Sleep -Milliseconds 120; continue }
+        Add-Content -LiteralPath $OutFile -Value ((Get-Date -Format 'HH:mm:ss') + "`tH`t(听到声音)") -Encoding UTF8
+        $wav = Join-Path $DataDir ('chunk-' + [guid]::NewGuid().ToString('N') + '.wav')
+        Write-Wav $wav $pcm
+        $json = & curl.exe -s -X POST 'https://api.siliconflow.cn/v1/audio/transcriptions' -H ("Authorization: Bearer " + $key) -F ("file=@" + $wav) -F 'model=FunAudioLLM/SenseVoiceSmall' 2>$null | Out-String
+        Remove-Item -LiteralPath $wav -Force -ErrorAction SilentlyContinue
+        if ($json) {
+            $obj = $json | ConvertFrom-Json
+            $text = [string]$obj.text
+            if ($text -and ($text -match '[\u4e00-\u9fa5]' -or $text.Length -ge 5)) {
+                Add-Content -LiteralPath $OutFile -Value ((Get-Date -Format 'HH:mm:ss') + "`t1`t" + $text.Trim()) -Encoding UTF8
+            }
+        }
+        Start-Sleep -Milliseconds 120
+    } catch {
+        Add-Content -LiteralPath $ErrFile -Value ((Get-Date -Format 'HH:mm:ss') + '  ' + $_.Exception.Message) -Encoding UTF8
+        Start-Sleep -Milliseconds 800
+    }
+}