@xmov/avatar 2.4.0 → 2.5.0-alpha.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +34 -6
- package/package-dist/agent/avatar.cjs +1 -0
- package/package-dist/agent/avatar.modern.js +1 -0
- package/package-dist/agent/avatar.module.js +1 -0
- package/package-dist/agent/avatar.umd.js +1 -0
- package/package-dist/agent/index.d.ts +42 -0
- package/{dist/agent/types.d.ts → package-dist/agent/public-types.d.ts} +115 -116
- package/package-dist/index.cjs +3 -0
- package/package-dist/index.d.ts +34 -0
- package/package-dist/index.modern.js +1 -0
- package/package-dist/index.module.js +1 -0
- package/package-dist/index.umd.js +14 -0
- package/package-dist/public-types.d.ts +205 -0
- package/package.json +41 -33
- package/dist/agent/avatar.cjs +0 -1
- package/dist/agent/avatar.modern.js +0 -1
- package/dist/agent/avatar.module.js +0 -1
- package/dist/agent/avatar.umd.js +0 -1
- package/dist/agent/index.d.ts +0 -137
- package/dist/baseRender/AudioRenderer.d.ts +0 -46
- package/dist/baseRender/AudioWorklet.d.ts +0 -78
- package/dist/baseRender/AvatarRenderer.d.ts +0 -225
- package/dist/baseRender/MSEAudioPlayer.d.ts +0 -51
- package/dist/baseRender/UIRenderer.d.ts +0 -39
- package/dist/baseRender/pcm-audio-processor.d.ts +0 -63
- package/dist/control/APIForwarder.d.ts +0 -23
- package/dist/control/DataCacheQueue.d.ts +0 -69
- package/dist/control/EventDispatcher.d.ts +0 -35
- package/dist/control/RenderScheduler.d.ts +0 -171
- package/dist/control/SaveAndDownload.d.ts +0 -14
- package/dist/control/StreamingClient.d.ts +0 -33
- package/dist/control/VideoPlayer.d.ts +0 -47
- package/dist/control/ttsa.d.ts +0 -125
- package/dist/encoding/media-recorder-encoder.d.ts +0 -33
- package/dist/encoding/pcm-webm-encoder.d.ts +0 -13
- package/dist/encoding/webcodec-opus-encoder.d.ts +0 -41
- package/dist/encoding/webm-muxer.d.ts +0 -90
- package/dist/index.cjs +0 -2
- package/dist/index.cjs.map +0 -1
- package/dist/index.d.ts +0 -251
- package/dist/index.modern.js +0 -2
- package/dist/index.modern.js.map +0 -1
- package/dist/index.module.js +0 -2
- package/dist/index.module.js.map +0 -1
- package/dist/index.umd.js +0 -2
- package/dist/index.umd.js.map +0 -1
- package/dist/modules/Composition.d.ts +0 -28
- package/dist/modules/ResourceManager.d.ts +0 -299
- package/dist/modules/TrackRenderer/base-track.d.ts +0 -4
- package/dist/modules/TrackRenderer/index.d.ts +0 -12
- package/dist/modules/TrackRenderer/render-implements.d.ts +0 -19
- package/dist/modules/TrackRenderer/track-pic.d.ts +0 -8
- package/dist/modules/TrackRenderer/track-subtitle.d.ts +0 -8
- package/dist/modules/cache-manager.d.ts +0 -5
- package/dist/modules/decoder.d.ts +0 -84
- package/dist/modules/error-handle.d.ts +0 -17
- package/dist/modules/network.d.ts +0 -21
- package/dist/modules/sentry-reporter.d.ts +0 -58
- package/dist/proto/face_data_pb.d.ts +0 -0
- package/dist/types/capability.d.ts +0 -15
- package/dist/types/error.d.ts +0 -70
- package/dist/types/event.d.ts +0 -25
- package/dist/types/frame-data.d.ts +0 -107
- package/dist/types/index.d.ts +0 -196
- package/dist/types/render.d.ts +0 -18
- package/dist/utils/DataInterface.d.ts +0 -113
- package/dist/utils/GLDevice.d.ts +0 -46
- package/dist/utils/GLPipeline.d.ts +0 -84
- package/dist/utils/GLPipelineDebugTools.d.ts +0 -5
- package/dist/utils/Math.d.ts +0 -21
- package/dist/utils/__tests__/capability-checker.test.d.ts +0 -1
- package/dist/utils/audio-session.d.ts +0 -11
- package/dist/utils/audio.d.ts +0 -1
- package/dist/utils/capability-checker.d.ts +0 -28
- package/dist/utils/encodeToken.d.ts +0 -14
- package/dist/utils/face.d.ts +0 -1
- package/dist/utils/float32-decoder.d.ts +0 -26
- package/dist/utils/fpsTracker.d.ts +0 -27
- package/dist/utils/index.d.ts +0 -22
- package/dist/utils/logger.d.ts +0 -9
- package/dist/utils/media-recorder-timestamp.d.ts +0 -15
- package/dist/utils/pcmAnalyzer.d.ts +0 -40
- package/dist/utils/perfermance.d.ts +0 -15
- package/dist/utils/request.d.ts +0 -20
- package/dist/utils/requestAnimateFrames.d.ts +0 -31
- package/dist/utils/time.d.ts +0 -9
- package/dist/utils/video-probe-asset.d.ts +0 -28
- package/dist/view/DebugOverlay.d.ts +0 -54
- package/dist/worker/streaming-video.d.ts +0 -1
- package/src/baseRender/AudioRenderer.ts +0 -328
- package/src/baseRender/AudioWorklet.ts +0 -776
- package/src/baseRender/AvatarRenderer.ts +0 -1550
- package/src/baseRender/MSEAudioPlayer.ts +0 -254
- package/src/baseRender/UIRenderer.ts +0 -195
- package/src/baseRender/pcm-audio-processor.js +0 -267
- package/src/control/APIForwarder.ts +0 -67
- package/src/control/DataCacheQueue.ts +0 -372
- package/src/control/EventDispatcher.ts +0 -106
- package/src/control/RenderScheduler.ts +0 -1000
- package/src/control/SaveAndDownload.js +0 -77
- package/src/control/StreamingClient.ts +0 -138
- package/src/control/VideoPlayer.ts +0 -306
- package/src/control/ttsa.ts +0 -754
- package/src/encoding/media-recorder-encoder.ts +0 -175
- package/src/encoding/pcm-webm-encoder.ts +0 -72
- package/src/encoding/webcodec-opus-encoder.ts +0 -258
- package/src/encoding/webm-muxer.ts +0 -337
- package/src/global.d.ts +0 -112
- package/src/index.ts +0 -2053
- package/src/modules/Composition.ts +0 -79
- package/src/modules/ResourceManager.ts +0 -926
- package/src/modules/TrackRenderer/base-track.ts +0 -7
- package/src/modules/TrackRenderer/index.ts +0 -40
- package/src/modules/TrackRenderer/render-implements.ts +0 -269
- package/src/modules/TrackRenderer/track-pic.ts +0 -19
- package/src/modules/TrackRenderer/track-subtitle.ts +0 -16
- package/src/modules/cache-manager.ts +0 -10
- package/src/modules/decoder.ts +0 -548
- package/src/modules/error-handle.ts +0 -20
- package/src/modules/network.ts +0 -71
- package/src/modules/sentry-reporter.ts +0 -171
- package/src/proto/face_data.proto +0 -45
- package/src/proto/face_data_pb.js +0 -1297
- package/src/proto/protobuf.min.js +0 -8
- package/src/types/capability.ts +0 -24
- package/src/types/error.ts +0 -211
- package/src/types/event.ts +0 -38
- package/src/types/frame-data.ts +0 -121
- package/src/types/index.ts +0 -220
- package/src/types/render.ts +0 -18
- package/src/utils/DataInterface.ts +0 -746
- package/src/utils/GLDevice.ts +0 -286
- package/src/utils/GLPipeline.ts +0 -1293
- package/src/utils/GLPipelineDebugTools.ts +0 -174
- package/src/utils/Math.ts +0 -266
- package/src/utils/__tests__/capability-checker.test.ts +0 -159
- package/src/utils/audio-session.ts +0 -144
- package/src/utils/audio.ts +0 -44
- package/src/utils/blueimp-md5.d.ts +0 -3
- package/src/utils/capability-checker.ts +0 -762
- package/src/utils/encodeToken.ts +0 -115
- package/src/utils/face.ts +0 -29
- package/src/utils/float32-decoder.js +0 -130
- package/src/utils/fpsTracker.ts +0 -100
- package/src/utils/index.ts +0 -182
- package/src/utils/logger.js +0 -36
- package/src/utils/media-recorder-timestamp.ts +0 -79
- package/src/utils/pcmAnalyzer.ts +0 -154
- package/src/utils/perfermance.ts +0 -141
- package/src/utils/request.ts +0 -107
- package/src/utils/requestAnimateFrames.ts +0 -195
- package/src/utils/time.ts +0 -32
- package/src/utils/video-probe-asset.ts +0 -99
- package/src/view/DebugOverlay.ts +0 -409
- package/src/worker/streaming-video.ts +0 -4647
- /package/{dist → package-dist}/agent/index.cjs +0 -0
- /package/{dist → package-dist}/agent/index.umd.js +0 -0
package/README.md
CHANGED
|
@@ -15,7 +15,7 @@ npm install @xmov/avatar --registry=https://npm.xmov.ai
|
|
|
15
15
|
## 快速开始
|
|
16
16
|
|
|
17
17
|
```typescript
|
|
18
|
-
import XmovAvatar from '@xmov/avatar';
|
|
18
|
+
import XmovAvatar, { InitModel } from '@xmov/avatar';
|
|
19
19
|
|
|
20
20
|
const avatar = new XmovAvatar({
|
|
21
21
|
containerId: '#container',
|
|
@@ -32,12 +32,12 @@ const avatar = new XmovAvatar({
|
|
|
32
32
|
// 初始化
|
|
33
33
|
await avatar.init({
|
|
34
34
|
onDownloadProgress: (progress) => console.log('下载进度:', progress),
|
|
35
|
-
initModel:
|
|
35
|
+
initModel: InitModel.normal, // 或 InitModel.invisible
|
|
36
36
|
});
|
|
37
37
|
|
|
38
38
|
// 播放文本(SSML)
|
|
39
39
|
avatar.speak('<speak>你好,世界!</speak>', true, true, {
|
|
40
|
-
client_speak_id: 'unique-id'
|
|
40
|
+
client_speak_id: 'unique-id', client_frame: 0
|
|
41
41
|
});
|
|
42
42
|
|
|
43
43
|
// 状态切换
|
|
@@ -73,10 +73,20 @@ await avatar.destroy('user');
|
|
|
73
73
|
| `showDebugInfo()` | 显示调试浮层 |
|
|
74
74
|
| `hideDebugInfo()` | 隐藏调试浮层 |
|
|
75
75
|
| `getSessionId()` | 获取会话id |
|
|
76
|
+
| `getRenderState()` | 获取渲染状态 |
|
|
77
|
+
| `changeWalkConfig(config)` | 更新行走配置 |
|
|
78
|
+
| `restartWebGL()` | 手动恢复 WebGL,返回 boolean |
|
|
79
|
+
| `startRecoder()` / `stopRecoder()` / `exportVideo()` | deprecated 兼容录制;导出触发下载,不返回 Blob |
|
|
80
|
+
|
|
81
|
+
静态 `XmovAvatar.checkCapability(audioOnlyMode?)` 返回能力报告。`getStatus()` 返回 `AvatarStatus` 数值枚举或初始值 `-1`;`-1` 表示尚未收到有效状态,不能单独用于判断初始化完成。初始化请等待 `init()`。
|
|
82
|
+
|
|
83
|
+
录制用法见 [录制说明](./docs/sdk.md)。高级配置、录制三方法、`onStateChange` 和 Agent 的 `speakByE2E/getState` 本轮保留,删除版本待定,不承诺下一大版本删除。
|
|
76
84
|
|
|
77
85
|
## 配置项
|
|
78
86
|
|
|
79
87
|
```typescript
|
|
88
|
+
import XmovAvatar from '@xmov/avatar';
|
|
89
|
+
|
|
80
90
|
const avatar = new XmovAvatar({
|
|
81
91
|
// 基础配置
|
|
82
92
|
containerId: '#container', // 容器元素选择器
|
|
@@ -105,14 +115,14 @@ const avatar = new XmovAvatar({
|
|
|
105
115
|
| 回调 | 说明 |
|
|
106
116
|
| ----------------------------------------------- | ------------------------------------------------------------- |
|
|
107
117
|
| `onMessage(error)` | 错误消息回调 |
|
|
108
|
-
| `onStatusChange(status)` | 状态变化:`
|
|
118
|
+
| `onStatusChange(status)` | 状态变化:`AvatarStatus` 数值枚举(非字符串) |
|
|
109
119
|
| `onRenderChange(state)` | 渲染状态:`init` / `rendering` / `paused` / `resumed` / `stopped` |
|
|
110
120
|
| `onVoiceStateChange(state, duration, speak_id)` | 语音状态变化 |
|
|
111
121
|
| `onSpeakStateChange(state, speak_id)` | 播报状态变化 |
|
|
112
122
|
| `onWalkStateChange(state)` | 行走状态变化 |
|
|
113
123
|
| `onWidgetEvent(data)` | Widget 事件回调 |
|
|
114
124
|
| `onNetworkInfo(info)` | 网络信息回调(rtt、downlink、networkStatus) |
|
|
115
|
-
| `onDownloadProgress(progress)` |
|
|
125
|
+
| `onDownloadProgress(progress)` | `init` 参数中的下载进度回调(0-100) |
|
|
116
126
|
| `onFPSUpdate(stats)` | FPS 统计信息回调 |
|
|
117
127
|
| `onStateChange(state)` | 通用状态变化回调 |
|
|
118
128
|
| `onStateRenderChange(state, duration)` | 渲染状态变化回调 |
|
|
@@ -160,7 +170,11 @@ pnpm app
|
|
|
160
170
|
### 构建
|
|
161
171
|
|
|
162
172
|
```bash
|
|
163
|
-
#
|
|
173
|
+
# 仅本地构建,不上传
|
|
174
|
+
pnpm run build:local
|
|
175
|
+
pnpm run build:demo:internal
|
|
176
|
+
|
|
177
|
+
# 以下命令包含上传,仅用于已批准发布
|
|
164
178
|
pnpm run build
|
|
165
179
|
|
|
166
180
|
# Lite 版本
|
|
@@ -247,3 +261,17 @@ refactor(api): 重构初始化接口 # 修订号递增
|
|
|
247
261
|
## License
|
|
248
262
|
|
|
249
263
|
ISC
|
|
264
|
+
|
|
265
|
+
## Agent UMD 加载
|
|
266
|
+
|
|
267
|
+
包内 `agent/index.umd.js` 是全局适配器,不能独立加载。将同一版本的以下两个文件从安装包复制到站点后,按顺序引入(不要使用 async):
|
|
268
|
+
|
|
269
|
+
```html
|
|
270
|
+
<script src="/sdk/package-dist/agent/avatar.umd.js"></script>
|
|
271
|
+
<script src="/sdk/package-dist/agent/index.umd.js"></script>
|
|
272
|
+
<script>
|
|
273
|
+
// 此时可使用 window.XingyunAvatarAgent
|
|
274
|
+
</script>
|
|
275
|
+
```
|
|
276
|
+
|
|
277
|
+
`@xmov/avatar/agent/umd` 指向第二个文件;不承诺可通过未导出的包子路径 import 第一个文件。需要单 script 接入时使用维护文档说明的独立 E2E CDN 构建。Agent CJS 当前返回构造函数,没有运行时命名枚举导出;将来新增枚举须同步更新多格式包装及测试。
|