@q253595422/dsh-imagegen-video 1.9.0 → 1.10.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +72 -0
- package/README.md +8 -2
- package/docs/releases/v1.10.0.md +41 -0
- package/docs/releases/v1.9.3.md +48 -0
- package/lib/client.js +1788 -228
- package/lib/client.js.map +1 -1
- package/lib/index.js +325 -48
- package/lib/locale-tables-chunk.js +191 -2
- package/package.json +7 -4
package/CHANGELOG.md
CHANGED
|
@@ -5,6 +5,78 @@ Attribution for third-party code is in [NOTICE](./NOTICE).
|
|
|
5
5
|
|
|
6
6
|
## Releases
|
|
7
7
|
|
|
8
|
+
### 1.10.0 — storyboards: a shot list that runs into clip nodes
|
|
9
|
+
|
|
10
|
+
- **A storyboard node.** One board is a list of shots — a prompt and a length
|
|
11
|
+
each, reorderable, renamable by moving — and every shot produces an ORDINARY
|
|
12
|
+
video node on the canvas. That is the whole design: because the result is the
|
|
13
|
+
same node type as a hand-made clip, it is previewable, downloadable,
|
|
14
|
+
favoritable, retryable and stitchable with no second workflow to learn.
|
|
15
|
+
- **Two kinds of continuity.** The independent mode submits every shot that has
|
|
16
|
+
no clip in one press; the carry mode submits one shot at a time, using the
|
|
17
|
+
previous shot's last frame as this shot's first frame, so consecutive shots
|
|
18
|
+
join up. A carry shot is blocked — with a visible state, not a silent refusal
|
|
19
|
+
— until its predecessor has a clip.
|
|
20
|
+
- **The tail frame is reusable on its own.** Any finished clip offers a
|
|
21
|
+
continue-from-tail action: it grabs the closing frame, drops it as an image
|
|
22
|
+
node, and wires it into a fresh video config, ready to type the next shot's
|
|
23
|
+
direction into.
|
|
24
|
+
- **The board stitches through the existing compose run.** Once two shots have
|
|
25
|
+
clips, the board's stitch action hands them to the same ffmpeg path, with the
|
|
26
|
+
same numbered order review; a shot still rendering is left out and the
|
|
27
|
+
shortfall is said out loud instead of being submitted as a run that would
|
|
28
|
+
fail.
|
|
29
|
+
- **State survives a reload.** The shot list, the shared settings and each
|
|
30
|
+
shot's link to its clip node are part of the canvas document; a board whose
|
|
31
|
+
stored state cannot be honoured fails the save loudly rather than being
|
|
32
|
+
written half-valid. Every row's state is read from its clip node, so the board
|
|
33
|
+
and the canvas can never disagree about what is finished.
|
|
34
|
+
- **Editing goes through the document**, so undo, redo and autosave work on a
|
|
35
|
+
board exactly as they do on a text node.
|
|
36
|
+
|
|
37
|
+
### 1.9.3 — session images, PPT delivery, and xAI Grok video
|
|
38
|
+
|
|
39
|
+
Upstream 1.9.1 + 1.9.2 landed here, alongside this repository's own fixes.
|
|
40
|
+
|
|
41
|
+
- **A host Agent failure is reported as itself.** Model and execution errors are
|
|
42
|
+
kept (and redacted) instead of surfacing as "no final PPTX was produced";
|
|
43
|
+
a run with no reply points at the default-model connection and tool setup.
|
|
44
|
+
- **The upstream skill's own `final/` deck is collected.** Only a run summary
|
|
45
|
+
marked complete with a passed validation report qualifies, and the deck is
|
|
46
|
+
still checked for PPTX structure and page count — an intermediate page file
|
|
47
|
+
never becomes the result.
|
|
48
|
+
- **PPT configuration opens in place.** The dialog reuses the generation
|
|
49
|
+
settings' own fields rather than reaching for the host settings button by DOM
|
|
50
|
+
lookup, with Escape, focus containment and return-to-trigger.
|
|
51
|
+
- **Uploads become a thumbnail grid** with an add tile: preview, reorder, delete,
|
|
52
|
+
and the order is the slide order.
|
|
53
|
+
- **The result pane shows only the final PPTX**, auto-opened: left column for
|
|
54
|
+
sources and options, right for the deck with page thumbnails, previous/next,
|
|
55
|
+
expand and download. Narrow screens go single-column with the source list
|
|
56
|
+
scrolling on its own. A task diagnostic entry exports the run's identifiers,
|
|
57
|
+
a failed preview can be retried, and the download survives the error.
|
|
58
|
+
- **Conversation tool results show their images again.** The renderer reads DSH's
|
|
59
|
+
persisted result metadata, so text-to-image, image-to-image and task-query
|
|
60
|
+
results all display thumbnails and open the original; older sessions keep
|
|
61
|
+
working through their image content blocks and JSON references, and a repeated
|
|
62
|
+
attachment appears once. Images stay UI data — what the model receives is
|
|
63
|
+
still text.
|
|
64
|
+
- **`format v4 message requires a producer-owned source kind` is fixed.** A PPT
|
|
65
|
+
run's first message carries `plugin:dsh-imagegen` instead of the v4-rejected
|
|
66
|
+
plugin wrapper; cast-heavy canvas skills share the fix.
|
|
67
|
+
- **Grok video speaks xAI's own contract.** A new `xai` family submits to
|
|
68
|
+
`/v1/videos/generations` and reads `request_id`, polls
|
|
69
|
+
`/v1/videos/{request_id}` for `video.url` / `video.duration`, and reports
|
|
70
|
+
`failed` and `expired` as failures. The body sends a numeric `duration`, a
|
|
71
|
+
lowercase `resolution` and `image: { url }`. The `xai-grok` preset ships
|
|
72
|
+
`grok-imagine-video-1.5` and `-lite`.
|
|
73
|
+
- **The narrow centre column stays usable.** Below 760px the conversation row
|
|
74
|
+
sizes to its content, the studio scrolls as a whole, and the config column no
|
|
75
|
+
longer stretches the layout — the generate button and the canvas stay reachable.
|
|
76
|
+
- **Desktop updates run through the launcher's install hook** and verify what it
|
|
77
|
+
actually reports: installed bundle, version, exit code and error code are each
|
|
78
|
+
checked, and an unverifiable result fails rather than claiming success.
|
|
79
|
+
|
|
8
80
|
### 1.9.0 — images to an editable PPTX
|
|
9
81
|
|
|
10
82
|
A standalone conversion workspace, reached from any finished image.
|
package/README.md
CHANGED
|
@@ -82,6 +82,7 @@ dsh plugin --profile web add ./q253595422-dsh-imagegen-video-1.7.8.tgz
|
|
|
82
82
|
| --- | --- |
|
|
83
83
|
| **无限画布** | 把提示词、参考图和生成节点连成可迭代的创作流程。 |
|
|
84
84
|
| **视频节点与拼接** | 视频节点与图片节点同一套控制;多选后按画布位置拼成一条成片。 |
|
|
85
|
+
| **分镜节点** | 一列镜头各出一段视频,可接上一镜尾帧;成品就是普通视频节点,同样能拼接。 |
|
|
85
86
|
| **电商套图** | 从商品参考图生成主图、卖点图、场景图等成套素材。 |
|
|
86
87
|
| **文生图 / 图生图** | 使用兼容的生图渠道生成、编辑并比较图片。 |
|
|
87
88
|
| **生视频** | 文生视频、图生视频、首尾帧与多参考图;按协议族适配异步渲染与轮询。 |
|
|
@@ -99,7 +100,9 @@ dsh plugin --profile web add ./q253595422-dsh-imagegen-video-1.7.8.tgz
|
|
|
99
100
|
<details>
|
|
100
101
|
<summary><b>画布、文件节点与技能细节</b></summary>
|
|
101
102
|
|
|
102
|
-
-
|
|
103
|
+
- 支持图片、文本、视频、生成配置、文件与**分镜**节点;图片节点可标注、移除背景或拆分图层。
|
|
104
|
+
- **分镜**:一个节点就是一列镜头,每镜一条提示词与一个时长,顺序即片序。可以「每镜独立」一次提交全部待生成的镜头,也可以「接上一镜尾帧」一次跑一镜——用上一镜的最后一帧当这一镜的第一帧。每一镜的成品都是普通视频节点,预览、下载、收藏、重试和拼接都走原来那条链路;分镜自己有「拼接全部镜头」,交给同一套本机 ffmpeg 和同一张顺序确认卡。
|
|
105
|
+
- **取尾帧续拍**:任意已完成的片段可以一键取结尾帧,落成图片节点并接好一个视频配置节点,直接写下一镜的描述就能接着拍。
|
|
103
106
|
- **海报编辑**:在图片节点上叠加文字与 Logo 图层,拖动改位置,实时预览;导出是一张新图片节点,原图与图层配方都保留,随时可以重开继续改。整条链路纯本地 Canvas 2D,不调用任何模型、不消耗额度。
|
|
104
107
|
- **快捷键面板**:按 `?`(或 `F1`)随时呼出,或点工具栏的键盘图标;`Esc` 关闭。常用操作同时写在控件自身的提示里(如「撤销 (Ctrl+Z)」),不必先记住有这块面板。
|
|
105
108
|
- 单个文件最大 50MB;可在画布内预览常见文档、表格、PDF、图片与音视频。
|
|
@@ -124,6 +127,9 @@ dsh plugin --profile web add ./q253595422-dsh-imagegen-video-1.7.8.tgz
|
|
|
124
127
|
|
|
125
128
|
判定规则与已知边界见 [`docs/compose-contract.md`](docs/compose-contract.md)。
|
|
126
129
|
|
|
130
|
+
分镜节点也有自己的「拼接全部镜头」:它把各镜已经生成的片段按镜头顺序交给同一条链路,
|
|
131
|
+
还在生成的镜头会被跳过并说明少了几镜。
|
|
132
|
+
|
|
127
133
|
<a id="ecommerce"></a>
|
|
128
134
|
|
|
129
135
|
从商品主体和可选风格参考出发,先预览套图计划、逐张调整提示词,再批量生成;主图可作为其他用途图片的一致性参考。
|
|
@@ -237,7 +243,7 @@ dsh plugin --profile web add ./q253595422-dsh-imagegen-video-1.7.8.tgz
|
|
|
237
243
|
|
|
238
244
|
**核心能力**:生图(文生图 / 图生图 / 多参考图编辑)、生视频(文生视频 / 图生视频 /
|
|
239
245
|
首尾帧 / 多参考图)、图片转可编辑 PPT(最多 12 张,每张一页)、无限画布(图片与视频节点、
|
|
240
|
-
|
|
246
|
+
分镜节点、片段拼接、技能)、电商套图、模板库与画廊。
|
|
241
247
|
|
|
242
248
|
**支持与问题反馈请提到本仓库的 Issues**([Bug 报告](https://github.com/q253595422/dsh-imagegen-video/issues/new?template=bug_report.yml) · [功能建议](https://github.com/q253595422/dsh-imagegen-video/issues/new?template=feature_request.yml) · [全部 Issues](https://github.com/q253595422/dsh-imagegen-video/issues))。
|
|
243
249
|
|
|
@@ -0,0 +1,41 @@
|
|
|
1
|
+
# v1.10.0 · 分镜:一列镜头,各出一段视频
|
|
2
|
+
|
|
3
|
+
> 各版本改动见 [CHANGELOG.md](../../CHANGELOG.md)。
|
|
4
|
+
|
|
5
|
+
本版在无限画布上加了一个**分镜节点**,并把「上一镜接着下一镜」做成画布上的一等操作。
|
|
6
|
+
它没有另起一套工作流:每一镜的成品就是一个普通的视频节点,预览、下载、收藏、重试和拼接
|
|
7
|
+
都还是原来那条链路。
|
|
8
|
+
|
|
9
|
+
## 分镜
|
|
10
|
+
|
|
11
|
+
- **一个节点就是一列镜头。** 每镜一条提示词、一个时长,可以加、删、上下移动;列表顺序
|
|
12
|
+
就是片序。「每镜独立」一次把还没有视频的镜头全部提交;「接上一镜尾帧」一次跑一镜,
|
|
13
|
+
用上一镜的最后一帧当这一镜的第一帧,镜头之间才真正接得上。
|
|
14
|
+
- **接不上的时候会说出来。** 选了「接上一镜尾帧」而上一镜还没出片时,这一镜的生成按钮
|
|
15
|
+
是禁用的,不会提交一个悄悄退化成纯文本生成的请求。
|
|
16
|
+
- **每一镜的状态来自它自己的视频节点。** 已完成、生成中、失败、还没生成四种状态都读自
|
|
17
|
+
那张节点,所以分镜上看到的进度和画布上看到的片段永远一致;删掉片段,那一镜就回到
|
|
18
|
+
待生成,可以直接重来。
|
|
19
|
+
|
|
20
|
+
## 拼接
|
|
21
|
+
|
|
22
|
+
- **分镜自己会拼。** 有两镜及以上出片后,「拼接全部镜头」把它们按镜头顺序交给现有的
|
|
23
|
+
compose 链路——同一张 ①②③ 顺序确认卡、同一个本机 ffmpeg。还在生成的镜头不会被塞进
|
|
24
|
+
去,界面会说明少了几镜,而不是提交一次注定失败的拼接。
|
|
25
|
+
|
|
26
|
+
## 画布
|
|
27
|
+
|
|
28
|
+
- **取尾帧续拍。** 任意已完成的片段都可以一键取结尾帧:生成一张图片节点,并接好一个
|
|
29
|
+
新的视频配置节点,直接写下一镜的描述就能接着拍。这是分镜衔接的手动版,用的还是画布
|
|
30
|
+
上原有的抓帧与生成。
|
|
31
|
+
- **刷新不丢。** 镜头列表、画布共享的画幅与分辨率、每一镜和它片段节点的对应关系都存在
|
|
32
|
+
画布文档里;重开画布照旧。文档里存了无法兑现的镜头数据时,保存会明确失败,而不是写进
|
|
33
|
+
去一份半坏的文档。
|
|
34
|
+
- **编辑走文档。** 在分镜里改提示词、调顺序,和其他节点一样支持撤销、重做与自动保存。
|
|
35
|
+
|
|
36
|
+
## 已知边界
|
|
37
|
+
|
|
38
|
+
- 分镜的镜头数上限为 40。超过上限的文档会被拒绝保存。
|
|
39
|
+
- 「接上一镜尾帧」依赖浏览器能解码上一镜的结尾帧;片段文件被清理掉时无法续拍,会给出
|
|
40
|
+
明确提示。
|
|
41
|
+
- 分镜不生成配乐、字幕或转场,只负责把镜头跑出来并拼成一条片子。
|
|
@@ -0,0 +1,48 @@
|
|
|
1
|
+
# v1.9.3 · 会话图片、PPT 交付与 xAI Grok 视频
|
|
2
|
+
|
|
3
|
+
> 各版本改动见 [CHANGELOG.md](../../CHANGELOG.md)。
|
|
4
|
+
|
|
5
|
+
本版把上游 1.9.1 与 1.9.2 的 PPT 交付改动合进来,并修掉本仓库自己的两处问题:
|
|
6
|
+
会话里的生图结果能显示图片了,「图片转 PPT」在窄栏下不再被挤出屏幕,Grok 视频接上了官方接口。
|
|
7
|
+
|
|
8
|
+
## PPT 转换
|
|
9
|
+
|
|
10
|
+
- **宿主错误不再被「未输出最终 PPTX」掩盖。** 模型或执行失败时保留具体错误并脱敏,
|
|
11
|
+
没有回复时提示检查默认模型连接与工具配置。
|
|
12
|
+
- **接收上游 skill 自己 final 目录里的最终 PPTX。** 只接受完成记录加通过的校验报告,
|
|
13
|
+
继续检查 PPTX 结构与页数;中间页文件不会被当成成功结果。
|
|
14
|
+
- **配置改为页内弹窗**,复用生图配置里的同一组字段,不再依赖宿主设置按钮的 DOM 查找;
|
|
15
|
+
支持 Escape、焦点约束与返回原按钮。
|
|
16
|
+
- **上传后是缩略图网格加「+」卡片**,可点击预览、移动顺序、删除;顺序即幻灯片顺序。
|
|
17
|
+
- **结果区只展示最终 PPTX。** 左右两栏:左边图片与参数,右边自动打开内容预览,
|
|
18
|
+
支持缩略图翻页、上一页/下一页、放大与下载;窄屏改单列,图片列表独立滚动。
|
|
19
|
+
新增任务诊断入口,预览失败可重试且仍可下载文件。复杂版式以 PowerPoint 为准。
|
|
20
|
+
|
|
21
|
+
## 会话与画布
|
|
22
|
+
|
|
23
|
+
- **会话中的生图工具读取 DSH 持久化的结果 metadata**,文生图、图生图与任务查询返回的
|
|
24
|
+
图片都能显示缩略图并打开原图;旧会话里的图片内容块与 JSON 引用仍然兼容,重复附件只显示一次。
|
|
25
|
+
图片只作界面展示,发给模型的内容仍是文本。
|
|
26
|
+
- **修复 PPT 首条消息的 `format v4 message requires a producer-owned source kind`**:
|
|
27
|
+
改用 `plugin:dsh-imagegen`,不再用被 DSH v4 拒绝的旧 plugin 包装;无限画布里的重型 skill 同样生效。
|
|
28
|
+
|
|
29
|
+
## 视频
|
|
30
|
+
|
|
31
|
+
- **Grok 视频接入官方协议。** 新增 `xai` 家族:提交到 `/v1/videos/generations` 读 `request_id`,
|
|
32
|
+
轮询 `/v1/videos/{request_id}` 读 `video.url` 与 `video.duration`,`failed` 与 `expired` 都按失败报告。
|
|
33
|
+
请求体按官方约定发送数字 `duration`、小写 `resolution` 与 `image: { url }`。
|
|
34
|
+
`xai-grok` 预设自带 `grok-imagine-video-1.5` 与 `-lite` 两个视频模型。
|
|
35
|
+
|
|
36
|
+
## 其它
|
|
37
|
+
|
|
38
|
+
- **窄栏布局不再被挤出屏幕。** 中间列很窄时对话区按内容收缩,工作室整体滚动,
|
|
39
|
+
配置栏不再撑破布局;生成按钮与画布都可达。
|
|
40
|
+
- Windows 桌面宿主的在线更新改走宿主安装接口,安装结果逐项核对,不接受「看起来成功」。
|
|
41
|
+
|
|
42
|
+
## 验证
|
|
43
|
+
|
|
44
|
+
类型检查、构建与 93 项离线检查通过,另有反向验证确认每处守卫被改回时对应检查会变红。
|
|
45
|
+
PPT 工作区的真实浏览器检查(`pnpm run ppt:preview && pnpm run test:ppt-browser`)需要 Playwright
|
|
46
|
+
与 Chromium,本机未安装时明确跳过并返回成功;等价的 jsdom 覆盖在 `pnpm test` 的 E1 里。
|
|
47
|
+
|
|
48
|
+
本环境没有用真实付费模型跑通整份多页转换,转换质量仍取决于输入图片、OCR 与模型能力。
|