@melite/models-h3 0.1.4-alpha → 0.2.0-alpha
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +561 -457
- package/README.md +39 -0
- package/lib/actions.d.ts +91 -17
- package/lib/actions.js +1472 -187
- package/lib/chainEdit.d.ts +187 -0
- package/lib/chainEdit.js +330 -0
- package/lib/chainUpscale.d.ts +25 -0
- package/lib/chainUpscale.js +134 -0
- package/lib/extend.d.ts +17 -0
- package/lib/extend.js +174 -0
- package/lib/filmMix.d.ts +24 -10
- package/lib/filmMix.js +30 -14
- package/lib/index.d.ts +14 -1
- package/lib/index.js +296 -186
- package/lib/mods/loras.d.ts +19 -88
- package/lib/mods/loras.js +38 -9
- package/lib/refine.d.ts +123 -0
- package/lib/refine.js +301 -0
- package/lib/repair.d.ts +15 -0
- package/lib/repair.js +164 -0
- package/lib/reshoot.d.ts +201 -0
- package/lib/reshoot.js +352 -0
- package/lib/schema.d.ts +92 -13
- package/lib/schema.js +355 -45
- package/lib/swap.d.ts +14 -0
- package/lib/swap.js +95 -0
- package/lib/timelineContract.d.ts +164 -1
- package/lib/timelineContract.js +220 -4
- package/lib/windowSpec.d.ts +23 -0
- package/lib/windowSpec.js +49 -0
- package/package.json +9 -8
package/README.md
ADDED
|
@@ -0,0 +1,39 @@
|
|
|
1
|
+
---
|
|
2
|
+
description: MiniMax H3 family, joint video and audio generation across timeline, single-shot, and keyframe lanes.
|
|
3
|
+
kind: package-library
|
|
4
|
+
---
|
|
5
|
+
|
|
6
|
+
# @melite/models-h3
|
|
7
|
+
|
|
8
|
+
The MiniMax H3 family — joint video and audio generation, one family owning three lanes (the one-model law): multi-window timeline films on route `h3-timeline`, single-shot FL2VA and Ref2VA clips on route `h3-fl2va`, and the keyframe lane. The survivor-id correction (2026-09-22) fixed the fold: the family is `h3`, a model names a checkpoint, and a variant names a lane — the old `h3-timeline` address survives as the timeline lane's route, and a dead-era draft addressing `h3` resolves to the family default, the timeline lane, the one deliberate behavior shift. The family serves a catalog row (offered, comfyui) with a studio block: the `video/h3-timeline` tenant owns the card's parameters — calls, keyframes, sampling, SLA sparsity, sharpen, interpolation, super-resolution, audio, loras, document.
|
|
9
|
+
|
|
10
|
+
Provisions pin the downloaded weights with sha256 digests, byte sizes, and target folders. The mods row boards the loras pack and marries steps with max: eleven user-picked distill and refiner rows (LightX2V, Kijai, the arena winners, DMAD, TaoMate) — no recipe stamps them; the absent-bag default builds from the catalog's `h3_lightx2v_turbo` row, and a missing row refuses at load.
|
|
11
|
+
|
|
12
|
+
The film action is the single seat of the video lane: the card's schema gate runs card-side, then dispatches here; the action owns the t4r guide admission, the clips law, the lora steps, and both renderers, and returns the artifact handle. The timeline contract pins the frame math: 22-frame seam overlap, the 22+17k carried grid capped at 362 frames, and the 9-slot image bus with caps (8 images, 3 videos, 3 audios, 8 refmods). The film mix owns the audio placement math — one owner that both the compose stamps and the film-time overlay read; a positioned clip row without a numeric start frame refuses loud. The schema module mirrors the h3-timeline card's param schema 1:1 — one spelling, never a second copy.
|
|
13
|
+
|
|
14
|
+
Beyond the package entry, the manifest exports `./mods/loras` (the flavor rows), `./actions` (the film action), `./schema` (the param carrier), `./timelineContract` (the frame grid), and `./filmMix` (the audio mix).
|
|
15
|
+
|
|
16
|
+
## Declaration
|
|
17
|
+
|
|
18
|
+
`src/index.ts` declares the DECL and the `family-h3` plugin; the subpath modules above are the family's published seams for the card, the flow, and the agents that read them. The timeline lane serves a three-member quant offer (the 2026-10-26 quant cure: "the system needs ALL THREE"): `int8` (the smhfacct hybrid default), `int8_convrot_pruned` (the Comfy-Org pruned ConvRot dit, already provisioned), and `int8_convrot` (the 34 GB non-pruned tier, a per-cell artifact) — beside the community Singularity fine-tune at `int8_pruned` (pruned int8, convrot unstated upstream; a per-variant `lane_inputs.unet` override, pick-only, with the first+last-frame audition and the VRAM peaks owed to the bench experiments).
|
|
19
|
+
|
|
20
|
+
## Model Experience
|
|
21
|
+
|
|
22
|
+
#### What the model sees
|
|
23
|
+
|
|
24
|
+
None — the package contributes no model-visible input. The DECL serves the estate's model catalog (label, description, variants, defaults) and the h3-timeline card that boards the family; it registers no session events and writes no prompt segments.
|
|
25
|
+
|
|
26
|
+
#### Token effect
|
|
27
|
+
|
|
28
|
+
Zero-direct token effect — the package registers a model family and composes engine graphs; it writes no prompt text into any model request.
|
|
29
|
+
|
|
30
|
+
#### KV Cache effect
|
|
31
|
+
|
|
32
|
+
Independent — the package contributes no persistent prompt prefix, so registering or removing the family invalidates nothing cached.
|
|
33
|
+
|
|
34
|
+
## Known Limitations and Deferred Work
|
|
35
|
+
|
|
36
|
+
- **LoRA steps marry at max** — while a counting bag row rides, steps are the bag's (the higher designed count wins across the rows); an authored step count loses to the designed one.
|
|
37
|
+
- **The carried grid refuses off-grid spans** — authored ranges must land on the 22+17k grid; the contract asserts and refuses with the legal neighboring end frames rather than snapping silently.
|
|
38
|
+
- **Ref caps are loud** — 9 image-bus slots (8 loose references, 7 with a last-frame anchor), 3 videos, 3 audios, 8 refmods; an over-cap stack refuses at the gate, never rides silent.
|
|
39
|
+
- **Dense-LoRA adaln drops are watched, not yet guarded** — a dense row can silently drop 51 adaln_proj keys on the pruned base; the guard rides the arena's first stacked load.
|
package/lib/actions.d.ts
CHANGED
|
@@ -1,5 +1,64 @@
|
|
|
1
1
|
import type { OutputHandle } from '@melite/comfyui-card-kit/graph';
|
|
2
|
+
import { GraphBuilder } from '@melite/comfyui-card-kit/graph';
|
|
2
3
|
import type { ComfyActionSpec } from '@melite/comfyui-card-kit';
|
|
4
|
+
|
|
5
|
+
export declare const H3_DEFAULT_LORA_ID = "h3_lightx2v_turbo";
|
|
6
|
+
/** The absent-bag default as a RESOLVED ROW — the same catalog row the
|
|
7
|
+
* compose default builds, exposed so the card can serve it as the
|
|
8
|
+
* ghost chip: the face then shows the adapter the film will actually
|
|
9
|
+
* run instead of an empty bag. One owner: the catalog. */
|
|
10
|
+
export declare const h3DefaultLoraEntry: () => {
|
|
11
|
+
id: string;
|
|
12
|
+
strength: number;
|
|
13
|
+
steps: number;
|
|
14
|
+
};
|
|
15
|
+
|
|
16
|
+
|
|
17
|
+
|
|
18
|
+
|
|
19
|
+
|
|
20
|
+
|
|
21
|
+
|
|
22
|
+
export declare function h3LoraStackOf(p: Record<string, unknown>): string;
|
|
23
|
+
/** THE MARRIED SHIFT'S ONE OWNER (same law as the lora plane): the
|
|
24
|
+
* sigma-shift grid the doc's lora plane owns — a pinned shift is the
|
|
25
|
+
* user's word, an unstated one marries the bag's highest-count row
|
|
26
|
+
* (marriedBagKnob), else the doc's own row. Both renderers read this.
|
|
27
|
+
* @param p the walked doc params */
|
|
28
|
+
export declare function h3ShiftVideoOf(p: Record<string, unknown>): number;
|
|
29
|
+
|
|
30
|
+
|
|
31
|
+
|
|
32
|
+
|
|
33
|
+
|
|
34
|
+
|
|
35
|
+
|
|
36
|
+
|
|
37
|
+
|
|
38
|
+
|
|
39
|
+
|
|
40
|
+
|
|
41
|
+
export declare const LANE_FILES: {
|
|
42
|
+
readonly clip: "qwen3vl_32b_minimax_h3_int8_convrot.safetensors";
|
|
43
|
+
readonly vae_video: "minimax_h3_video_vae_int8_convrot.safetensors";
|
|
44
|
+
readonly vae_audio: "minimax_h3_audio_vae_fp32.safetensors";
|
|
45
|
+
readonly sr_vae: "ema_vae_fp16.safetensors";
|
|
46
|
+
};
|
|
47
|
+
|
|
48
|
+
|
|
49
|
+
|
|
50
|
+
|
|
51
|
+
|
|
52
|
+
|
|
53
|
+
export declare const FILM_AUDIO_RATE = 48000;
|
|
54
|
+
/** THE JOIN-RATE DOOR: one spelling for every audio leg that feeds a
|
|
55
|
+
* join's CreateVideo — the leg passes MeliteAudioResample at
|
|
56
|
+
* FILM_AUDIO_RATE (engine-core bandlimited sinc; equal-rate input
|
|
57
|
+
* passes the SAME dict through, so a leg already at the film rate
|
|
58
|
+
* pays nothing but the stated law).
|
|
59
|
+
* @param g the run's graph builder
|
|
60
|
+
* @param audio the leg's AUDIO output handle */
|
|
61
|
+
export declare function filmJoinAudio(g: GraphBuilder, audio: OutputHandle): OutputHandle;
|
|
3
62
|
/** The h3 facts door: the resolved lane_inputs parsed into the
|
|
4
63
|
* loader names the renderers read (the unet from the row; the
|
|
5
64
|
* three invariants from the package's own LANE_FILES).
|
|
@@ -17,23 +76,38 @@ export declare function parseH3Facts(raw: unknown): H3Facts;
|
|
|
17
76
|
* Exported so the card's single-call lift judges through the same
|
|
18
77
|
* re-check (the h3-b duplicate is gone: one owner). */
|
|
19
78
|
export declare const assertOverlayGated: (doc: Record<string, unknown>, where: string) => void;
|
|
20
|
-
|
|
21
|
-
|
|
22
|
-
|
|
23
|
-
|
|
24
|
-
|
|
25
|
-
|
|
26
|
-
|
|
27
|
-
|
|
28
|
-
|
|
29
|
-
|
|
30
|
-
|
|
31
|
-
|
|
32
|
-
|
|
33
|
-
|
|
34
|
-
|
|
35
|
-
|
|
36
|
-
|
|
79
|
+
|
|
80
|
+
|
|
81
|
+
|
|
82
|
+
|
|
83
|
+
|
|
84
|
+
|
|
85
|
+
|
|
86
|
+
|
|
87
|
+
|
|
88
|
+
|
|
89
|
+
|
|
90
|
+
export declare function chainSaveBoundaries(g: GraphBuilder, saves: readonly OutputHandle[]): OutputHandle;
|
|
91
|
+
/** THE FILE-JOIN PRIMITIVE, half 2 — the concat + container (the
|
|
92
|
+
* film tail's own law, ONE spelling for every join-by-file seat):
|
|
93
|
+
* MeliteConcatVideos decodes the saved FILES back CPU-side strictly
|
|
94
|
+
* after the boundary token; CreateVideo → SaveVideo delivers the
|
|
95
|
+
* joined film.
|
|
96
|
+
* @param g the run's graph builder
|
|
97
|
+
* @param prefixes the members' SaveVideo prefixes, film order
|
|
98
|
+
* @param after the boundary chain's final token (the ordering proof)
|
|
99
|
+
* @param out the joined film's filename_prefix
|
|
100
|
+
* @param opts.audio an audio override for the container mux (the
|
|
101
|
+
* film's mixed stem); absent = the concat's own decoded audio
|
|
102
|
+
* @param opts.append an exact saved-file path wired as the LAST
|
|
103
|
+
* member after the prefix list (the multi-window extend's assembled
|
|
104
|
+
* extension — ChainAssemble's video_path output; DAG-proven by its
|
|
105
|
+
* own data dependency, no boundary needed)
|
|
106
|
+
* @returns the joined film's SaveVideo passthrough */
|
|
107
|
+
export declare function concatSavedFilms(g: GraphBuilder, prefixes: readonly string[], after: OutputHandle, out: string, opts?: {
|
|
108
|
+
audio?: OutputHandle;
|
|
109
|
+
append?: OutputHandle;
|
|
110
|
+
}): OutputHandle;
|
|
37
111
|
/** The seam's cross-window wires: the RAW decode + sampler handles
|
|
38
112
|
* of one rendered window (pre-trim, pre-sharpen — the true tail). */
|
|
39
113
|
export interface WindowHandles {
|