vargai 0.3.2 → 0.4.0-alpha10

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (64) hide show
  1. package/biome.json +6 -1
  2. package/docs/index.html +1130 -0
  3. package/docs/prompting.md +326 -0
  4. package/docs/react.md +834 -0
  5. package/package.json +14 -5
  6. package/src/cli/commands/index.ts +2 -4
  7. package/src/cli/commands/render.ts +136 -0
  8. package/src/cli/commands/studio.ts +47 -0
  9. package/src/cli/index.ts +6 -1
  10. package/src/react/elements.ts +146 -0
  11. package/src/react/examples/branching.tsx +66 -0
  12. package/src/react/examples/captions-demo.tsx +37 -0
  13. package/src/react/examples/character-video.tsx +84 -0
  14. package/src/react/examples/grid.tsx +53 -0
  15. package/src/react/examples/layouts-demo.tsx +57 -0
  16. package/src/react/examples/madi.tsx +60 -0
  17. package/src/react/examples/music-test.tsx +35 -0
  18. package/src/react/examples/onlyfans-1m/workflow.tsx +88 -0
  19. package/src/react/examples/orange-portrait.tsx +41 -0
  20. package/src/react/examples/split-element-demo.tsx +60 -0
  21. package/src/react/examples/split-layout-demo.tsx +60 -0
  22. package/src/react/examples/split.tsx +41 -0
  23. package/src/react/examples/video-grid.tsx +46 -0
  24. package/src/react/index.ts +43 -0
  25. package/src/react/layouts/grid.tsx +28 -0
  26. package/src/react/layouts/index.ts +2 -0
  27. package/src/react/layouts/split.tsx +20 -0
  28. package/src/react/react.test.ts +309 -0
  29. package/src/react/render.ts +21 -0
  30. package/src/react/renderers/animate.ts +59 -0
  31. package/src/react/renderers/captions.ts +297 -0
  32. package/src/react/renderers/clip.ts +258 -0
  33. package/src/react/renderers/context.ts +17 -0
  34. package/src/react/renderers/image.ts +109 -0
  35. package/src/react/renderers/index.ts +22 -0
  36. package/src/react/renderers/music.ts +60 -0
  37. package/src/react/renderers/packshot.ts +84 -0
  38. package/src/react/renderers/progress.ts +173 -0
  39. package/src/react/renderers/render.ts +319 -0
  40. package/src/react/renderers/slider.ts +69 -0
  41. package/src/react/renderers/speech.ts +53 -0
  42. package/src/react/renderers/split.ts +91 -0
  43. package/src/react/renderers/subtitle.ts +16 -0
  44. package/src/react/renderers/swipe.ts +75 -0
  45. package/src/react/renderers/title.ts +17 -0
  46. package/src/react/renderers/utils.ts +124 -0
  47. package/src/react/renderers/video.ts +127 -0
  48. package/src/react/runtime/jsx-dev-runtime.ts +43 -0
  49. package/src/react/runtime/jsx-runtime.ts +35 -0
  50. package/src/react/types.ts +239 -0
  51. package/src/studio/index.ts +26 -0
  52. package/src/studio/scanner.ts +102 -0
  53. package/src/studio/server.ts +554 -0
  54. package/src/studio/stages.ts +251 -0
  55. package/src/studio/step-renderer.ts +279 -0
  56. package/src/studio/types.ts +60 -0
  57. package/src/studio/ui/cache.html +303 -0
  58. package/src/studio/ui/index.html +1820 -0
  59. package/tsconfig.cli.json +8 -0
  60. package/tsconfig.json +6 -2
  61. package/bun.lock +0 -1255
  62. package/docs/plan.md +0 -66
  63. package/docs/todo.md +0 -14
  64. /package/docs/{varg-sdk.md → sdk.md} +0 -0
package/docs/plan.md DELETED
@@ -1,66 +0,0 @@
1
- # varg ts-sdk migration plan
2
-
3
- ## core
4
-
5
- - [ ] File (load from path, url, buffer)
6
- - [ ] File.toTemp() - save to temp file for editly integration
7
- - [ ] scene`` tagged template for composing elements in prompts
8
- - [ ] types (AspectRatio, Element, etc)
9
-
10
- ## providers
11
-
12
- - [ ] @varg/fal (kling, nano-banana, lipsync)
13
- - [ ] @varg/elevenlabs (tts, music)
14
- - [ ] @varg/higgsfield (soul, characters)
15
- - [ ] @varg/heygen (talking heads)
16
- - [ ] @varg/openai (sora, gpt-image, dall-e)
17
- - [ ] @varg/replicate (birefnet, generic models)
18
-
19
- ## generation
20
-
21
- - [ ] generateImage (text to image)
22
- - [ ] generateImage (image to image / edit)
23
- - [ ] generateVideo (text to video)
24
- - [ ] generateVideo (image to video)
25
- - [ ] generateSpeech (voiceover via elevenlabs)
26
- - [ ] generateMusic (music generation via elevenlabs)
27
- - [ ] generateLipsync (sync video to audio via fal)
28
- - [ ] generateTalkingHead (photo to talking video via heygen)
29
- - [ ] generateElement (character/item/style reference for consistent generation)
30
-
31
- ## editing (use editly directly)
32
-
33
- users use editly npm package directly for video composition.
34
- we provide `File.toTemp()` to bridge ai outputs → editly paths.
35
-
36
- editly covers these py-sdk features:
37
- - [ ] crop_to_aspect_ratio → editly clips with resizeMode
38
- - [ ] mix_audio_with_ducking → editly audioNorm + audioTracks
39
- - [ ] apply_zoom_effect → editly zoomDirection on layers
40
- - [ ] create_ken_burns_effect → editly zoomDirection: "in" | "out"
41
- - [ ] create_slideshow → editly clips[] with transitions
42
- - [ ] concatenate_videos → editly clips[] with transitions
43
- - [ ] picture_in_picture → editly layers with position/size
44
- - [ ] blur_background_resize → editly resizeMode: "contain-blur"
45
- - [ ] 67 gl-transitions (fade, crossfade, wipe, cube, etc.)
46
-
47
- ## custom effects (not in editly)
48
-
49
- - [ ] addCaptions (tiktok-style word-by-word) - custom fabric.js layer for editly
50
- - [ ] createSlider (before/after reveal animation)
51
- - [ ] createPushTransition (card push effect)
52
- - [ ] createSwipeAnimation (tinder-style card swipes)
53
- - [ ] createSplitScreen (side-by-side comparison)
54
- - [ ] createPackshot (end card with cta button + blinking cta)
55
-
56
- ## image processing
57
-
58
- - [ ] removeBackground (via replicate birefnet)
59
-
60
- ## notes
61
-
62
- - editly used directly (not wrapped)
63
- - File.toTemp() bridges ai outputs to editly string paths
64
- - providers are separate packages (@varg/fal, @varg/elevenlabs, etc)
65
- - generateElement returns { images, text } for use in prompts
66
- - scene`` template composes elements in prompts
package/docs/todo.md DELETED
@@ -1,14 +0,0 @@
1
-
2
- # TODO
3
-
4
- • [ ] fal
5
- • [ ] higgsfield
6
- • [ ] captions (exactly as in TikTok)
7
- • [ ] editing (simple concat of video frames)
8
- • [ ] voiceover via elevenlabs
9
- • [ ] music generation via elevenlabs
10
- • [ ] adding music on top of video
11
- • [ ] lypsync (via sync models over fal)
12
- • [ ] resize with blur: i.e. 9:16 is resided to 4:5 by adding sides with a blur on all video
13
- • [ ] Picture-in-the-picture: one video on top of another
14
- • [ ] fade / slideshow transitions
File without changes