takomi 2.1.45 → 2.5.4

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (679) hide show
  1. package/.pi/README.md +5 -5
  2. package/.pi/agents/architect.md +2 -2
  3. package/.pi/agents/designer.md +2 -2
  4. package/.pi/agents/worker.md +32 -0
  5. package/.pi/extensions/oauth-router/README.md +3 -3
  6. package/.pi/extensions/oauth-router/config.ts +34 -34
  7. package/.pi/extensions/oauth-router/report-ui.ts +205 -205
  8. package/.pi/extensions/oauth-router/scripts/vibe-verify.py +5 -5
  9. package/.pi/extensions/takomi-context-manager/diagnostics.ts +560 -560
  10. package/.pi/extensions/takomi-context-manager/model-policy-gate.ts +15 -103
  11. package/.pi/extensions/takomi-context-manager/policy-tools.ts +93 -93
  12. package/.pi/extensions/takomi-context-manager/skill-categories.d.ts +11 -11
  13. package/.pi/extensions/takomi-context-manager/skill-tools.ts +208 -208
  14. package/.pi/extensions/takomi-context-manager/tool-renderers.ts +112 -112
  15. package/.pi/extensions/takomi-runtime/command-text.ts +5 -4
  16. package/.pi/extensions/takomi-runtime/commands.ts +17 -17
  17. package/.pi/extensions/takomi-runtime/gate-provenance.ts +24 -24
  18. package/.pi/extensions/takomi-runtime/index.ts +278 -86
  19. package/.pi/extensions/takomi-runtime/model-routing-defaults.ts +168 -232
  20. package/.pi/extensions/takomi-runtime/profile.ts +9 -8
  21. package/.pi/extensions/takomi-runtime/routing-policy.ts +84 -65
  22. package/.pi/extensions/takomi-runtime/shared.ts +7 -30
  23. package/.pi/extensions/takomi-runtime/tool-renderers.ts +234 -234
  24. package/.pi/extensions/takomi-runtime/workflow-catalog.ts +54 -54
  25. package/.pi/extensions/takomi-subagents/agents.ts +5 -0
  26. package/.pi/extensions/takomi-subagents/async-lifecycle.ts +401 -401
  27. package/.pi/extensions/takomi-subagents/detached-results.ts +940 -940
  28. package/.pi/extensions/takomi-subagents/index.ts +4 -0
  29. package/.pi/extensions/takomi-subagents/native-render.ts +253 -250
  30. package/.pi/extensions/takomi-subagents/pi-subagents-engine.ts +7 -1
  31. package/.pi/extensions/takomi-subagents/result-heartbeat.ts +55 -55
  32. package/.pi/extensions/takomi-subagents/subagent-ux.ts +162 -162
  33. package/.pi/extensions/takomi-subagents/tool-runner.ts +65 -1
  34. package/.pi/settings.json +39 -36
  35. package/.pi/takomi/model-routing.md +6 -0
  36. package/.pi/takomi-profile.json +8 -4
  37. package/README.md +1 -1
  38. package/assets/.agent/skills/embedded-captions/CATALOG.md +93 -93
  39. package/assets/.agent/skills/embedded-captions/SKILL.md +286 -286
  40. package/assets/.agent/skills/embedded-captions/assets/brand/CDPR-fankit-terms.txt +35 -35
  41. package/assets/.agent/skills/embedded-captions/assets/brand/cyberpunk-widths.json +115 -115
  42. package/assets/.agent/skills/embedded-captions/assets/fonts/char-widths.json +2211 -2211
  43. package/assets/.agent/skills/embedded-captions/assets/strokefonts/HersheyScript1.svg +241 -241
  44. package/assets/.agent/skills/embedded-captions/assets/strokefonts/HersheyScriptMed.svg +241 -241
  45. package/assets/.agent/skills/embedded-captions/dna/README.md +148 -148
  46. package/assets/.agent/skills/embedded-captions/dna/chrome.json +68 -68
  47. package/assets/.agent/skills/embedded-captions/dna/cream.json +69 -69
  48. package/assets/.agent/skills/embedded-captions/dna/documentary.json +62 -62
  49. package/assets/.agent/skills/embedded-captions/dna/editorial.json +70 -70
  50. package/assets/.agent/skills/embedded-captions/dna/glitch.json +82 -82
  51. package/assets/.agent/skills/embedded-captions/dna/ink.json +65 -65
  52. package/assets/.agent/skills/embedded-captions/dna/keynote.json +62 -62
  53. package/assets/.agent/skills/embedded-captions/dna/loud.json +75 -75
  54. package/assets/.agent/skills/embedded-captions/dna/neon.json +58 -58
  55. package/assets/.agent/skills/embedded-captions/dna/velocity.json +89 -89
  56. package/assets/.agent/skills/embedded-captions/modes/cinematic/README.md +48 -48
  57. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/champion/spec.md +98 -98
  58. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/champion/template.html +188 -188
  59. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/memory-wall/spec.md +134 -134
  60. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/memory-wall/template.html +179 -179
  61. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/portrait-header/spec.md +81 -81
  62. package/assets/.agent/skills/embedded-captions/modes/cinematic/_archive/portrait-header/template.html +170 -170
  63. package/assets/.agent/skills/embedded-captions/modes/cinematic/cinematic-cream/spec.md +16 -16
  64. package/assets/.agent/skills/embedded-captions/modes/cinematic/cinematic-cream/template.html +226 -226
  65. package/assets/.agent/skills/embedded-captions/modes/cinematic/engine.html +355 -355
  66. package/assets/.agent/skills/embedded-captions/modes/standard/_anatomy.md +233 -233
  67. package/assets/.agent/skills/embedded-captions/modes/standard/_motion.md +192 -192
  68. package/assets/.agent/skills/embedded-captions/modes/standard/fonts/build-fonts-css.cjs +97 -97
  69. package/assets/.agent/skills/embedded-captions/references/aesthetic-principles.md +168 -168
  70. package/assets/.agent/skills/embedded-captions/references/anti-patterns.md +188 -188
  71. package/assets/.agent/skills/embedded-captions/references/bespoke-vs-presets.md +178 -178
  72. package/assets/.agent/skills/embedded-captions/references/caption-grouping.md +130 -130
  73. package/assets/.agent/skills/embedded-captions/references/composition-craft.md +522 -522
  74. package/assets/.agent/skills/embedded-captions/references/direction-catalog.md +138 -138
  75. package/assets/.agent/skills/embedded-captions/references/example-renders/champion.html +371 -371
  76. package/assets/.agent/skills/embedded-captions/references/example-renders/memory-wall.html +334 -334
  77. package/assets/.agent/skills/embedded-captions/references/failure-modes.md +145 -145
  78. package/assets/.agent/skills/embedded-captions/references/layout-heuristics.md +238 -238
  79. package/assets/.agent/skills/embedded-captions/references/motion-vocabulary.md +148 -148
  80. package/assets/.agent/skills/embedded-captions/references/rail.md +68 -68
  81. package/assets/.agent/skills/embedded-captions/references/reference-bar.md +47 -47
  82. package/assets/.agent/skills/embedded-captions/references/scene-types.md +94 -94
  83. package/assets/.agent/skills/embedded-captions/references/test-set.md +66 -66
  84. package/assets/.agent/skills/embedded-captions/references/typographic-moves.md +266 -266
  85. package/assets/.agent/skills/embedded-captions/references/typography-presets.md +63 -63
  86. package/assets/.agent/skills/embedded-captions/scripts/audio-envelope.cjs +95 -95
  87. package/assets/.agent/skills/embedded-captions/scripts/check-occlusion.cjs +250 -250
  88. package/assets/.agent/skills/embedded-captions/scripts/check-overflow.cjs +194 -194
  89. package/assets/.agent/skills/embedded-captions/scripts/check-rail-climax.cjs +233 -233
  90. package/assets/.agent/skills/embedded-captions/scripts/check-timing.cjs +173 -173
  91. package/assets/.agent/skills/embedded-captions/scripts/fill-timings.cjs +124 -124
  92. package/assets/.agent/skills/embedded-captions/scripts/fit-fonts.cjs +158 -158
  93. package/assets/.agent/skills/embedded-captions/scripts/gen-stroke-path.py +46 -46
  94. package/assets/.agent/skills/embedded-captions/scripts/inject-fonts.cjs +169 -169
  95. package/assets/.agent/skills/embedded-captions/scripts/lib-dna.cjs +201 -201
  96. package/assets/.agent/skills/embedded-captions/scripts/make-cinematic.cjs +1205 -1205
  97. package/assets/.agent/skills/embedded-captions/scripts/make-composition.cjs +404 -404
  98. package/assets/.agent/skills/embedded-captions/scripts/make-theme.cjs +8781 -8781
  99. package/assets/.agent/skills/embedded-captions/scripts/matte.cjs +279 -279
  100. package/assets/.agent/skills/embedded-captions/scripts/measure-layout.cjs +293 -293
  101. package/assets/.agent/skills/embedded-captions/scripts/prepare.sh +39 -39
  102. package/assets/.agent/skills/embedded-captions/scripts/preview-frames.cjs +268 -268
  103. package/assets/.agent/skills/embedded-captions/scripts/render-and-composite.sh +469 -469
  104. package/assets/.agent/skills/embedded-captions/scripts/render-theme.sh +34 -34
  105. package/assets/.agent/skills/embedded-captions/scripts/safe-zones.cjs +813 -813
  106. package/assets/.agent/skills/embedded-captions/scripts/transcribe.cjs +332 -332
  107. package/assets/.agent/skills/embedded-captions/themes/PORTING.md +49 -49
  108. package/assets/.agent/skills/embedded-captions/themes/README.md +244 -244
  109. package/assets/.agent/skills/embedded-captions/themes/anchor.json +27 -27
  110. package/assets/.agent/skills/embedded-captions/themes/arcade.json +51 -51
  111. package/assets/.agent/skills/embedded-captions/themes/aurora.json +41 -41
  112. package/assets/.agent/skills/embedded-captions/themes/biolume.json +35 -35
  113. package/assets/.agent/skills/embedded-captions/themes/brush.json +74 -74
  114. package/assets/.agent/skills/embedded-captions/themes/chalkboard.json +52 -52
  115. package/assets/.agent/skills/embedded-captions/themes/dossier.json +56 -56
  116. package/assets/.agent/skills/embedded-captions/themes/graffiti.json +62 -62
  117. package/assets/.agent/skills/embedded-captions/themes/hologram.json +41 -41
  118. package/assets/.agent/skills/embedded-captions/themes/inkwater.json +43 -43
  119. package/assets/.agent/skills/embedded-captions/themes/laser.json +46 -46
  120. package/assets/.agent/skills/embedded-captions/themes/lastpage.json +33 -33
  121. package/assets/.agent/skills/embedded-captions/themes/neonsign.json +53 -53
  122. package/assets/.agent/skills/embedded-captions/themes/nightcity.json +56 -56
  123. package/assets/.agent/skills/embedded-captions/themes/ordnance.json +54 -54
  124. package/assets/.agent/skills/embedded-captions/themes/papercut.json +37 -37
  125. package/assets/.agent/skills/embedded-captions/themes/popup.json +46 -46
  126. package/assets/.agent/skills/embedded-captions/themes/ransom.json +62 -62
  127. package/assets/.agent/skills/embedded-captions/themes/scoreboard.json +54 -54
  128. package/assets/.agent/skills/embedded-captions/themes/spectrum.json +46 -46
  129. package/assets/.agent/skills/embedded-captions/themes/stardust.json +29 -29
  130. package/assets/.agent/skills/embedded-captions/themes/stomp.json +43 -43
  131. package/assets/.agent/skills/embedded-captions/themes/terminal.json +49 -49
  132. package/assets/.agent/skills/embedded-captions/themes/thunder.json +44 -44
  133. package/assets/.agent/skills/embedded-captions/themes/transit.json +44 -44
  134. package/assets/.agent/skills/embedded-captions/themes/vhs.json +47 -47
  135. package/assets/.agent/skills/faceless-explainer/SKILL.md +209 -209
  136. package/assets/.agent/skills/faceless-explainer/references/cut-catalog.md +215 -215
  137. package/assets/.agent/skills/faceless-explainer/references/motion-language.md +156 -156
  138. package/assets/.agent/skills/faceless-explainer/references/story-design.md +248 -248
  139. package/assets/.agent/skills/faceless-explainer/references/visual-design.md +146 -146
  140. package/assets/.agent/skills/faceless-explainer/scripts/assemble-index.mjs +570 -570
  141. package/assets/.agent/skills/faceless-explainer/scripts/audio.mjs +253 -253
  142. package/assets/.agent/skills/faceless-explainer/scripts/build-frame.mjs +536 -536
  143. package/assets/.agent/skills/faceless-explainer/scripts/captions.mjs +508 -508
  144. package/assets/.agent/skills/faceless-explainer/scripts/lib/assets.mjs +55 -55
  145. package/assets/.agent/skills/faceless-explainer/scripts/lib/dimensions.mjs +45 -45
  146. package/assets/.agent/skills/faceless-explainer/scripts/lib/storyboard.mjs +249 -249
  147. package/assets/.agent/skills/faceless-explainer/scripts/lib/tokens.mjs +204 -204
  148. package/assets/.agent/skills/faceless-explainer/scripts/lib/transition-registry.mjs +38 -38
  149. package/assets/.agent/skills/faceless-explainer/scripts/lib/transitions.json +71 -71
  150. package/assets/.agent/skills/faceless-explainer/scripts/transitions.mjs +320 -320
  151. package/assets/.agent/skills/faceless-explainer/sub-agents/frame-worker.md +75 -75
  152. package/assets/.agent/skills/figma/SKILL.md +121 -121
  153. package/assets/.agent/skills/general-video/SKILL.md +143 -143
  154. package/assets/.agent/skills/hyperframes/SKILL.md +164 -164
  155. package/assets/.agent/skills/hyperframes-animation/SKILL.md +84 -84
  156. package/assets/.agent/skills/hyperframes-animation/adapters/animate-text.md +64 -64
  157. package/assets/.agent/skills/hyperframes-animation/adapters/animejs.md +114 -114
  158. package/assets/.agent/skills/hyperframes-animation/adapters/css-animations.md +143 -143
  159. package/assets/.agent/skills/hyperframes-animation/adapters/gsap-easing-and-stagger.md +118 -118
  160. package/assets/.agent/skills/hyperframes-animation/adapters/gsap-timeline-and-labels.md +96 -96
  161. package/assets/.agent/skills/hyperframes-animation/adapters/gsap-transforms-and-perf.md +96 -96
  162. package/assets/.agent/skills/hyperframes-animation/adapters/gsap.md +105 -105
  163. package/assets/.agent/skills/hyperframes-animation/adapters/html-in-canvas-patterns.md +507 -507
  164. package/assets/.agent/skills/hyperframes-animation/adapters/lottie.md +117 -117
  165. package/assets/.agent/skills/hyperframes-animation/adapters/three.md +131 -131
  166. package/assets/.agent/skills/hyperframes-animation/adapters/typegpu.md +178 -178
  167. package/assets/.agent/skills/hyperframes-animation/adapters/waapi.md +101 -101
  168. package/assets/.agent/skills/hyperframes-animation/blueprints/comparison-split.md +27 -27
  169. package/assets/.agent/skills/hyperframes-animation/blueprints/constellation-hub.md +44 -44
  170. package/assets/.agent/skills/hyperframes-animation/blueprints/cta-morph-press.md +28 -28
  171. package/assets/.agent/skills/hyperframes-animation/blueprints/cursor-ui-demo.md +57 -57
  172. package/assets/.agent/skills/hyperframes-animation/blueprints/dataviz-countup.md +46 -46
  173. package/assets/.agent/skills/hyperframes-animation/blueprints/device-surface-showcase.md +53 -53
  174. package/assets/.agent/skills/hyperframes-animation/blueprints/grid-card-assemble.md +66 -66
  175. package/assets/.agent/skills/hyperframes-animation/blueprints/kinetic-type-beats.md +78 -78
  176. package/assets/.agent/skills/hyperframes-animation/blueprints/logo-assemble-lockup.md +69 -69
  177. package/assets/.agent/skills/hyperframes-animation/blueprints/overwhelm-surround.md +28 -28
  178. package/assets/.agent/skills/hyperframes-animation/blueprints/spatial-pan-stations.md +37 -37
  179. package/assets/.agent/skills/hyperframes-animation/blueprints/ticker-takeover.md +29 -29
  180. package/assets/.agent/skills/hyperframes-animation/blueprints/titlecard-reveal.md +42 -42
  181. package/assets/.agent/skills/hyperframes-animation/blueprints/typewriter-reveal.md +51 -51
  182. package/assets/.agent/skills/hyperframes-animation/blueprints/video-text-pivot.md +30 -30
  183. package/assets/.agent/skills/hyperframes-animation/blueprints-index.md +146 -146
  184. package/assets/.agent/skills/hyperframes-animation/examples/brand-reveal-assemble-zoom.html +382 -382
  185. package/assets/.agent/skills/hyperframes-animation/examples/comparison-split-cards.html +649 -649
  186. package/assets/.agent/skills/hyperframes-animation/examples/concept-demo-decode-pan.html +520 -520
  187. package/assets/.agent/skills/hyperframes-animation/examples/cta-morph-press.html +468 -468
  188. package/assets/.agent/skills/hyperframes-animation/examples/cta-orbit-collapse.html +1298 -1298
  189. package/assets/.agent/skills/hyperframes-animation/examples/demo-page-scroll-spotlight.html +759 -759
  190. package/assets/.agent/skills/hyperframes-animation/examples/hook-counter-burst.html +729 -729
  191. package/assets/.agent/skills/hyperframes-animation/examples/messaging-multi-phrase.html +352 -352
  192. package/assets/.agent/skills/hyperframes-animation/examples/metric-video-text-pivot.html +779 -779
  193. package/assets/.agent/skills/hyperframes-animation/examples/problem-mockup-overwhelm.html +1374 -1374
  194. package/assets/.agent/skills/hyperframes-animation/examples/proof-logo-chain.html +861 -861
  195. package/assets/.agent/skills/hyperframes-animation/examples/takeover-ticker-displace.html +347 -347
  196. package/assets/.agent/skills/hyperframes-animation/examples/workflow-approve-press.html +606 -606
  197. package/assets/.agent/skills/hyperframes-animation/rules/3d-page-scroll.md +227 -227
  198. package/assets/.agent/skills/hyperframes-animation/rules/3d-text-depth-layers.md +297 -297
  199. package/assets/.agent/skills/hyperframes-animation/rules/ai-tracking-box.md +382 -382
  200. package/assets/.agent/skills/hyperframes-animation/rules/ambient-glow-bloom.md +305 -305
  201. package/assets/.agent/skills/hyperframes-animation/rules/asr-keyword-glow.md +286 -286
  202. package/assets/.agent/skills/hyperframes-animation/rules/avatar-cloud-network.md +371 -371
  203. package/assets/.agent/skills/hyperframes-animation/rules/camera-cursor-tracking.md +246 -246
  204. package/assets/.agent/skills/hyperframes-animation/rules/card-morph-anchor.md +267 -267
  205. package/assets/.agent/skills/hyperframes-animation/rules/center-outward-expansion.md +227 -227
  206. package/assets/.agent/skills/hyperframes-animation/rules/context-sensitive-cursor.md +257 -257
  207. package/assets/.agent/skills/hyperframes-animation/rules/coordinate-target-zoom.md +332 -332
  208. package/assets/.agent/skills/hyperframes-animation/rules/counting-dynamic-scale.md +283 -283
  209. package/assets/.agent/skills/hyperframes-animation/rules/css-marker-patterns.md +373 -373
  210. package/assets/.agent/skills/hyperframes-animation/rules/cursor-click-ripple.md +262 -262
  211. package/assets/.agent/skills/hyperframes-animation/rules/depth-of-field-blur.md +313 -313
  212. package/assets/.agent/skills/hyperframes-animation/rules/depth-scatter-assemble.md +303 -303
  213. package/assets/.agent/skills/hyperframes-animation/rules/discrete-text-sequence.md +273 -273
  214. package/assets/.agent/skills/hyperframes-animation/rules/dynamic-content-sequencing.md +307 -307
  215. package/assets/.agent/skills/hyperframes-animation/rules/gsap-effects.md +299 -299
  216. package/assets/.agent/skills/hyperframes-animation/rules/hacker-flip-3d.md +223 -223
  217. package/assets/.agent/skills/hyperframes-animation/rules/kinetic-beat-slam.md +183 -183
  218. package/assets/.agent/skills/hyperframes-animation/rules/motion-blur-streak.md +328 -328
  219. package/assets/.agent/skills/hyperframes-animation/rules/multi-phase-camera.md +273 -273
  220. package/assets/.agent/skills/hyperframes-animation/rules/orbit-3d-entry.md +301 -301
  221. package/assets/.agent/skills/hyperframes-animation/rules/physics-press-reaction.md +350 -350
  222. package/assets/.agent/skills/hyperframes-animation/rules/press-release-spring.md +296 -296
  223. package/assets/.agent/skills/hyperframes-animation/rules/reactive-displacement.md +277 -277
  224. package/assets/.agent/skills/hyperframes-animation/rules/scale-swap-transition.md +298 -298
  225. package/assets/.agent/skills/hyperframes-animation/rules/sine-wave-loop.md +278 -278
  226. package/assets/.agent/skills/hyperframes-animation/rules/split-tilt-cards.md +277 -277
  227. package/assets/.agent/skills/hyperframes-animation/rules/spring-pop-entrance.md +273 -273
  228. package/assets/.agent/skills/hyperframes-animation/rules/stat-bars-and-fills.md +156 -156
  229. package/assets/.agent/skills/hyperframes-animation/rules/svg-icon-enrichment.md +329 -329
  230. package/assets/.agent/skills/hyperframes-animation/rules/svg-path-draw.md +274 -274
  231. package/assets/.agent/skills/hyperframes-animation/rules/vertical-spring-ticker.md +239 -239
  232. package/assets/.agent/skills/hyperframes-animation/rules/viewport-change.md +349 -349
  233. package/assets/.agent/skills/hyperframes-animation/rules-index.md +86 -86
  234. package/assets/.agent/skills/hyperframes-animation/scripts/animation-map.mjs +606 -606
  235. package/assets/.agent/skills/hyperframes-animation/scripts/package-loader.mjs +288 -288
  236. package/assets/.agent/skills/hyperframes-animation/scripts/package-loader.test.mjs +62 -62
  237. package/assets/.agent/skills/hyperframes-animation/techniques.md +507 -507
  238. package/assets/.agent/skills/hyperframes-animation/transitions/TRANSITION-REGISTRY.md +167 -167
  239. package/assets/.agent/skills/hyperframes-animation/transitions/catalog.md +127 -127
  240. package/assets/.agent/skills/hyperframes-animation/transitions/css-3d.md +12 -12
  241. package/assets/.agent/skills/hyperframes-animation/transitions/css-blur.md +51 -51
  242. package/assets/.agent/skills/hyperframes-animation/transitions/css-cover.md +43 -43
  243. package/assets/.agent/skills/hyperframes-animation/transitions/css-destruction.md +95 -95
  244. package/assets/.agent/skills/hyperframes-animation/transitions/css-dissolve.md +66 -66
  245. package/assets/.agent/skills/hyperframes-animation/transitions/css-distortion.md +45 -45
  246. package/assets/.agent/skills/hyperframes-animation/transitions/css-grid.md +10 -10
  247. package/assets/.agent/skills/hyperframes-animation/transitions/css-light.md +49 -49
  248. package/assets/.agent/skills/hyperframes-animation/transitions/css-mechanical.md +30 -30
  249. package/assets/.agent/skills/hyperframes-animation/transitions/css-other.md +25 -25
  250. package/assets/.agent/skills/hyperframes-animation/transitions/css-push.md +41 -41
  251. package/assets/.agent/skills/hyperframes-animation/transitions/css-radial.md +37 -37
  252. package/assets/.agent/skills/hyperframes-animation/transitions/css-scale.md +24 -24
  253. package/assets/.agent/skills/hyperframes-animation/transitions/overview.md +153 -153
  254. package/assets/.agent/skills/hyperframes-cli/SKILL.md +113 -113
  255. package/assets/.agent/skills/hyperframes-cli/references/doctor-browser.md +45 -45
  256. package/assets/.agent/skills/hyperframes-cli/references/init-and-scaffold.md +51 -51
  257. package/assets/.agent/skills/hyperframes-cli/references/lambda.md +132 -132
  258. package/assets/.agent/skills/hyperframes-cli/references/lint-validate-inspect.md +121 -121
  259. package/assets/.agent/skills/hyperframes-cli/references/preview-render.md +164 -164
  260. package/assets/.agent/skills/hyperframes-cli/references/upgrade-info-misc.md +75 -75
  261. package/assets/.agent/skills/hyperframes-core/SKILL.md +78 -78
  262. package/assets/.agent/skills/hyperframes-core/references/composition-patterns.md +263 -263
  263. package/assets/.agent/skills/hyperframes-core/references/data-attributes.md +70 -70
  264. package/assets/.agent/skills/hyperframes-core/references/determinism-rules.md +68 -68
  265. package/assets/.agent/skills/hyperframes-core/references/full-screen-motion.md +62 -62
  266. package/assets/.agent/skills/hyperframes-core/references/minimal-composition.md +66 -66
  267. package/assets/.agent/skills/hyperframes-core/references/script-format.md +49 -49
  268. package/assets/.agent/skills/hyperframes-core/references/storyboard-format.md +95 -95
  269. package/assets/.agent/skills/hyperframes-core/references/sub-compositions.md +237 -237
  270. package/assets/.agent/skills/hyperframes-core/references/subagent-dispatch.md +41 -41
  271. package/assets/.agent/skills/hyperframes-core/references/tailwind.md +125 -125
  272. package/assets/.agent/skills/hyperframes-core/references/tracks-and-clips.md +76 -76
  273. package/assets/.agent/skills/hyperframes-core/references/variables-and-media.md +90 -90
  274. package/assets/.agent/skills/hyperframes-creative/SKILL.md +70 -70
  275. package/assets/.agent/skills/hyperframes-creative/frame-presets/biennale-yellow/FRAME.md +289 -289
  276. package/assets/.agent/skills/hyperframes-creative/frame-presets/biennale-yellow/caption-skin.html +221 -221
  277. package/assets/.agent/skills/hyperframes-creative/frame-presets/biennale-yellow/frame-showcase.html +1214 -1214
  278. package/assets/.agent/skills/hyperframes-creative/frame-presets/blockframe/FRAME.md +275 -275
  279. package/assets/.agent/skills/hyperframes-creative/frame-presets/blockframe/caption-skin.html +224 -224
  280. package/assets/.agent/skills/hyperframes-creative/frame-presets/blockframe/frame-showcase.html +1347 -1347
  281. package/assets/.agent/skills/hyperframes-creative/frame-presets/blue-professional/FRAME.md +307 -307
  282. package/assets/.agent/skills/hyperframes-creative/frame-presets/blue-professional/caption-skin.html +223 -223
  283. package/assets/.agent/skills/hyperframes-creative/frame-presets/blue-professional/frame-showcase.html +1372 -1372
  284. package/assets/.agent/skills/hyperframes-creative/frame-presets/bold-poster/FRAME.md +275 -275
  285. package/assets/.agent/skills/hyperframes-creative/frame-presets/bold-poster/caption-skin.html +230 -230
  286. package/assets/.agent/skills/hyperframes-creative/frame-presets/bold-poster/frame-showcase.html +1140 -1140
  287. package/assets/.agent/skills/hyperframes-creative/frame-presets/broadside/FRAME.md +284 -284
  288. package/assets/.agent/skills/hyperframes-creative/frame-presets/broadside/caption-skin.html +225 -225
  289. package/assets/.agent/skills/hyperframes-creative/frame-presets/broadside/frame-showcase.html +1166 -1166
  290. package/assets/.agent/skills/hyperframes-creative/frame-presets/capsule/FRAME.md +284 -284
  291. package/assets/.agent/skills/hyperframes-creative/frame-presets/capsule/caption-skin.html +224 -224
  292. package/assets/.agent/skills/hyperframes-creative/frame-presets/capsule/frame-showcase.html +1465 -1465
  293. package/assets/.agent/skills/hyperframes-creative/frame-presets/cartesian/FRAME.md +278 -278
  294. package/assets/.agent/skills/hyperframes-creative/frame-presets/cartesian/caption-skin.html +222 -222
  295. package/assets/.agent/skills/hyperframes-creative/frame-presets/cartesian/frame-showcase.html +1263 -1263
  296. package/assets/.agent/skills/hyperframes-creative/frame-presets/claude/FRAME.md +277 -277
  297. package/assets/.agent/skills/hyperframes-creative/frame-presets/claude/caption-skin.html +224 -224
  298. package/assets/.agent/skills/hyperframes-creative/frame-presets/claude/frame-showcase.html +1439 -1439
  299. package/assets/.agent/skills/hyperframes-creative/frame-presets/cobalt-grid/FRAME.md +265 -265
  300. package/assets/.agent/skills/hyperframes-creative/frame-presets/cobalt-grid/caption-skin.html +238 -238
  301. package/assets/.agent/skills/hyperframes-creative/frame-presets/cobalt-grid/frame-showcase.html +1468 -1468
  302. package/assets/.agent/skills/hyperframes-creative/frame-presets/coral/FRAME.md +314 -314
  303. package/assets/.agent/skills/hyperframes-creative/frame-presets/coral/caption-skin.html +226 -226
  304. package/assets/.agent/skills/hyperframes-creative/frame-presets/coral/frame-showcase.html +1268 -1268
  305. package/assets/.agent/skills/hyperframes-creative/frame-presets/creative-mode/FRAME.md +333 -333
  306. package/assets/.agent/skills/hyperframes-creative/frame-presets/creative-mode/caption-skin.html +227 -227
  307. package/assets/.agent/skills/hyperframes-creative/frame-presets/creative-mode/frame-showcase.html +1330 -1330
  308. package/assets/.agent/skills/hyperframes-creative/frame-presets/daisy-days/FRAME.md +274 -274
  309. package/assets/.agent/skills/hyperframes-creative/frame-presets/daisy-days/caption-skin.html +230 -230
  310. package/assets/.agent/skills/hyperframes-creative/frame-presets/daisy-days/frame-showcase.html +1444 -1444
  311. package/assets/.agent/skills/hyperframes-creative/frame-presets/editorial-forest/FRAME.md +265 -265
  312. package/assets/.agent/skills/hyperframes-creative/frame-presets/editorial-forest/caption-skin.html +223 -223
  313. package/assets/.agent/skills/hyperframes-creative/frame-presets/editorial-forest/frame-showcase.html +1273 -1273
  314. package/assets/.agent/skills/hyperframes-creative/palettes/bold-energetic.md +14 -14
  315. package/assets/.agent/skills/hyperframes-creative/palettes/clean-corporate.md +14 -14
  316. package/assets/.agent/skills/hyperframes-creative/palettes/dark-premium.md +14 -14
  317. package/assets/.agent/skills/hyperframes-creative/palettes/jewel-rich.md +14 -14
  318. package/assets/.agent/skills/hyperframes-creative/palettes/monochrome.md +14 -14
  319. package/assets/.agent/skills/hyperframes-creative/palettes/nature-earth.md +14 -14
  320. package/assets/.agent/skills/hyperframes-creative/palettes/neon-electric.md +14 -14
  321. package/assets/.agent/skills/hyperframes-creative/palettes/pastel-soft.md +14 -14
  322. package/assets/.agent/skills/hyperframes-creative/palettes/warm-editorial.md +14 -14
  323. package/assets/.agent/skills/hyperframes-creative/references/audio-reactive.md +76 -76
  324. package/assets/.agent/skills/hyperframes-creative/references/beat-direction.md +164 -164
  325. package/assets/.agent/skills/hyperframes-creative/references/composition-patterns.md +199 -199
  326. package/assets/.agent/skills/hyperframes-creative/references/data-in-motion.md +19 -19
  327. package/assets/.agent/skills/hyperframes-creative/references/design-adherence.md +19 -19
  328. package/assets/.agent/skills/hyperframes-creative/references/design-picker.md +123 -123
  329. package/assets/.agent/skills/hyperframes-creative/references/design-spec.md +55 -55
  330. package/assets/.agent/skills/hyperframes-creative/references/house-style.md +73 -73
  331. package/assets/.agent/skills/hyperframes-creative/references/motion-principles.md +150 -150
  332. package/assets/.agent/skills/hyperframes-creative/references/narration.md +92 -92
  333. package/assets/.agent/skills/hyperframes-creative/references/prompt-expansion.md +68 -68
  334. package/assets/.agent/skills/hyperframes-creative/references/typography.md +218 -218
  335. package/assets/.agent/skills/hyperframes-creative/references/video-composition.md +63 -63
  336. package/assets/.agent/skills/hyperframes-creative/references/visual-styles.md +457 -457
  337. package/assets/.agent/skills/hyperframes-creative/scripts/contrast-report.mjs +353 -353
  338. package/assets/.agent/skills/hyperframes-creative/scripts/extract-audio-data.py +188 -188
  339. package/assets/.agent/skills/hyperframes-creative/scripts/package-loader.mjs +288 -288
  340. package/assets/.agent/skills/hyperframes-creative/scripts/package-loader.test.mjs +62 -62
  341. package/assets/.agent/skills/hyperframes-creative/templates/design-picker.html +1432 -1432
  342. package/assets/.agent/skills/hyperframes-keyframes/SKILL.md +237 -237
  343. package/assets/.agent/skills/hyperframes-keyframes/agents/openai.yaml +4 -4
  344. package/assets/.agent/skills/hyperframes-keyframes/references/keyframe-patterns.md +106 -106
  345. package/assets/.agent/skills/hyperframes-media/SKILL.md +97 -97
  346. package/assets/.agent/skills/hyperframes-media/assets/sfx/CREDITS.md +35 -35
  347. package/assets/.agent/skills/hyperframes-media/assets/sfx/manifest.json +97 -97
  348. package/assets/.agent/skills/hyperframes-media/references/bgm.md +72 -72
  349. package/assets/.agent/skills/hyperframes-media/references/captions/authoring.md +159 -159
  350. package/assets/.agent/skills/hyperframes-media/references/captions/motion.md +87 -87
  351. package/assets/.agent/skills/hyperframes-media/references/captions/transcript-handling.md +97 -97
  352. package/assets/.agent/skills/hyperframes-media/references/remove-background.md +143 -143
  353. package/assets/.agent/skills/hyperframes-media/references/requirements.md +29 -29
  354. package/assets/.agent/skills/hyperframes-media/references/sfx.md +42 -42
  355. package/assets/.agent/skills/hyperframes-media/references/transcribe.md +52 -52
  356. package/assets/.agent/skills/hyperframes-media/references/tts-to-captions.md +24 -24
  357. package/assets/.agent/skills/hyperframes-media/references/tts.md +135 -135
  358. package/assets/.agent/skills/hyperframes-media/scripts/audio.mjs +293 -293
  359. package/assets/.agent/skills/hyperframes-media/scripts/heygen-tts.mjs +121 -121
  360. package/assets/.agent/skills/hyperframes-media/scripts/lib/bgm.mjs +235 -235
  361. package/assets/.agent/skills/hyperframes-media/scripts/lib/concurrency.mjs +14 -14
  362. package/assets/.agent/skills/hyperframes-media/scripts/lib/concurrency.test.mjs +41 -41
  363. package/assets/.agent/skills/hyperframes-media/scripts/lib/heygen.mjs +131 -131
  364. package/assets/.agent/skills/hyperframes-media/scripts/lib/sfx.mjs +128 -128
  365. package/assets/.agent/skills/hyperframes-media/scripts/lib/tts.mjs +298 -298
  366. package/assets/.agent/skills/hyperframes-media/scripts/lib/tts.spawn.test.mjs +97 -97
  367. package/assets/.agent/skills/hyperframes-media/scripts/lib/tts.test.mjs +66 -66
  368. package/assets/.agent/skills/hyperframes-media/scripts/lyria-recipe.py +128 -128
  369. package/assets/.agent/skills/hyperframes-media/scripts/wait-bgm.mjs +167 -167
  370. package/assets/.agent/skills/hyperframes-registry/SKILL.md +101 -101
  371. package/assets/.agent/skills/hyperframes-registry/examples/add-block.md +51 -51
  372. package/assets/.agent/skills/hyperframes-registry/examples/add-component.md +73 -73
  373. package/assets/.agent/skills/hyperframes-registry/references/contributing.md +166 -166
  374. package/assets/.agent/skills/hyperframes-registry/references/demo-html-pattern.md +54 -54
  375. package/assets/.agent/skills/hyperframes-registry/references/discovery.md +215 -215
  376. package/assets/.agent/skills/hyperframes-registry/references/install-locations.md +45 -45
  377. package/assets/.agent/skills/hyperframes-registry/references/templates.md +417 -417
  378. package/assets/.agent/skills/hyperframes-registry/references/wiring-blocks.md +61 -61
  379. package/assets/.agent/skills/hyperframes-registry/references/wiring-components.md +39 -39
  380. package/assets/.agent/skills/media-use/SKILL.md +124 -124
  381. package/assets/.agent/skills/media-use/scripts/eval.mjs +369 -369
  382. package/assets/.agent/skills/media-use/scripts/lib/adopt.mjs +112 -112
  383. package/assets/.agent/skills/media-use/scripts/lib/bgm-provider.mjs +20 -20
  384. package/assets/.agent/skills/media-use/scripts/lib/brand-provider.mjs +59 -59
  385. package/assets/.agent/skills/media-use/scripts/lib/cache.mjs +114 -114
  386. package/assets/.agent/skills/media-use/scripts/lib/freeze.mjs +26 -26
  387. package/assets/.agent/skills/media-use/scripts/lib/heygen-search.mjs +51 -51
  388. package/assets/.agent/skills/media-use/scripts/lib/image-provider.mjs +44 -44
  389. package/assets/.agent/skills/media-use/scripts/lib/index-gen.mjs +63 -63
  390. package/assets/.agent/skills/media-use/scripts/lib/manifest.mjs +91 -91
  391. package/assets/.agent/skills/media-use/scripts/lib/manifest.test.mjs +293 -293
  392. package/assets/.agent/skills/media-use/scripts/lib/probe.mjs +39 -39
  393. package/assets/.agent/skills/media-use/scripts/lib/probe.test.mjs +31 -31
  394. package/assets/.agent/skills/media-use/scripts/lib/providers.mjs +29 -29
  395. package/assets/.agent/skills/media-use/scripts/lib/sfx-provider.mjs +23 -23
  396. package/assets/.agent/skills/media-use/scripts/resolve.mjs +247 -247
  397. package/assets/.agent/skills/media-use/scripts/resolve.test.mjs +247 -247
  398. package/assets/.agent/skills/motion-graphics/SKILL.md +172 -172
  399. package/assets/.agent/skills/motion-graphics/agents/builder.md +40 -40
  400. package/assets/.agent/skills/motion-graphics/agents/director.md +53 -53
  401. package/assets/.agent/skills/motion-graphics/agents/finalize.md +17 -17
  402. package/assets/.agent/skills/motion-graphics/catalog-map.md +40 -40
  403. package/assets/.agent/skills/motion-graphics/categories/asset-fusion/module.md +37 -37
  404. package/assets/.agent/skills/motion-graphics/categories/charts/module.md +21 -21
  405. package/assets/.agent/skills/motion-graphics/categories/kinetic-type/module.md +19 -19
  406. package/assets/.agent/skills/motion-graphics/categories/logo-reveal/module.md +17 -17
  407. package/assets/.agent/skills/motion-graphics/categories/lower-thirds/module.md +16 -16
  408. package/assets/.agent/skills/motion-graphics/categories/maps/bake-basemap.mjs +273 -273
  409. package/assets/.agent/skills/motion-graphics/categories/maps/module.md +61 -61
  410. package/assets/.agent/skills/motion-graphics/categories/news/module.md +56 -56
  411. package/assets/.agent/skills/motion-graphics/categories/stat/module.md +21 -21
  412. package/assets/.agent/skills/motion-graphics/categories/tweet/module.md +16 -16
  413. package/assets/.agent/skills/motion-graphics/categories/webpage/module.md +21 -21
  414. package/assets/.agent/skills/motion-graphics/grounding/PROTOCOL.md +64 -64
  415. package/assets/.agent/skills/motion-graphics/grounding/locate.mjs +227 -227
  416. package/assets/.agent/skills/motion-graphics/phases/source/guide.md +21 -21
  417. package/assets/.agent/skills/motion-graphics/references/builder-contract.md +38 -38
  418. package/assets/.agent/skills/motion-graphics/references/motion-vocabulary.md +43 -43
  419. package/assets/.agent/skills/motion-graphics/references/shot-plan-ir.md +54 -54
  420. package/assets/.agent/skills/motion-graphics/samples/asset-fusion/_ref-circle-highlight.html +306 -306
  421. package/assets/.agent/skills/music-to-video/SKILL.md +197 -197
  422. package/assets/.agent/skills/music-to-video/references/frame-skeleton.md +100 -100
  423. package/assets/.agent/skills/music-to-video/references/montage.md +58 -58
  424. package/assets/.agent/skills/music-to-video/references/motion-primitive-catalog.md +75 -75
  425. package/assets/.agent/skills/music-to-video/references/motion-primitives/3d-card-flip/index.html +154 -154
  426. package/assets/.agent/skills/music-to-video/references/motion-primitives/assets/gsap.min.js +11 -11
  427. package/assets/.agent/skills/music-to-video/references/motion-primitives/bg-flow-field/index.html +326 -326
  428. package/assets/.agent/skills/music-to-video/references/motion-primitives/binary-decrypt/index.html +120 -120
  429. package/assets/.agent/skills/music-to-video/references/motion-primitives/blur-resolve/index.html +95 -95
  430. package/assets/.agent/skills/music-to-video/references/motion-primitives/braam-punch/index.html +135 -135
  431. package/assets/.agent/skills/music-to-video/references/motion-primitives/chromatic-split/index.html +146 -146
  432. package/assets/.agent/skills/music-to-video/references/motion-primitives/chrome-sweep/index.html +103 -103
  433. package/assets/.agent/skills/music-to-video/references/motion-primitives/counting-punch/index.html +154 -154
  434. package/assets/.agent/skills/music-to-video/references/motion-primitives/crash-zoom-in/index.html +155 -155
  435. package/assets/.agent/skills/music-to-video/references/motion-primitives/datamosh-smear/index.html +166 -166
  436. package/assets/.agent/skills/music-to-video/references/motion-primitives/directional-fill/index.html +133 -133
  437. package/assets/.agent/skills/music-to-video/references/motion-primitives/dolly-zoom/index.html +137 -137
  438. package/assets/.agent/skills/music-to-video/references/motion-primitives/electric-arc/index.html +144 -144
  439. package/assets/.agent/skills/music-to-video/references/motion-primitives/flash-cut/index.html +132 -132
  440. package/assets/.agent/skills/music-to-video/references/motion-primitives/gooey-metaball/index.html +241 -241
  441. package/assets/.agent/skills/music-to-video/references/motion-primitives/hard-cut/index.html +117 -117
  442. package/assets/.agent/skills/music-to-video/references/motion-primitives/hypercut-whip/index.html +79 -79
  443. package/assets/.agent/skills/music-to-video/references/motion-primitives/iris-open/index.html +104 -104
  444. package/assets/.agent/skills/music-to-video/references/motion-primitives/kinetic-letter-in/index.html +92 -92
  445. package/assets/.agent/skills/music-to-video/references/motion-primitives/liquid-morph/index.html +131 -131
  446. package/assets/.agent/skills/music-to-video/references/motion-primitives/mask-reveal/index.html +109 -109
  447. package/assets/.agent/skills/music-to-video/references/motion-primitives/mosaic-pack/index.html +124 -124
  448. package/assets/.agent/skills/music-to-video/references/motion-primitives/neon-flicker/index.html +108 -108
  449. package/assets/.agent/skills/music-to-video/references/motion-primitives/outline-to-fill/index.html +117 -117
  450. package/assets/.agent/skills/music-to-video/references/motion-primitives/palette-flip/index.html +132 -132
  451. package/assets/.agent/skills/music-to-video/references/motion-primitives/particle-burst/index.html +141 -141
  452. package/assets/.agent/skills/music-to-video/references/motion-primitives/pixel-dissolve/index.html +121 -121
  453. package/assets/.agent/skills/music-to-video/references/motion-primitives/radial-burst-lines/index.html +160 -160
  454. package/assets/.agent/skills/music-to-video/references/motion-primitives/screen-shake/index.html +113 -113
  455. package/assets/.agent/skills/music-to-video/references/motion-primitives/slot-machine-reveal/index.html +130 -130
  456. package/assets/.agent/skills/music-to-video/references/motion-primitives/spotlight-sweep/index.html +137 -137
  457. package/assets/.agent/skills/music-to-video/references/motion-primitives/staggered-exit/index.html +117 -117
  458. package/assets/.agent/skills/music-to-video/references/motion-primitives/text-spectral-rays/USAGE.md +42 -42
  459. package/assets/.agent/skills/music-to-video/references/motion-primitives/text-spectral-rays/index.html +313 -313
  460. package/assets/.agent/skills/music-to-video/references/motion-primitives/text-wave-distort/index.html +136 -136
  461. package/assets/.agent/skills/music-to-video/references/motion-primitives/tile-mosaic/index.html +144 -144
  462. package/assets/.agent/skills/music-to-video/references/motion-primitives/typewriter-reveal/index.html +122 -122
  463. package/assets/.agent/skills/music-to-video/references/motion-primitives/word-grid-burst/index.html +126 -126
  464. package/assets/.agent/skills/music-to-video/references/planning.md +104 -104
  465. package/assets/.agent/skills/music-to-video/references/storyboard-format.md +94 -94
  466. package/assets/.agent/skills/music-to-video/references/template-catalog.md +106 -106
  467. package/assets/.agent/skills/music-to-video/references/templates/card-flyby/index.html +527 -527
  468. package/assets/.agent/skills/music-to-video/references/templates/card-flyby/program.json +13 -13
  469. package/assets/.agent/skills/music-to-video/references/templates/held-message-living-field/index.html +485 -485
  470. package/assets/.agent/skills/music-to-video/references/templates/held-text-strobe-burst/index.html +302 -302
  471. package/assets/.agent/skills/music-to-video/references/templates/intro-kinetic-cascade/index.html +610 -610
  472. package/assets/.agent/skills/music-to-video/references/templates/intro-kinetic-cascade/program.json +41 -41
  473. package/assets/.agent/skills/music-to-video/references/templates/logo-split-lockup-pulse/index.html +596 -596
  474. package/assets/.agent/skills/music-to-video/references/templates/poster-tile-mosaic/index.html +589 -589
  475. package/assets/.agent/skills/music-to-video/references/templates/poster-tile-mosaic/program.json +25 -25
  476. package/assets/.agent/skills/music-to-video/references/templates/roll-flipbook-word-cycle/index.html +267 -267
  477. package/assets/.agent/skills/music-to-video/references/templates/split-anchor-word-slot/index.html +594 -594
  478. package/assets/.agent/skills/music-to-video/references/templates/split-anchor-word-slot/program.json +39 -39
  479. package/assets/.agent/skills/music-to-video/references/templates/typewriter-phrase-keyword-shuffle/index.html +238 -238
  480. package/assets/.agent/skills/music-to-video/scripts/analyze-beatgrid.py +531 -531
  481. package/assets/.agent/skills/music-to-video/scripts/assemble-index.mjs +218 -218
  482. package/assets/.agent/skills/music-to-video/scripts/lib/storyboard.mjs +249 -249
  483. package/assets/.agent/skills/music-to-video/scripts/stage-assets.mjs +58 -58
  484. package/assets/.agent/skills/music-to-video/scripts/validate-plan.mjs +161 -161
  485. package/assets/.agent/skills/music-to-video/sub-agents/frame-worker.md +75 -75
  486. package/assets/.agent/skills/pr-to-video/SKILL.md +240 -240
  487. package/assets/.agent/skills/pr-to-video/references/code-vocabulary.md +111 -111
  488. package/assets/.agent/skills/pr-to-video/references/cut-catalog.md +215 -215
  489. package/assets/.agent/skills/pr-to-video/references/motion-language.md +156 -156
  490. package/assets/.agent/skills/pr-to-video/references/story-design.md +211 -211
  491. package/assets/.agent/skills/pr-to-video/references/visual-design.md +164 -164
  492. package/assets/.agent/skills/pr-to-video/scripts/assemble-index.mjs +570 -570
  493. package/assets/.agent/skills/pr-to-video/scripts/audio.mjs +253 -253
  494. package/assets/.agent/skills/pr-to-video/scripts/build-frame.mjs +536 -536
  495. package/assets/.agent/skills/pr-to-video/scripts/captions.mjs +508 -508
  496. package/assets/.agent/skills/pr-to-video/scripts/fetch-people-avatars.mjs +157 -157
  497. package/assets/.agent/skills/pr-to-video/scripts/fetch-pr.mjs +164 -164
  498. package/assets/.agent/skills/pr-to-video/scripts/ingest.mjs +539 -539
  499. package/assets/.agent/skills/pr-to-video/scripts/lib/assets.mjs +55 -55
  500. package/assets/.agent/skills/pr-to-video/scripts/lib/dimensions.mjs +45 -45
  501. package/assets/.agent/skills/pr-to-video/scripts/lib/storyboard.mjs +249 -249
  502. package/assets/.agent/skills/pr-to-video/scripts/lib/tokens.mjs +204 -204
  503. package/assets/.agent/skills/pr-to-video/scripts/lib/transition-registry.mjs +38 -38
  504. package/assets/.agent/skills/pr-to-video/scripts/lib/transitions.json +71 -71
  505. package/assets/.agent/skills/pr-to-video/scripts/transitions.mjs +320 -320
  506. package/assets/.agent/skills/pr-to-video/sub-agents/frame-worker.md +95 -95
  507. package/assets/.agent/skills/product-launch-video/SKILL.md +208 -208
  508. package/assets/.agent/skills/product-launch-video/references/cut-catalog.md +220 -220
  509. package/assets/.agent/skills/product-launch-video/references/motion-language.md +156 -156
  510. package/assets/.agent/skills/product-launch-video/references/story-design.md +373 -373
  511. package/assets/.agent/skills/product-launch-video/references/visual-design.md +126 -126
  512. package/assets/.agent/skills/product-launch-video/scripts/assemble-index.mjs +570 -570
  513. package/assets/.agent/skills/product-launch-video/scripts/audio.mjs +253 -253
  514. package/assets/.agent/skills/product-launch-video/scripts/build-frame.mjs +536 -536
  515. package/assets/.agent/skills/product-launch-video/scripts/captions.mjs +508 -508
  516. package/assets/.agent/skills/product-launch-video/scripts/lib/assets.mjs +55 -55
  517. package/assets/.agent/skills/product-launch-video/scripts/lib/dimensions.mjs +45 -45
  518. package/assets/.agent/skills/product-launch-video/scripts/lib/storyboard.mjs +249 -249
  519. package/assets/.agent/skills/product-launch-video/scripts/lib/tokens.mjs +204 -204
  520. package/assets/.agent/skills/product-launch-video/scripts/lib/transition-registry.mjs +38 -38
  521. package/assets/.agent/skills/product-launch-video/scripts/lib/transitions.json +71 -71
  522. package/assets/.agent/skills/product-launch-video/scripts/stage-assets.mjs +39 -39
  523. package/assets/.agent/skills/product-launch-video/scripts/transitions.mjs +320 -320
  524. package/assets/.agent/skills/product-launch-video/sub-agents/frame-worker.md +75 -75
  525. package/assets/.agent/skills/remotion/SKILL.md +357 -38
  526. package/assets/.agent/skills/remotion/rules/3d.md +5 -5
  527. package/assets/.agent/skills/remotion/rules/assets/text-animations-word-highlight.tsx +1 -6
  528. package/assets/.agent/skills/remotion/rules/audio-visualization.md +198 -0
  529. package/assets/.agent/skills/remotion/rules/audio.md +1 -4
  530. package/assets/.agent/skills/remotion/rules/calculate-metadata.md +48 -18
  531. package/assets/.agent/skills/remotion/rules/compositions.md +16 -24
  532. package/assets/.agent/skills/remotion/rules/display-captions.md +79 -21
  533. package/assets/.agent/skills/remotion/rules/effects.md +235 -0
  534. package/assets/.agent/skills/remotion/rules/ffmpeg.md +34 -0
  535. package/assets/.agent/skills/remotion/rules/get-audio-duration.md +13 -13
  536. package/assets/.agent/skills/remotion/rules/get-video-dimensions.md +1 -1
  537. package/assets/.agent/skills/remotion/rules/get-video-duration.md +12 -10
  538. package/assets/.agent/skills/remotion/rules/gifs.md +21 -18
  539. package/assets/.agent/skills/remotion/rules/google-fonts.md +72 -0
  540. package/assets/.agent/skills/remotion/rules/html-in-canvas.md +122 -0
  541. package/assets/.agent/skills/remotion/rules/images.md +5 -64
  542. package/assets/.agent/skills/remotion/rules/import-srt-captions.md +9 -7
  543. package/assets/.agent/skills/remotion/rules/light-leaks.md +73 -0
  544. package/assets/.agent/skills/remotion/rules/local-fonts.md +65 -0
  545. package/assets/.agent/skills/remotion/rules/lottie.md +10 -8
  546. package/assets/.agent/skills/remotion/rules/maplibre.md +458 -0
  547. package/assets/.agent/skills/remotion/rules/measuring-dom-nodes.md +0 -1
  548. package/assets/.agent/skills/remotion/rules/measuring-text.md +2 -5
  549. package/assets/.agent/skills/remotion/rules/parameters.md +21 -10
  550. package/assets/.agent/skills/remotion/rules/sequencing.md +35 -9
  551. package/assets/.agent/skills/remotion/rules/sfx.md +51 -0
  552. package/assets/.agent/skills/remotion/rules/silence-detection.md +71 -0
  553. package/assets/.agent/skills/remotion/rules/subtitles.md +36 -0
  554. package/assets/.agent/skills/remotion/rules/tailwind.md +2 -2
  555. package/assets/.agent/skills/remotion/rules/timing.md +89 -106
  556. package/assets/.agent/skills/remotion/rules/transcribe-captions.md +58 -7
  557. package/assets/.agent/skills/remotion/rules/transitions.md +117 -42
  558. package/assets/.agent/skills/remotion/rules/transparent-videos.md +106 -0
  559. package/assets/.agent/skills/remotion/rules/trimming.md +1 -3
  560. package/assets/.agent/skills/remotion/rules/video-layout.md +68 -0
  561. package/assets/.agent/skills/remotion/rules/voiceover.md +99 -0
  562. package/assets/.agent/skills/remotion-real-ui-video/SKILL.md +264 -264
  563. package/assets/.agent/skills/remotion-real-ui-video/references/anti-patterns.md +114 -114
  564. package/assets/.agent/skills/remotion-real-ui-video/references/completion-checklist.md +75 -75
  565. package/assets/.agent/skills/remotion-real-ui-video/references/real-ui-bridge-example.md +93 -93
  566. package/assets/.agent/skills/remotion-to-hyperframes/SKILL.md +127 -127
  567. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/run.sh +249 -249
  568. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/README.md +41 -41
  569. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/expected.json +26 -26
  570. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/hf-src/index.html +61 -61
  571. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/package.json +14 -14
  572. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/remotion.config.ts +13 -13
  573. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/src/Root.tsx +13 -13
  574. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/src/TitleCard.tsx +34 -34
  575. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/src/index.ts +4 -4
  576. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-1-title-card/remotion-src/tsconfig.json +15 -15
  577. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/README.md +54 -54
  578. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/expected.json +29 -29
  579. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/hf-src/index.html +118 -118
  580. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/package.json +14 -14
  581. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/remotion.config.ts +13 -13
  582. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/src/MultiScene.tsx +105 -105
  583. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/src/Root.tsx +13 -13
  584. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/src/index.ts +4 -4
  585. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/remotion-src/tsconfig.json +15 -15
  586. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-2-multi-scene/setup.sh +34 -34
  587. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/README.md +85 -85
  588. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/expected.json +41 -41
  589. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/hf-src/index.html +269 -269
  590. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/package.json +15 -15
  591. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/remotion.config.ts +13 -13
  592. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/Root.tsx +27 -27
  593. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/Stargazed.tsx +37 -37
  594. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/components/AnimatedNumber.tsx +23 -23
  595. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/components/StatCard.tsx +59 -59
  596. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/components/UnderlinedText.tsx +47 -47
  597. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/index.ts +4 -4
  598. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/scenes/OutroScene.tsx +18 -18
  599. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/scenes/StatsScene.tsx +34 -34
  600. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/src/scenes/TitleScene.tsx +55 -55
  601. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-3-data-driven/remotion-src/tsconfig.json +15 -15
  602. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/README.md +51 -51
  603. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/01-use-state.tsx +29 -29
  604. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/02-use-effect-deps.tsx +29 -29
  605. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/03-async-metadata.tsx +39 -39
  606. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/04-third-party-react.tsx +30 -30
  607. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/05-lambda-config.tsx +38 -38
  608. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/06-warnings-only.tsx +36 -36
  609. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/07-custom-hook.tsx +28 -28
  610. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/cases/08-mixed.tsx +41 -41
  611. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/expected.json +85 -85
  612. package/assets/.agent/skills/remotion-to-hyperframes/assets/test-corpus/tier-4-escape-hatch/validate.sh +110 -110
  613. package/assets/.agent/skills/remotion-to-hyperframes/references/api-map.md +142 -142
  614. package/assets/.agent/skills/remotion-to-hyperframes/references/escape-hatch.md +115 -115
  615. package/assets/.agent/skills/remotion-to-hyperframes/references/eval.md +140 -140
  616. package/assets/.agent/skills/remotion-to-hyperframes/references/fonts.md +112 -112
  617. package/assets/.agent/skills/remotion-to-hyperframes/references/limitations.md +136 -136
  618. package/assets/.agent/skills/remotion-to-hyperframes/references/lottie.md +121 -121
  619. package/assets/.agent/skills/remotion-to-hyperframes/references/media.md +149 -149
  620. package/assets/.agent/skills/remotion-to-hyperframes/references/parameters.md +167 -167
  621. package/assets/.agent/skills/remotion-to-hyperframes/references/sequencing.md +195 -195
  622. package/assets/.agent/skills/remotion-to-hyperframes/references/timing.md +165 -165
  623. package/assets/.agent/skills/remotion-to-hyperframes/references/transitions.md +114 -114
  624. package/assets/.agent/skills/remotion-to-hyperframes/scripts/frame_strip.sh +107 -107
  625. package/assets/.agent/skills/remotion-to-hyperframes/scripts/lint_source.py +358 -358
  626. package/assets/.agent/skills/remotion-to-hyperframes/scripts/render_diff.sh +103 -103
  627. package/assets/.agent/skills/remotion-to-hyperframes/scripts/tests/fixtures/blocker.tsx +50 -50
  628. package/assets/.agent/skills/remotion-to-hyperframes/scripts/tests/fixtures/clean.tsx +46 -46
  629. package/assets/.agent/skills/remotion-to-hyperframes/scripts/tests/smoke.sh +90 -90
  630. package/assets/.agent/skills/shared-resend-portfolio/SKILL.md +124 -124
  631. package/assets/.agent/skills/slideshow/SKILL.md +550 -550
  632. package/assets/.agent/skills/slideshow/references/standalone-harness.md +1020 -1020
  633. package/assets/.agent/skills/talking-head-recut/NOTICE.md +39 -39
  634. package/assets/.agent/skills/talking-head-recut/SKILL.md +1191 -1191
  635. package/assets/.agent/skills/talking-head-recut/assets/vendor/gsap.min.js +10 -10
  636. package/assets/.agent/skills/talking-head-recut/references/DESIGN_INDEX.md +145 -145
  637. package/assets/.agent/skills/talking-head-recut/references/frames/clean.html +92 -92
  638. package/assets/.agent/skills/talking-head-recut/references/frames/hairline.html +171 -171
  639. package/assets/.agent/skills/talking-head-recut/references/frames/polaroid.html +131 -131
  640. package/assets/.agent/skills/talking-head-recut/references/layouts/overlay.html +164 -164
  641. package/assets/.agent/skills/talking-head-recut/references/layouts/pip.html +143 -143
  642. package/assets/.agent/skills/talking-head-recut/references/layouts/split.html +121 -121
  643. package/assets/.agent/skills/talking-head-recut/references/layouts/stack.html +109 -109
  644. package/assets/.agent/skills/talking-head-recut/references/styles/academic.html +172 -172
  645. package/assets/.agent/skills/talking-head-recut/references/styles/audit.html +170 -170
  646. package/assets/.agent/skills/talking-head-recut/references/styles/editorial.html +189 -189
  647. package/assets/.agent/skills/talking-head-recut/references/styles/geom.html +181 -181
  648. package/assets/.agent/skills/talking-head-recut/references/styles/minimal.html +130 -130
  649. package/assets/.agent/skills/talking-head-recut/references/styles/spotlight.html +142 -142
  650. package/assets/.agent/skills/talking-head-recut/references/styles/swiss.html +188 -188
  651. package/assets/.agent/skills/talking-head-recut/references/styles/terminal.html +196 -196
  652. package/assets/.agent/skills/talking-head-recut/references/styles/whiteboard.html +170 -170
  653. package/assets/.agent/skills/talking-head-recut/references/styles/xhs.html +206 -206
  654. package/assets/.agent/skills/website-to-video/SKILL.md +145 -145
  655. package/assets/.agent/skills/website-to-video/assets/sfx/CREDITS.md +35 -35
  656. package/assets/.agent/skills/website-to-video/assets/sfx/manifest.json +97 -97
  657. package/assets/.agent/skills/website-to-video/references/beat-builder-guide.md +263 -263
  658. package/assets/.agent/skills/website-to-video/references/capabilities.md +713 -713
  659. package/assets/.agent/skills/website-to-video/references/step-0-capture.md +55 -55
  660. package/assets/.agent/skills/website-to-video/references/step-1-design.md +333 -333
  661. package/assets/.agent/skills/website-to-video/references/step-2-brief.md +178 -178
  662. package/assets/.agent/skills/website-to-video/references/step-3-storyboard.md +572 -572
  663. package/assets/.agent/skills/website-to-video/references/step-4-vo.md +230 -230
  664. package/assets/.agent/skills/website-to-video/references/step-5-build.md +483 -483
  665. package/assets/.agent/skills/website-to-video/references/step-6-validate.md +341 -341
  666. package/assets/.agent/skills/website-to-video/scripts/w2h-verify.mjs +759 -759
  667. package/package.json +6 -5
  668. package/src/pi-takomi-core/orchestration.ts +39 -21
  669. package/src/pi-takomi-core/routing.ts +8 -8
  670. package/src/pi-takomi-core/types.ts +25 -5
  671. package/src/pi-takomi-core/workflows.ts +86 -86
  672. package/src/takomi-stats.js +5 -5
  673. package/assets/.agent/skills/remotion/rules/animations.md +0 -29
  674. package/assets/.agent/skills/remotion/rules/assets.md +0 -78
  675. package/assets/.agent/skills/remotion/rules/can-decode.md +0 -75
  676. package/assets/.agent/skills/remotion/rules/charts.md +0 -58
  677. package/assets/.agent/skills/remotion/rules/extract-frames.md +0 -229
  678. package/assets/.agent/skills/remotion/rules/fonts.md +0 -152
  679. package/assets/.agent/skills/remotion/rules/maps.md +0 -403
@@ -1,713 +1,713 @@
1
- # HyperFrames — Complete Capabilities Inventory
2
-
3
- Everything possible in HyperFrames as of today's workspace, synthesized from direct source reads of all 7 packages, 16 skills, and the full registry.
4
-
5
- > **How to read this file.** Scan the **Table of Contents** below first. **Do NOT read this file linearly** — it is a 700+ line inventory; reading top-to-bottom every session wastes context. When the storyboard or a specific beat needs a particular capability (HTML-in-Canvas, shader transitions, audio-reactive, dynamic counters, etc.), jump straight to that section.
6
-
7
- You are NOT limited to what was captured from the website. You can create shaders from scratch, search for and download registry blocks, build Three.js scenes, write custom WebGL effects, use any web API — anything a browser can render.
8
-
9
- For implementation patterns (working code), see `techniques.md`. This file is the WHAT; techniques.md is the HOW.
10
-
11
- ## Essential Rules
12
-
13
- - **Deterministic:** No `Math.random()`, no `Date.now()`, no `requestAnimationFrame`, no `repeat: -1`. The render engine seeks to exact timestamps.
14
- - **Timeline contract:** `window.__timelines["composition-id"] = tl` must be set synchronously. The timeline length defines the composition duration.
15
- - **Sub-compositions:** External `.html` files loaded via `data-composition-src`. Auto-nested timelines, scoped CSS, scoped scripts.
16
- - **Linter:** 60+ rules. Run `npx hyperframes lint` before render. Catches missing timelines, overlapping clips, broken paths, GSAP errors.
17
-
18
- ## Table of Contents
19
-
20
- | # | Section | What it covers |
21
- | --- | ---------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
22
- | 1 | **Composition fundamentals** | Data attributes, timeline contract, resolution presets (1080p, 4K, portrait, square, custom) |
23
- | 2 | **Animation engines (6 adapters)** | GSAP + 15 plugins, Anime.js v4, CSS @keyframes, WAAPI, Lottie (lottie-web + dotlottie), Three.js (hf-seek event) |
24
- | 3 | **Shader transitions (14 WebGL)** | domain-warp, ridged-burn, whip-pan, sdf-iris, ripple-waves, gravitational-lens, cinematic-zoom, chromatic-split, swirl-vortex, thermal-distortion, flash-through-white, cross-warp-morph, light-leak, glitch — plus custom GLSL |
25
- | 4 | **CSS scene transitions (30+)** | Push/slide, scale/zoom, radial/clip, 3D flip, blur, dissolve, cover/blinds, light leak/burn, distortion/glitch, mechanical/shutter, grid dissolve, destruction/burn, VHS/gravity/morph — 6 timing presets |
26
- | 5 | **Visual effects + textures** | Text markers (highlight, circle, burst, scribble, sketchout), grain/noise, light leaks, film burn, vignette, glow, paper texture, shimmer sweep |
27
- | 6 | **Caption techniques** | Per-word karaoke, intensity tiers, 5 exit styles, 6 tone mappings, per-word styling triggers, 7 audio source formats, positioning helpers |
28
- | 7 | **Audio-reactive animation** | Bass→scale, mid→shape, treble→glow; any GSAP property; band extraction script; banned patterns |
29
- | 8 | **HTML-in-canvas** | Live DOM as GPU texture (drawElementImage), Three.js planes, WebGL shaders on HTML, 7 VFX blocks (iPhone/MacBook device, liquid, glass, magnetic, portal, shatter, text cursor) |
30
- | 9 | **Three.js / WebGL custom scenes** | Full 3D: AnimationMixer, custom GLSL, post-processing, GLTF models, lights, cameras, materials — all deterministic via hf-seek |
31
- | 10 | **SVG / canvas / variable fonts** | SVG path drawing, Canvas 2D procedural art, CSS 3D card, per-word type, variable font axes, character typing, velocity-matched cuts, MotionPath |
32
- | 11 | **Media: video, audio, TTS** | Video compositing + frame injection, audio mixer (multi-track), Kokoro TTS (54 voices, 9 languages), Whisper/Groq/OpenAI transcription, background removal (u2net) |
33
- | 12 | **Registry (51 blocks + 4 components + 8 examples)** | Social overlays (8), showcases (5), data viz (2), logo branding (1), 3D/VFX (7), shader transitions (14), transition galleries (13), components (grain, shimmer, pixelate, texture-mask), 8 starter examples |
34
- | 13 | **CLI (25 commands)** | init, add, catalog, play, preview, publish, render (MP4/WebM/MOV/PNG, HDR, GPU, parallel), lint, validate, inspect, snapshot, capture, tts, transcribe, remove-background, doctor, and more |
35
- | 14 | **Linter (60+ rules)** | Core, media, GSAP, captions, composition, adapters, textures, fonts — plus async URL checks |
36
- | 15 | **Player web component** | `<hyperframes-player>` with seek/play/pause API, 11 events, media mirror, runtime auto-inject |
37
- | 16 | **Engine + Producer** | MP4/WebM/MOV/PNG output, HDR (PQ/HLG), transparency (ProRes), GPU encoding (NVENC/VideoToolbox/VAAPI/QSV), parallel rendering, video frame injection |
38
- | 17 | **Studio (in-browser NLE)** | Timeline editor, drag/resize clips, asset browser, render queue, lint modal, caption editor, element picker |
39
- | 18 | **Determinism guarantees** | No Math.random, no Date.now, no RAF, no repeat:-1, no callbacks, synchronous construction |
40
- | 19 | **Variables / parameterization** | Typed runtime variables (string, color, number, boolean, enum), CLI override, strict validation |
41
- | 20 | **Sub-compositions** | External file or inline template, auto-nested timelines, scoped CSS, scoped scripts, variable inheritance |
42
- | 21 | **Global runtime APIs** | 25+ window globals for timelines, player, variables, adapters, hooks |
43
- | 22 | **Skills (16)** | hyperframes, cli, media, registry, contrast, animation-map, website-to-video, remotion, gsap, animejs, css-animations, waapi, lottie, three, tailwind, contribute-catalog |
44
- | 23 | **References (15 docs)** | transitions, css-patterns, dynamic-techniques, motion-principles, typography, narration, captions, audio-reactive, transcript-guide, techniques, beat-direction, visual-styles, and more |
45
- | 24 | **Documentation (27 pages)** | Guides + package docs covering rendering, HDR, html-in-canvas, performance, prompting, troubleshooting, etc. |
46
-
47
- ---
48
-
49
- ## 1. Composition fundamentals
50
-
51
- ### Data attributes recognized by the runtime
52
-
53
- - **Root composition:** `data-composition-id`, `data-start`, `data-duration`, `data-width`, `data-height`, `data-composition-src` (external sub-comp), `data-composition-duration`, `data-composition-variables` (JSON), `data-variable-values` (override)
54
- - **Every clip:** `id`, `data-start`, `data-duration`, `data-track-index`, `class="clip"`, optional `data-media-start`, `data-volume`, `data-playback-start`
55
- - **Sub-composition host:** `data-composition-id`, `data-composition-src` OR inline `<template id="${compId}-template">`
56
- - **Parser also reads:** `data-type` (composition|text), `data-end`, `data-keyframes` (JSON), `data-x|y|scale|opacity`, `data-color|font-size|font-weight|font-family|text-shadow|outline|highlight*`, `data-layer` (z-index, deprecated for timeline but used for audio mixer layers), `data-resolution`, `data-composition-width|height`
57
-
58
- ### Timeline contract
59
-
60
- - `gsap.timeline({ paused: true })` registered on `window.__timelines["<composition-id>"]`
61
- - Master clock (TransportClock + WebAudioTransport) drives the timeline via `tl.totalTime(t, false)` or `tl.seek(t, false)`
62
- - Framework auto-nests sub-comp timelines
63
- - Duration sourced from `data-duration` on root, not from GSAP length
64
- - Synchronous timeline construction required (no async/await/setTimeout)
65
- - Looping handled by `<hyperframes-player>`, not GSAP `repeat: -1`
66
-
67
- ### Resolution presets
68
-
69
- VALID_CANVAS_RESOLUTIONS: 1920×1080 default, 1080×1920 portrait, 1080×1080 square, 4K, 1440×2560, plus `normalizeResolutionFlag` for `--resolution` CLI flag.
70
-
71
- ---
72
-
73
- ## 2. Animation engines (6 deterministic frame adapters)
74
-
75
- The runtime registers these adapters in order; each implements `discover()` / `seek({time})` / `pause` / `play?` / `revert`:
76
-
77
- | Adapter | What it drives | How to load | Notable |
78
- | ---------------------------------- | ----------------------------------------------------------------------------- | --------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------- |
79
- | GSAP (createGsapAdapter) | The primary timeline + all tweens registered on `window.__timelines[<id>]` | CDN `https://cdn.jsdelivr.net/npm/gsap@3.14.2/dist/gsap.min.js` | Plugins via standard GSAP register; HyperFrames does NOT patch THREE.Clock (uses `__hfThreeTime` instead) |
80
- | Anime.js v4 (createAnimeJsAdapter) | Anime instances pushed to `window.__hfAnime` | CDN `animejs@4.0.2/lib/anime.iife.min.js` or ESM | Adapter multiplies composition seconds by 1000 for ms |
81
- | CSS animations (createCssAdapter) | Any element with computed `animation-name` | Declarative `@keyframes` | Falls back to negative `animation-delay` when WAAPI unavailable |
82
- | WAAPI (createWaapiAdapter) | All Animation objects on document | `element.animate()` | Uses `document.getAnimations()` |
83
- | Lottie (createLottieAdapter) | `window.__hfLottie` array; supports lottie-web + dotlottie-web | CDN `lottie.min.js` + `@lottiefiles/dotlottie-web` | `goToAndStop(time*1000)` or `setCurrentRawFrameValue` / `seek(%)` |
84
- | Three.js (createThreeAdapter) | `window.__hfThreeTime` + dispatches `CustomEvent("hf-seek", {detail:{time}})` | ESM CDN `three@0.181.2/+esm` | Composition's render loop listens to `hf-seek`; pattern: `mixer.setTime(time)` |
85
-
86
- ### GSAP plugins (documented patterns)
87
-
88
- - **TextPlugin** — text mutation in `tl.call` (skills/gsap/references/effects.md)
89
- - **MotionPathPlugin** — curve-constrained tweens (skills/hyperframes/references/techniques.md)
90
- - **CustomEase** — bezier eases imported from Remotion-style timing
91
- - **ScrollTrigger / Flip / SplitText / Draggable / Inertia / Observer / ScrambleText / CustomWiggle / CustomBounce / ScrollSmoother / GSDevTools** — work natively if loaded and tweens are on the registered paused timeline, but no special HyperFrames adapter
92
- - Producer injects ScrollTrigger CDN automatically when needed (packages/producer/src/services/htmlCompiler.ts)
93
-
94
- ---
95
-
96
- ## 3. Shader transitions — @hyperframes/shader-transitions
97
-
98
- 14 named WebGL fragment shaders. All share the same uniforms: `u_from`, `u_to`, `u_progress`, `u_resolution`, `u_accent`, `u_accent_dark`, `u_accent_bright`.
99
-
100
- ### The 14 shaders
101
-
102
- | Name | Visual | Notes |
103
- | ------------------- | -------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------- |
104
- | domain-warp | Multi-octave FBM warps both scenes oppositely; organic dissolve edge with accent flash | Uses NQ noise bundle |
105
- | ridged-burn | Ridged multifractal mask reveals B; accent → bright → white burn ramp; sparks | NQ |
106
- | whip-pan | 10-sample horizontal motion blur + lateral crossfade | No noise |
107
- | sdf-iris | Aspect-corrected circle SDF expansion + accent-tinted glow rings | — |
108
- | ripple-waves | Radial standing-wave UV displacement + tinted crossfade | — |
109
- | gravitational-lens | Pinch pull toward center + R/B chromatic separation | — |
110
- | cinematic-zoom | 12 RGB-offset radial zoom blur samples (chromatic zoom streak) | — |
111
- | chromatic-split | R/B radial channel shift outward / inward; G fixed | Distinct from CSS chromatic aberration |
112
- | swirl-vortex | CCW swirl with FBM noise; reciprocal on incoming | NQ |
113
- | thermal-distortion | Vertical sin + FBM horizontal displacement; warm haze | NQ |
114
- | flash-through-white | Fade through white midpoint — a visible white flash between scenes | No accent. Use only when the brand specifically calls for a white-flash beat boundary; this is NOT a neutral "default" transition. |
115
- | cross-warp-morph | FBM vector field displaces both scenes; third FBM biases irregular wipe | NQ |
116
- | light-leak | Fixed off-frame leak with exponential falloff + accent warmth + ridge flare | Hard-coded leak anchor |
117
- | glitch | Line displacement + RGB lateral split + scan modulation + posterization + flicker | Deterministic |
118
-
119
- ### Public API
120
-
121
- ```js
122
- HyperShader.init({
123
- bgColor: "#0b0f14",
124
- accentColor: "#f59e42",
125
- scenes: ["scene1", "scene2"],
126
- transitions: [{ time: 3, shader: "sdf-iris", duration: 0.65, ease: "power2.inOut" }],
127
- timeline: gsap.timeline({ paused: true }),
128
- compositionId: "main",
129
- previewCaptureFps: 30,
130
- });
131
- ```
132
-
133
- - Capability probe: `isHtmlInCanvasCaptureSupported()` (Chrome layoutSubtree/drawElementImage)
134
- - Tuning: `?__hf_shader_capture_scale=` (0.25–1), `?__hf_shader_loading=` (internal|player|none)
135
- - Cache: IndexedDB for PNG snapshots; max 2 textured transitions live at once
136
- - Fallback (`applyFallbackTransition`): smoothstep opacity tween when capture / texImage2D fails
137
- - Engine mode skips GL/capture when `window.__HF_VIRTUAL_TIME__` set (producer uses metadata)
138
-
139
- You can also **write custom GLSL shaders from scratch** — any fragment shader works with the standard uniforms.
140
-
141
- ---
142
-
143
- ## 4. CSS scene transitions (30+ named patterns)
144
-
145
- Documented in skills/hyperframes/references/transitions/ across 14 category files. All GSAP-driven, none mixable with shader transitions in same composition.
146
-
147
- ### By category
148
-
149
- | Category | Patterns |
150
- | -------------------------------- | ------------------------------------------------------------------------------------------------ |
151
- | Push / slide (css-push.md) | Push slide, vertical push, elastic push, squeeze |
152
- | Scale / zoom (css-scale.md) | Zoom through, zoom out, scale-up swap |
153
- | Radial / clip (css-radial.md) | Circle iris, diamond iris, diagonal split |
154
- | 3D (css-3d.md) | 3D card flip, hinge door |
155
- | Blur (css-blur.md) | Crossfade, blur crossfade, focus pull |
156
- | Dissolve (css-dissolve.md) | Color dip (gap-to-black), staggered color blocks (2-block, 5-block) |
157
- | Cover (css-cover.md) | Horizontal blinds, vertical blinds (variable strip counts: 6 / 12 / 20) |
158
- | Light (css-light.md) | Light leak overlays, overexposure burn, film burn |
159
- | Distortion (css-distortion.md) | Glitch (CSS — RGB layer jitter), chromatic aberration, ripple |
160
- | Mechanical (css-mechanical.md) | Shutter (two-half), clock wipe (9-point rotating wedge) |
161
- | Grid (css-grid.md) | Grid dissolve (12 or 120 cells), grid pixelate wipe |
162
- | Destruction (css-destruction.md) | Page burn (SVG clip-path + canvas char rim) |
163
- | Other (css-other.md) | VHS tape (strip-based seeded jitter), gravity drop, morph circle, blur through, directional blur |
164
- | Rejected | Star iris, tilt-shift, lens flare (don't use — non-CSS-realistic) |
165
-
166
- ### Timing presets
167
-
168
- | Preset | duration | ease |
169
- | -------- | -------- | ---------------------- |
170
- | snappy | 0.2s | power4.inOut |
171
- | smooth | 0.4s | power2.inOut |
172
- | gentle | 0.6s | sine.inOut |
173
- | dramatic | 0.5s | power3.in → power3.out |
174
- | instant | 0.15s | expo.inOut |
175
- | luxe | 0.7s | power1.inOut |
176
-
177
- ---
178
-
179
- ## 5. Visual effects + textures
180
-
181
- ### Marker/emphasis patterns (css-patterns.md)
182
-
183
- | Mode | What it does | Implementation |
184
- | --------- | --------------------------------- | ----------------------------------------- |
185
- | highlight | Yellow bar wipes behind text | CSS bar + GSAP scaleX 0→1 |
186
- | circle | Hand-drawn red ring around word | CSS border ellipse + back.out scale |
187
- | burst | 12 radial spikes from word center | DOM line array, --len/--angle vars |
188
- | scribble | Wavy underline drawn over time | SVG `<path>` quadratic + stroke-dash GSAP |
189
- | sketchout | Cross-hatch x-out over text | Two 2px rotated lines |
190
-
191
- ### Grain / noise
192
-
193
- - **grain-overlay** (registry component): SVG feTurbulence data-URL + CSS keyframe jitter, `steps(1)`, default opacity 0.15
194
- - **Layered radial-gradient grain** (preferred pattern): no SVG, no canvas-taint, fast everywhere
195
-
196
- ### Light / film
197
-
198
- - Light leak transitions (CSS + shader variants)
199
- - Overexposure burn — `brightness()` ramp + flash overlay
200
- - Film burn — multi-layer amber/orange/red radials
201
- - Vignette — radial-gradient overlay
202
- - Paper texture (in registry/examples/warm-grain/)
203
-
204
- ### Glow
205
-
206
- - Caption text glow: textShadow radius keyed to treble bands (always on active words only, never parents)
207
- - Radial glow backgrounds: CSS gradients / blurred blobs
208
-
209
- ---
210
-
211
- ## 6. Caption techniques
212
-
213
- ### Animation styles
214
-
215
- - Baseline: per-word karaoke highlight (every energy level)
216
- - Intensity tiers: accent + glow + 15% scale (high energy) → 3% scale (low energy)
217
- - Exits by energy (dynamic-techniques.md): scatter, drop, collapse, fade+slide, fade
218
- - Tone mappings (captions.md): scale-pop `back.out(1.7)`, fade+slide `power3.out`, typewriter, bounce, `elastic.out`, word-by-word
219
-
220
- ### Per-word styling triggers
221
-
222
- - Brand/product names
223
- - ALL CAPS
224
- - Numbers / stats
225
- - Emotional keywords
226
- - CTAs
227
- - Marker highlight modes (5 listed above)
228
-
229
- ### Audio sources for caption timing
230
-
231
- | Source | Format | Granularity |
232
- | ------------------------------------------ | -------- | ----------------- |
233
- | hyperframes transcribe (local whisper.cpp) | JSON | Word-level |
234
- | OpenAI verbose_json | JSON | Word-level |
235
- | Groq verbose_json | JSON | Word-level |
236
- | Manually authored | JSON | Word-level |
237
- | SRT | text | Phrase-level only |
238
- | VTT | text | Phrase-level only |
239
- | hyperframes tts → transcribe chain | wav→json | Word-level |
240
-
241
- ### Positioning helpers
242
-
243
- - Landscape: bottom 80–120px centered
244
- - Portrait: ~600–700px from bottom
245
- - `window.__hyperframes.fitTextFontSize(text, {maxWidth, fontFamily, fontWeight})` for dynamic sizing
246
-
247
- ---
248
-
249
- ## 7. Audio-reactive animation
250
-
251
- ### Data shape
252
-
253
- ```js
254
- window.AUDIO_DATA = {
255
- fps: 30,
256
- totalFrames: 900,
257
- frames: [{ bands: [0.42, 0.18, ...] }] // bands normalized 0–1 per band across track
258
- };
259
- ```
260
-
261
- Index 0 = bass, higher = treble. Bands range 0–1, normalized across full track length.
262
-
263
- ### Mappings documented
264
-
265
- | Band | Property |
266
- | --------------------- | ---------------------------- |
267
- | Bass (bands[0–1]) | scale (pulse) |
268
- | Mid (bands[4–8]) | borderRadius, width |
269
- | Treble (bands[12–14]) | textShadow, boxShadow (glow) |
270
- | Overall amplitude | opacity, y, backgroundColor |
271
-
272
- Any GSAP-tweenable property is fair game — including clipPath, filter, SVG attrs, CSS variables.
273
-
274
- ### Extraction
275
-
276
- ```bash
277
- python3 .../extract-audio-data.py audio.mp3 --fps 30 --bands 8
278
- ```
279
-
280
- Pre-extracted only — no Web Audio at render time.
281
-
282
- ### Banned in audio-reactive
283
-
284
- EQ bars, spectrum UI, generic waveforms, note clip-art, generic particles, rainbow cycling, white strobe on beats, abstract pulsing orbs.
285
-
286
- ---
287
-
288
- ## 8. HTML-in-canvas
289
-
290
- Documented in skills/hyperframes/references/html-in-canvas-patterns.md (504 lines).
291
-
292
- ### Capability
293
-
294
- - Chrome's experimental `layoutSubtree` + `drawElementImage` rasterizes live DOM into canvas
295
- - Feature detection: `isHtmlInCanvasCaptureSupported()`
296
- - Used by shader-transitions for scene textures
297
- - Combined with Three.js: `CanvasTexture` + post-processing
298
-
299
- ### Available patterns
300
-
301
- - HTML on a Three.js plane (displacement, distortion, liquid sim)
302
- - HTML in shaders (texture sampling for VFX)
303
- - Recursive HTML-in-canvas-in-shader-in-HTML
304
-
305
- ### Experimental VFX blocks using this
306
-
307
- - `vfx-iphone-device` (GLTF iPhone + MacBook, HTML screens)
308
- - `vfx-liquid-background` (liquid sim displaces HTML)
309
- - `vfx-liquid-glass`
310
- - `vfx-magnetic`
311
- - `vfx-portal`
312
- - `vfx-shatter`
313
- - `vfx-text-cursor` (chromatic edges, canvas post)
314
-
315
- ---
316
-
317
- ## 9. Three.js / WebGL custom scenes
318
-
319
- ### Integration pattern
320
-
321
- ```js
322
- window.addEventListener("hf-seek", (e) => {
323
- const time = e.detail.time;
324
- mixer.setTime(time);
325
- shaderUniforms.u_time.value = time;
326
- renderer.render(scene, camera);
327
- });
328
- ```
329
-
330
- - Load: `import * as THREE from "https://cdn.jsdelivr.net/npm/three@0.181.2/+esm"`
331
- - Deterministic: every frame must derive from `time`, never `requestAnimationFrame` / `Date.now()`
332
- - Includes: AnimationMixer, custom GLSL shaders, post-processing, GLTF models, lights, cameras, materials
333
-
334
- ---
335
-
336
- ## 10. SVG / canvas / variable fonts (other authored techniques)
337
-
338
- (From skills/hyperframes/references/techniques.md)
339
-
340
- | Technique | Mechanism |
341
- | ------------------------ | ------------------------------------------------------------------------------------ |
342
- | SVG path drawing | `strokeDasharray` + `getTotalLength()` + GSAP stroke offset |
343
- | Canvas 2D procedural art | Seeded hash function + `tl.to` proxy `{time}` onUpdate |
344
- | CSS 3D card | GSAP `rotationY` + `perspective: 900` |
345
- | Per-word kinetic type | GSAP timings array, sliding decay |
346
- | Variable font axes | Animate CSS vars → `font-variation-settings: "opsz" var(--opsz), "wght" var(--wght)` |
347
- | Character typing | `tl.call` text mutation + `steps(1)` cursor blink |
348
- | Velocity-matched cuts | Match outgoing blur/translate velocity to incoming for seamless beats |
349
- | MotionPathPlugin | `gsap.registerPlugin(MotionPathPlugin)` + path string |
350
-
351
- ---
352
-
353
- ## 11. Media: video, audio, TTS
354
-
355
- ### Video compositing
356
-
357
- - `<video muted playsinline data-start="..." data-duration="..." data-track-index="..." src="...">`
358
- - HyperFrames extracts frames at render via videoFrameInjector (avoids unreliable headless `<video>` playback)
359
- - Linter forbids `<video>` with audio at the same time — split into separate `<video muted>` + `<audio>`
360
- - Video frame extraction uses FFmpeg
361
- - HDR videos: PQ or HLG transfer detection + x265 with mastering metadata
362
-
363
- ### Audio mixer
364
-
365
- - `<audio id="..." data-start="..." data-duration="..." data-volume="0.8" data-track-index="2" src="...">`
366
- - Multiple tracks mixed with `amix normalize=0` + per-track adelay + volume
367
- - Master audioGain from EngineConfig
368
- - Output: AAC 192kbps
369
-
370
- ### TTS (Kokoro-82M, local)
371
-
372
- - 54 bundled voices with prefixes: `a` American EN, `b` British EN, `e` Spanish, `f` French, `h` Hindi, `i` Italian, `j` Japanese, `p` Brazilian Portuguese, `z` Mandarin
373
- - Default voice: `af_heart`
374
- - Speed: 0.1–3.0 (default 1.0)
375
- - Languages: en-us, en-gb, es, fr-fr, hi, it, pt-br, ja, zh (non-EN needs system espeak-ng)
376
- - Output: WAV; no pitch/volume CLI flags
377
- - No API key required
378
-
379
- ### Transcription
380
-
381
- - Whisper.cpp models: tiny, base, small, medium, large-v3, small.en, medium.en (default small)
382
- - Groq API: whisper-large-v3 with word granularities
383
- - OpenAI API: whisper-1 verbose_json
384
- - Imports: SRT, VTT, JSON formats
385
- - Quality gates: music-token detection, garbage cleaning, retry with medium.en
386
-
387
- ### Background removal
388
-
389
- - u2net ONNX models
390
- - Devices: auto / cpu / coreml / cuda
391
- - Quality presets: fast / balanced / best
392
- - Outputs: transparent WebM, ProRes MOV, PNG sequence
393
- - Optional dual output (foreground + extracted background)
394
-
395
- ---
396
-
397
- ## 12. Registry — 51 blocks + 4 components + 8 examples
398
-
399
- ### Blocks by category
400
-
401
- **Social overlays (8):** instagram-follow, tiktok-follow, yt-lower-third, x-post, reddit-post, spotify-card, macos-notification, blue-sweater-intro-video
402
-
403
- **Showcases (5):** app-showcase (3D phones), north-korea-locked-down (map + annotation), apple-money-count (counter + SFX), vpn-youtube-spot (app-store scroll), nyc-paris-flight (map + plane path)
404
-
405
- **Data viz (2):** data-chart (animated bar+line, NYT-style), flowchart + flowchart-vertical (decision tree with SVG connectors, typing correction)
406
-
407
- **Logo / branding (1):** logo-outro (build + glow + tagline + URL pill)
408
-
409
- **3D / experimental VFX (8):** ui-3d-reveal, vfx-iphone-device (GLTF), vfx-liquid-background, vfx-liquid-glass, vfx-magnetic, vfx-portal, vfx-shatter, vfx-text-cursor
410
-
411
- **Single shader transitions (14):** one block per named shader — domain-warp-dissolve, ridged-burn, whip-pan, sdf-iris, ripple-waves, gravitational-lens, cinematic-zoom, chromatic-radial-split, glitch, swirl-vortex, thermal-distortion, flash-through-white, cross-warp-morph, light-leak
412
-
413
- **Transition galleries (13 showcase pieces):** transitions-3d, transitions-blur, transitions-cover, transitions-destruction, transitions-dissolve, transitions-distortion, transitions-grid, transitions-light, transitions-mechanical, transitions-other, transitions-push, transitions-radial, transitions-scale
414
-
415
- ### Components (4 reusable snippets)
416
-
417
- - **grain-overlay** — SVG feTurbulence + CSS keyframes
418
- - **shimmer-sweep** — Light sweep gradient mask on text
419
- - **grid-pixelate-wipe** — Grid squares stagger fade scene wipe
420
- - **texture-mask-text** — Luminance-masked letterforms with 66 mask PNGs (Masonry, Stone, Ground/Road, Wood, Metal, Organic/Soft texture categories)
421
-
422
- ### Examples (8 starter projects)
423
-
424
- warm-grain, play-mode, swiss-grid, vignelli, decision-tree, kinetic-type, product-promo, nyt-graph
425
-
426
- Install: `npx hyperframes add <name>` for blocks/components, `hyperframes init <dir> --example <name>` for examples.
427
-
428
- ---
429
-
430
- ## 13. CLI — 25 commands
431
-
432
- | Command | Purpose |
433
- | ----------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
434
- | init | Scaffold project from template/example (interactive or --non-interactive) |
435
- | add | Install registry block / component |
436
- | catalog | Browse registry blocks/components (--type, --tag, --json, --human-friendly picker) |
437
- | play | Lightweight browser player (default port 3003) |
438
- | preview | Studio dev server (port 3002; --force-new, --list, --kill-all) |
439
- | publish | Zip + upload + return hyperframes.dev URL |
440
- | render | Render to MP4 / WebM / MOV / PNG sequence — flags: --fps 24/30/60, --quality draft/standard/high, --workers, --docker, --hdr/--sdr, --crf, --video-bitrate, --gpu, --browser-gpu auto/software/hardware, --max-concurrent-renders 1-10, --variables JSON, --variables-file PATH, --strict-variables, --resolution preset |
441
- | lint | Static lint (--json, --verbose) |
442
- | validate | Bundle + headless Chrome + console + contrast (--contrast default true, --timeout 3000) |
443
- | inspect / layout | Visual layout audit (overflow detection at N timestamps; --samples 9, --at, --tolerance 2, --max-issues 80) |
444
- | info | Print project metadata |
445
- | compositions | List compositions (root + sub-comps) |
446
- | benchmark | 5 preset configs × N runs (--runs 3) |
447
- | browser | Manage Chrome (ensure/path/clear) |
448
- | remove-background | u2net + FFmpeg → transparent video |
449
- | transcribe | whisper.cpp or import SRT/VTT/JSON |
450
- | tts | Kokoro-82M (--voice, --speed, --lang, --list) |
451
- | docs | Print bundled markdown topics (data-attributes, examples, rendering, gsap, troubleshooting, compositions) |
452
- | doctor | Environment checklist (Node, CPU, memory, disk, FFmpeg, FFprobe, Chrome, Docker) |
453
- | upgrade | npm update check + optional global install |
454
- | skills | Run `npx skills add heygen-com/hyperframes --all` |
455
- | telemetry | enable/disable/status |
456
- | snapshot | PNG screenshots at timeline timestamps |
457
- | capture | Capture URL → site assets + screenshots + design tokens (uses Puppeteer + optional Gemini vision) |
458
-
459
- ### Website capture (`hyperframes capture <url>`)
460
-
461
- Detects these libraries on captured sites (for context labeling): GSAP / ScrollTrigger, Three.js, Lottie, Anime.js, PixiJS, Babylon.js, Rive, Matter.js, Lenis, Framer Motion, Tailwind CSS, WebGL (shader fingerprinting). Captured outputs feed the website-to-video skill workflow.
462
-
463
- ---
464
-
465
- ## 14. Linter — 60+ rules
466
-
467
- Across 8 files in packages/core/src/lint/rules/:
468
-
469
- | Rule file | Catches |
470
- | ----------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
471
- | core | Missing composition-id, missing dimensions, missing timeline registry, registry mismatch, invalid script syntax, scoped-CSS issues, non-deterministic code |
472
- | media | Duplicate media id, video missing muted, video nested in timed element, placeholder URLs, base64 prohibited, missing src/start/id, imperative play()/pause()/seek() |
473
- | gsap | Overlapping tweens, exit missing hard kill, GSAP animating .clip element, unscoped selectors, CSS transform conflict, missing GSAP script, infinite repeat (repeat: -1), repeat ceil overshoot, scene layer visibility kill, audio-reactive single-tween-per-group |
474
- | captions | Caption exit missing kill, text overflow risk, transcript not inline, parse error, container position, scale mismatch, textShadow on parent container |
475
- | composition | File too large, dense tracks, missing class="clip", deprecated data-layer/data-end, split attribute selectors, external script deps, RAF in composition, invalid variable JSON |
476
- | adapters | Missing Lottie script, missing Three script |
477
- | textures | Drop-shadow on text, class missing base, text missing mask, unknown texture class |
478
- | fonts | Google Fonts import (use @font-face), font-family without @font-face |
479
-
480
- Plus async URL checks (`lintMediaUrls`, `lintScriptUrls` — HEAD probes).
481
-
482
- `validateCompositionGsap` also forbids: `Math.random`, `Date.now`, `new Date`, `setTimeout`, `setInterval`, `requestAnimationFrame`, `repeat: -1`.
483
-
484
- **Note:** `onUpdate` callbacks, `tl.call()`, and GSAP event callbacks (`onComplete`, `onStart`, etc.) are NOT banned by the linter — they are required for canvas/WebGL rendering and character-by-character typing patterns. The linter only catches the determinism violations listed above.
485
-
486
- ---
487
-
488
- ## 15. Player — `<hyperframes-player>` web component
489
-
490
- ### Attributes
491
-
492
- `src`, `srcdoc`, `width`, `height`, `controls`, `muted`, `volume`, `poster`, `playback-rate`, `audio-src`, `shader-capture-scale`, `shader-loading` (internal|player|none), `loop`, `autoplay`, `speed-presets`
493
-
494
- ### Public API
495
-
496
- `seek(t)` (synchronous when same-origin — uses `iframe.contentWindow.__player.seek` directly), `play()`, `pause()`, `currentTime`, `duration`, `paused`, `ready`, `playbackRate`, `iframeElement`
497
-
498
- ### Events
499
-
500
- `ready`, `timeupdate`, `play`, `pause`, `ended`, `volumechange`, `ratechange`, `shadertransitionstate`, `playbackerror`, `error`, `audioownershipchange`
501
-
502
- ### Media mirror
503
-
504
- Parent audio/video elements with `data-start` are proxied; `_mirrorParentMediaTime` corrects drift; `_audioOwner` promotes to parent if autoplay blocked.
505
-
506
- ### Runtime auto-inject
507
-
508
- Loads `RUNTIME_CDN_URL` (`@hyperframes/core/dist/hyperframe.runtime.iife.js`) if missing `__hf`/`__player` but timelines exist.
509
-
510
- ---
511
-
512
- ## 16. Engine + Producer — rendering pipeline
513
-
514
- ### Output formats
515
-
516
- mp4, webm, mov, png-sequence — with HDR (PQ / HLG / SDR / auto-detect), transparency (ProRes MOV / WebM / PNG), or standard 8-bit SDR
517
-
518
- ### Encoding controls
519
-
520
- - `--fps`: 24 / 30 / 60
521
- - `--quality`: draft / standard / high
522
- - `--crf`: integer (mutually exclusive with `--video-bitrate`)
523
- - `--video-bitrate`: e.g. `8M`
524
- - `--gpu`: NVENC, VideoToolbox, VAAPI, QSV
525
- - `--browser-gpu`: auto / software / hardware
526
- - `--workers`: parallel render workers
527
- - `--max-concurrent-renders`: 1–10 (sets `PRODUCER_MAX_CONCURRENT_RENDERS`)
528
- - `--resolution`: preset (1080p, 4k, portrait, etc.)
529
- - `--docker`: render inside Dockerfile.test image (reproducibility)
530
- - `--hdr` / `--sdr`: force HDR or SDR pipeline
531
-
532
- ### Engine subsystems
533
-
534
- - Frame capture: BeginFrame on Linux headless-shell (fast, no alpha) or `Page.captureScreenshot` (alpha + supersample)
535
- - Video frame injector: pre-extracts video to images, swaps `<video>` for `<img>` during capture (LRU cache by path + byte budget)
536
- - Audio mixer: FFmpeg-based; per-track delay, volume, master gain, AAC 192k output
537
- - Chunk encoder: H.264 / H.265 / VP9 / ProRes presets with optional GPU
538
- - Streaming encoder: `streamingEncodeMaxDurationSeconds` for long renders
539
- - HDR compositing: `rgba16float` WebGPU readback (headed Chrome), PQ OETF helpers
540
- - Layer compositor: groups DOM by z-order; splits HDR elements into separate layers
541
- - Alpha blit: matrix3d affine extraction, `blitRgba8OverRgb48le`, `blitRgb48leAffine`
542
- - Parallel coordinator: concurrency, coresPerWorker, minParallelFrames, largeRenderThreshold
543
- - Browser pool: optional with timeout configs
544
-
545
- ### Producer-only
546
-
547
- - `RenderConfig` with `hdrMode` (auto / force-hdr / force-sdr), `outputResolution` mapped to `deviceScaleFactor`
548
- - File server injects `HF_EARLY_STUB`, `HF_BRIDGE_SCRIPT`, virtual-time so `window.__hf` bridges `window.__player.renderSeek`
549
- - HDR-aware shader transition compositing via `window.__hf.transitions` metadata
550
-
551
- ---
552
-
553
- ## 17. Studio — in-browser NLE
554
-
555
- Full editor in packages/studio/:
556
-
557
- - **NLELayout**: NLE preview + timeline + controls
558
- - **Timeline**: clip rendering, drag to move (`data-start`), resize (`data-duration`), `data-track-index` reassignment, asset drop, file drop
559
- - **PlayerControls**: scrub, play, pause, frame step (`stepFrameTime`), `STUDIO_PREVIEW_FPS`
560
- - **useTimelinePlayer**: resolves `__player` / `__timeline` / `__timelines`
561
- - **LeftSidebar**: compositions list, asset browser
562
- - **RenderQueue + useRenderQueue**: queue multiple renders
563
- - **LintModal**: in-app lint output
564
- - **MediaPreview + AudioWaveform**: waveform rendering
565
- - **CaptionOverlay, CaptionTimeline, CaptionPropertyPanel**: caption editor
566
- - **useCaptionSync**: word-level sync
567
- - **useElementPicker**: click-to-inspect picker mode
568
- - Built with Tailwind v3 (separate from Tailwind v4 browser runtime used by compositions).
569
-
570
- ---
571
-
572
- ## 18. Determinism guarantees
573
-
574
- - No `Math.random()` (use seeded PRNGs; mulberry32 is the pattern in skills)
575
- - No `Date.now()` / `new Date()`
576
- - No `setTimeout` / `setInterval` in timeline construction
577
- - No `requestAnimationFrame` (timeline-driven; engine seeks per frame)
578
- - No `repeat: -1` (calculate exact repeats: `Math.ceil(duration / cycleDuration) - 1`)
579
- - No `onComplete`/`onStart`/`onRepeat` callbacks (engine doesn't fire them). **Exception:** `onUpdate` and `tl.call()` ARE supported — they're required for canvas/WebGL rendering, character-by-character typing, and counter patterns. See §10 (Canvas 2D procedural art) for the documented pattern.
580
- - No `gsap.set` on clips from later scenes (use `tl.set(selector, vars, position)`)
581
- - Synchronous timeline construction (no async)
582
- - Master clock can clamp at composition end
583
-
584
- ---
585
-
586
- ## 19. Variables / parameterization
587
-
588
- Compositions support typed runtime variables:
589
-
590
- ```html
591
- <html
592
- data-composition-variables='[
593
- {"name":"brand","type":"string","default":"Stripe"},
594
- {"name":"primary","type":"color","default":"#635BFF"},
595
- {"name":"duration","type":"number","default":15},
596
- {"name":"darkMode","type":"boolean","default":false},
597
- {"name":"layout","type":"enum","options":["hero","split","stacked"]}
598
- ]'
599
- ></html>
600
- ```
601
-
602
- Access via `window.__hyperframes.getVariables()`. Override at render time:
603
-
604
- ```bash
605
- npx hyperframes render --variables '{"brand":"Linear","primary":"#5E6AD2"}'
606
- npx hyperframes render --variables-file vars.json
607
- npx hyperframes render --strict-variables # error if unused / mismatched
608
- ```
609
-
610
- `validateVariables()` checks values against declarations at the CLI/tooling boundary.
611
-
612
- ---
613
-
614
- ## 20. Sub-compositions
615
-
616
- Two loading mechanisms:
617
-
618
- - **External file:** `data-composition-src="compositions/act-1.html"` — fetched at runtime
619
- - **Inline template:** `<template id="<id>-template">` — extracted by `loadInlineTemplateCompositions`
620
-
621
- Each sub-comp:
622
-
623
- - Has its own `data-composition-id`
624
- - Has its own `window.__timelines[<id>]`
625
- - Auto-nested into the root timeline
626
- - Scoped CSS via `scopeCssToComposition` (`[data-composition-id="<id>"]` selector)
627
- - Wrapped scripts via `wrapScopedCompositionScript`
628
- - Reads `data-variable-values` merged with own defaults into `window.__hfVariablesByComp[<id>]`
629
- - External scripts load with `EXTERNAL_SCRIPT_LOAD_TIMEOUT_MS` timeout. Failed loads emit `external_composition_load_failed` / `external_composition_script_load_issue` diagnostics.
630
-
631
- ---
632
-
633
- ## 21. Global runtime APIs (`window.*`)
634
-
635
- | Global | Purpose |
636
- | ------------------------------------- | ----------------------------------------------------------------------- |
637
- | `__hyperframes` | `{ fitTextFontSize, getVariables }` |
638
- | `__timelines` | `{ [compositionId]: GsapTimeline }` |
639
- | `__player` | Internal player bridge: seek, play, pause, renderSeek, etc. |
640
- | `__clipManifest` | Computed clip array (for Studio) |
641
- | `__playerReady` | Resolved when player ready |
642
- | `__renderReady` | Resolved when ready for render capture |
643
- | `__HF_PARITY_MODE` | Engine parity flag |
644
- | `__HF_FPS` | Render FPS hint |
645
- | `__HF_MAX_DURATION_SEC` | Engine clamp |
646
- | `__HF_VIRTUAL_TIME__` | Set by engine in render mode (shader-transitions switches paths) |
647
- | `__hfThreeTime` | Current time for Three.js adapter |
648
- | `__HF_PICKER_API` | Element picker hook for Studio |
649
- | `__hfAnime` | Array of Anime.js instances |
650
- | `__hfLottie` | Array of Lottie animations |
651
- | `__hfVariables` | Resolved root variables |
652
- | `__hfVariablesByComp` | Per-composition variable map |
653
- | `__hfRuntimeTeardown` | Cleanup function |
654
- | `__tailwindReady` | Tailwind browser build ready (gates capture) |
655
- | `__hf.transitions` | Shader transition metadata (read by producer for HDR-aware compositing) |
656
- | `__beforeTimeline`, `__afterTimeline` | Optional user hooks |
657
- | `__afterRender`, `__beforeRender` | Optional user hooks |
658
- | `gsap`, `THREE`, `anime`, `lottie` | Library globals |
659
-
660
- Control bridge actions: play, pause, seek, set-muted, set-playback-rate, enable-pick-mode, disable-pick-mode, set-volume, set-media-output-muted.
661
-
662
- ---
663
-
664
- ## 22. Skills available — 16
665
-
666
- | Skill | Purpose |
667
- | ------------------------- | ----------------------------------------------------------------------- |
668
- | hyperframes | Core framework skill (composition authoring) |
669
- | hyperframes-cli | All CLI commands as an agent skill |
670
- | hyperframes-media | Media workflows (TTS, transcribe, captions integration) |
671
- | hyperframes-registry | Installing blocks/components |
672
- | hyperframes-contrast | WCAG audit (scripts/contrast-report.mjs) |
673
- | hyperframes-animation-map | Per-tween bbox + flags report |
674
- | website-to-video | Capture → DESIGN.md → brief → storyboard+script → VO → build → validate |
675
- | remotion-to-hyperframes | Migration patterns + API map + CustomEase |
676
- | gsap | GSAP API + plugins reference |
677
- | animejs | Anime.js v4 patterns |
678
- | css-animations | @keyframes patterns |
679
- | waapi | Web Animations API |
680
- | lottie | Lottie integration |
681
- | three | Three.js + deterministic seek |
682
- | tailwind | Tailwind browser runtime v4 |
683
- | contribute-catalog | Adding blocks to registry |
684
-
685
- ---
686
-
687
- ## 23. References inventory (skills/hyperframes/references/)
688
-
689
- 16 reference docs covering:
690
-
691
- - text-effects.md — 24 named text animation effects (per-character, per-word, per-line, whole) — vocabulary reference for the separate `pixel-point/animate-text` skill (load it via `npx skills add pixel-point/animate-text` or `/animate-text`). Specs live in that upstream skill, not in this repo.
692
- - transitions.md + transitions/catalog.md + 14 category subfiles
693
- - css-patterns.md (marker patterns)
694
- - dynamic-techniques.md (caption animation)
695
- - motion-principles.md (easing as emotion, choreography)
696
- - typography.md (banned-font list, pairing rules, variable fonts)
697
- - narration.md (script + VO pacing)
698
- - captions.md (caption authoring contract)
699
- - audio-reactive.md (band mappings + extraction)
700
- - transcript-guide.md (whisper, Groq, OpenAI workflows)
701
- - techniques.md (the big technique catalog — SVG, canvas 2D, 3D, kinetic, lottie, variable fonts, MotionPath, audio-reactive)
702
- - beat-direction.md, design-picker.md, prompt-expansion.md, video-composition.md
703
- - visual-styles.md (8 named visual styles: Swiss Pulse, Velvet Standard, Deconstructed, Maximalist Type, Data Drift, Soft Signal, Folk Frequency, Shadow Cut — available via the `visual-style` skill)
704
-
705
- ---
706
-
707
- ## 24. Documentation pages (docs/)
708
-
709
- 27 mdx pages in docs/guides/ and docs/packages/:
710
-
711
- **Guides:** 4k-rendering, claude-design, common-mistakes, deploy, gsap-animation, hdr, html-in-canvas, hyperframes-vs-remotion, open-design, performance, prompting, remove-background, rendering, timeline-editing, troubleshooting, video-editor-cheatsheet, website-to-video, etc.
712
-
713
- **Packages:** cli.mdx, core.mdx, engine.mdx, player.mdx, producer.mdx, studio.mdx
1
+ # HyperFrames — Complete Capabilities Inventory
2
+
3
+ Everything possible in HyperFrames as of today's workspace, synthesized from direct source reads of all 7 packages, 16 skills, and the full registry.
4
+
5
+ > **How to read this file.** Scan the **Table of Contents** below first. **Do NOT read this file linearly** — it is a 700+ line inventory; reading top-to-bottom every session wastes context. When the storyboard or a specific beat needs a particular capability (HTML-in-Canvas, shader transitions, audio-reactive, dynamic counters, etc.), jump straight to that section.
6
+
7
+ You are NOT limited to what was captured from the website. You can create shaders from scratch, search for and download registry blocks, build Three.js scenes, write custom WebGL effects, use any web API — anything a browser can render.
8
+
9
+ For implementation patterns (working code), see `techniques.md`. This file is the WHAT; techniques.md is the HOW.
10
+
11
+ ## Essential Rules
12
+
13
+ - **Deterministic:** No `Math.random()`, no `Date.now()`, no `requestAnimationFrame`, no `repeat: -1`. The render engine seeks to exact timestamps.
14
+ - **Timeline contract:** `window.__timelines["composition-id"] = tl` must be set synchronously. The timeline length defines the composition duration.
15
+ - **Sub-compositions:** External `.html` files loaded via `data-composition-src`. Auto-nested timelines, scoped CSS, scoped scripts.
16
+ - **Linter:** 60+ rules. Run `npx hyperframes lint` before render. Catches missing timelines, overlapping clips, broken paths, GSAP errors.
17
+
18
+ ## Table of Contents
19
+
20
+ | # | Section | What it covers |
21
+ | --- | ---------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
22
+ | 1 | **Composition fundamentals** | Data attributes, timeline contract, resolution presets (1080p, 4K, portrait, square, custom) |
23
+ | 2 | **Animation engines (6 adapters)** | GSAP + 15 plugins, Anime.js v4, CSS @keyframes, WAAPI, Lottie (lottie-web + dotlottie), Three.js (hf-seek event) |
24
+ | 3 | **Shader transitions (14 WebGL)** | domain-warp, ridged-burn, whip-pan, sdf-iris, ripple-waves, gravitational-lens, cinematic-zoom, chromatic-split, swirl-vortex, thermal-distortion, flash-through-white, cross-warp-morph, light-leak, glitch — plus custom GLSL |
25
+ | 4 | **CSS scene transitions (30+)** | Push/slide, scale/zoom, radial/clip, 3D flip, blur, dissolve, cover/blinds, light leak/burn, distortion/glitch, mechanical/shutter, grid dissolve, destruction/burn, VHS/gravity/morph — 6 timing presets |
26
+ | 5 | **Visual effects + textures** | Text markers (highlight, circle, burst, scribble, sketchout), grain/noise, light leaks, film burn, vignette, glow, paper texture, shimmer sweep |
27
+ | 6 | **Caption techniques** | Per-word karaoke, intensity tiers, 5 exit styles, 6 tone mappings, per-word styling triggers, 7 audio source formats, positioning helpers |
28
+ | 7 | **Audio-reactive animation** | Bass→scale, mid→shape, treble→glow; any GSAP property; band extraction script; banned patterns |
29
+ | 8 | **HTML-in-canvas** | Live DOM as GPU texture (drawElementImage), Three.js planes, WebGL shaders on HTML, 7 VFX blocks (iPhone/MacBook device, liquid, glass, magnetic, portal, shatter, text cursor) |
30
+ | 9 | **Three.js / WebGL custom scenes** | Full 3D: AnimationMixer, custom GLSL, post-processing, GLTF models, lights, cameras, materials — all deterministic via hf-seek |
31
+ | 10 | **SVG / canvas / variable fonts** | SVG path drawing, Canvas 2D procedural art, CSS 3D card, per-word type, variable font axes, character typing, velocity-matched cuts, MotionPath |
32
+ | 11 | **Media: video, audio, TTS** | Video compositing + frame injection, audio mixer (multi-track), Kokoro TTS (54 voices, 9 languages), Whisper/Groq/OpenAI transcription, background removal (u2net) |
33
+ | 12 | **Registry (51 blocks + 4 components + 8 examples)** | Social overlays (8), showcases (5), data viz (2), logo branding (1), 3D/VFX (7), shader transitions (14), transition galleries (13), components (grain, shimmer, pixelate, texture-mask), 8 starter examples |
34
+ | 13 | **CLI (25 commands)** | init, add, catalog, play, preview, publish, render (MP4/WebM/MOV/PNG, HDR, GPU, parallel), lint, validate, inspect, snapshot, capture, tts, transcribe, remove-background, doctor, and more |
35
+ | 14 | **Linter (60+ rules)** | Core, media, GSAP, captions, composition, adapters, textures, fonts — plus async URL checks |
36
+ | 15 | **Player web component** | `<hyperframes-player>` with seek/play/pause API, 11 events, media mirror, runtime auto-inject |
37
+ | 16 | **Engine + Producer** | MP4/WebM/MOV/PNG output, HDR (PQ/HLG), transparency (ProRes), GPU encoding (NVENC/VideoToolbox/VAAPI/QSV), parallel rendering, video frame injection |
38
+ | 17 | **Studio (in-browser NLE)** | Timeline editor, drag/resize clips, asset browser, render queue, lint modal, caption editor, element picker |
39
+ | 18 | **Determinism guarantees** | No Math.random, no Date.now, no RAF, no repeat:-1, no callbacks, synchronous construction |
40
+ | 19 | **Variables / parameterization** | Typed runtime variables (string, color, number, boolean, enum), CLI override, strict validation |
41
+ | 20 | **Sub-compositions** | External file or inline template, auto-nested timelines, scoped CSS, scoped scripts, variable inheritance |
42
+ | 21 | **Global runtime APIs** | 25+ window globals for timelines, player, variables, adapters, hooks |
43
+ | 22 | **Skills (16)** | hyperframes, cli, media, registry, contrast, animation-map, website-to-video, remotion, gsap, animejs, css-animations, waapi, lottie, three, tailwind, contribute-catalog |
44
+ | 23 | **References (15 docs)** | transitions, css-patterns, dynamic-techniques, motion-principles, typography, narration, captions, audio-reactive, transcript-guide, techniques, beat-direction, visual-styles, and more |
45
+ | 24 | **Documentation (27 pages)** | Guides + package docs covering rendering, HDR, html-in-canvas, performance, prompting, troubleshooting, etc. |
46
+
47
+ ---
48
+
49
+ ## 1. Composition fundamentals
50
+
51
+ ### Data attributes recognized by the runtime
52
+
53
+ - **Root composition:** `data-composition-id`, `data-start`, `data-duration`, `data-width`, `data-height`, `data-composition-src` (external sub-comp), `data-composition-duration`, `data-composition-variables` (JSON), `data-variable-values` (override)
54
+ - **Every clip:** `id`, `data-start`, `data-duration`, `data-track-index`, `class="clip"`, optional `data-media-start`, `data-volume`, `data-playback-start`
55
+ - **Sub-composition host:** `data-composition-id`, `data-composition-src` OR inline `<template id="${compId}-template">`
56
+ - **Parser also reads:** `data-type` (composition|text), `data-end`, `data-keyframes` (JSON), `data-x|y|scale|opacity`, `data-color|font-size|font-weight|font-family|text-shadow|outline|highlight*`, `data-layer` (z-index, deprecated for timeline but used for audio mixer layers), `data-resolution`, `data-composition-width|height`
57
+
58
+ ### Timeline contract
59
+
60
+ - `gsap.timeline({ paused: true })` registered on `window.__timelines["<composition-id>"]`
61
+ - Master clock (TransportClock + WebAudioTransport) drives the timeline via `tl.totalTime(t, false)` or `tl.seek(t, false)`
62
+ - Framework auto-nests sub-comp timelines
63
+ - Duration sourced from `data-duration` on root, not from GSAP length
64
+ - Synchronous timeline construction required (no async/await/setTimeout)
65
+ - Looping handled by `<hyperframes-player>`, not GSAP `repeat: -1`
66
+
67
+ ### Resolution presets
68
+
69
+ VALID_CANVAS_RESOLUTIONS: 1920×1080 default, 1080×1920 portrait, 1080×1080 square, 4K, 1440×2560, plus `normalizeResolutionFlag` for `--resolution` CLI flag.
70
+
71
+ ---
72
+
73
+ ## 2. Animation engines (6 deterministic frame adapters)
74
+
75
+ The runtime registers these adapters in order; each implements `discover()` / `seek({time})` / `pause` / `play?` / `revert`:
76
+
77
+ | Adapter | What it drives | How to load | Notable |
78
+ | ---------------------------------- | ----------------------------------------------------------------------------- | --------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------- |
79
+ | GSAP (createGsapAdapter) | The primary timeline + all tweens registered on `window.__timelines[<id>]` | CDN `https://cdn.jsdelivr.net/npm/gsap@3.14.2/dist/gsap.min.js` | Plugins via standard GSAP register; HyperFrames does NOT patch THREE.Clock (uses `__hfThreeTime` instead) |
80
+ | Anime.js v4 (createAnimeJsAdapter) | Anime instances pushed to `window.__hfAnime` | CDN `animejs@4.0.2/lib/anime.iife.min.js` or ESM | Adapter multiplies composition seconds by 1000 for ms |
81
+ | CSS animations (createCssAdapter) | Any element with computed `animation-name` | Declarative `@keyframes` | Falls back to negative `animation-delay` when WAAPI unavailable |
82
+ | WAAPI (createWaapiAdapter) | All Animation objects on document | `element.animate()` | Uses `document.getAnimations()` |
83
+ | Lottie (createLottieAdapter) | `window.__hfLottie` array; supports lottie-web + dotlottie-web | CDN `lottie.min.js` + `@lottiefiles/dotlottie-web` | `goToAndStop(time*1000)` or `setCurrentRawFrameValue` / `seek(%)` |
84
+ | Three.js (createThreeAdapter) | `window.__hfThreeTime` + dispatches `CustomEvent("hf-seek", {detail:{time}})` | ESM CDN `three@0.181.2/+esm` | Composition's render loop listens to `hf-seek`; pattern: `mixer.setTime(time)` |
85
+
86
+ ### GSAP plugins (documented patterns)
87
+
88
+ - **TextPlugin** — text mutation in `tl.call` (skills/gsap/references/effects.md)
89
+ - **MotionPathPlugin** — curve-constrained tweens (skills/hyperframes/references/techniques.md)
90
+ - **CustomEase** — bezier eases imported from Remotion-style timing
91
+ - **ScrollTrigger / Flip / SplitText / Draggable / Inertia / Observer / ScrambleText / CustomWiggle / CustomBounce / ScrollSmoother / GSDevTools** — work natively if loaded and tweens are on the registered paused timeline, but no special HyperFrames adapter
92
+ - Producer injects ScrollTrigger CDN automatically when needed (packages/producer/src/services/htmlCompiler.ts)
93
+
94
+ ---
95
+
96
+ ## 3. Shader transitions — @hyperframes/shader-transitions
97
+
98
+ 14 named WebGL fragment shaders. All share the same uniforms: `u_from`, `u_to`, `u_progress`, `u_resolution`, `u_accent`, `u_accent_dark`, `u_accent_bright`.
99
+
100
+ ### The 14 shaders
101
+
102
+ | Name | Visual | Notes |
103
+ | ------------------- | -------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------- |
104
+ | domain-warp | Multi-octave FBM warps both scenes oppositely; organic dissolve edge with accent flash | Uses NQ noise bundle |
105
+ | ridged-burn | Ridged multifractal mask reveals B; accent → bright → white burn ramp; sparks | NQ |
106
+ | whip-pan | 10-sample horizontal motion blur + lateral crossfade | No noise |
107
+ | sdf-iris | Aspect-corrected circle SDF expansion + accent-tinted glow rings | — |
108
+ | ripple-waves | Radial standing-wave UV displacement + tinted crossfade | — |
109
+ | gravitational-lens | Pinch pull toward center + R/B chromatic separation | — |
110
+ | cinematic-zoom | 12 RGB-offset radial zoom blur samples (chromatic zoom streak) | — |
111
+ | chromatic-split | R/B radial channel shift outward / inward; G fixed | Distinct from CSS chromatic aberration |
112
+ | swirl-vortex | CCW swirl with FBM noise; reciprocal on incoming | NQ |
113
+ | thermal-distortion | Vertical sin + FBM horizontal displacement; warm haze | NQ |
114
+ | flash-through-white | Fade through white midpoint — a visible white flash between scenes | No accent. Use only when the brand specifically calls for a white-flash beat boundary; this is NOT a neutral "default" transition. |
115
+ | cross-warp-morph | FBM vector field displaces both scenes; third FBM biases irregular wipe | NQ |
116
+ | light-leak | Fixed off-frame leak with exponential falloff + accent warmth + ridge flare | Hard-coded leak anchor |
117
+ | glitch | Line displacement + RGB lateral split + scan modulation + posterization + flicker | Deterministic |
118
+
119
+ ### Public API
120
+
121
+ ```js
122
+ HyperShader.init({
123
+ bgColor: "#0b0f14",
124
+ accentColor: "#f59e42",
125
+ scenes: ["scene1", "scene2"],
126
+ transitions: [{ time: 3, shader: "sdf-iris", duration: 0.65, ease: "power2.inOut" }],
127
+ timeline: gsap.timeline({ paused: true }),
128
+ compositionId: "main",
129
+ previewCaptureFps: 30,
130
+ });
131
+ ```
132
+
133
+ - Capability probe: `isHtmlInCanvasCaptureSupported()` (Chrome layoutSubtree/drawElementImage)
134
+ - Tuning: `?__hf_shader_capture_scale=` (0.25–1), `?__hf_shader_loading=` (internal|player|none)
135
+ - Cache: IndexedDB for PNG snapshots; max 2 textured transitions live at once
136
+ - Fallback (`applyFallbackTransition`): smoothstep opacity tween when capture / texImage2D fails
137
+ - Engine mode skips GL/capture when `window.__HF_VIRTUAL_TIME__` set (producer uses metadata)
138
+
139
+ You can also **write custom GLSL shaders from scratch** — any fragment shader works with the standard uniforms.
140
+
141
+ ---
142
+
143
+ ## 4. CSS scene transitions (30+ named patterns)
144
+
145
+ Documented in skills/hyperframes/references/transitions/ across 14 category files. All GSAP-driven, none mixable with shader transitions in same composition.
146
+
147
+ ### By category
148
+
149
+ | Category | Patterns |
150
+ | -------------------------------- | ------------------------------------------------------------------------------------------------ |
151
+ | Push / slide (css-push.md) | Push slide, vertical push, elastic push, squeeze |
152
+ | Scale / zoom (css-scale.md) | Zoom through, zoom out, scale-up swap |
153
+ | Radial / clip (css-radial.md) | Circle iris, diamond iris, diagonal split |
154
+ | 3D (css-3d.md) | 3D card flip, hinge door |
155
+ | Blur (css-blur.md) | Crossfade, blur crossfade, focus pull |
156
+ | Dissolve (css-dissolve.md) | Color dip (gap-to-black), staggered color blocks (2-block, 5-block) |
157
+ | Cover (css-cover.md) | Horizontal blinds, vertical blinds (variable strip counts: 6 / 12 / 20) |
158
+ | Light (css-light.md) | Light leak overlays, overexposure burn, film burn |
159
+ | Distortion (css-distortion.md) | Glitch (CSS — RGB layer jitter), chromatic aberration, ripple |
160
+ | Mechanical (css-mechanical.md) | Shutter (two-half), clock wipe (9-point rotating wedge) |
161
+ | Grid (css-grid.md) | Grid dissolve (12 or 120 cells), grid pixelate wipe |
162
+ | Destruction (css-destruction.md) | Page burn (SVG clip-path + canvas char rim) |
163
+ | Other (css-other.md) | VHS tape (strip-based seeded jitter), gravity drop, morph circle, blur through, directional blur |
164
+ | Rejected | Star iris, tilt-shift, lens flare (don't use — non-CSS-realistic) |
165
+
166
+ ### Timing presets
167
+
168
+ | Preset | duration | ease |
169
+ | -------- | -------- | ---------------------- |
170
+ | snappy | 0.2s | power4.inOut |
171
+ | smooth | 0.4s | power2.inOut |
172
+ | gentle | 0.6s | sine.inOut |
173
+ | dramatic | 0.5s | power3.in → power3.out |
174
+ | instant | 0.15s | expo.inOut |
175
+ | luxe | 0.7s | power1.inOut |
176
+
177
+ ---
178
+
179
+ ## 5. Visual effects + textures
180
+
181
+ ### Marker/emphasis patterns (css-patterns.md)
182
+
183
+ | Mode | What it does | Implementation |
184
+ | --------- | --------------------------------- | ----------------------------------------- |
185
+ | highlight | Yellow bar wipes behind text | CSS bar + GSAP scaleX 0→1 |
186
+ | circle | Hand-drawn red ring around word | CSS border ellipse + back.out scale |
187
+ | burst | 12 radial spikes from word center | DOM line array, --len/--angle vars |
188
+ | scribble | Wavy underline drawn over time | SVG `<path>` quadratic + stroke-dash GSAP |
189
+ | sketchout | Cross-hatch x-out over text | Two 2px rotated lines |
190
+
191
+ ### Grain / noise
192
+
193
+ - **grain-overlay** (registry component): SVG feTurbulence data-URL + CSS keyframe jitter, `steps(1)`, default opacity 0.15
194
+ - **Layered radial-gradient grain** (preferred pattern): no SVG, no canvas-taint, fast everywhere
195
+
196
+ ### Light / film
197
+
198
+ - Light leak transitions (CSS + shader variants)
199
+ - Overexposure burn — `brightness()` ramp + flash overlay
200
+ - Film burn — multi-layer amber/orange/red radials
201
+ - Vignette — radial-gradient overlay
202
+ - Paper texture (in registry/examples/warm-grain/)
203
+
204
+ ### Glow
205
+
206
+ - Caption text glow: textShadow radius keyed to treble bands (always on active words only, never parents)
207
+ - Radial glow backgrounds: CSS gradients / blurred blobs
208
+
209
+ ---
210
+
211
+ ## 6. Caption techniques
212
+
213
+ ### Animation styles
214
+
215
+ - Baseline: per-word karaoke highlight (every energy level)
216
+ - Intensity tiers: accent + glow + 15% scale (high energy) → 3% scale (low energy)
217
+ - Exits by energy (dynamic-techniques.md): scatter, drop, collapse, fade+slide, fade
218
+ - Tone mappings (captions.md): scale-pop `back.out(1.7)`, fade+slide `power3.out`, typewriter, bounce, `elastic.out`, word-by-word
219
+
220
+ ### Per-word styling triggers
221
+
222
+ - Brand/product names
223
+ - ALL CAPS
224
+ - Numbers / stats
225
+ - Emotional keywords
226
+ - CTAs
227
+ - Marker highlight modes (5 listed above)
228
+
229
+ ### Audio sources for caption timing
230
+
231
+ | Source | Format | Granularity |
232
+ | ------------------------------------------ | -------- | ----------------- |
233
+ | hyperframes transcribe (local whisper.cpp) | JSON | Word-level |
234
+ | OpenAI verbose_json | JSON | Word-level |
235
+ | Groq verbose_json | JSON | Word-level |
236
+ | Manually authored | JSON | Word-level |
237
+ | SRT | text | Phrase-level only |
238
+ | VTT | text | Phrase-level only |
239
+ | hyperframes tts → transcribe chain | wav→json | Word-level |
240
+
241
+ ### Positioning helpers
242
+
243
+ - Landscape: bottom 80–120px centered
244
+ - Portrait: ~600–700px from bottom
245
+ - `window.__hyperframes.fitTextFontSize(text, {maxWidth, fontFamily, fontWeight})` for dynamic sizing
246
+
247
+ ---
248
+
249
+ ## 7. Audio-reactive animation
250
+
251
+ ### Data shape
252
+
253
+ ```js
254
+ window.AUDIO_DATA = {
255
+ fps: 30,
256
+ totalFrames: 900,
257
+ frames: [{ bands: [0.42, 0.18, ...] }] // bands normalized 0–1 per band across track
258
+ };
259
+ ```
260
+
261
+ Index 0 = bass, higher = treble. Bands range 0–1, normalized across full track length.
262
+
263
+ ### Mappings documented
264
+
265
+ | Band | Property |
266
+ | --------------------- | ---------------------------- |
267
+ | Bass (bands[0–1]) | scale (pulse) |
268
+ | Mid (bands[4–8]) | borderRadius, width |
269
+ | Treble (bands[12–14]) | textShadow, boxShadow (glow) |
270
+ | Overall amplitude | opacity, y, backgroundColor |
271
+
272
+ Any GSAP-tweenable property is fair game — including clipPath, filter, SVG attrs, CSS variables.
273
+
274
+ ### Extraction
275
+
276
+ ```bash
277
+ python3 .../extract-audio-data.py audio.mp3 --fps 30 --bands 8
278
+ ```
279
+
280
+ Pre-extracted only — no Web Audio at render time.
281
+
282
+ ### Banned in audio-reactive
283
+
284
+ EQ bars, spectrum UI, generic waveforms, note clip-art, generic particles, rainbow cycling, white strobe on beats, abstract pulsing orbs.
285
+
286
+ ---
287
+
288
+ ## 8. HTML-in-canvas
289
+
290
+ Documented in skills/hyperframes/references/html-in-canvas-patterns.md (504 lines).
291
+
292
+ ### Capability
293
+
294
+ - Chrome's experimental `layoutSubtree` + `drawElementImage` rasterizes live DOM into canvas
295
+ - Feature detection: `isHtmlInCanvasCaptureSupported()`
296
+ - Used by shader-transitions for scene textures
297
+ - Combined with Three.js: `CanvasTexture` + post-processing
298
+
299
+ ### Available patterns
300
+
301
+ - HTML on a Three.js plane (displacement, distortion, liquid sim)
302
+ - HTML in shaders (texture sampling for VFX)
303
+ - Recursive HTML-in-canvas-in-shader-in-HTML
304
+
305
+ ### Experimental VFX blocks using this
306
+
307
+ - `vfx-iphone-device` (GLTF iPhone + MacBook, HTML screens)
308
+ - `vfx-liquid-background` (liquid sim displaces HTML)
309
+ - `vfx-liquid-glass`
310
+ - `vfx-magnetic`
311
+ - `vfx-portal`
312
+ - `vfx-shatter`
313
+ - `vfx-text-cursor` (chromatic edges, canvas post)
314
+
315
+ ---
316
+
317
+ ## 9. Three.js / WebGL custom scenes
318
+
319
+ ### Integration pattern
320
+
321
+ ```js
322
+ window.addEventListener("hf-seek", (e) => {
323
+ const time = e.detail.time;
324
+ mixer.setTime(time);
325
+ shaderUniforms.u_time.value = time;
326
+ renderer.render(scene, camera);
327
+ });
328
+ ```
329
+
330
+ - Load: `import * as THREE from "https://cdn.jsdelivr.net/npm/three@0.181.2/+esm"`
331
+ - Deterministic: every frame must derive from `time`, never `requestAnimationFrame` / `Date.now()`
332
+ - Includes: AnimationMixer, custom GLSL shaders, post-processing, GLTF models, lights, cameras, materials
333
+
334
+ ---
335
+
336
+ ## 10. SVG / canvas / variable fonts (other authored techniques)
337
+
338
+ (From skills/hyperframes/references/techniques.md)
339
+
340
+ | Technique | Mechanism |
341
+ | ------------------------ | ------------------------------------------------------------------------------------ |
342
+ | SVG path drawing | `strokeDasharray` + `getTotalLength()` + GSAP stroke offset |
343
+ | Canvas 2D procedural art | Seeded hash function + `tl.to` proxy `{time}` onUpdate |
344
+ | CSS 3D card | GSAP `rotationY` + `perspective: 900` |
345
+ | Per-word kinetic type | GSAP timings array, sliding decay |
346
+ | Variable font axes | Animate CSS vars → `font-variation-settings: "opsz" var(--opsz), "wght" var(--wght)` |
347
+ | Character typing | `tl.call` text mutation + `steps(1)` cursor blink |
348
+ | Velocity-matched cuts | Match outgoing blur/translate velocity to incoming for seamless beats |
349
+ | MotionPathPlugin | `gsap.registerPlugin(MotionPathPlugin)` + path string |
350
+
351
+ ---
352
+
353
+ ## 11. Media: video, audio, TTS
354
+
355
+ ### Video compositing
356
+
357
+ - `<video muted playsinline data-start="..." data-duration="..." data-track-index="..." src="...">`
358
+ - HyperFrames extracts frames at render via videoFrameInjector (avoids unreliable headless `<video>` playback)
359
+ - Linter forbids `<video>` with audio at the same time — split into separate `<video muted>` + `<audio>`
360
+ - Video frame extraction uses FFmpeg
361
+ - HDR videos: PQ or HLG transfer detection + x265 with mastering metadata
362
+
363
+ ### Audio mixer
364
+
365
+ - `<audio id="..." data-start="..." data-duration="..." data-volume="0.8" data-track-index="2" src="...">`
366
+ - Multiple tracks mixed with `amix normalize=0` + per-track adelay + volume
367
+ - Master audioGain from EngineConfig
368
+ - Output: AAC 192kbps
369
+
370
+ ### TTS (Kokoro-82M, local)
371
+
372
+ - 54 bundled voices with prefixes: `a` American EN, `b` British EN, `e` Spanish, `f` French, `h` Hindi, `i` Italian, `j` Japanese, `p` Brazilian Portuguese, `z` Mandarin
373
+ - Default voice: `af_heart`
374
+ - Speed: 0.1–3.0 (default 1.0)
375
+ - Languages: en-us, en-gb, es, fr-fr, hi, it, pt-br, ja, zh (non-EN needs system espeak-ng)
376
+ - Output: WAV; no pitch/volume CLI flags
377
+ - No API key required
378
+
379
+ ### Transcription
380
+
381
+ - Whisper.cpp models: tiny, base, small, medium, large-v3, small.en, medium.en (default small)
382
+ - Groq API: whisper-large-v3 with word granularities
383
+ - OpenAI API: whisper-1 verbose_json
384
+ - Imports: SRT, VTT, JSON formats
385
+ - Quality gates: music-token detection, garbage cleaning, retry with medium.en
386
+
387
+ ### Background removal
388
+
389
+ - u2net ONNX models
390
+ - Devices: auto / cpu / coreml / cuda
391
+ - Quality presets: fast / balanced / best
392
+ - Outputs: transparent WebM, ProRes MOV, PNG sequence
393
+ - Optional dual output (foreground + extracted background)
394
+
395
+ ---
396
+
397
+ ## 12. Registry — 51 blocks + 4 components + 8 examples
398
+
399
+ ### Blocks by category
400
+
401
+ **Social overlays (8):** instagram-follow, tiktok-follow, yt-lower-third, x-post, reddit-post, spotify-card, macos-notification, blue-sweater-intro-video
402
+
403
+ **Showcases (5):** app-showcase (3D phones), north-korea-locked-down (map + annotation), apple-money-count (counter + SFX), vpn-youtube-spot (app-store scroll), nyc-paris-flight (map + plane path)
404
+
405
+ **Data viz (2):** data-chart (animated bar+line, NYT-style), flowchart + flowchart-vertical (decision tree with SVG connectors, typing correction)
406
+
407
+ **Logo / branding (1):** logo-outro (build + glow + tagline + URL pill)
408
+
409
+ **3D / experimental VFX (8):** ui-3d-reveal, vfx-iphone-device (GLTF), vfx-liquid-background, vfx-liquid-glass, vfx-magnetic, vfx-portal, vfx-shatter, vfx-text-cursor
410
+
411
+ **Single shader transitions (14):** one block per named shader — domain-warp-dissolve, ridged-burn, whip-pan, sdf-iris, ripple-waves, gravitational-lens, cinematic-zoom, chromatic-radial-split, glitch, swirl-vortex, thermal-distortion, flash-through-white, cross-warp-morph, light-leak
412
+
413
+ **Transition galleries (13 showcase pieces):** transitions-3d, transitions-blur, transitions-cover, transitions-destruction, transitions-dissolve, transitions-distortion, transitions-grid, transitions-light, transitions-mechanical, transitions-other, transitions-push, transitions-radial, transitions-scale
414
+
415
+ ### Components (4 reusable snippets)
416
+
417
+ - **grain-overlay** — SVG feTurbulence + CSS keyframes
418
+ - **shimmer-sweep** — Light sweep gradient mask on text
419
+ - **grid-pixelate-wipe** — Grid squares stagger fade scene wipe
420
+ - **texture-mask-text** — Luminance-masked letterforms with 66 mask PNGs (Masonry, Stone, Ground/Road, Wood, Metal, Organic/Soft texture categories)
421
+
422
+ ### Examples (8 starter projects)
423
+
424
+ warm-grain, play-mode, swiss-grid, vignelli, decision-tree, kinetic-type, product-promo, nyt-graph
425
+
426
+ Install: `npx hyperframes add <name>` for blocks/components, `hyperframes init <dir> --example <name>` for examples.
427
+
428
+ ---
429
+
430
+ ## 13. CLI — 25 commands
431
+
432
+ | Command | Purpose |
433
+ | ----------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
434
+ | init | Scaffold project from template/example (interactive or --non-interactive) |
435
+ | add | Install registry block / component |
436
+ | catalog | Browse registry blocks/components (--type, --tag, --json, --human-friendly picker) |
437
+ | play | Lightweight browser player (default port 3003) |
438
+ | preview | Studio dev server (port 3002; --force-new, --list, --kill-all) |
439
+ | publish | Zip + upload + return hyperframes.dev URL |
440
+ | render | Render to MP4 / WebM / MOV / PNG sequence — flags: --fps 24/30/60, --quality draft/standard/high, --workers, --docker, --hdr/--sdr, --crf, --video-bitrate, --gpu, --browser-gpu auto/software/hardware, --max-concurrent-renders 1-10, --variables JSON, --variables-file PATH, --strict-variables, --resolution preset |
441
+ | lint | Static lint (--json, --verbose) |
442
+ | validate | Bundle + headless Chrome + console + contrast (--contrast default true, --timeout 3000) |
443
+ | inspect / layout | Visual layout audit (overflow detection at N timestamps; --samples 9, --at, --tolerance 2, --max-issues 80) |
444
+ | info | Print project metadata |
445
+ | compositions | List compositions (root + sub-comps) |
446
+ | benchmark | 5 preset configs × N runs (--runs 3) |
447
+ | browser | Manage Chrome (ensure/path/clear) |
448
+ | remove-background | u2net + FFmpeg → transparent video |
449
+ | transcribe | whisper.cpp or import SRT/VTT/JSON |
450
+ | tts | Kokoro-82M (--voice, --speed, --lang, --list) |
451
+ | docs | Print bundled markdown topics (data-attributes, examples, rendering, gsap, troubleshooting, compositions) |
452
+ | doctor | Environment checklist (Node, CPU, memory, disk, FFmpeg, FFprobe, Chrome, Docker) |
453
+ | upgrade | npm update check + optional global install |
454
+ | skills | Run `npx skills add heygen-com/hyperframes --all` |
455
+ | telemetry | enable/disable/status |
456
+ | snapshot | PNG screenshots at timeline timestamps |
457
+ | capture | Capture URL → site assets + screenshots + design tokens (uses Puppeteer + optional Gemini vision) |
458
+
459
+ ### Website capture (`hyperframes capture <url>`)
460
+
461
+ Detects these libraries on captured sites (for context labeling): GSAP / ScrollTrigger, Three.js, Lottie, Anime.js, PixiJS, Babylon.js, Rive, Matter.js, Lenis, Framer Motion, Tailwind CSS, WebGL (shader fingerprinting). Captured outputs feed the website-to-video skill workflow.
462
+
463
+ ---
464
+
465
+ ## 14. Linter — 60+ rules
466
+
467
+ Across 8 files in packages/core/src/lint/rules/:
468
+
469
+ | Rule file | Catches |
470
+ | ----------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
471
+ | core | Missing composition-id, missing dimensions, missing timeline registry, registry mismatch, invalid script syntax, scoped-CSS issues, non-deterministic code |
472
+ | media | Duplicate media id, video missing muted, video nested in timed element, placeholder URLs, base64 prohibited, missing src/start/id, imperative play()/pause()/seek() |
473
+ | gsap | Overlapping tweens, exit missing hard kill, GSAP animating .clip element, unscoped selectors, CSS transform conflict, missing GSAP script, infinite repeat (repeat: -1), repeat ceil overshoot, scene layer visibility kill, audio-reactive single-tween-per-group |
474
+ | captions | Caption exit missing kill, text overflow risk, transcript not inline, parse error, container position, scale mismatch, textShadow on parent container |
475
+ | composition | File too large, dense tracks, missing class="clip", deprecated data-layer/data-end, split attribute selectors, external script deps, RAF in composition, invalid variable JSON |
476
+ | adapters | Missing Lottie script, missing Three script |
477
+ | textures | Drop-shadow on text, class missing base, text missing mask, unknown texture class |
478
+ | fonts | Google Fonts import (use @font-face), font-family without @font-face |
479
+
480
+ Plus async URL checks (`lintMediaUrls`, `lintScriptUrls` — HEAD probes).
481
+
482
+ `validateCompositionGsap` also forbids: `Math.random`, `Date.now`, `new Date`, `setTimeout`, `setInterval`, `requestAnimationFrame`, `repeat: -1`.
483
+
484
+ **Note:** `onUpdate` callbacks, `tl.call()`, and GSAP event callbacks (`onComplete`, `onStart`, etc.) are NOT banned by the linter — they are required for canvas/WebGL rendering and character-by-character typing patterns. The linter only catches the determinism violations listed above.
485
+
486
+ ---
487
+
488
+ ## 15. Player — `<hyperframes-player>` web component
489
+
490
+ ### Attributes
491
+
492
+ `src`, `srcdoc`, `width`, `height`, `controls`, `muted`, `volume`, `poster`, `playback-rate`, `audio-src`, `shader-capture-scale`, `shader-loading` (internal|player|none), `loop`, `autoplay`, `speed-presets`
493
+
494
+ ### Public API
495
+
496
+ `seek(t)` (synchronous when same-origin — uses `iframe.contentWindow.__player.seek` directly), `play()`, `pause()`, `currentTime`, `duration`, `paused`, `ready`, `playbackRate`, `iframeElement`
497
+
498
+ ### Events
499
+
500
+ `ready`, `timeupdate`, `play`, `pause`, `ended`, `volumechange`, `ratechange`, `shadertransitionstate`, `playbackerror`, `error`, `audioownershipchange`
501
+
502
+ ### Media mirror
503
+
504
+ Parent audio/video elements with `data-start` are proxied; `_mirrorParentMediaTime` corrects drift; `_audioOwner` promotes to parent if autoplay blocked.
505
+
506
+ ### Runtime auto-inject
507
+
508
+ Loads `RUNTIME_CDN_URL` (`@hyperframes/core/dist/hyperframe.runtime.iife.js`) if missing `__hf`/`__player` but timelines exist.
509
+
510
+ ---
511
+
512
+ ## 16. Engine + Producer — rendering pipeline
513
+
514
+ ### Output formats
515
+
516
+ mp4, webm, mov, png-sequence — with HDR (PQ / HLG / SDR / auto-detect), transparency (ProRes MOV / WebM / PNG), or standard 8-bit SDR
517
+
518
+ ### Encoding controls
519
+
520
+ - `--fps`: 24 / 30 / 60
521
+ - `--quality`: draft / standard / high
522
+ - `--crf`: integer (mutually exclusive with `--video-bitrate`)
523
+ - `--video-bitrate`: e.g. `8M`
524
+ - `--gpu`: NVENC, VideoToolbox, VAAPI, QSV
525
+ - `--browser-gpu`: auto / software / hardware
526
+ - `--workers`: parallel render workers
527
+ - `--max-concurrent-renders`: 1–10 (sets `PRODUCER_MAX_CONCURRENT_RENDERS`)
528
+ - `--resolution`: preset (1080p, 4k, portrait, etc.)
529
+ - `--docker`: render inside Dockerfile.test image (reproducibility)
530
+ - `--hdr` / `--sdr`: force HDR or SDR pipeline
531
+
532
+ ### Engine subsystems
533
+
534
+ - Frame capture: BeginFrame on Linux headless-shell (fast, no alpha) or `Page.captureScreenshot` (alpha + supersample)
535
+ - Video frame injector: pre-extracts video to images, swaps `<video>` for `<img>` during capture (LRU cache by path + byte budget)
536
+ - Audio mixer: FFmpeg-based; per-track delay, volume, master gain, AAC 192k output
537
+ - Chunk encoder: H.264 / H.265 / VP9 / ProRes presets with optional GPU
538
+ - Streaming encoder: `streamingEncodeMaxDurationSeconds` for long renders
539
+ - HDR compositing: `rgba16float` WebGPU readback (headed Chrome), PQ OETF helpers
540
+ - Layer compositor: groups DOM by z-order; splits HDR elements into separate layers
541
+ - Alpha blit: matrix3d affine extraction, `blitRgba8OverRgb48le`, `blitRgb48leAffine`
542
+ - Parallel coordinator: concurrency, coresPerWorker, minParallelFrames, largeRenderThreshold
543
+ - Browser pool: optional with timeout configs
544
+
545
+ ### Producer-only
546
+
547
+ - `RenderConfig` with `hdrMode` (auto / force-hdr / force-sdr), `outputResolution` mapped to `deviceScaleFactor`
548
+ - File server injects `HF_EARLY_STUB`, `HF_BRIDGE_SCRIPT`, virtual-time so `window.__hf` bridges `window.__player.renderSeek`
549
+ - HDR-aware shader transition compositing via `window.__hf.transitions` metadata
550
+
551
+ ---
552
+
553
+ ## 17. Studio — in-browser NLE
554
+
555
+ Full editor in packages/studio/:
556
+
557
+ - **NLELayout**: NLE preview + timeline + controls
558
+ - **Timeline**: clip rendering, drag to move (`data-start`), resize (`data-duration`), `data-track-index` reassignment, asset drop, file drop
559
+ - **PlayerControls**: scrub, play, pause, frame step (`stepFrameTime`), `STUDIO_PREVIEW_FPS`
560
+ - **useTimelinePlayer**: resolves `__player` / `__timeline` / `__timelines`
561
+ - **LeftSidebar**: compositions list, asset browser
562
+ - **RenderQueue + useRenderQueue**: queue multiple renders
563
+ - **LintModal**: in-app lint output
564
+ - **MediaPreview + AudioWaveform**: waveform rendering
565
+ - **CaptionOverlay, CaptionTimeline, CaptionPropertyPanel**: caption editor
566
+ - **useCaptionSync**: word-level sync
567
+ - **useElementPicker**: click-to-inspect picker mode
568
+ - Built with Tailwind v3 (separate from Tailwind v4 browser runtime used by compositions).
569
+
570
+ ---
571
+
572
+ ## 18. Determinism guarantees
573
+
574
+ - No `Math.random()` (use seeded PRNGs; mulberry32 is the pattern in skills)
575
+ - No `Date.now()` / `new Date()`
576
+ - No `setTimeout` / `setInterval` in timeline construction
577
+ - No `requestAnimationFrame` (timeline-driven; engine seeks per frame)
578
+ - No `repeat: -1` (calculate exact repeats: `Math.ceil(duration / cycleDuration) - 1`)
579
+ - No `onComplete`/`onStart`/`onRepeat` callbacks (engine doesn't fire them). **Exception:** `onUpdate` and `tl.call()` ARE supported — they're required for canvas/WebGL rendering, character-by-character typing, and counter patterns. See §10 (Canvas 2D procedural art) for the documented pattern.
580
+ - No `gsap.set` on clips from later scenes (use `tl.set(selector, vars, position)`)
581
+ - Synchronous timeline construction (no async)
582
+ - Master clock can clamp at composition end
583
+
584
+ ---
585
+
586
+ ## 19. Variables / parameterization
587
+
588
+ Compositions support typed runtime variables:
589
+
590
+ ```html
591
+ <html
592
+ data-composition-variables='[
593
+ {"name":"brand","type":"string","default":"Stripe"},
594
+ {"name":"primary","type":"color","default":"#635BFF"},
595
+ {"name":"duration","type":"number","default":15},
596
+ {"name":"darkMode","type":"boolean","default":false},
597
+ {"name":"layout","type":"enum","options":["hero","split","stacked"]}
598
+ ]'
599
+ ></html>
600
+ ```
601
+
602
+ Access via `window.__hyperframes.getVariables()`. Override at render time:
603
+
604
+ ```bash
605
+ npx hyperframes render --variables '{"brand":"Linear","primary":"#5E6AD2"}'
606
+ npx hyperframes render --variables-file vars.json
607
+ npx hyperframes render --strict-variables # error if unused / mismatched
608
+ ```
609
+
610
+ `validateVariables()` checks values against declarations at the CLI/tooling boundary.
611
+
612
+ ---
613
+
614
+ ## 20. Sub-compositions
615
+
616
+ Two loading mechanisms:
617
+
618
+ - **External file:** `data-composition-src="compositions/act-1.html"` — fetched at runtime
619
+ - **Inline template:** `<template id="<id>-template">` — extracted by `loadInlineTemplateCompositions`
620
+
621
+ Each sub-comp:
622
+
623
+ - Has its own `data-composition-id`
624
+ - Has its own `window.__timelines[<id>]`
625
+ - Auto-nested into the root timeline
626
+ - Scoped CSS via `scopeCssToComposition` (`[data-composition-id="<id>"]` selector)
627
+ - Wrapped scripts via `wrapScopedCompositionScript`
628
+ - Reads `data-variable-values` merged with own defaults into `window.__hfVariablesByComp[<id>]`
629
+ - External scripts load with `EXTERNAL_SCRIPT_LOAD_TIMEOUT_MS` timeout. Failed loads emit `external_composition_load_failed` / `external_composition_script_load_issue` diagnostics.
630
+
631
+ ---
632
+
633
+ ## 21. Global runtime APIs (`window.*`)
634
+
635
+ | Global | Purpose |
636
+ | ------------------------------------- | ----------------------------------------------------------------------- |
637
+ | `__hyperframes` | `{ fitTextFontSize, getVariables }` |
638
+ | `__timelines` | `{ [compositionId]: GsapTimeline }` |
639
+ | `__player` | Internal player bridge: seek, play, pause, renderSeek, etc. |
640
+ | `__clipManifest` | Computed clip array (for Studio) |
641
+ | `__playerReady` | Resolved when player ready |
642
+ | `__renderReady` | Resolved when ready for render capture |
643
+ | `__HF_PARITY_MODE` | Engine parity flag |
644
+ | `__HF_FPS` | Render FPS hint |
645
+ | `__HF_MAX_DURATION_SEC` | Engine clamp |
646
+ | `__HF_VIRTUAL_TIME__` | Set by engine in render mode (shader-transitions switches paths) |
647
+ | `__hfThreeTime` | Current time for Three.js adapter |
648
+ | `__HF_PICKER_API` | Element picker hook for Studio |
649
+ | `__hfAnime` | Array of Anime.js instances |
650
+ | `__hfLottie` | Array of Lottie animations |
651
+ | `__hfVariables` | Resolved root variables |
652
+ | `__hfVariablesByComp` | Per-composition variable map |
653
+ | `__hfRuntimeTeardown` | Cleanup function |
654
+ | `__tailwindReady` | Tailwind browser build ready (gates capture) |
655
+ | `__hf.transitions` | Shader transition metadata (read by producer for HDR-aware compositing) |
656
+ | `__beforeTimeline`, `__afterTimeline` | Optional user hooks |
657
+ | `__afterRender`, `__beforeRender` | Optional user hooks |
658
+ | `gsap`, `THREE`, `anime`, `lottie` | Library globals |
659
+
660
+ Control bridge actions: play, pause, seek, set-muted, set-playback-rate, enable-pick-mode, disable-pick-mode, set-volume, set-media-output-muted.
661
+
662
+ ---
663
+
664
+ ## 22. Skills available — 16
665
+
666
+ | Skill | Purpose |
667
+ | ------------------------- | ----------------------------------------------------------------------- |
668
+ | hyperframes | Core framework skill (composition authoring) |
669
+ | hyperframes-cli | All CLI commands as an agent skill |
670
+ | hyperframes-media | Media workflows (TTS, transcribe, captions integration) |
671
+ | hyperframes-registry | Installing blocks/components |
672
+ | hyperframes-contrast | WCAG audit (scripts/contrast-report.mjs) |
673
+ | hyperframes-animation-map | Per-tween bbox + flags report |
674
+ | website-to-video | Capture → DESIGN.md → brief → storyboard+script → VO → build → validate |
675
+ | remotion-to-hyperframes | Migration patterns + API map + CustomEase |
676
+ | gsap | GSAP API + plugins reference |
677
+ | animejs | Anime.js v4 patterns |
678
+ | css-animations | @keyframes patterns |
679
+ | waapi | Web Animations API |
680
+ | lottie | Lottie integration |
681
+ | three | Three.js + deterministic seek |
682
+ | tailwind | Tailwind browser runtime v4 |
683
+ | contribute-catalog | Adding blocks to registry |
684
+
685
+ ---
686
+
687
+ ## 23. References inventory (skills/hyperframes/references/)
688
+
689
+ 16 reference docs covering:
690
+
691
+ - text-effects.md — 24 named text animation effects (per-character, per-word, per-line, whole) — vocabulary reference for the separate `pixel-point/animate-text` skill (load it via `npx skills add pixel-point/animate-text` or `/animate-text`). Specs live in that upstream skill, not in this repo.
692
+ - transitions.md + transitions/catalog.md + 14 category subfiles
693
+ - css-patterns.md (marker patterns)
694
+ - dynamic-techniques.md (caption animation)
695
+ - motion-principles.md (easing as emotion, choreography)
696
+ - typography.md (banned-font list, pairing rules, variable fonts)
697
+ - narration.md (script + VO pacing)
698
+ - captions.md (caption authoring contract)
699
+ - audio-reactive.md (band mappings + extraction)
700
+ - transcript-guide.md (whisper, Groq, OpenAI workflows)
701
+ - techniques.md (the big technique catalog — SVG, canvas 2D, 3D, kinetic, lottie, variable fonts, MotionPath, audio-reactive)
702
+ - beat-direction.md, design-picker.md, prompt-expansion.md, video-composition.md
703
+ - visual-styles.md (8 named visual styles: Swiss Pulse, Velvet Standard, Deconstructed, Maximalist Type, Data Drift, Soft Signal, Folk Frequency, Shadow Cut — available via the `visual-style` skill)
704
+
705
+ ---
706
+
707
+ ## 24. Documentation pages (docs/)
708
+
709
+ 27 mdx pages in docs/guides/ and docs/packages/:
710
+
711
+ **Guides:** 4k-rendering, claude-design, common-mistakes, deploy, gsap-animation, hdr, html-in-canvas, hyperframes-vs-remotion, open-design, performance, prompting, remove-background, rendering, timeline-editing, troubleshooting, video-editor-cheatsheet, website-to-video, etc.
712
+
713
+ **Packages:** cli.mdx, core.mdx, engine.mdx, player.mdx, producer.mdx, studio.mdx