takomi 2.1.45 → 2.5.4

package/assets/.agent/skills/remotion-to-hyperframes/references/eval.md

@@ -1,140 +1,140 @@
-# Eval: how to validate a translation end-to-end
-
-Every translation should be measured. The skill ships three scripts and
-a tiered test corpus that, together, gate translation quality.
-
-## The three scripts
-
-| Script                   | Input                       | Output                                                              |
-| ------------------------ | --------------------------- | ------------------------------------------------------------------- |
-| `scripts/lint_source.py` | Remotion source dir or file | JSON findings + exit code (0 clean, 1 has blockers)                 |
-| `scripts/render_diff.sh` | two MP4 paths               | per-frame SSIM + JSON summary (`mean`, `min`, `p05`, `p95`, `pass`) |
-| `scripts/frame_strip.sh` | two MP4 paths               | side-by-side comparison strip PNG for visual debugging              |
-
-Run them in this order: **lint → render → diff → (if fail) strip**.
-
-## Per-fixture flow
-
-```bash
-# 1. Lint the source — blockers mean stop
-python3 ../../scripts/lint_source.py ./remotion-src/src/
-
-# 2. Generate any binary assets (T2+T3 only)
-[ -f setup.sh ] && ./setup.sh
-
-# 3. Render Remotion baseline
-cd remotion-src && npm install && npm run render
-# -> remotion-src/out/baseline.mp4
-
-# 4. Render HF translation
-cd .. && node ../../../packages/cli/dist/cli.js render hf-src/ --output hf.mp4
-# -> hf.mp4
-
-# 5. SSIM diff
-../../scripts/render_diff.sh ./remotion-src/out/baseline.mp4 ./hf.mp4 ./diff
-# -> diff/summary.json
-
-# 6. If diff fails, generate frame strip for visual inspection
-../../scripts/frame_strip.sh ./remotion-src/out/baseline.mp4 ./hf.mp4 ./strip 8
-# -> strip/strip.png
-```
-
-## Reading `diff/summary.json`
-
-```json
-{
-  "frame_count": 90,
-  "mean": 0.974,
-  "min": 0.972,
-  "max": 0.999,
-  "p05": 0.972,
-  "p95": 0.983,
-  "threshold": 0.95,
-  "pass": true
-}
-```
-
-| Field         | What it tells you                                                           |
-| ------------- | --------------------------------------------------------------------------- |
-| `mean`        | average SSIM across all frames; the headline number                         |
-| `min`         | worst frame; below threshold means at least one frame is structurally wrong |
-| `p05` / `p95` | 5th / 95th percentile — most frames sit between these                       |
-| `threshold`   | from `R2HF_SSIM_THRESHOLD` env var (default 0.85)                           |
-| `pass`        | whether `mean >= threshold`                                                 |
-
-## Validated tier thresholds
-
-Calibrated against actual Remotion + HF renders:
-
-| Tier | Composition shape                           | Mean  | Threshold | Margin |
-| ---- | ------------------------------------------- | ----- | --------- | ------ |
-| T1   | single-element fade-in                      | 0.974 | 0.95      | +0.022 |
-| T2   | multi-scene + spring + audio + image        | 0.985 | 0.95      | +0.016 |
-| T3   | data-driven, custom subcomponents, count-up | 0.953 | 0.90      | +0.038 |
-
-Each fixture's `expected.json` carries:
-
-- `ssim_threshold` — the gate for `pass`
-- `validation` — the actual measured numbers from the calibration run
-- `translation_notes` — what's lossy and why
-
-## Critical: encoder config
-
-Both Remotion and HF must output the same pixel format for SSIM to be
-meaningful. Remotion's default JPEG output writes `yuvj420p` (full-range);
-HF outputs `yuv420p` (limited-range). The mismatch costs ~0.05 SSIM.
-
-Every fixture's `remotion.config.ts` sets:
-
-```ts
-Config.setVideoImageFormat("png");
-Config.setColorSpace("bt709");
-```
-
-If the user's source doesn't have these, add them in the translation
-step — otherwise the diff measures encoder differences, not translation
-fidelity.
-
-## What the noise floor looks like
-
-The dominant non-translation noise is **system font fallback divergence**.
-Remotion's bundled Chromium and HF's `chrome-headless-shell` interpret
-`font-weight: 800` differently when there's no real font installed:
-
-- Remotion HELLO at 160px: medium-weight stroke
-- HF HELLO at 160px: heavy-weight stroke
-
-This costs ~0.025 mean SSIM. Visible in T1's frame strip.
-[fonts.md](fonts.md) covers how to mitigate (use Inter, load explicit
-Google Fonts).
-
-## Threshold rule of thumb
-
-Set the threshold ~0.02 below measured `p05`:
-
-- Real translation regressions drop mean by 0.05+ — caught.
-- Encoder/font drift between CI runs is bounded at ~0.01 — not caught.
-
-If a calibration run's measured mean is far above your initial threshold
-guess, _don't_ tighten the threshold to fit. Leave headroom — fixtures
-re-rendered on different hardware will drift.
-
-## When the diff fails
-
-1. **Look at `frame_strip.sh` output first.** A side-by-side strip at 6–10
-   evenly-spaced timestamps shows whether the failure is structural
-   (wrong scene durations, missing element) or cosmetic (different font
-   weight, slight timing skew).
-2. **Check `diff/ssim.log`.** Per-frame SSIM tells you _which_ frames
-   failed. Cluster of bad frames in the middle of a scene = animation
-   problem; bad frames at scene boundaries = sequencing problem.
-3. **Re-read the relevant reference.** [timing.md](timing.md) for
-   spring/easing issues, [sequencing.md](sequencing.md) for scene
-   boundary issues, [media.md](media.md) for asset loading issues.
-
-## CI integration
-
-The fixtures are not yet wired into CI (`packages/producer/tests/` runs
-inside Docker; the skill corpus needs the same). PR 7 of the stack adds
-the orchestrator that runs all four tiers and emits an aggregated pass
-report. For now, evaluate by hand per fixture.
+# Eval: how to validate a translation end-to-end
+
+Every translation should be measured. The skill ships three scripts and
+a tiered test corpus that, together, gate translation quality.
+
+## The three scripts
+
+| Script                   | Input                       | Output                                                              |
+| ------------------------ | --------------------------- | ------------------------------------------------------------------- |
+| `scripts/lint_source.py` | Remotion source dir or file | JSON findings + exit code (0 clean, 1 has blockers)                 |
+| `scripts/render_diff.sh` | two MP4 paths               | per-frame SSIM + JSON summary (`mean`, `min`, `p05`, `p95`, `pass`) |
+| `scripts/frame_strip.sh` | two MP4 paths               | side-by-side comparison strip PNG for visual debugging              |
+
+Run them in this order: **lint → render → diff → (if fail) strip**.
+
+## Per-fixture flow
+
+```bash
+# 1. Lint the source — blockers mean stop
+python3 ../../scripts/lint_source.py ./remotion-src/src/
+
+# 2. Generate any binary assets (T2+T3 only)
+[ -f setup.sh ] && ./setup.sh
+
+# 3. Render Remotion baseline
+cd remotion-src && npm install && npm run render
+# -> remotion-src/out/baseline.mp4
+
+# 4. Render HF translation
+cd .. && node ../../../packages/cli/dist/cli.js render hf-src/ --output hf.mp4
+# -> hf.mp4
+
+# 5. SSIM diff
+../../scripts/render_diff.sh ./remotion-src/out/baseline.mp4 ./hf.mp4 ./diff
+# -> diff/summary.json
+
+# 6. If diff fails, generate frame strip for visual inspection
+../../scripts/frame_strip.sh ./remotion-src/out/baseline.mp4 ./hf.mp4 ./strip 8
+# -> strip/strip.png
+```
+
+## Reading `diff/summary.json`
+
+```json
+{
+  "frame_count": 90,
+  "mean": 0.974,
+  "min": 0.972,
+  "max": 0.999,
+  "p05": 0.972,
+  "p95": 0.983,
+  "threshold": 0.95,
+  "pass": true
+}
+```
+
+| Field         | What it tells you                                                           |
+| ------------- | --------------------------------------------------------------------------- |
+| `mean`        | average SSIM across all frames; the headline number                         |
+| `min`         | worst frame; below threshold means at least one frame is structurally wrong |
+| `p05` / `p95` | 5th / 95th percentile — most frames sit between these                       |
+| `threshold`   | from `R2HF_SSIM_THRESHOLD` env var (default 0.85)                           |
+| `pass`        | whether `mean >= threshold`                                                 |
+
+## Validated tier thresholds
+
+Calibrated against actual Remotion + HF renders:
+
+| Tier | Composition shape                           | Mean  | Threshold | Margin |
+| ---- | ------------------------------------------- | ----- | --------- | ------ |
+| T1   | single-element fade-in                      | 0.974 | 0.95      | +0.022 |
+| T2   | multi-scene + spring + audio + image        | 0.985 | 0.95      | +0.016 |
+| T3   | data-driven, custom subcomponents, count-up | 0.953 | 0.90      | +0.038 |
+
+Each fixture's `expected.json` carries:
+
+- `ssim_threshold` — the gate for `pass`
+- `validation` — the actual measured numbers from the calibration run
+- `translation_notes` — what's lossy and why
+
+## Critical: encoder config
+
+Both Remotion and HF must output the same pixel format for SSIM to be
+meaningful. Remotion's default JPEG output writes `yuvj420p` (full-range);
+HF outputs `yuv420p` (limited-range). The mismatch costs ~0.05 SSIM.
+
+Every fixture's `remotion.config.ts` sets:
+
+```ts
+Config.setVideoImageFormat("png");
+Config.setColorSpace("bt709");
+```
+
+If the user's source doesn't have these, add them in the translation
+step — otherwise the diff measures encoder differences, not translation
+fidelity.
+
+## What the noise floor looks like
+
+The dominant non-translation noise is **system font fallback divergence**.
+Remotion's bundled Chromium and HF's `chrome-headless-shell` interpret
+`font-weight: 800` differently when there's no real font installed:
+
+- Remotion HELLO at 160px: medium-weight stroke
+- HF HELLO at 160px: heavy-weight stroke
+
+This costs ~0.025 mean SSIM. Visible in T1's frame strip.
+[fonts.md](fonts.md) covers how to mitigate (use Inter, load explicit
+Google Fonts).
+
+## Threshold rule of thumb
+
+Set the threshold ~0.02 below measured `p05`:
+
+- Real translation regressions drop mean by 0.05+ — caught.
+- Encoder/font drift between CI runs is bounded at ~0.01 — not caught.
+
+If a calibration run's measured mean is far above your initial threshold
+guess, _don't_ tighten the threshold to fit. Leave headroom — fixtures
+re-rendered on different hardware will drift.
+
+## When the diff fails
+
+1. **Look at `frame_strip.sh` output first.** A side-by-side strip at 6–10
+   evenly-spaced timestamps shows whether the failure is structural
+   (wrong scene durations, missing element) or cosmetic (different font
+   weight, slight timing skew).
+2. **Check `diff/ssim.log`.** Per-frame SSIM tells you _which_ frames
+   failed. Cluster of bad frames in the middle of a scene = animation
+   problem; bad frames at scene boundaries = sequencing problem.
+3. **Re-read the relevant reference.** [timing.md](timing.md) for
+   spring/easing issues, [sequencing.md](sequencing.md) for scene
+   boundary issues, [media.md](media.md) for asset loading issues.
+
+## CI integration
+
+The fixtures are not yet wired into CI (`packages/producer/tests/` runs
+inside Docker; the skill corpus needs the same). PR 7 of the stack adds
+the orchestrator that runs all four tiers and emits an aggregated pass
+report. For now, evaluate by hand per fixture.

package/assets/.agent/skills/remotion-to-hyperframes/references/fonts.md

@@ -1,112 +1,112 @@
-# Font translation
-
-Fonts are the dominant non-translation noise floor. Same `font-weight: 800`
-renders perceptibly bolder on HF's `chrome-headless-shell` than on
-Remotion's bundled Chromium when there's no real font installed. Validation
-showed this costs ~0.025 mean SSIM at the noise floor.
-
-## Pattern: `@remotion/google-fonts/<Family>`
-
-```tsx
-import { loadFont } from "@remotion/google-fonts/Inter";
-loadFont("normal", { weights: ["400", "800"] });
-```
-
-Translate to a `<link>` tag in `<head>`:
-
-```html
-<head>
-  <link rel="preconnect" href="https://fonts.googleapis.com" />
-  <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin />
-  <link
-    href="https://fonts.googleapis.com/css2?family=Inter:wght@400;800&display=swap"
-    rel="stylesheet"
-  />
-  <style>
-    body {
-      font-family: Inter, sans-serif;
-    }
-  </style>
-</head>
-```
-
-Pull the family name and weights from the import path and `loadFont`
-arguments. HF's compiler inlines the Google Fonts CSS at render time, so
-you don't pay a network round-trip per render.
-
-## Pattern: local fonts via `@font-face`
-
-```tsx
-import { Font } from "remotion";
-
-Font.loadFont("/MyFont.woff2", "MyFont");
-```
-
-Translate to a `@font-face` rule:
-
-```html
-<style>
-  @font-face {
-    font-family: "MyFont";
-    src: url("assets/MyFont.woff2") format("woff2");
-    font-weight: 400;
-    font-style: normal;
-  }
-</style>
-```
-
-Copy the font file into `hf-src/assets/` next to the HTML.
-
-## Pattern: system font fallback (no font load)
-
-```tsx
-<div style={{ fontFamily: "Helvetica, Arial, sans-serif" }}>...</div>
-```
-
-Same string in HF — but be aware: on Linux without a real Helvetica
-installed (typical CI environment), Remotion and HF fall back to
-_different_ sans-serif system fonts because they bundle different
-Chromium versions. This is the noise floor: ~0.025 mean SSIM cost,
-visible as different stroke widths at large font weights (800+).
-
-If matching the Remotion render exactly matters for a specific
-fixture, load the same font explicitly — don't rely on system
-fallback.
-
-## When in doubt: use Inter
-
-Inter renders identically across Chromium versions and is free.
-Translate any "system sans-serif" Remotion comp to Inter when you
-need to minimize font drift in the validation harness.
-
-## Font loading and `delayRender`
-
-Remotion uses `delayRender()` to defer the first frame until fonts
-load. HF's compiler inlines Google Fonts at compile time and waits
-on `@font-face` readiness via the Frame Adapter pattern — the
-`delayRender` call drops in translation. See [media.md](media.md).
-
-## Multi-weight loading
-
-When Remotion loads multiple weights:
-
-```tsx
-loadFont("normal", { weights: ["400", "500", "700", "800"] });
-```
-
-Inline all weights in the Google Fonts URL:
-
-```
-?family=Inter:wght@400;500;700;800&display=swap
-```
-
-Translation rule: enumerate every distinct `font-weight` value
-that appears in the composition's CSS (`font-weight: 800` →
-weight 800 must be loaded). If the Remotion source loads weights
-that aren't actually used, drop them.
-
-## Font subsetting
-
-Remotion's `loadFont` doesn't subset; HF's compiler doesn't either
-(yet). Don't try to optimize this in translation — it's lossless to
-keep the same weight set as the Remotion source.
+# Font translation
+
+Fonts are the dominant non-translation noise floor. Same `font-weight: 800`
+renders perceptibly bolder on HF's `chrome-headless-shell` than on
+Remotion's bundled Chromium when there's no real font installed. Validation
+showed this costs ~0.025 mean SSIM at the noise floor.
+
+## Pattern: `@remotion/google-fonts/<Family>`
+
+```tsx
+import { loadFont } from "@remotion/google-fonts/Inter";
+loadFont("normal", { weights: ["400", "800"] });
+```
+
+Translate to a `<link>` tag in `<head>`:
+
+```html
+<head>
+  <link rel="preconnect" href="https://fonts.googleapis.com" />
+  <link rel="preconnect" href="https://fonts.gstatic.com" crossorigin />
+  <link
+    href="https://fonts.googleapis.com/css2?family=Inter:wght@400;800&display=swap"
+    rel="stylesheet"
+  />
+  <style>
+    body {
+      font-family: Inter, sans-serif;
+    }
+  </style>
+</head>
+```
+
+Pull the family name and weights from the import path and `loadFont`
+arguments. HF's compiler inlines the Google Fonts CSS at render time, so
+you don't pay a network round-trip per render.
+
+## Pattern: local fonts via `@font-face`
+
+```tsx
+import { Font } from "remotion";
+
+Font.loadFont("/MyFont.woff2", "MyFont");
+```
+
+Translate to a `@font-face` rule:
+
+```html
+<style>
+  @font-face {
+    font-family: "MyFont";
+    src: url("assets/MyFont.woff2") format("woff2");
+    font-weight: 400;
+    font-style: normal;
+  }
+</style>
+```
+
+Copy the font file into `hf-src/assets/` next to the HTML.
+
+## Pattern: system font fallback (no font load)
+
+```tsx
+<div style={{ fontFamily: "Helvetica, Arial, sans-serif" }}>...</div>
+```
+
+Same string in HF — but be aware: on Linux without a real Helvetica
+installed (typical CI environment), Remotion and HF fall back to
+_different_ sans-serif system fonts because they bundle different
+Chromium versions. This is the noise floor: ~0.025 mean SSIM cost,
+visible as different stroke widths at large font weights (800+).
+
+If matching the Remotion render exactly matters for a specific
+fixture, load the same font explicitly — don't rely on system
+fallback.
+
+## When in doubt: use Inter
+
+Inter renders identically across Chromium versions and is free.
+Translate any "system sans-serif" Remotion comp to Inter when you
+need to minimize font drift in the validation harness.
+
+## Font loading and `delayRender`
+
+Remotion uses `delayRender()` to defer the first frame until fonts
+load. HF's compiler inlines Google Fonts at compile time and waits
+on `@font-face` readiness via the Frame Adapter pattern — the
+`delayRender` call drops in translation. See [media.md](media.md).
+
+## Multi-weight loading
+
+When Remotion loads multiple weights:
+
+```tsx
+loadFont("normal", { weights: ["400", "500", "700", "800"] });
+```
+
+Inline all weights in the Google Fonts URL:
+
+```
+?family=Inter:wght@400;500;700;800&display=swap
+```
+
+Translation rule: enumerate every distinct `font-weight` value
+that appears in the composition's CSS (`font-weight: 800` →
+weight 800 must be loaded). If the Remotion source loads weights
+that aren't actually used, drop them.
+
+## Font subsetting
+
+Remotion's `loadFont` doesn't subset; HF's compiler doesn't either
+(yet). Don't try to optimize this in translation — it's lossless to
+keep the same weight set as the Remotion source.