openpond 0.0.34 → 0.0.35

package/dist/web/courses/post-training/09-credible-experiments.vtt

@@ -0,0 +1,69 @@
+WEBVTT
+
+1
+00:00:00.700 --> 00:00:08.157
+A research result requires many versioned tasks, protected information boundaries, matched baselines, and held-out evaluation.
+
+2
+00:00:09.546 --> 00:00:21.550
+Policy-visible input includes the issue, repository revision, allowed tools, and public tests. Training-only evidence may contain an expert repair, privileged patch, or public diagnostic.
+
+3
+00:00:22.939 --> 00:00:29.533
+Evaluator-only hidden tests, anti-exploit checks, and held-out repository clusters must remain outside both.
+
+4
+00:00:30.921 --> 00:00:44.512
+The Taskset preserves those boundaries together with source revision, license, split, verifier version, and content hash. Related issues from the same repository should be clustered before splitting; otherwise memorization can look like generalization.
+
+5
+00:00:45.901 --> 00:00:56.770
+Hugging Face support is worthwhile when it behaves as a reproducible importer. Pin the repository revision. Inspect the dataset card and license. Choose configuration and split explicitly.
+
+6
+00:00:58.159 --> 00:01:09.430
+Map columns through a reviewed transform, log rejected rows, preserve original identifiers, and materialize an immutable snapshot. A training run should never silently follow a changing main branch.
+
+7
+00:01:10.819 --> 00:01:23.637
+Every proposed method needs a simple credible baseline. Begin with the base model and the most direct token-imitation objective supported by the data. Add offline distillation or preference learning when those signals are relevant.
+
+8
+00:01:25.026 --> 00:01:33.578
+Compare with GRPO or another RLVR baseline before claiming value from OPSD, SDFT, or SDPO.
+
+9
+00:01:34.966 --> 00:01:45.786
+Equal optimizer tokens and equal total compute answer different questions. A distillation method may use fewer rollouts while spending additional teacher forward passes. Report both controls.
+
+10
+00:01:47.175 --> 00:02:04.540
+Evaluation should span four dimensions. Capability measures task success. Diversity measures pass-at-k, entropy, and distinct strategies. Retention tests old domains and distribution drift. Integrity audits reward exploits, leakage, and disagreement with a shadow verifier.
+
+11
+00:02:05.929 --> 00:02:09.200
+A single average can hide serious regressions.
+
+12
+00:02:10.589 --> 00:02:21.368
+Compute accounting includes student rollout tokens, teacher-scored tokens, backward tokens, verifier time, external calls, failed jobs, memory, storage, and wall clock.
+
+13
+00:02:22.757 --> 00:02:39.168
+The primary study compares GRPO, SDPO, and a routed success-and-failure method on code repair while separating public diagnostics from hidden tests. Verified math can replicate the GRPO and OPSD claims with exact graders.
+
+14
+00:02:40.557 --> 00:02:52.330
+A tool protocol can replicate token imitation and SDFT while measuring retention. The extra domains test whether a conclusion transfers; they do not replace the main story halfway through it.
+
+15
+00:02:53.719 --> 00:03:04.398
+The paper should bind every claim to a dataset revision, metric, run set, seed, confidence interval, and ablation. That structure keeps a local result from turning into a universal claim.
+
+16
+00:03:05.787 --> 00:03:19.839
+The final map is simple. Demonstrations produce imitation targets. Preferences produce relative targets. Verifiable outcomes produce rewards. Privileged solutions and failure explanations produce context-conditioned teacher distributions.
+
+17
+00:03:21.228 --> 00:03:31.234
+Evidence determines the target. The target determines the update. The update changes future behavior. Evaluation measures what improved—and what changed elsewhere.

package/dist/web/courses/post-training/10-technical-appendix.vtt

@@ -0,0 +1,69 @@
+WEBVTT
+
+1
+00:00:00.700 --> 00:00:07.565
+The first appendix isolates two GRPO evaluation choices that matter after the main mechanism is understood.
+
+2
+00:00:12.059 --> 00:00:22.337
+Length normalization changes gradient weight. A fourteen-hundred-token correct answer and a one-hundred-eighty-token correct answer may receive the same reward but contribute very different numbers of token terms.
+
+3
+00:00:26.831 --> 00:00:34.831
+Sequence averaging, token averaging, overlong penalties, and group normalization therefore change the effective objective.
+
+4
+00:00:39.326 --> 00:00:48.329
+Pass-at-one measures reliability from one sample. Pass-at-k asks whether any of k samples succeeds and exposes remaining search diversity.
+
+5
+00:00:52.824 --> 00:01:00.100
+A model can improve pass-at-one while collapsing onto one strategy, so report both metrics with the sampling configuration.
+
+6
+00:01:01.500 --> 00:01:09.590
+The systems problem is storage. A large vocabulary creates one teacher logit for every token at every trajectory position.
+
+7
+00:01:13.011 --> 00:01:22.055
+Top-k compression stores the most likely teacher logits and approximates the remaining tail. This reduces memory and bandwidth but changes the target distribution.
+
+8
+00:01:25.476 --> 00:01:32.200
+Measure divergence from full logits on a validation sample, and count teacher-forward cost when comparing efficiency.
+
+9
+00:01:33.600 --> 00:01:40.143
+The reported graphs belong in an appendix because they come from different models, datasets, and experimental budgets.
+
+10
+00:01:42.001 --> 00:01:47.822
+The OPSD study reports its largest displayed aggregate gain at the smallest Qwen3 model.
+
+11
+00:01:49.680 --> 00:02:02.137
+At one point seven billion parameters, the displayed base score is thirty-seven point one, GRPO is thirty-seven point seven, and OPSD is forty-three point four. The gaps are smaller at four and eight billion parameters.
+
+12
+00:02:03.994 --> 00:02:09.133
+That is a hypothesis for replication, not a universal model-size law.
+
+13
+00:02:10.991 --> 00:02:21.720
+The SDFT study emphasizes knowledge acquisition and retention. Its displayed strict aggregate moves from eighty to eighty-nine, while its out-of-distribution aggregate moves from eighty to ninety-eight.
+
+14
+00:02:23.578 --> 00:02:35.713
+The SDPO study reports forty-one point two for GRPO and forty-eight point eight for SDPO on its code benchmark. Their bars answer different questions and should not be read as a controlled head-to-head comparison.
+
+15
+00:02:37.571 --> 00:02:50.208
+SRPO means Sample-Routed Policy Optimization. It sends verified successes toward a GRPO-style outcome update and failures with explanations toward an SDPO-style corrective target.
+
+16
+00:02:52.066 --> 00:03:03.839
+The useful principle is signal routing. A successful rollout already shows what worked and can support sparse selection. A failed rollout with diagnostics may reveal how to recover and can support dense correction.
+
+17
+00:03:05.697 --> 00:03:11.067
+The router preserves that asymmetry instead of forcing every sample through one uniform loss.