mlx-bun 0.0.4
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/LICENSE +21 -0
- package/README.md +362 -0
- package/THIRD_PARTY_LICENSES.md +41 -0
- package/bin/mlx-bun.mjs +32 -0
- package/docs/curve-designer.html +303 -0
- package/docs/design/adapters-end-to-end.md +201 -0
- package/docs/design/compat-cli-surface-design.md +227 -0
- package/docs/design/docs-reorg-plan.md +152 -0
- package/docs/design/hlg-sampling.md +340 -0
- package/docs/design/memory-system.md +339 -0
- package/docs/design/optimization_plan.md +344 -0
- package/docs/design/parallel-slots.md +515 -0
- package/docs/design/runtime-isolation.md +247 -0
- package/docs/design/segmented-backward-training.md +508 -0
- package/docs/investigations/chunk-finetune-experiment.md +84 -0
- package/docs/investigations/curve-bisector-routing.md +123 -0
- package/docs/investigations/curve-runs/bisector-route.json +98 -0
- package/docs/investigations/curve-runs/bisector-trace.json +1393 -0
- package/docs/investigations/curve-runs/curve-terrain.json +1179 -0
- package/docs/investigations/curve-runs/curve-terrain.svg +42 -0
- package/docs/investigations/curve-terrain.html +105 -0
- package/docs/investigations/expert-offload-single-user-moe.md +292 -0
- package/docs/investigations/hlg-ab.html +34 -0
- package/docs/investigations/hlg-explorer.html +238 -0
- package/docs/investigations/hlg-figs/cliff.svg +1 -0
- package/docs/investigations/hlg-figs/cross.svg +1 -0
- package/docs/investigations/hlg-figs/edges.svg +1 -0
- package/docs/investigations/hlg-figs/k20-grids.svg +1 -0
- package/docs/investigations/hlg-figs/k20-peaks.svg +1 -0
- package/docs/investigations/hlg-figs/lw-curve.svg +1 -0
- package/docs/investigations/hlg-figs/terrain.svg +1 -0
- package/docs/investigations/hlg-report.html +262 -0
- package/docs/investigations/hlg-runs/hlg-ab.json +149 -0
- package/docs/investigations/hlg-runs/hlg-blind-prompts.md +87 -0
- package/docs/investigations/hlg-runs/hlg-blind.json +107 -0
- package/docs/investigations/hlg-runs/hlg-cliff.json +197 -0
- package/docs/investigations/hlg-runs/hlg-cross.json +505 -0
- package/docs/investigations/hlg-runs/hlg-edge.json +388 -0
- package/docs/investigations/hlg-runs/hlg-eval1.json +25 -0
- package/docs/investigations/hlg-runs/hlg-frontier.json +86 -0
- package/docs/investigations/hlg-runs/hlg-grid.json +242 -0
- package/docs/investigations/hlg-runs/hlg-grid2.json +343 -0
- package/docs/investigations/hlg-runs/hlg-lw-coarse.json +110 -0
- package/docs/investigations/hlg-runs/hlg-map.json +383 -0
- package/docs/investigations/hlg-runs/run0-original.log +159 -0
- package/docs/investigations/hlg-runs/runA-recommended.log +131 -0
- package/docs/investigations/hlg-runs/runAA-cliff-cpm5.log +26 -0
- package/docs/investigations/hlg-runs/runAB-grid2-e4b.log +18 -0
- package/docs/investigations/hlg-runs/runAC-peak-e4b-partial.log +25 -0
- package/docs/investigations/hlg-runs/runAD-ab-samples.log +8 -0
- package/docs/investigations/hlg-runs/runAE-edge-e4b.log +51 -0
- package/docs/investigations/hlg-runs/runAF-logit-calibration.log +10 -0
- package/docs/investigations/hlg-runs/runAG-eval-config2.log +16 -0
- package/docs/investigations/hlg-runs/runB-gain-variants.log +192 -0
- package/docs/investigations/hlg-runs/runC-pivots.log +162 -0
- package/docs/investigations/hlg-runs/runD-oetf.log +132 -0
- package/docs/investigations/hlg-runs/runE-eotf.log +162 -0
- package/docs/investigations/hlg-runs/runF-shaper-working.log +86 -0
- package/docs/investigations/hlg-runs/runG-shaper-sweep.log +101 -0
- package/docs/investigations/hlg-runs/runH-wsweep.log +176 -0
- package/docs/investigations/hlg-runs/runI-asweep.log +176 -0
- package/docs/investigations/hlg-runs/runJ-knobmap.log +49 -0
- package/docs/investigations/hlg-runs/runK-frontier.log +19 -0
- package/docs/investigations/hlg-runs/runL-widemap.log +65 -0
- package/docs/investigations/hlg-runs/runM-frontier-emb.log +15 -0
- package/docs/investigations/hlg-runs/runN-verify.log +116 -0
- package/docs/investigations/hlg-runs/runO-frontier-seed5000.log +15 -0
- package/docs/investigations/hlg-runs/runP-grid-AxSm.log +15 -0
- package/docs/investigations/hlg-runs/runQ-grid-tgW.log +15 -0
- package/docs/investigations/hlg-runs/runR-blind-transcript.log +79 -0
- package/docs/investigations/hlg-runs/runS-cross-coherence.log +33 -0
- package/docs/investigations/hlg-runs/runT-cross-cpm5.log +33 -0
- package/docs/investigations/hlg-runs/runU-cross-12b.log +33 -0
- package/docs/investigations/hlg-runs/runV-lw-e4b.log +22 -0
- package/docs/investigations/hlg-runs/runW-lw-12b.log +22 -0
- package/docs/investigations/hlg-runs/runX-lw-cpm5.log +22 -0
- package/docs/investigations/hlg-runs/runY-cliff-e4b.log +26 -0
- package/docs/investigations/hlg-runs/runZ-cliff-12b.log +26 -0
- package/docs/investigations/hlg-sampling-investigation.md +970 -0
- package/docs/investigations/lab-build-journal.md +157 -0
- package/docs/investigations/pi-builtin-investigation.md +308 -0
- package/docs/investigations/starter-model-port-handoff.md +323 -0
- package/docs/planning/IDEAS.md +26 -0
- package/docs/planning/PRODUCT_ROADMAP.md +426 -0
- package/docs/planning/ResearchTopics.md +119 -0
- package/docs/planning/chunk-task-roadmap.md +77 -0
- package/docs/planning/journal.md +155 -0
- package/docs/reference/distribution.md +121 -0
- package/docs/reference/embedding.md +168 -0
- package/docs/reference/library-api.md +153 -0
- package/docs/reference/server-api.md +224 -0
- package/docs/reference/server-config.md +243 -0
- package/docs/segmented-backward-handoff.md +148 -0
- package/package.json +68 -0
- package/src/anthropic.ts +491 -0
- package/src/chat-template.ts +186 -0
- package/src/cli.ts +1075 -0
- package/src/config.ts +229 -0
- package/src/curve-sampler.ts +122 -0
- package/src/dataset/generators.ts +1087 -0
- package/src/dataset/index.ts +12 -0
- package/src/dataset/job.ts +81 -0
- package/src/dataset/llm.ts +71 -0
- package/src/dataset/registry.ts +528 -0
- package/src/download.ts +283 -0
- package/src/eval/README.md +86 -0
- package/src/eval/kl-prompts.ts +29 -0
- package/src/eval/kl.ts +294 -0
- package/src/eval/quality-db.ts +92 -0
- package/src/eval/runner.ts +102 -0
- package/src/eval/score.ts +49 -0
- package/src/eval/tasks/bfcl.ts +500 -0
- package/src/eval/tasks/gsm8k.ts +85 -0
- package/src/eval/tasks/hashhop.ts +109 -0
- package/src/eval/tasks/humaneval.ts +252 -0
- package/src/eval/tasks/ifeval.ts +354 -0
- package/src/eval/tasks/mmlu.ts +145 -0
- package/src/evaldb.ts +199 -0
- package/src/expert-offload-build.ts +77 -0
- package/src/expert-offload.ts +61 -0
- package/src/expert-trace.ts +67 -0
- package/src/fit.ts +254 -0
- package/src/generate.ts +451 -0
- package/src/harness-pi.ts +177 -0
- package/src/hf-push.ts +628 -0
- package/src/index.ts +22 -0
- package/src/jobs/db.ts +139 -0
- package/src/jobs/index.ts +29 -0
- package/src/jobs/job-entry.ts +106 -0
- package/src/jobs/runner.ts +304 -0
- package/src/jobs/sse.ts +114 -0
- package/src/jobs/types.ts +58 -0
- package/src/kv-store.ts +185 -0
- package/src/lora.ts +314 -0
- package/src/md-modules.d.ts +7 -0
- package/src/mlx/array.ts +237 -0
- package/src/mlx/autograd.ts +267 -0
- package/src/mlx/checkpoint.ts +116 -0
- package/src/mlx/compile.ts +158 -0
- package/src/mlx/custom-vjp.ts +140 -0
- package/src/mlx/ffi.ts +433 -0
- package/src/mlx/metal-kernel.ts +130 -0
- package/src/mlx/ops.ts +707 -0
- package/src/mmap.ts +90 -0
- package/src/model/batched-mask.ts +204 -0
- package/src/model/batched-rotating.ts +300 -0
- package/src/model/compiled-decode.ts +681 -0
- package/src/model/factory.ts +27 -0
- package/src/model/fingerprint.ts +33 -0
- package/src/model/flash-attention.ts +674 -0
- package/src/model/fused-decode-kernel.ts +305 -0
- package/src/model/fused-geglu-kernel.ts +87 -0
- package/src/model/gemma4-base.ts +1616 -0
- package/src/model/gemma4.ts +1012 -0
- package/src/model/generated/gemma4-12b.ts +526 -0
- package/src/model/generated/gemma4-26b.ts +500 -0
- package/src/model/generated/gemma4-e4b.ts +757 -0
- package/src/model/generated/index.ts +18 -0
- package/src/model/minicpm5.ts +278 -0
- package/src/model/qwen3-delta.ts +224 -0
- package/src/model/qwen3_5.ts +429 -0
- package/src/model/support.ts +46 -0
- package/src/native-pack.ts +152 -0
- package/src/pi-provider.ts +95 -0
- package/src/pi-terminal.ts +264 -0
- package/src/pi-web.ts +924 -0
- package/src/preflight.ts +123 -0
- package/src/prompt-cache.ts +113 -0
- package/src/quantize/allocator.ts +627 -0
- package/src/quantize/calibration.ts +180 -0
- package/src/quantize/config-writer.ts +132 -0
- package/src/quantize/index.ts +57 -0
- package/src/quantize/job.ts +136 -0
- package/src/quantize/quantizer.ts +462 -0
- package/src/quantize/safetensors-writer.ts +171 -0
- package/src/quantize/sensitivity.ts +234 -0
- package/src/registry.ts +336 -0
- package/src/responses.ts +774 -0
- package/src/safetensors.ts +158 -0
- package/src/sampler.ts +517 -0
- package/src/serve/batch-scheduler.ts +362 -0
- package/src/serve/generation-gateway.ts +160 -0
- package/src/server.ts +1891 -0
- package/src/spec/drafter.ts +261 -0
- package/src/spec/generate.ts +221 -0
- package/src/status-page.html +497 -0
- package/src/tokenizer.ts +38 -0
- package/src/tool-call.ts +242 -0
- package/src/train/dataset.ts +461 -0
- package/src/train/export.ts +32 -0
- package/src/train/forward.ts +229 -0
- package/src/train/index.ts +43 -0
- package/src/train/job.ts +148 -0
- package/src/train/lora-params.ts +194 -0
- package/src/train/loss.ts +342 -0
- package/src/train/merge.ts +195 -0
- package/src/train/optimizer.ts +176 -0
- package/src/train/rank.ts +101 -0
- package/src/train/segmented.ts +520 -0
- package/src/train/trainer.ts +600 -0
- package/src/tui.ts +161 -0
- package/src/vision/embedder.ts +168 -0
- package/src/vision/preprocess.ts +247 -0
- package/src/vision/prompt.ts +158 -0
- package/src/vision/siglip.ts +599 -0
- package/src/web/app.html +2471 -0
- package/src/web/skills/web-research/SKILL.md +44 -0
- package/src/web/skills.ts +59 -0
- package/src/web-tools.ts +426 -0
- package/src/weights.ts +91 -0
|
@@ -0,0 +1,262 @@
|
|
|
1
|
+
<!doctype html><html lang="en"><head><meta charset="utf-8">
|
|
2
|
+
<meta name="viewport" content="width=device-width,initial-scale=1">
|
|
3
|
+
<title>HLG Sampling — Investigation Report</title><style>
|
|
4
|
+
:root{
|
|
5
|
+
--text-primary:#1f2937; --text-secondary:#475569; --text-tertiary:#94a3b8;
|
|
6
|
+
--bg:#fbfcfe; --bg-card:#ffffff; --bg-tertiary:#eef2f7; --border:#e2e8f0;
|
|
7
|
+
--accent:#2563eb; --positive:#16a34a; --warn:#d97706; --cyan:#0891b2; --danger:#dc2626;
|
|
8
|
+
}
|
|
9
|
+
*{box-sizing:border-box}
|
|
10
|
+
body{margin:0;background:var(--bg);color:var(--text-primary);
|
|
11
|
+
font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",ui-sans-serif,system-ui,sans-serif;
|
|
12
|
+
line-height:1.62;font-size:16px;-webkit-font-smoothing:antialiased}
|
|
13
|
+
.wrap{max-width:920px;margin:0 auto;padding:56px 28px 120px}
|
|
14
|
+
header.hero{border-bottom:2px solid var(--border);padding-bottom:28px;margin-bottom:8px}
|
|
15
|
+
.kicker{font-size:12.5px;letter-spacing:.14em;text-transform:uppercase;color:var(--accent);font-weight:700}
|
|
16
|
+
h1{font-size:34px;line-height:1.18;margin:.32em 0 .18em;letter-spacing:-.02em}
|
|
17
|
+
.sub{color:var(--text-secondary);font-size:17px;max-width:680px}
|
|
18
|
+
.meta{margin-top:14px;font-size:13px;color:var(--text-tertiary)}
|
|
19
|
+
.thesis{background:linear-gradient(180deg,#f1f6ff,#fbfcfe);border:1px solid #dbe7ff;border-left:4px solid var(--accent);
|
|
20
|
+
border-radius:12px;padding:18px 22px;margin:26px 0 8px;font-size:16.5px}
|
|
21
|
+
.thesis b{color:var(--accent)}
|
|
22
|
+
h2{font-size:24px;margin:54px 0 4px;letter-spacing:-.01em;padding-top:8px}
|
|
23
|
+
h2 .n{color:var(--text-tertiary);font-weight:600;font-size:18px;margin-right:10px}
|
|
24
|
+
h3{font-size:17px;margin:30px 0 6px;color:var(--text-primary)}
|
|
25
|
+
p{margin:12px 0}
|
|
26
|
+
.lead{font-size:17px;color:var(--text-secondary)}
|
|
27
|
+
code{background:var(--bg-tertiary);border-radius:5px;padding:.08em .38em;font-size:.87em;
|
|
28
|
+
font-family:ui-monospace,SFMono-Regular,Menlo,monospace;color:#0f172a}
|
|
29
|
+
strong{font-weight:650}
|
|
30
|
+
figure{margin:26px 0;background:var(--bg-card);border:1px solid var(--border);border-radius:14px;
|
|
31
|
+
padding:18px 18px 10px;box-shadow:0 1px 2px rgba(15,23,42,.04),0 8px 24px -16px rgba(15,23,42,.18)}
|
|
32
|
+
figure svg{width:100%;height:auto;display:block}
|
|
33
|
+
figcaption{font-size:13px;color:var(--text-tertiary);margin-top:10px;padding-top:10px;border-top:1px solid var(--border)}
|
|
34
|
+
figcaption b{color:var(--text-secondary)}
|
|
35
|
+
table{border-collapse:collapse;width:100%;margin:20px 0;font-size:14.5px}
|
|
36
|
+
th,td{text-align:left;padding:9px 12px;border-bottom:1px solid var(--border);vertical-align:top}
|
|
37
|
+
thead th{background:var(--bg-tertiary);font-size:12.5px;letter-spacing:.02em;color:var(--text-secondary);border-bottom:2px solid var(--border)}
|
|
38
|
+
tbody tr:hover{background:#f8fafc}
|
|
39
|
+
.tag{display:inline-block;font-size:11.5px;font-weight:700;padding:2px 9px;border-radius:999px;line-height:1.5}
|
|
40
|
+
.tag.cluster{background:#fef3c7;color:#92400e}
|
|
41
|
+
.tag.free{background:#dcfce7;color:#166534}
|
|
42
|
+
.tag.curve{background:#dbeafe;color:#1e40af}
|
|
43
|
+
.callout{border:1px solid var(--border);border-left:4px solid var(--text-tertiary);background:var(--bg-card);
|
|
44
|
+
border-radius:10px;padding:14px 18px;margin:20px 0;font-size:15px}
|
|
45
|
+
.callout.terrain{border-left-color:var(--positive);background:#f6fdf9}
|
|
46
|
+
.callout.rock{border-left-color:var(--danger);background:#fef6f6}
|
|
47
|
+
.callout h4{margin:0 0 6px;font-size:13px;text-transform:uppercase;letter-spacing:.08em;color:var(--text-secondary)}
|
|
48
|
+
.pending{background:var(--bg-tertiary);border:1px dashed var(--border);border-radius:10px;padding:30px;text-align:center;color:var(--text-tertiary)}
|
|
49
|
+
ul.clean{margin:12px 0;padding-left:22px}
|
|
50
|
+
ul.clean li{margin:7px 0}
|
|
51
|
+
.foot{margin-top:70px;padding-top:22px;border-top:1px solid var(--border);font-size:13px;color:var(--text-tertiary)}
|
|
52
|
+
.runidx{columns:2;column-gap:30px;font-size:13px;color:var(--text-secondary)}
|
|
53
|
+
.runidx div{break-inside:avoid;margin:3px 0}
|
|
54
|
+
.runidx code{font-size:12px}
|
|
55
|
+
@media(max-width:680px){.runidx{columns:1}h1{font-size:27px}.wrap{padding:34px 18px 80px}}
|
|
56
|
+
</style></head>
|
|
57
|
+
<body><div class="wrap">
|
|
58
|
+
|
|
59
|
+
<header class="hero">
|
|
60
|
+
<div class="kicker">mlx-bun · sampling investigation</div>
|
|
61
|
+
<h1>Transplanting Hybrid Log-Gamma onto LLM logit sampling</h1>
|
|
62
|
+
<p class="sub">Mapping a piecewise HDR transfer function as a replacement sampler — what each control does, where the coherent region is walled, and whether the geometry is a property of the curve or of the model.</p>
|
|
63
|
+
<div class="meta">Reference model gemma-4-e4b · cross-checked on gemma-4-12B and MiniCPM5-1B · June 2026</div>
|
|
64
|
+
</header>
|
|
65
|
+
|
|
66
|
+
<div class="thesis">
|
|
67
|
+
Temperature is <b>one global slope</b> on the logits. It couples two things you might want to do separately:
|
|
68
|
+
tamp down the over-confident top token, and lift the long tail. HLG (ITU-R BT.2100) is a <b>piecewise</b> curve —
|
|
69
|
+
a toe in the shadows, a power region in the mids, a log shoulder in the highlights, plus a system gamma. The bet:
|
|
70
|
+
transplant that shape onto logit sampling to <b>decouple</b> those moves — and get several controls where temperature gave one.
|
|
71
|
+
</div>
|
|
72
|
+
|
|
73
|
+
<h2><span class="n">1</span>The idea</h2>
|
|
74
|
+
<p class="lead">A sampler's logits look, abstractly, like a tone curve: a bright "highlight" (the dominant token), a band of
|
|
75
|
+
"midtone" plausible alternatives, and a dark "shadow" tail of unlikely tokens. Temperature scales that whole curve by a
|
|
76
|
+
single exponent — raise it and you simultaneously dim the highlight <em>and</em> raise the shadows; you cannot do one without the other.</p>
|
|
77
|
+
<p>HLG splits the curve into regions with independent behavior: a gamma/√ <strong>toe</strong>, a power <strong>mid</strong>, a logarithmic
|
|
78
|
+
<strong>shoulder</strong>, and a separate system <strong>OOTF gamma</strong> (γ = 1.2 + 0.42·log₁₀(L_W/1000)). Transplanted onto sampling, those
|
|
79
|
+
become: roll off the over-confident top (<code>shoulder</code> / <code>A</code>), sharpen the interesting middle (<code>s_m</code>), gate the
|
|
80
|
+
junk tail (<code>window</code> / <code>target_gap</code>), and bend the global curvature (<code>L_W</code>). It is a <strong>replacement</strong> sampler —
|
|
81
|
+
flag-gated (<code>--hlg-sampling</code>, default off), post-inference, model-agnostic — that stands in for temperature + top-p + top-k entirely.</p>
|
|
82
|
+
|
|
83
|
+
<h3>Two cross-domain adaptations</h3>
|
|
84
|
+
<p>The literal HDR curve does not work out of the box, because LM logits are not images:</p>
|
|
85
|
+
<ul class="clean">
|
|
86
|
+
<li><strong>Windowed anchor.</strong> A logit distribution is a spike-plus-tail, not an image histogram. Min-max normalization
|
|
87
|
+
collapses every real candidate into the shoulder. Fix: anchor the input window <code>W</code> nats below the top token, so the
|
|
88
|
+
candidates land across the curve instead of piling up at the top.</li>
|
|
89
|
+
<li><strong>Inverted toe.</strong> HLG's toe <em>lifts</em> shadows (it describes how a display renders near-black). A sampler wants the
|
|
90
|
+
opposite — to <em>crush</em> the tail. So the toe is inverted from lift to suppress.</li>
|
|
91
|
+
<li><strong>Decoupled <code>out_scale</code>.</strong> The output scale auto-derives to pin the top→reference-token gap to <code>target_gap</code>,
|
|
92
|
+
so changing the window doesn't silently change the sharpness.</li>
|
|
93
|
+
</ul>
|
|
94
|
+
|
|
95
|
+
<h2><span class="n">2</span>How we measured</h2>
|
|
96
|
+
<p>Every configuration is compared against the model's <strong>own recommended recipe</strong> (its <code>generation_config.json</code>,
|
|
97
|
+
run unchanged) — the only thing that varies is the sampling method. Two metrics, two stages:</p>
|
|
98
|
+
<ul class="clean">
|
|
99
|
+
<li><strong>Coherence</strong> — a factual "canary" prompt (the sharpest spike-to-tail; it breaks last) scored by <em>junk ratio</em>,
|
|
100
|
+
the fraction of non-Latin-script letters, which is the word-salad signature. Cheap, so it screens the whole grid first.</li>
|
|
101
|
+
<li><strong>Diversity</strong> — measured <em>only on coherent survivors</em> (so garbage can't win): <em>1−self-BLEU</em> on the divergent
|
|
102
|
+
region (shared prefix stripped), backed by distinct-2 and an LM-embedding cosine. The factual prompt stays the coherence canary.</li>
|
|
103
|
+
</ul>
|
|
104
|
+
<div class="callout">
|
|
105
|
+
<h4>Stance</h4>
|
|
106
|
+
This is a <strong>map, not a verdict.</strong> Each run is a coordinate held loosely — we don't give up at the first rock or
|
|
107
|
+
declare victory at the first tree. Small-sample diversity is noisy (self-BLEU swings ~±0.08 at K=6), so effect sizes near that
|
|
108
|
+
scale are reported as terrain, not findings, and the decisive sweeps are re-run at K=20.
|
|
109
|
+
</div>
|
|
110
|
+
|
|
111
|
+
<h2><span class="n">3</span>The five knobs</h2>
|
|
112
|
+
<p class="lead">HLG exposes five controls where temperature gave one. They are <em>not</em> five copies of the same lever — they
|
|
113
|
+
play different roles, which is the whole point of the transplant.</p>
|
|
114
|
+
<table>
|
|
115
|
+
<thead><tr><th>Knob</th><th>What it does</th><th>Role on the coherence wall</th><th>Diversity</th></tr></thead>
|
|
116
|
+
<tbody>
|
|
117
|
+
<tr><td><code>target_gap</code></td><td>overall sharpness anchor (top→ref gap)</td><td><span class="tag cluster">gate cluster</span> graded cliff, vocab-shifted</td><td>sharpness lever</td></tr>
|
|
118
|
+
<tr><td><code>W</code> (window)</td><td>candidate gate, nats below the top</td><td><span class="tag cluster">gate cluster</span> sharp edge at high A</td><td>candidate gate</td></tr>
|
|
119
|
+
<tr><td><code>s_m</code></td><td>mid-region slope (sharpen the middle)</td><td><span class="tag cluster">gate cluster</span> the coupling hub</td><td>coupled lever</td></tr>
|
|
120
|
+
<tr><td><code>A</code> (shoulder)</td><td>highlight roll-off / top-token confidence</td><td><span class="tag free">orthogonal</span> doesn't move the floor</td><td>the <b>free</b> lever</td></tr>
|
|
121
|
+
<tr><td><code>L_W</code></td><td>OOTF curvature (γ of the whole curve)</td><td><span class="tag curve">outside cluster</span> robust; walls at γ extremes</td><td>non-monotone, model-specific</td></tr>
|
|
122
|
+
</tbody>
|
|
123
|
+
</table>
|
|
124
|
+
|
|
125
|
+
<h2><span class="n">4</span>The coherent basin</h2>
|
|
126
|
+
<p>Sweeping the knobs two at a time produces a coherent <strong>basin</strong> walled by cliffs, with a diversity gradient inside it.
|
|
127
|
+
The left panel is the <code>A × s_m</code> plane; the right is <code>target_gap × W</code>. Darker = more diverse; ✗ = the canary broke;
|
|
128
|
+
green-outlined cells beat the default's diversity.</p>
|
|
129
|
+
<figure><svg viewBox="0 0 900 470" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="ht htd" font-family="ui-sans-serif,system-ui,sans-serif"><title id="ht">HLG diversity terrain — two planes</title><desc id="htd">Heatmaps of self-BLEU diversity across the A×s_m and target_gap×W planes; darker = more diverse; ✗ = incoherent; green outline = above the default contour.</desc><text x="450" y="28" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">HLG diversity terrain (e4b) — coherent basin + diversity (self-BLEU)</text><text x="235" y="60" text-anchor="middle" font-size="15" font-weight="700" fill="var(--text-primary,#1f2937)">A × s_m</text><text x="235" y="78" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">A (shoulder) → tighter</text><text x="84" y="215" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 84 215)">s_m →</text><text x="135" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.01</text><text x="185" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.05</text><text x="235" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.2</text><text x="285" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">1</text><text x="335" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">5</text><text x="102" y="119" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.05</text><text x="102" y="169" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.2</text><text x="102" y="219" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.7</text><text x="102" y="269" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">1.5</text><text x="102" y="319" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">3</text><rect x="110" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="160" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.82" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="184" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.83</text><rect x="210" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.90" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.86</text><rect x="260" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.80" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="284" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.82</text><rect x="310" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.15" stroke="var(--border,#e5e7eb)"/><text x="334" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.56</text><rect x="110" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.87" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="168" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.85</text><rect x="160" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.57" stroke="var(--border,#e5e7eb)"/><text x="184" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.73</text><rect x="210" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.90" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="168" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.86</text><rect x="260" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.65" stroke="var(--border,#e5e7eb)"/><text x="284" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.76</text><rect x="310" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="334" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><rect x="110" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.75" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.80</text><rect x="160" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="184" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="210" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="260" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.55" stroke="var(--border,#e5e7eb)"/><text x="284" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.72</text><rect x="310" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.43" stroke="var(--border,#e5e7eb)"/><text x="334" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.67</text><rect x="110" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.73" stroke="var(--border,#e5e7eb)"/><text x="134" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.79</text><rect x="160" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="184" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="210" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="234" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="260" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.40" stroke="var(--border,#e5e7eb)"/><text x="284" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.66</text><rect x="310" y="240" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="334" y="269" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="110" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="134" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="160" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="184" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="210" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="234" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="260" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="284" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="310" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="334" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><text x="725" y="60" text-anchor="middle" font-size="15" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap × W</text><text x="725" y="78" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">target_gap → sharper</text><text x="574" y="215" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 574 215)">W →</text><text x="625" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">10</text><text x="675" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">13</text><text x="725" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">16</text><text x="775" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">25</text><text x="825" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">50</text><text x="592" y="119" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">4</text><text x="592" y="169" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">5</text><text x="592" y="219" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">6</text><text x="592" y="269" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">10</text><text x="592" y="319" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">20</text><rect x="600" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="674" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="700" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="724" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="750" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="774" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="800" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="140" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="169" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="140" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="674" y="169" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="700" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.63" stroke="var(--border,#e5e7eb)"/><text x="724" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.75</text><rect x="750" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="774" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="800" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="190" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="219" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="674" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="700" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="724" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="750" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="774" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="800" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.07" stroke="var(--border,#e5e7eb)"/><text x="824" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.50</text><rect x="600" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.63" stroke="var(--border,#e5e7eb)"/><text x="624" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.75</text><rect x="650" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="674" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="700" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="724" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="750" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.57" stroke="var(--border,#e5e7eb)"/><text x="774" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.73</text><rect x="800" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.95" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="624" y="318" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.88</text><rect x="650" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="674" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><rect x="700" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.33" stroke="var(--border,#e5e7eb)"/><text x="724" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.63</text><rect x="750" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.25" stroke="var(--border,#e5e7eb)"/><text x="774" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.60</text><rect x="800" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="824" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><g transform="translate(110,442)"><rect x="0" y="-10" width="16" height="16" rx="3" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="22" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">✗ incoherent (canary broke)</text><rect x="200" y="-10" width="16" height="16" rx="3" fill="var(--accent,#2563eb)" fill-opacity="0.3"/><rect x="218" y="-10" width="16" height="16" rx="3" fill="var(--accent,#2563eb)" fill-opacity="0.85"/><text x="240" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">diversity: light → dark = more diverse</text><rect x="540" y="-10" width="16" height="16" rx="3" fill="none" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="562" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">above default contour (0.799)</text></g></svg><figcaption><b>Diversity terrain (e4b).</b> The basin is walled by coupled diagonal cliffs — knobs trade off against each other at the edge. Diversity is a noisy plateau that rises toward the loose corner of the basin, hovering around the default level.</figcaption></figure>
|
|
130
|
+
|
|
131
|
+
<h2><span class="n">5</span>The wall's geometry</h2>
|
|
132
|
+
<p>Resolving every pairwise coherence boundary (two within-pair, four cross-pair) shows the wall is <strong>not</strong> a stack of
|
|
133
|
+
independent thresholds. It is a single coupled surface — with one knob standing outside it.</p>
|
|
134
|
+
<ul class="clean">
|
|
135
|
+
<li><strong><code>A</code> is orthogonal to the wall.</strong> Crank it across four orders of magnitude and the gate cliffs barely move.
|
|
136
|
+
Mechanism: the coherence floor is a <em>tail</em> phenomenon, and <code>A</code> only reshapes the <em>top</em> — it adds no tail mass, so it's free on coherence.</li>
|
|
137
|
+
<li><strong><code>s_m</code> is the coupling hub.</strong> It trades off against both gates: a loose mid demands a tighter gate. At low <code>s_m</code>
|
|
138
|
+
the cliff can vanish entirely; at high <code>s_m</code> it needs more gating to stay coherent.</li>
|
|
139
|
+
<li><strong>The wall = a coupled <code>tg</code>/<code>W</code>/<code>s_m</code> cluster.</strong> Those three share one "tail-mass budget"; <code>A</code> sits outside it;
|
|
140
|
+
<code>L_W</code> (below) sits outside it too. So the two diversity levers split by their relation to the wall — <code>A</code> is <em>free</em>, <code>s_m</code> is <em>coupled</em>.</li>
|
|
141
|
+
</ul>
|
|
142
|
+
|
|
143
|
+
<h2><span class="n">6</span>Does the geometry generalize?</h2>
|
|
144
|
+
<p>The whole map above is one model. Re-running the cross-pair coherence boundary on <strong>12B</strong> (dense Gemma, same ~262k vocab)
|
|
145
|
+
and <strong>CPM5</strong> (MiniCPM5-1B, Llama family, ~73k vocab) sorts the structure into what belongs to the <em>curve</em> versus the <em>vocab</em>.</p>
|
|
146
|
+
<figure><svg viewBox="0 0 960 658" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG coherence geometry across three models</title><desc id="d">Cross-pair coherence grids for e4b, 12B and CPM5. The sharpness cluster (s_m×tg, A×tg) replicates across all three; the window axis (s_m×W, A×W) tracks vocab size — the two Gemmas agree, CPM5 diverges.</desc><text x="480" y="26" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">Does the geometry generalize? Cross-pair coherence across 3 models</text><text x="480" y="46" text-anchor="middle" font-size="12" fill="var(--text-secondary,#6b7280)">green = coherent · red ✗ = canary broke · each grid is 4×4 over the break-spanning ranges</text><text x="288" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">e4b</text><text x="288" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Gemma · 262k</text><text x="518" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">12B</text><text x="518" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Gemma · 262k</text><text x="748" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">CPM5</text><text x="748" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Llama · ~73k</text><rect x="14" y="108" width="932" height="244" rx="8" fill="var(--positive,#16a34a)" fill-opacity="0.05" stroke="var(--positive,#16a34a)" stroke-opacity="0.35"/><text x="26" y="124" font-size="12" font-weight="700" fill="var(--positive,#16a34a)">Replicates across all 3 — the sharpness cluster</text><text x="150" y="180" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">s_m × target_gap</text><rect x="262" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="281" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="165" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="177.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 184)">s_m →</text><text x="300" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="492" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="511" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="165" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="177.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 184)">s_m →</text><text x="530" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="722" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 184)">s_m →</text><text x="760" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><text x="150" y="298" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">A × target_gap</text><rect x="262" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 302)">A →</text><text x="300" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="492" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 302)">A →</text><text x="530" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="722" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 302)">A →</text><text x="760" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="14" y="366" width="932" height="244" rx="8" fill="var(--accent,#2563eb)" fill-opacity="0.05" stroke="var(--accent,#2563eb)" stroke-opacity="0.35"/><text x="26" y="382" font-size="12" font-weight="700" fill="var(--accent,#2563eb)">Vocab-dependent — the window axis (Gemmas agree, CPM5 diverges)</text><text x="150" y="438" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">s_m × W</text><rect x="262" y="404" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="416.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="423" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="435.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 442)">s_m →</text><text x="300" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="492" y="404" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="416.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="423" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="435.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 442)">s_m →</text><text x="530" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="722" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 442)">s_m →</text><text x="760" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><text x="150" y="556" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">A × W</text><rect x="262" y="522" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="534.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="541" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="553.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 560)">A →</text><text x="300" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="492" y="522" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="534.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="541" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="553.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="557.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><text x="486" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 560)">A →</text><text x="530" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="722" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="787.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="722" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="787.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><text x="716" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 560)">A →</text><text x="760" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><g transform="translate(26,644)"><rect x="0" y="-11" width="14" height="14" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="20" y="0" font-size="11" fill="var(--text-secondary,#6b7280)">coherent</text><rect x="100" y="-11" width="14" height="14" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="120" y="0" font-size="11" fill="var(--text-secondary,#6b7280)">canary broke</text><text x="240" y="0" font-size="11" font-style="italic" fill="var(--text-tertiary,#9ca3af)">Same red pattern across columns = the curve, not the model.</text></g></svg><figcaption><b>Cross-pair coherence across three models.</b> The sharpness cluster (top band) replicates everywhere; the window axis (bottom band) tracks vocab size — the two Gemmas agree, CPM5 diverges.</figcaption></figure>
|
|
147
|
+
<table>
|
|
148
|
+
<thead><tr><th>Cross-pair</th><th>e4b (Gemma 262k)</th><th>12B (Gemma 262k)</th><th>CPM5 (Llama ~73k)</th><th>Generalizes?</th></tr></thead>
|
|
149
|
+
<tbody>
|
|
150
|
+
<tr><td><code>s_m × target_gap</code></td><td>diagonal — low s_m tolerates low tg</td><td>same diagonal</td><td>same diagonal (shifted threshold)</td><td><b style="color:var(--positive)">yes</b></td></tr>
|
|
151
|
+
<tr><td><code>A × target_gap</code></td><td>gate cliff A-independent</td><td>same</td><td>same</td><td><b style="color:var(--positive)">yes</b></td></tr>
|
|
152
|
+
<tr><td><code>s_m × W</code></td><td>s_m≥2 breaks at W=5</td><td>same</td><td>fully clean (decoupled)</td><td><b style="color:var(--danger)">vocab</b></td></tr>
|
|
153
|
+
<tr><td><code>A × W</code></td><td>W cliff A-independent</td><td>similar</td><td>high-A / wide-W break</td><td><b style="color:var(--danger)">vocab</b></td></tr>
|
|
154
|
+
</tbody>
|
|
155
|
+
</table>
|
|
156
|
+
<div class="callout terrain">
|
|
157
|
+
<h4>Result (terrain)</h4>
|
|
158
|
+
The <strong>sharpness coupling — <code>s_m ↔ target_gap</code> coupled, <code>A</code> orthogonal — replicates across all three models and both
|
|
159
|
+
architectures.</strong> That's a property of the HLG curve, not the model. The <strong>window axis is vocab-sensitive</strong>: the two
|
|
160
|
+
same-vocab Gemmas behave identically, only CPM5 (less tail to inflate) diverges. 12B was the control, and it tracked e4b, not CPM5.
|
|
161
|
+
</div>
|
|
162
|
+
|
|
163
|
+
<h2><span class="n">7</span>L_W — the curvature knob</h2>
|
|
164
|
+
<p>The <code>out_scale</code> derivation pins the top→reference anchor to <code>target_gap</code>, so <code>L_W</code> doesn't move the anchor — it bends
|
|
165
|
+
the <strong>curvature</strong> of the mid/tail. Swept across six orders of magnitude (γ from −0.06 to 2.46):</p>
|
|
166
|
+
<figure><svg viewBox="0 0 800 480" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">L_W (OOTF γ) — diversity curve</title><desc id="d">Diversity vs OOTF gamma for the L_W knob; coherent band shaded, walls at gamma below 0 and above ~2.4, interior diversity peak near gamma 1.</desc><text x="400" y="28" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">L_W across 3 models — a coherence-robust curvature knob; diversity response differs</text><text x="400" y="46" text-anchor="middle" font-size="11.5" fill="var(--text-secondary,#6b7280)">x = OOTF γ (= 1.2 + 0.42·log₁₀(L_W/1000)) · y = diversity (1−self-BLEU) · 3 models · coherent across ~5 decades, walls only at the extremes</text><rect x="165.78947368421052" y="70" width="466.66666666666663" height="326" fill="var(--positive,#16a34a)" fill-opacity="0.06"/><text x="399.12280701754383" y="84" text-anchor="middle" font-size="10.5" fill="var(--positive,#16a34a)" font-weight="600">coherent band (L_W 3 … 100k+)</text><line x1="131.4035087719298" y1="70" x2="131.4035087719298" y2="396" stroke="#ef4444" stroke-width="1.5" stroke-dasharray="4 3" stroke-opacity="0.7"/><text x="127.40350877192981" y="390" text-anchor="end" font-size="10" fill="#b91c1c">γ<0 inverts → wall (all)</text><line x1="720.8771929824561" y1="70" x2="720.8771929824561" y2="396" stroke="#ef4444" stroke-width="1.5" stroke-dasharray="4 3" stroke-opacity="0.7"/><text x="715.8771929824561" y="98" text-anchor="end" font-size="10" fill="#b91c1c">over-sharpen wall (Gemmas only)</text><line x1="70" y1="375.625" x2="770" y2="375.625" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="379.625" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="70" y1="324.6875" x2="770" y2="324.6875" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="328.6875" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.55</text><line x1="70" y1="273.7499999999999" x2="770" y2="273.7499999999999" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="277.7499999999999" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="70" y1="222.8124999999999" x2="770" y2="222.8124999999999" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="226.8124999999999" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.65</text><line x1="70" y1="171.87499999999986" x2="770" y2="171.87499999999986" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="175.87499999999986" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.70</text><line x1="70" y1="120.93749999999983" x2="770" y2="120.93749999999983" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="124.93749999999983" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.75</text><line x1="70" y1="69.99999999999979" x2="770" y2="69.99999999999979" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="73.99999999999979" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.80</text><line x1="131.4035087719298" y1="396" x2="131.4035087719298" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="131.4035087719298" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">0.0</text><text x="131.4035087719298" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 100</text><line x1="254.21052631578945" y1="396" x2="254.21052631578945" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="254.21052631578945" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">0.5</text><text x="254.21052631578945" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 21</text><line x1="377.0175438596491" y1="396" x2="377.0175438596491" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="377.0175438596491" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.0</text><text x="377.0175438596491" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 334</text><line x1="426.14035087719293" y1="396" x2="426.14035087719293" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="426.14035087719293" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.2</text><text x="426.14035087719293" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 1k</text><line x1="499.82456140350877" y1="396" x2="499.82456140350877" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="499.82456140350877" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.5</text><text x="499.82456140350877" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 5k</text><line x1="622.6315789473684" y1="396" x2="622.6315789473684" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="622.6315789473684" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">2.0</text><text x="622.6315789473684" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 80k</text><line x1="745.438596491228" y1="396" x2="745.438596491228" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="745.438596491228" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">2.5</text><text x="745.438596491228" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 1.4M</text><text x="420" y="466" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">OOTF γ → sharper</text><text x="18" y="233" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 18 233)">diversity →</text><rect x="70" y="151.50000000000006" width="700" height="40.749999999999886" fill="var(--text-tertiary,#9ca3af)" fill-opacity="0.13"/><line x1="70" y1="192.24999999999994" x2="770" y2="192.24999999999994" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1" stroke-dasharray="6 4" stroke-opacity="0.7"/><line x1="70" y1="151.50000000000006" x2="770" y2="151.50000000000006" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1" stroke-dasharray="6 4" stroke-opacity="0.7"/><text x="766" y="146.50000000000006" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">default recipes (0.68–0.72)</text><path d="M165.8 202.4 L219.8 182.1 L268.9 192.2 L323.0 182.1 L372.1 110.8 L426.1 151.5 L475.3 283.9 L529.3 263.6 L578.4 263.6 L632.5 304.3" fill="none" stroke="#2563eb" stroke-width="2.5"/><circle cx="165.78947368421052" cy="202.43749999999997" r="3.5" fill="#2563eb"/><circle cx="219.82456140350877" cy="182.06250000000006" r="3.5" fill="#2563eb"/><circle cx="268.9473684210526" cy="192.24999999999994" r="3.5" fill="#2563eb"/><circle cx="322.9824561403509" cy="182.06250000000006" r="3.5" fill="#2563eb"/><circle cx="372.1052631578947" cy="110.75000000000003" r="3.5" fill="#2563eb"/><circle cx="426.14035087719293" cy="151.50000000000006" r="3.5" fill="#2563eb"/><circle cx="475.26315789473676" cy="283.9375" r="3.5" fill="#2563eb"/><circle cx="529.2982456140351" cy="263.5625" r="3.5" fill="#2563eb"/><circle cx="578.421052631579" cy="263.5625" r="3.5" fill="#2563eb"/><circle cx="632.4561403508771" cy="304.3125000000001" r="3.5" fill="#2563eb"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><text x="735.6140350877192" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><path d="M165.8 345.1 L219.8 365.4 L268.9 365.4 L323.0 365.4 L372.1 314.5 L426.1 334.9 L475.3 334.9 L529.3 324.7 L578.4 324.7 L632.5 324.7" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="165.78947368421052" cy="345.06249999999994" r="3.5" fill="#d97706"/><circle cx="219.82456140350877" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="268.9473684210526" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="322.9824561403509" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="372.1052631578947" cy="314.4999999999999" r="3.5" fill="#d97706"/><circle cx="426.14035087719293" cy="334.87499999999994" r="3.5" fill="#d97706"/><circle cx="475.26315789473676" cy="334.87499999999994" r="3.5" fill="#d97706"/><circle cx="529.2982456140351" cy="324.6875" r="3.5" fill="#d97706"/><circle cx="578.421052631579" cy="324.6875" r="3.5" fill="#d97706"/><circle cx="632.4561403508771" cy="324.6875" r="3.5" fill="#d97706"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><text x="735.6140350877192" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><path d="M165.8 233.0 L219.8 283.9 L268.9 263.6 L323.0 304.3 L372.1 304.3 L426.1 314.5 L475.3 324.7 L529.3 294.1 L578.4 314.5 L632.5 345.1 L735.6 314.5" fill="none" stroke="#0891b2" stroke-width="2.5"/><circle cx="165.78947368421052" cy="233" r="3.5" fill="#0891b2"/><circle cx="219.82456140350877" cy="283.9375" r="3.5" fill="#0891b2"/><circle cx="268.9473684210526" cy="263.5625" r="3.5" fill="#0891b2"/><circle cx="322.9824561403509" cy="304.3125000000001" r="3.5" fill="#0891b2"/><circle cx="372.1052631578947" cy="304.3125000000001" r="3.5" fill="#0891b2"/><circle cx="426.14035087719293" cy="314.4999999999999" r="3.5" fill="#0891b2"/><circle cx="475.26315789473676" cy="324.6875" r="3.5" fill="#0891b2"/><circle cx="529.2982456140351" cy="294.125" r="3.5" fill="#0891b2"/><circle cx="578.421052631579" cy="314.4999999999999" r="3.5" fill="#0891b2"/><circle cx="632.4561403508771" cy="345.06249999999994" r="3.5" fill="#0891b2"/><circle cx="735.6140350877192" cy="314.4999999999999" r="3.5" fill="#0891b2"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><line x1="295" y1="61" x2="315" y2="61" stroke="#2563eb" stroke-width="2.5"/><circle cx="305" cy="61" r="3.5" fill="#2563eb"/><text x="321" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">e4b</text><line x1="365" y1="61" x2="385" y2="61" stroke="#d97706" stroke-width="2.5"/><circle cx="375" cy="61" r="3.5" fill="#d97706"/><text x="391" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">12B</text><line x1="435" y1="61" x2="455" y2="61" stroke="#0891b2" stroke-width="2.5"/><circle cx="445" cy="61" r="3.5" fill="#0891b2"/><text x="461" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">CPM5</text></svg><figcaption><b>L_W diversity curve, three models.</b> Coherence is robust across ~5 decades; the knob walls only at the extremes (γ<0 inverts the ranking; γ≳2.4 over-sharpens — Gemma-only). The coherence structure here is solid; the diversity <em>traces are the coarse K=6 sweep</em> and are revised downward at K=20 — see §9.</figcaption></figure>
|
|
167
|
+
<ul class="clean">
|
|
168
|
+
<li><strong>Not a gate.</strong> Coherent across <code>L_W ∈ [3, 10⁵]</code> — five decades — versus the gates' tight unit-scale breaks. It
|
|
169
|
+
walls only at the <em>extremes</em>: low (γ<0 inverts the token ranking → junk; universal) and high (γ≳2.4 over-sharpens → junk; Gemma-only, CPM5's smaller vocab passes).</li>
|
|
170
|
+
<li><strong>Diversity: a retracted win.</strong> At K=6, e4b's curve looked like an interior peak that <em>beat</em> its default. At K=20
|
|
171
|
+
(§9) that evaporates — every <code>L_W</code> setting sits well below the default. The honest read: <strong>L_W's diversity is uniformly below the
|
|
172
|
+
recommended recipe</strong>; the apparent e4b win was small-sample noise. <code>L_W</code>'s real character is its coherence robustness, not a diversity gain.</li>
|
|
173
|
+
</ul>
|
|
174
|
+
|
|
175
|
+
<h2><span class="n">8</span>Resolving the cliffs</h2>
|
|
176
|
+
<p>The coarse maps stepped <em>over</em> the steepest features. Stepping <code>target_gap</code> and <code>W</code> at unit resolution (with the
|
|
177
|
+
junk% gradient, not just pass/fail) reveals two qualitatively different cliff <em>shapes</em>.</p>
|
|
178
|
+
<figure><svg viewBox="0 0 920 450" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG cliff resolution — two shapes</title><desc id="d">Fine junk% gradient through the target_gap cliff (a graded ramp, position shifts by vocab) and the W lower edge at high A (a sharp model-invariant edge near 7.5), three models.</desc><text x="460" y="30" text-anchor="middle" font-size="16.5" font-weight="700" fill="var(--text-primary,#1f2937)">Fine cliff resolution — the coarse grid jumped over two different shapes</text><text x="460" y="49" text-anchor="middle" font-size="11.5" fill="var(--text-secondary,#6b7280)">unit steps · mean canary junk% (K=5 seeds) · the transition the 8/12 and 5/10 jumps hid</text><text x="244" y="42" text-anchor="middle" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap cliff — a graded ramp</text><text x="244" y="58" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">base (A=0.35, s_m=0.7, W=6) · position shifts by vocab</text><line x1="44" y1="380" x2="444" y2="380" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="384" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="44" y1="291.17647058823525" x2="444" y2="291.17647058823525" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="295.17647058823525" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">10%</text><line x1="44" y1="202.35294117647058" x2="444" y2="202.35294117647058" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="206.35294117647058" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">20%</text><line x1="44" y1="113.52941176470588" x2="444" y2="113.52941176470588" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="117.52941176470588" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">30%</text><line x1="44" y1="371.11764705882354" x2="444" y2="371.11764705882354" stroke="var(--positive,#16a34a)" stroke-width="1.2" stroke-dasharray="5 3" stroke-opacity="0.8"/><text x="444" y="367.11764705882354" text-anchor="end" font-size="9.5" fill="var(--positive,#16a34a)">coherent <1%</text><line x1="44" y1="380" x2="44" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="44" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><line x1="110.66666666666666" y1="380" x2="110.66666666666666" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="110.66666666666666" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><line x1="177.33333333333331" y1="380" x2="177.33333333333331" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="177.33333333333331" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><line x1="244" y1="380" x2="244" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="244" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><line x1="310.66666666666663" y1="380" x2="310.66666666666663" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="310.66666666666663" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">11</text><line x1="377.33333333333337" y1="380" x2="377.33333333333337" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="377.33333333333337" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">12</text><line x1="444" y1="380" x2="444" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="444" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">13</text><text x="244" y="416" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">target_gap →</text><path d="M44.0 131.3 L110.7 104.6 L177.3 229.0 L244.0 371.1 L310.7 371.1 L377.3 380.0 L444.0 380.0" fill="none" stroke="#2563eb" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="131.29411764705884" r="3" fill="#2563eb"/><circle cx="110.66666666666666" cy="104.64705882352942" r="3" fill="#2563eb"/><circle cx="177.33333333333331" cy="229" r="3" fill="#2563eb"/><circle cx="244" cy="371.11764705882354" r="3" fill="#2563eb"/><circle cx="310.66666666666663" cy="371.11764705882354" r="3" fill="#2563eb"/><circle cx="377.33333333333337" cy="380" r="3" fill="#2563eb"/><circle cx="444" cy="380" r="3" fill="#2563eb"/><path d="M44.0 166.8 L110.7 229.0 L177.3 344.5 L244.0 371.1 L310.7 380.0 L377.3 380.0 L444.0 380.0" fill="none" stroke="#d97706" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="166.8235294117647" r="3" fill="#d97706"/><circle cx="110.66666666666666" cy="229" r="3" fill="#d97706"/><circle cx="177.33333333333331" cy="344.4705882352941" r="3" fill="#d97706"/><circle cx="244" cy="371.11764705882354" r="3" fill="#d97706"/><circle cx="310.66666666666663" cy="380" r="3" fill="#d97706"/><circle cx="377.33333333333337" cy="380" r="3" fill="#d97706"/><circle cx="444" cy="380" r="3" fill="#d97706"/><path d="M44.0 300.1 L110.7 371.1 L177.3 371.1 L244.0 362.2 L310.7 380.0 L377.3 380.0 L444.0 380.0" fill="none" stroke="#0891b2" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="300.05882352941177" r="3" fill="#0891b2"/><circle cx="110.66666666666666" cy="371.11764705882354" r="3" fill="#0891b2"/><circle cx="177.33333333333331" cy="371.11764705882354" r="3" fill="#0891b2"/><circle cx="244" cy="362.2352941176471" r="3" fill="#0891b2"/><circle cx="310.66666666666663" cy="380" r="3" fill="#0891b2"/><circle cx="377.33333333333337" cy="380" r="3" fill="#0891b2"/><circle cx="444" cy="380" r="3" fill="#0891b2"/><text x="704" y="42" text-anchor="middle" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">W edge @ A=100 — a sharp cliff</text><text x="704" y="58" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">channel closes abruptly 7→8 in all three</text><line x1="504" y1="380" x2="904" y2="380" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="384" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="504" y1="291.17647058823525" x2="904" y2="291.17647058823525" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="295.17647058823525" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">10%</text><line x1="504" y1="202.35294117647058" x2="904" y2="202.35294117647058" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="206.35294117647058" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">20%</text><line x1="504" y1="113.52941176470588" x2="904" y2="113.52941176470588" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="117.52941176470588" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">30%</text><line x1="504" y1="371.11764705882354" x2="904" y2="371.11764705882354" stroke="var(--positive,#16a34a)" stroke-width="1.2" stroke-dasharray="5 3" stroke-opacity="0.8"/><text x="904" y="367.11764705882354" text-anchor="end" font-size="9.5" fill="var(--positive,#16a34a)">coherent <1%</text><line x1="504" y1="380" x2="504" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="504" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">3</text><line x1="561.1428571428571" y1="380" x2="561.1428571428571" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="561.1428571428571" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><line x1="618.2857142857142" y1="380" x2="618.2857142857142" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="618.2857142857142" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">5</text><line x1="675.4285714285714" y1="380" x2="675.4285714285714" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="675.4285714285714" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">6</text><line x1="732.5714285714286" y1="380" x2="732.5714285714286" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="732.5714285714286" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><line x1="789.7142857142858" y1="380" x2="789.7142857142858" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="789.7142857142858" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><line x1="846.8571428571429" y1="380" x2="846.8571428571429" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="846.8571428571429" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><line x1="904" y1="380" x2="904" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="904" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="704" y="416" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">window (W) →</text><path d="M504.0 166.8 L561.1 157.9 L618.3 202.4 L675.4 131.3 L732.6 237.9 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#2563eb" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="166.8235294117647" r="3" fill="#2563eb"/><circle cx="561.1428571428571" cy="157.94117647058823" r="3" fill="#2563eb"/><circle cx="618.2857142857142" cy="202.35294117647058" r="3" fill="#2563eb"/><circle cx="675.4285714285714" cy="131.29411764705884" r="3" fill="#2563eb"/><circle cx="732.5714285714286" cy="237.88235294117646" r="3" fill="#2563eb"/><circle cx="789.7142857142858" cy="380" r="3" fill="#2563eb"/><circle cx="846.8571428571429" cy="380" r="3" fill="#2563eb"/><circle cx="904" cy="380" r="3" fill="#2563eb"/><path d="M504.0 149.1 L561.1 149.1 L618.3 166.8 L675.4 220.1 L732.6 264.5 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#d97706" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="149.05882352941177" r="3" fill="#d97706"/><circle cx="561.1428571428571" cy="149.05882352941177" r="3" fill="#d97706"/><circle cx="618.2857142857142" cy="166.8235294117647" r="3" fill="#d97706"/><circle cx="675.4285714285714" cy="220.11764705882354" r="3" fill="#d97706"/><circle cx="732.5714285714286" cy="264.52941176470586" r="3" fill="#d97706"/><circle cx="789.7142857142858" cy="380" r="3" fill="#d97706"/><circle cx="846.8571428571429" cy="380" r="3" fill="#d97706"/><circle cx="904" cy="380" r="3" fill="#d97706"/><path d="M504.0 282.3 L561.1 282.3 L618.3 300.1 L675.4 344.5 L732.6 362.2 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#0891b2" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="282.29411764705884" r="3" fill="#0891b2"/><circle cx="561.1428571428571" cy="282.29411764705884" r="3" fill="#0891b2"/><circle cx="618.2857142857142" cy="300.05882352941177" r="3" fill="#0891b2"/><circle cx="675.4285714285714" cy="344.4705882352941" r="3" fill="#0891b2"/><circle cx="732.5714285714286" cy="362.2352941176471" r="3" fill="#0891b2"/><circle cx="789.7142857142858" cy="380" r="3" fill="#0891b2"/><circle cx="846.8571428571429" cy="380" r="3" fill="#0891b2"/><circle cx="904" cy="380" r="3" fill="#0891b2"/><line x1="310" y1="436" x2="330" y2="436" stroke="#2563eb" stroke-width="2.5"/><circle cx="320" cy="436" r="3" fill="#2563eb"/><text x="336" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">e4b</text><line x1="410" y1="436" x2="430" y2="436" stroke="#d97706" stroke-width="2.5"/><circle cx="420" cy="436" r="3" fill="#d97706"/><text x="436" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">12B</text><line x1="510" y1="436" x2="530" y2="436" stroke="#0891b2" stroke-width="2.5"/><circle cx="520" cy="436" r="3" fill="#0891b2"/><text x="536" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">CPM5</text></svg><figcaption><b>Fine cliff resolution.</b> target_gap is a graded ramp whose position slides with vocab; W at high A is a sharp edge that closes at 7→8 in every model. Two different shapes the coarse 8/12 and 5/10 jumps had hidden.</figcaption></figure>
|
|
179
|
+
<ul class="clean">
|
|
180
|
+
<li><strong><code>target_gap</code> is a graded ramp</strong>, not a step — a 2–3-step slope. Its <em>position</em> shifts by vocab (CPM5 coherent earliest, e4b latest).</li>
|
|
181
|
+
<li><strong><code>W</code> at high <code>A</code> is a sharp edge</strong> — a high plateau then an abrupt close at W=8 in all three models. The <em>edge position is model-invariant</em>; only the plateau height varies by vocab.</li>
|
|
182
|
+
</ul>
|
|
183
|
+
<div class="callout rock">
|
|
184
|
+
<h4>A disconfirmed prediction (logged, not buried)</h4>
|
|
185
|
+
We expected 12B's <code>target_gap</code> cliff to be the <em>steepest</em>. It is not — e4b's is at least as steep. 12B's genuine
|
|
186
|
+
"sensitivity" is in <em>diversity</em> (the L_W suppression), a different axis. The prior was a rock; it's recorded as a data point and we moved on.
|
|
187
|
+
</div>
|
|
188
|
+
|
|
189
|
+
<h2><span class="n">9</span>K=20 deep-dive — settling the noise</h2>
|
|
190
|
+
<p>Four experiments re-run at K=20, where the noisy diversity metric finally settles. Two mixed variables to resolve how
|
|
191
|
+
the cliffs bend; two re-measured the diversity claims that sat within K=6 noise.</p>
|
|
192
|
+
|
|
193
|
+
<h3>The cliffs are tilted surfaces, not fixed walls</h3>
|
|
194
|
+
<figure><svg viewBox="0 0 900 360" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">K=20 coherence surfaces</title><desc id="d">Two fine 2-D coherence grids at K=20. The target_gap cliff slides monotonically with s_m; the W edge slides with A. Cells show mean junk percent; dot = coherent.</desc><text x="450" y="26" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">Coherence is a tilted surface, not a fixed wall (K=20)</text><text x="450" y="45" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">cell = mean canary junk% over 20 seeds · green dot = coherent · red = junk, darker = worse</text><text x="215" y="69" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap ramp × s_m</text><text x="215" y="85" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">the cliff slides with the coupling hub</text><rect x="95" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="114" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="135" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="154" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="175" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="194" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="215" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="234" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="255" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="274" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="295" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="314" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="95" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="135" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.67" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">20</text><rect x="175" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.23" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">7</text><rect x="215" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="234" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="255" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="274" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="295" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="314" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="95" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="135" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="175" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.90" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">27</text><rect x="215" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.77" stroke="#dc2626" stroke-opacity="0.28"/><text x="234" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">23</text><rect x="255" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.50" stroke="#dc2626" stroke-opacity="0.28"/><text x="274" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">15</text><rect x="295" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.33" stroke="#dc2626" stroke-opacity="0.28"/><text x="314" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">10</text><rect x="95" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="135" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="175" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="215" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="234" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="255" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="274" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="295" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.67" stroke="#dc2626" stroke-opacity="0.28"/><text x="314" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">20</text><text x="114" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><text x="154" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><text x="194" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><text x="234" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="274" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">11</text><text x="314" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">12</text><text x="88" y="118" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">0.2</text><text x="88" y="158" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">0.7</text><text x="88" y="198" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">2</text><text x="88" y="238" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><text x="215" y="285" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">target_gap →</text><text x="65" y="175" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 65 175)">s_m →</text><text x="697" y="69" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">W sharp edge × A</text><text x="697" y="85" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">the channel-close slides with A (≈4 at low A, ≈8 at A=100)</text><rect x="545" y="95" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="117" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="583" y="95" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="117" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="621" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="639" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="659" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="677" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="697" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="715" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="735" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="545" y="133" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="155" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="583" y="133" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.18" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="155" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">5</text><rect x="621" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="639" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="659" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="677" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="697" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="715" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="735" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="545" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="583" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="621" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.87" stroke="#dc2626" stroke-opacity="0.28"/><text x="639" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">26</text><rect x="659" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.53" stroke="#dc2626" stroke-opacity="0.28"/><text x="677" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">16</text><rect x="697" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="715" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="735" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><text x="563" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">3</text><text x="601" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><text x="639" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">5</text><text x="677" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">6</text><text x="715" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><text x="753" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><text x="791" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><text x="829" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="538" y="117" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">1</text><text x="538" y="155" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="538" y="193" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">100</text><text x="697" y="239" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">window (W) →</text><text x="515" y="152" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 515 152)">A →</text></svg><figcaption><b>Fine 2-D coherence at K=20.</b> Left: the target_gap cliff slides monotonically with s_m — at s_m=0.2 there is no cliff at all; raise s_m and the tg needed for coherence climbs out of frame. Right: the W edge slides with A — it closes at W≈4–5 for low A but not until W≈8 at A=100, so the earlier 'invariant 7→8 edge' was specific to A=100.</figcaption></figure>
|
|
195
|
+
<p>The "coupling hub" isn't a metaphor: <code>s_m</code> literally translates the <code>target_gap</code> cliff edge, and <code>A</code>
|
|
196
|
+
translates the <code>W</code> edge. The base-config slices resolved in §8 were single rows through these tilted surfaces.</p>
|
|
197
|
+
|
|
198
|
+
<h3>One diversity claim dies, one confirms</h3>
|
|
199
|
+
<figure><svg viewBox="0 0 900 300" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t2 d2" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t2">K=20 diversity sweeps</title><desc id="d2">At K=20, L_W diversity sits uniformly below the default; the A gradient is a clean monotone that only beats default at the loosest A.</desc><text x="450" y="24" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">Settled diversity at K=20 — one claim dies, one confirms</text><text x="239" y="48" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">L_W around the supposed peak</text><text x="239" y="64" text-anchor="middle" font-size="10.5" fill="#2563eb">K=20: uniformly BELOW default — the K=6 peak was noise</text><line x1="42" y1="307.06666666666666" x2="436" y2="307.06666666666666" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="311.06666666666666" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.30</text><line x1="42" y1="245.73333333333332" x2="436" y2="245.73333333333332" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="249.73333333333332" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.40</text><line x1="42" y1="184.40000000000003" x2="436" y2="184.40000000000003" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="188.40000000000003" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="42" y1="123.06666666666669" x2="436" y2="123.06666666666669" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="127.06666666666669" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="42" y1="102.82666666666668" x2="436" y2="102.82666666666668" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1.3" stroke-dasharray="6 4"/><text x="436" y="97.82666666666668" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">default 0.633</text><line x1="82.7586206896552" y1="258" x2="82.7586206896552" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="82.7586206896552" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.8</text><line x1="232.20689655172413" y1="258" x2="232.20689655172413" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="232.20689655172413" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">1.0</text><line x1="368.06896551724134" y1="258" x2="368.06896551724134" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="368.06896551724134" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">1.2</text><text x="239" y="291" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">OOTF γ →</text><path d="M82.8 232.9 L130.3 234.7 L177.9 238.4 L225.4 226.1 L273.0 221.8 L320.5 217.5 L368.1 219.4 L415.6 220.6" fill="none" stroke="#2563eb" stroke-width="2.5"/><circle cx="82.7586206896552" cy="232.85333333333335" r="3.5" fill="#2563eb" /><circle cx="130.3103448275862" cy="234.69333333333336" r="3.5" fill="#2563eb" /><circle cx="177.86206896551727" cy="238.37333333333336" r="3.5" fill="#2563eb" /><circle cx="225.41379310344828" cy="226.10666666666668" r="3.5" fill="#2563eb" /><circle cx="272.9655172413793" cy="221.81333333333333" r="3.5" fill="#2563eb" /><circle cx="320.51724137931024" cy="217.52" r="3.5" fill="#2563eb" /><circle cx="368.06896551724134" cy="219.36" r="3.5" fill="#2563eb" /><circle cx="415.62068965517244" cy="220.58666666666667" r="3.5" fill="#2563eb" /><text x="689" y="48" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">A diversity gradient</text><text x="689" y="64" text-anchor="middle" font-size="10.5" fill="#16a34a">clean monotone — the free lever; only loosest A beats default</text><line x1="492" y1="248.8" x2="886" y2="248.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="252.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.30</text><line x1="492" y1="202.8" x2="886" y2="202.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="206.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.40</text><line x1="492" y1="156.8" x2="886" y2="156.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="160.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="492" y1="110.80000000000004" x2="886" y2="110.80000000000004" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="114.80000000000004" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="492" y1="95.62" x2="886" y2="95.62" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1.3" stroke-dasharray="6 4"/><text x="886" y="90.62" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">default 0.633</text><line x1="510.76190476190476" y1="258" x2="510.76190476190476" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="510.76190476190476" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.01</text><line x1="641.9019912897102" y1="258" x2="641.9019912897102" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="641.9019912897102" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.05</text><line x1="698.3809523809524" y1="258" x2="698.3809523809524" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="698.3809523809524" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.1</text><line x1="800.4584807019089" y1="258" x2="800.4584807019089" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="800.4584807019089" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.35</text><line x1="856.937441793151" y1="258" x2="856.937441793151" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="856.937441793151" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.7</text><text x="689" y="291" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">A (shoulder) →</text><path d="M510.8 81.8 L641.9 140.2 L698.4 160.0 L754.9 180.7 L800.5 185.8 L856.9 242.4" fill="none" stroke="#16a34a" stroke-width="2.5"/><circle cx="510.76190476190476" cy="81.82" r="5" fill="#16a34a" stroke="#16a34a" stroke-width="2"/><circle cx="641.9019912897102" cy="140.24" r="3.5" fill="#16a34a" /><circle cx="698.3809523809524" cy="160.02000000000004" r="3.5" fill="#16a34a" /><circle cx="754.8599134721946" cy="180.72000000000003" r="3.5" fill="#16a34a" /><circle cx="800.4584807019089" cy="185.78000000000003" r="3.5" fill="#16a34a" /><circle cx="856.937441793151" cy="242.36" r="3.5" fill="#16a34a" /></svg><figcaption><b>Settled diversity at K=20 (e4b default = 0.633).</b> Left: every L_W setting sits ~0.19 below default — the K=6 '0.76 beats default' was small-sample noise. Right: the A gradient is a clean monotone, and only the loosest A (0.01, ringed) clears the default line.</figcaption></figure>
|
|
200
|
+
<div class="callout rock">
|
|
201
|
+
<h4>K=6 → K=20: a claim retracted</h4>
|
|
202
|
+
At K=6, e4b's <code>L_W</code> curve appeared to peak <em>above</em> its default (0.76 vs 0.70). At K=20 it does not — the default
|
|
203
|
+
is 0.633 and every <code>L_W</code> point sits at 0.42–0.45. The peak was noise. This brings e4b in line with what K=6 already
|
|
204
|
+
showed for 12B and CPM5 (both below their defaults): across the board, <strong>HLG's curvature knob does not beat the recommended recipe on diversity.</strong>
|
|
205
|
+
</div>
|
|
206
|
+
<div class="callout terrain">
|
|
207
|
+
<h4>What K=20 confirms</h4>
|
|
208
|
+
<code>A</code> is the genuine <strong>free diversity lever</strong>: diversity falls cleanly and monotonically as <code>A</code> tightens
|
|
209
|
+
(0.66 → 0.31 across A 0.01→0.7), and the <em>one</em> place HLG clears a model's default at all is the loosest <code>A</code> (+0.03 at A=0.01).
|
|
210
|
+
Modest, but real and reproducible. <span style="color:var(--text-tertiary)">(The A sweep was cut at A=0.7 when the batch was stopped; the monotone trend and the diversity ceiling are captured.)</span>
|
|
211
|
+
</div>
|
|
212
|
+
|
|
213
|
+
<h3>The texture of the edges</h3>
|
|
214
|
+
<p>Zooming sub-unit into the transitions (K=20, tracking break-<em>rate</em> and max, not just the mean) shows the "cliffs" are not
|
|
215
|
+
all the same kind of thing.</p>
|
|
216
|
+
<figure><svg viewBox="0 0 860 536" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG edge texture</title><desc id="d">Break-rate across the four transition zooms at K=20: the gate cliffs are soft probabilistic ramps, the L_W low wall is a hard threshold at gamma 0, the high wall is barely there.</desc><text x="430" y="26" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">Edge texture (K=20) — break-rate, not magnitude, is what slides</text><text x="46" y="58" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap ramp</text><text x="414" y="58" text-anchor="end" font-size="11.5" font-weight="700" fill="#d97706">soft · probabilistic</text><line x1="46" y1="240" x2="414" y2="240" stroke="var(--grid,#eef2f7)"/><text x="40" y="243" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="46" y1="200.5" x2="414" y2="200.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="203.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="46" y1="161" x2="414" y2="161" stroke="var(--grid,#eef2f7)"/><text x="40" y="164" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="46" y1="121.5" x2="414" y2="121.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="124.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="46" y1="82" x2="414" y2="82" stroke="var(--grid,#eef2f7)"/><text x="40" y="85" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="35.77777777777778" y="202.07999999999998" width="20.444444444444443" height="37.92" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="81.77777777777777" y="205.24" width="20.444444444444443" height="34.76" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="127.77777777777777" y="208.4" width="20.444444444444443" height="31.6" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="173.77777777777777" y="217.88" width="20.444444444444443" height="22.12" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="219.77777777777777" y="228.94" width="20.444444444444443" height="11.06" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="265.77777777777777" y="230.52" width="20.444444444444443" height="9.48" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="311.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="357.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="403.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M46.0 82.0 L92.0 82.0 L138.0 82.0 L184.0 105.7 L230.0 129.4 L276.0 161.0 L322.0 224.2 L368.0 224.2 L414.0 216.3" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="46" cy="82" r="3" fill="#d97706"/><circle cx="92" cy="82" r="3" fill="#d97706"/><circle cx="138" cy="82" r="3" fill="#d97706"/><circle cx="184" cy="105.7" r="3" fill="#d97706"/><circle cx="230" cy="129.4" r="3" fill="#d97706"/><circle cx="276" cy="161" r="3" fill="#d97706"/><circle cx="322" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="368" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="414" cy="216.29999999999998" r="3" fill="#d97706"/><text x="46" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7</text><text x="138" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">8</text><text x="230" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">9</text><text x="322" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">10</text><text x="414" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">11</text><text x="230" y="271" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">target_gap →</text><text x="476" y="58" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">W channel-close (A=100)</text><text x="844" y="58" text-anchor="end" font-size="11.5" font-weight="700" fill="#d97706">soft · steeper</text><line x1="476" y1="240" x2="844" y2="240" stroke="var(--grid,#eef2f7)"/><text x="470" y="243" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="476" y1="200.5" x2="844" y2="200.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="203.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="476" y1="161" x2="844" y2="161" stroke="var(--grid,#eef2f7)"/><text x="470" y="164" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="476" y1="121.5" x2="844" y2="121.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="124.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="476" y1="82" x2="844" y2="82" stroke="var(--grid,#eef2f7)"/><text x="470" y="85" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="465.77777777777777" y="214.72" width="20.444444444444443" height="25.28" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="527.1111111111112" y="225.78" width="20.444444444444443" height="14.219999999999999" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="588.4444444444445" y="230.52" width="20.444444444444443" height="9.48" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="619.1111111111112" y="232.1" width="20.444444444444443" height="7.9" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="649.7777777777778" y="232.1" width="20.444444444444443" height="7.9" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="680.4444444444446" y="238.42" width="20.444444444444443" height="1.58" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="711.1111111111111" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="772.4444444444446" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="833.7777777777778" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M476.0 97.8 L537.3 97.8 L598.7 161.0 L629.3 184.7 L660.0 208.4 L690.7 208.4 L721.3 224.2 L782.7 240.0 L844.0 240.0" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="476" cy="97.8" r="3" fill="#d97706"/><circle cx="537.3333333333334" cy="97.8" r="3" fill="#d97706"/><circle cx="598.6666666666666" cy="161" r="3" fill="#d97706"/><circle cx="629.3333333333334" cy="184.7" r="3" fill="#d97706"/><circle cx="660" cy="208.4" r="3" fill="#d97706"/><circle cx="690.6666666666667" cy="208.4" r="3" fill="#d97706"/><circle cx="721.3333333333333" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="782.6666666666667" cy="240" r="3" fill="#d97706"/><circle cx="844" cy="240" r="3" fill="#d97706"/><text x="476" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">6</text><text x="598.6666666666666" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7</text><text x="660" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7.5</text><text x="721.3333333333333" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">8</text><text x="844" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">9</text><text x="660" y="271" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">window W →</text><text x="46" y="308" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">L_W low wall (γ→0)</text><text x="414" y="308" text-anchor="end" font-size="11.5" font-weight="700" fill="#dc2626">HARD · at γ=0</text><line x1="46" y1="490" x2="414" y2="490" stroke="var(--grid,#eef2f7)"/><text x="40" y="493" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="46" y1="450.5" x2="414" y2="450.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="453.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="46" y1="411" x2="414" y2="411" stroke="var(--grid,#eef2f7)"/><text x="40" y="414" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="46" y1="371.5" x2="414" y2="371.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="374.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="46" y1="332" x2="414" y2="332" stroke="var(--grid,#eef2f7)"/><text x="40" y="335" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="36.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="67.46666666666665" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="87.91111111111111" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="108.35555555555557" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="128.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="159.46666666666667" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="190.13333333333335" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="231.02222222222224" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="312.80000000000007" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="404.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M46.0 490.0 L76.7 490.0 L97.1 490.0 L117.6 490.0 L138.0 490.0 L168.7 490.0 L199.3 490.0 L240.2 490.0 L322.0 490.0 L414.0 490.0" fill="none" stroke="#dc2626" stroke-width="2.5"/><circle cx="46" cy="490" r="3" fill="#dc2626"/><circle cx="76.66666666666666" cy="490" r="3" fill="#dc2626"/><circle cx="97.11111111111111" cy="490" r="3" fill="#dc2626"/><circle cx="117.55555555555557" cy="490" r="3" fill="#dc2626"/><circle cx="138" cy="490" r="3" fill="#dc2626"/><circle cx="168.66666666666666" cy="490" r="3" fill="#dc2626"/><circle cx="199.33333333333334" cy="490" r="3" fill="#dc2626"/><circle cx="240.22222222222223" cy="490" r="3" fill="#dc2626"/><circle cx="322.00000000000006" cy="490" r="3" fill="#dc2626"/><circle cx="414" cy="490" r="3" fill="#dc2626"/><text x="46" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0</text><text x="97.11111111111111" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.05</text><text x="138" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.09</text><text x="199.33333333333334" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.15</text><text x="322.00000000000006" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.27</text><text x="230" y="521" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">γ →</text><text x="46" y="324" font-size="9.5" fill="var(--text-tertiary,#9ca3af)"><tspan x="46" dy="0">every point γ≥0 is clean — the wall is the sign flip at γ<0, a</tspan><tspan x="46" dy="11">deterministic discontinuity just off the left edge</tspan></text><text x="476" y="308" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">L_W high wall (γ→2.4)</text><text x="844" y="308" text-anchor="end" font-size="11.5" font-weight="700" fill="#16a34a">barely a wall</text><line x1="476" y1="490" x2="844" y2="490" stroke="var(--grid,#eef2f7)"/><text x="470" y="493" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="476" y1="450.5" x2="844" y2="450.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="453.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="476" y1="411" x2="844" y2="411" stroke="var(--grid,#eef2f7)"/><text x="470" y="414" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="476" y1="371.5" x2="844" y2="371.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="374.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="476" y1="332" x2="844" y2="332" stroke="var(--grid,#eef2f7)"/><text x="470" y="335" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="460.6666666666667" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="523.7523809523809" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="597.3523809523812" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="691.9809523809525" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="755.0666666666668" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="828.6666666666666" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M476.0 490.0 L539.1 482.1 L612.7 482.1 L707.3 474.2 L770.4 474.2 L844.0 466.3" fill="none" stroke="#16a34a" stroke-width="2.5"/><circle cx="476" cy="490" r="3" fill="#16a34a"/><circle cx="539.0857142857143" cy="482.1" r="3" fill="#16a34a"/><circle cx="612.6857142857145" cy="482.1" r="3" fill="#16a34a"/><circle cx="707.3142857142859" cy="474.20000000000005" r="3" fill="#16a34a"/><circle cx="770.4000000000002" cy="474.20000000000005" r="3" fill="#16a34a"/><circle cx="844" cy="466.29999999999995" r="3" fill="#16a34a"/><text x="476" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.11</text><text x="539.0857142857143" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.17</text><text x="612.6857142857145" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.24</text><text x="707.3142857142859" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.33</text><text x="770.4000000000002" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.39</text><text x="844" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.46</text><text x="660" y="521" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">γ →</text><text x="476" y="324" font-size="9.5" fill="var(--text-tertiary,#9ca3af)"><tspan x="476" dy="0">only 3/20 break even at γ=2.46 — the coarse 'REJECT' was a</tspan><tspan x="476" dy="11">1-of-2-seed artifact</tspan></text><text x="46" y="530" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">line = % of 20 seeds that broke · faint bars = mean junk% · the cliffs are statistical edges (some seeds wander into junk), not hard thresholds</text></svg><figcaption><b>Edge texture (K=20).</b> Break-rate across the four transition zooms. The gate cliffs are soft probabilistic ramps (a declining fraction of seeds break, while the ones that do break hard); the L_W low wall is a hard deterministic threshold at γ=0 (the ranking sign-flip); the high wall is barely a wall (3/20 even at γ=2.46).</figcaption></figure>
|
|
217
|
+
<ul class="clean">
|
|
218
|
+
<li><strong>The gate cliffs (<code>tg</code>, <code>W</code>) are <em>statistical</em> edges.</strong> Per seed it's bimodal — clean or hard-break (max stays
|
|
219
|
+
43–88% mid-ramp) — so the smooth "ramp" is really the declining <em>fraction</em> of seeds that wander into junk, not a softening failure.</li>
|
|
220
|
+
<li><strong>The <code>L_W</code> low wall is a <em>hard</em> threshold at γ=0</strong> — a sign flip of the ranking, deterministic. Every sampled γ≥0 is clean.</li>
|
|
221
|
+
<li><strong>The <code>L_W</code> high wall is barely there</strong> — the coarse "REJECT" was a small-sample artifact.</li>
|
|
222
|
+
</ul>
|
|
223
|
+
<div class="callout">
|
|
224
|
+
<h4>Play with it</h4>
|
|
225
|
+
Two interactive companions: <strong><a href="hlg-explorer.html">hlg-explorer.html</a></strong> — drag the sliders and watch the
|
|
226
|
+
transfer curve and the token distribution reshape live (a faithful port of the shaper; its top-1/entropy readout <em>predicts</em>
|
|
227
|
+
coherence — a config whose HLG top-1 collapses below raw will salad). And <strong><a href="hlg-ab.html">hlg-ab.html</a></strong> —
|
|
228
|
+
the same prompts sampled by the default recipe vs HLG-base vs HLG-loose-A, side by side, so the diversity differences are readable as text.
|
|
229
|
+
</div>
|
|
230
|
+
|
|
231
|
+
<h2><span class="n">10</span>Where it stands</h2>
|
|
232
|
+
<p class="lead">A map, held loosely. The durable structural results:</p>
|
|
233
|
+
<ul class="clean">
|
|
234
|
+
<li>The coherence wall is a <strong>coupled <code>tg</code>/<code>W</code>/<code>s_m</code> cluster</strong>; <strong><code>A</code> is an orthogonal, free diversity lever</strong>;
|
|
235
|
+
<strong><code>L_W</code> is a coherence-robust curvature knob</strong> outside the cluster.</li>
|
|
236
|
+
<li>The <strong>sharpness coupling is invariant</strong> across models and architectures; the <strong>window axis is vocab-sensitive</strong>.</li>
|
|
237
|
+
<li>Cliffs come in <strong>two shapes</strong>: <code>target_gap</code> a vocab-shifted ramp, <code>W</code>@highA a model-invariant sharp edge.</li>
|
|
238
|
+
<li>Diversity wins are <strong>marginal</strong>, and K=20 trimmed them further: the only place HLG clears a model's default is the
|
|
239
|
+
loosest <code>A</code> (+0.03), and <code>L_W</code> shaping sits below default everywhere. The value here is the <em>geometry</em>, not a diversity gain.</li>
|
|
240
|
+
<li>The curve <strong>shape is secondary to the final sharpness</strong> (<code>out_scale</code>, set by <code>target_gap</code>). A heavily
|
|
241
|
+
reshaped curve with <code>target_gap≈4</code> flattens the distribution (HLG top-1 25% vs raw 50%, entropy <em>up</em>) and salads on every seed —
|
|
242
|
+
so the distribution's top-1/entropy, not the curve's looks, is the coherence oracle. The interactive explorer makes this checkable before you ever run the model.</li>
|
|
243
|
+
</ul>
|
|
244
|
+
<p>Open threads: a blind external-judge read of the actual text (the one instrument not yet collected); the <code>A</code> diversity
|
|
245
|
+
gradient on 12B/CPM5 at K=20 (only e4b is settled); finishing the cut A sweep (≥1.5) and re-measuring 12B/CPM5's <code>L_W</code> diversity at K=20.</p>
|
|
246
|
+
|
|
247
|
+
<div class="foot">
|
|
248
|
+
<p><strong>Run index.</strong> Logs preserved under <code>docs/investigations/hlg-runs/</code>; full write-up in
|
|
249
|
+
<code>docs/investigations/hlg-sampling-investigation.md</code>. Generators: <code>hlg-map</code>, <code>hlg-cross</code>, <code>hlg-lw</code>,
|
|
250
|
+
<code>hlg-cliff</code>, <code>hlg-grid2</code>, <code>hlg-peak</code> (+ the <code>*-viz</code> figure builders).</p>
|
|
251
|
+
<div class="runidx">
|
|
252
|
+
<div><code>run0–O</code> — pivots, passes 1–4 (e4b)</div>
|
|
253
|
+
<div><code>runP/Q/R</code> — A×s_m, tg×W grids, blind</div>
|
|
254
|
+
<div><code>runS</code> — cross-pair coherence (e4b)</div>
|
|
255
|
+
<div><code>runT/U</code> — cross-pair on CPM5 / 12B</div>
|
|
256
|
+
<div><code>runV/W/X</code> — L_W sweep on e4b / 12B / CPM5</div>
|
|
257
|
+
<div><code>runY/Z/AA</code> — cliff resolution, 3 models</div>
|
|
258
|
+
<div><code>runAB/AC</code> — K=20 grids / peaks (e4b)</div>
|
|
259
|
+
</div>
|
|
260
|
+
</div>
|
|
261
|
+
|
|
262
|
+
</div></body></html>
|