mlx-bun 0.0.13 → 0.3.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (427) hide show
  1. package/README.md +71 -578
  2. package/bin/mlx-bun.mjs +1 -1
  3. package/docs/README.md +91 -0
  4. package/docs/{design → archive}/hlg-sampling.md +3 -3
  5. package/docs/{design → archive/investigations}/audio-input-plan.md +4 -4
  6. package/docs/{design → archive/investigations}/colibri-glm52-port.md +1 -1
  7. package/docs/{design → archive/investigations}/diffusion-gemma-port.md +3 -3
  8. package/docs/{design → archive/investigations}/faithful-l1-consolidation.md +4 -4
  9. package/docs/{investigations → archive/investigations}/hlg-sampling-investigation.md +1 -1
  10. package/docs/{design → archive/investigations}/minicpm5-decode-megakernel.md +11 -11
  11. package/docs/{design → archive/investigations}/optimization_plan.md +1 -1
  12. package/docs/archive/investigations/pareto-specialized-runtime-findings.md +92 -0
  13. package/docs/{design → archive/investigations}/pre-colibri-stabilization.md +5 -5
  14. package/docs/{design → archive/investigations}/the-dreaming-handoff.md +2 -2
  15. package/docs/{planning → archive/planning}/chat-ui-vision.md +1 -1
  16. package/docs/{planning → archive/planning}/chunk-task-roadmap.md +1 -1
  17. package/docs/{planning → archive/planning}/curve-sampler-research-plan.md +4 -4
  18. package/docs/{planning → archive/planning}/memory-docs-and-dag-plan.md +1 -1
  19. package/docs/{planning → archive/planning}/release-notes-v0.0.9.md +1 -1
  20. package/docs/archive/planning/release-notes-v0.2.0.md +49 -0
  21. package/docs/{planning → archive/planning}/website-readme-pass-plan.md +1 -1
  22. package/docs/design/batching.md +569 -0
  23. package/docs/design/decode-speed-program.md +3178 -169
  24. package/docs/design/dreaming-nightly-pipeline.md +675 -282
  25. package/docs/design/generic-model-support.md +579 -334
  26. package/docs/design/kv-cache.md +680 -0
  27. package/docs/design/orpo-training.md +673 -1239
  28. package/docs/design/speculative-decoding.md +1627 -0
  29. package/docs/design/turboquant.md +2102 -0
  30. package/docs/design/unified-engine-frontier-plan.md +1831 -727
  31. package/docs/design/web-chat-redesign.md +666 -1083
  32. package/docs/planning/PRODUCT_ROADMAP.md +34 -1
  33. package/docs/planning/release-notes-v0.3.0.md +35 -0
  34. package/docs/planning/video-series.md +421 -0
  35. package/docs/reference/benchmarks.md +1162 -0
  36. package/docs/reference/cli.md +395 -149
  37. package/docs/reference/distribution.md +321 -181
  38. package/docs/reference/environment.md +348 -0
  39. package/docs/reference/glossary.md +39 -0
  40. package/docs/reference/library-api.md +580 -142
  41. package/docs/reference/memory.md +227 -64
  42. package/docs/reference/models.md +137 -6
  43. package/docs/reference/server-api.md +938 -422
  44. package/docs/reference/server-config.md +652 -320
  45. package/docs/reference/training.md +393 -254
  46. package/docs/reference/troubleshooting.md +166 -0
  47. package/package.json +10 -5
  48. package/src/admission-plan.ts +18 -0
  49. package/src/anthropic.ts +92 -3
  50. package/src/audio/decode.ts +2 -2
  51. package/src/audio/features.ts +2 -2
  52. package/src/backends/mlx/autoregressive.ts +108 -0
  53. package/src/backends/mlx/batch-group.ts +1646 -0
  54. package/src/backends/mlx/diffusion.ts +39 -0
  55. package/src/backends/mlx/draft-target.ts +47 -0
  56. package/src/backends/mlx/evaluation.ts +105 -0
  57. package/src/backends/mlx/fill-append.ts +45 -0
  58. package/src/backends/mlx/gateway-binding.ts +71 -0
  59. package/src/backends/mlx/graph.ts +38 -0
  60. package/src/backends/mlx/memory-client.ts +189 -0
  61. package/src/backends/mlx/memory-guard.ts +40 -0
  62. package/src/backends/mlx/methods.ts +90 -0
  63. package/src/backends/mlx/model-prompt.ts +164 -0
  64. package/src/backends/mlx/model-serving.ts +79 -0
  65. package/src/backends/mlx/prefill.ts +33 -0
  66. package/src/backends/mlx/request-policy.ts +20 -0
  67. package/src/backends/mlx/rollback.ts +51 -0
  68. package/src/backends/mlx/serial-executor.ts +273 -0
  69. package/src/backends/mlx/speculative.ts +114 -0
  70. package/src/backends/mlx/state-views.ts +26 -0
  71. package/src/backends/mlx/text-engine.ts +73 -0
  72. package/src/cli.ts +189 -61
  73. package/src/client.ts +66 -0
  74. package/src/config.ts +21 -4
  75. package/src/contracts/completion.ts +16 -0
  76. package/src/contracts/execution.ts +49 -0
  77. package/src/contracts/generation.ts +103 -0
  78. package/src/contracts/host.ts +7 -0
  79. package/src/contracts/jobs.ts +66 -0
  80. package/src/contracts/pi-provider.ts +30 -0
  81. package/src/contracts/pi.ts +259 -0
  82. package/src/contracts/resources.ts +18 -0
  83. package/src/contracts/scheduling.ts +27 -0
  84. package/src/contracts/tsconfig.json +14 -0
  85. package/src/diffusion/diffusion-generate.ts +218 -153
  86. package/src/embed.ts +1 -1
  87. package/src/engine/admission.ts +59 -0
  88. package/src/engine/cancellation.ts +38 -0
  89. package/src/engine/engine.ts +56 -0
  90. package/src/engine/execution-coordinator.ts +70 -0
  91. package/src/engine/execution-plan.ts +51 -0
  92. package/src/engine/resources.ts +42 -0
  93. package/src/engine/scheduler.ts +67 -0
  94. package/src/engine/session.ts +247 -0
  95. package/src/eval/README.md +44 -1
  96. package/src/eval/kl.ts +263 -23
  97. package/src/eval/reference-logits.ts +207 -0
  98. package/src/eval/runner.ts +10 -79
  99. package/src/eval/tasks/bfcl.ts +2 -1
  100. package/src/eval/tasks/gsm8k.ts +2 -1
  101. package/src/eval/tasks/hashhop.ts +2 -1
  102. package/src/eval/tasks/humaneval.ts +5 -4
  103. package/src/eval/tasks/ifeval.ts +2 -1
  104. package/src/eval/tasks/mmlu.ts +2 -1
  105. package/src/expert-io.ts +3 -1
  106. package/src/expert-offload.ts +3 -1
  107. package/src/fill/echo-index.ts +188 -0
  108. package/src/fill/fill-session.ts +452 -0
  109. package/src/fill/proposal.ts +68 -0
  110. package/src/fill/schema-rows.ts +506 -0
  111. package/src/fill/tool-boundary.ts +103 -0
  112. package/src/fit.ts +24 -43
  113. package/src/generate.ts +740 -337
  114. package/src/grammar.ts +14 -8
  115. package/src/harness-pi.ts +15 -34
  116. package/src/hub-rest.ts +4 -4
  117. package/src/index.ts +27 -0
  118. package/src/inference/denoising.ts +17 -0
  119. package/src/inference/graph.ts +33 -0
  120. package/src/inference/prefill.ts +39 -0
  121. package/src/inference/rollback.ts +7 -0
  122. package/src/jobs/db.ts +4 -0
  123. package/src/jobs/index.ts +2 -0
  124. package/src/jobs/job-entry.ts +15 -14
  125. package/src/jobs/runner.ts +98 -13
  126. package/src/jobs/task-client.ts +19 -0
  127. package/src/jobs/types.ts +2 -58
  128. package/src/kv-scheme.ts +199 -0
  129. package/src/kv-store.ts +459 -234
  130. package/src/lab/README.md +18 -0
  131. package/src/{assets → lab/curve}/curve-designer.html +2 -2
  132. package/src/{curve-sampler.ts → lab/curve/curve-sampler.ts} +2 -2
  133. package/src/{expert-trace.ts → lab/expert-trace/expert-trace.ts} +7 -5
  134. package/src/{model → lab/paged-kv}/paged-kv.ts +9 -6
  135. package/src/library.ts +40 -0
  136. package/src/lora.ts +18 -0
  137. package/src/media-fetch.ts +20 -4
  138. package/src/memory/article.ts +1 -1
  139. package/src/memory/chunk.ts +1 -1
  140. package/src/memory/model.ts +32 -170
  141. package/src/memory/prompts.ts +1 -1
  142. package/src/memory/rest.ts +1 -1
  143. package/src/memory/schedule.ts +1 -1
  144. package/src/memory/stages.ts +4 -1
  145. package/src/memory/vault.ts +3 -4
  146. package/src/mlx/array.ts +9 -10
  147. package/src/mlx/compile.ts +12 -2
  148. package/src/mlx/ffi.ts +66 -22
  149. package/src/mlx/materialize.ts +23 -0
  150. package/src/mlx/metal-kernel.ts +10 -11
  151. package/src/mlx/ops.ts +64 -19
  152. package/src/mlx/quantized-rows.ts +36 -0
  153. package/src/mlx/token-bitmask.ts +52 -0
  154. package/src/mlx/turboquant-kv-decode.ts +82 -0
  155. package/src/mlx/turboquant-kv-inverse.ts +122 -0
  156. package/src/mlx/turboquant-ops.ts +33 -3
  157. package/src/mlx/turboquant-tables.ts +2 -2
  158. package/src/model/batched-mask.ts +9 -3
  159. package/src/model/batched-quant.ts +2 -2
  160. package/src/model/batched-rotating-quant.ts +45 -99
  161. package/src/model/batched-rotating-state.ts +73 -0
  162. package/src/model/batched-rotating.ts +57 -106
  163. package/src/model/batched-row-storage.ts +127 -0
  164. package/src/model/compiled-decode.ts +4 -3
  165. package/src/model/diffusion-gemma.ts +8 -8
  166. package/src/model/factory.ts +87 -49
  167. package/src/model/fingerprint.ts +1 -1
  168. package/src/model/flash-attention.ts +3 -3
  169. package/src/model/gemma4-base.ts +187 -17
  170. package/src/model/gemma4.ts +6 -6
  171. package/src/model/generated/gemma4-12b.ts +52 -148
  172. package/src/model/generated/gemma4-26b.ts +34 -94
  173. package/src/model/generated/gemma4-e4b.ts +28 -76
  174. package/src/model/glm52-cache.ts +19 -9
  175. package/src/model/glm52-dsa.ts +13 -9
  176. package/src/model/glm52-memory.ts +28 -1
  177. package/src/model/implementation.ts +69 -0
  178. package/src/model/minicpm5.ts +7 -8
  179. package/src/model/profile.ts +443 -0
  180. package/src/model/qwen-append.ts +12 -0
  181. package/src/model/qwen-conv.ts +52 -0
  182. package/src/model/qwen3-delta.ts +98 -2
  183. package/src/model/qwen3-mrope.ts +252 -0
  184. package/src/model/qwen3_5-checkpoint.ts +164 -0
  185. package/src/model/qwen3_5.ts +336 -60
  186. package/src/model/support.ts +1 -1
  187. package/src/model/trellis-balanced-scatter.ts +51 -0
  188. package/src/model/trellis-linear.ts +672 -0
  189. package/src/model/trellis-shared-m.ts +151 -0
  190. package/src/model/trellis-shared-scatter.ts +144 -0
  191. package/src/model/trellis-splitk-prefill.ts +158 -0
  192. package/src/model/trellis-tiled-prefill.ts +136 -0
  193. package/src/model/trellis-vector-expand.ts +62 -0
  194. package/src/model/trellis-wide-prefill.ts +94 -0
  195. package/src/model/universal/dense.ts +1 -1
  196. package/src/model/universal/modules.ts +8 -1
  197. package/src/native/frame_extract.swift +140 -0
  198. package/src/native-pack.ts +15 -7
  199. package/src/pi-provider.ts +6 -64
  200. package/src/pi-web.ts +14 -320
  201. package/src/prompt-cache.ts +97 -54
  202. package/src/quantize/allocator.ts +1 -1
  203. package/src/quantize/atomic-output.ts +38 -0
  204. package/src/quantize/calibration.ts +2 -1
  205. package/src/quantize/config-writer.ts +16 -3
  206. package/src/quantize/index.ts +28 -1
  207. package/src/quantize/job.ts +11 -0
  208. package/src/quantize/quantizer.ts +265 -100
  209. package/src/quantize/rotate.ts +603 -0
  210. package/src/quantize/safetensors-writer.ts +79 -1
  211. package/src/quantize/sensitivity.ts +41 -59
  212. package/src/quantize/trellis.ts +586 -0
  213. package/src/quantize/weight-transform.ts +292 -0
  214. package/src/responses.ts +130 -3
  215. package/src/runtime-config.ts +81 -0
  216. package/src/sampler.ts +276 -4
  217. package/src/serve/admin-routes.ts +184 -0
  218. package/src/serve/aux-routes.ts +132 -0
  219. package/src/serve/batch-scheduler.ts +8 -1558
  220. package/src/serve/chat-request.ts +391 -0
  221. package/src/serve/chat-stage.ts +195 -0
  222. package/src/serve/checkpoint-identity.ts +64 -0
  223. package/src/serve/completion-executor.ts +354 -0
  224. package/src/serve/completion-sink.ts +157 -0
  225. package/src/serve/discovery-routes.ts +204 -0
  226. package/src/serve/generation-gateway.ts +211 -243
  227. package/src/serve/http.ts +159 -0
  228. package/src/serve/inference-request.ts +79 -0
  229. package/src/serve/isolate.ts +297 -105
  230. package/src/serve/kv-budget.ts +14 -0
  231. package/src/serve/lab-routes.ts +341 -0
  232. package/src/serve/lane-registry.ts +2 -1
  233. package/src/serve/model-admin-routes.ts +155 -0
  234. package/src/serve/model-binding.ts +43 -0
  235. package/src/serve/model-host.ts +512 -0
  236. package/src/serve/openai-wire.ts +103 -0
  237. package/src/serve/parent-application.ts +56 -0
  238. package/src/serve/pipeline.ts +33 -0
  239. package/src/serve/preparation.ts +33 -0
  240. package/src/serve/prompt-response-trace.ts +147 -0
  241. package/src/serve/request-plan.ts +162 -0
  242. package/src/serve/request-prep.ts +346 -0
  243. package/src/serve/response-lease.ts +24 -0
  244. package/src/serve/responses-client.ts +69 -0
  245. package/src/serve/session-completion-engine.ts +110 -0
  246. package/src/serve/session-search.ts +1 -1
  247. package/src/serve/static-routes.ts +101 -0
  248. package/src/serve/text-completion-stage.ts +104 -0
  249. package/src/serve/token-streams.ts +519 -0
  250. package/src/server.ts +523 -3551
  251. package/src/spec/assistant-source.ts +10 -44
  252. package/src/spec/deepspec-source.ts +6 -6
  253. package/src/spec/dflash-source.ts +9 -8
  254. package/src/spec/dspark/ab-stats.ts +3 -3
  255. package/src/spec/dspark/calibration.ts +2 -2
  256. package/src/spec/dspark/deepspec-module.ts +2 -2
  257. package/src/spec/dspark/generate-dflash.ts +2 -2
  258. package/src/spec/dspark/generate.ts +2 -2
  259. package/src/spec/dspark/loader.ts +1 -1
  260. package/src/spec/dspark/module-dflash.ts +5 -4
  261. package/src/spec/dspark/module.ts +3 -3
  262. package/src/spec/dspark/quantize-drafter.ts +1 -1
  263. package/src/spec/generate.ts +1 -1
  264. package/src/spec/glm52-mtp-source.ts +9 -1
  265. package/src/spec/ngram-source.ts +1 -1
  266. package/src/spec/prefix-state.ts +45 -0
  267. package/src/spec/qwen-mtp-source.ts +528 -0
  268. package/src/spec/serve-loop.ts +179 -213
  269. package/src/spec/source.ts +42 -10
  270. package/src/spec/two-model.ts +1 -1
  271. package/src/ssd-cache.ts +95 -24
  272. package/src/ssd-durability.ts +207 -0
  273. package/src/tool-call.ts +51 -14
  274. package/src/train/flash-cce.ts +14 -13
  275. package/src/train/forward.ts +38 -1
  276. package/src/train/loss.ts +3 -2
  277. package/src/train/prefix-shared.ts +5 -1
  278. package/src/train/segmented.ts +9 -6
  279. package/src/train/trainer.ts +9 -8
  280. package/src/vision/preprocess.ts +1 -1
  281. package/src/vision/prompt.ts +48 -2
  282. package/src/vision/qwen3vl-preprocess.ts +409 -0
  283. package/src/vision/qwen3vl-prompt.ts +196 -0
  284. package/src/vision/qwen3vl-tower.ts +555 -0
  285. package/src/vision/video-frames.ts +148 -0
  286. package/src/web/app.html +1 -1
  287. package/src/web/app.js +15 -6
  288. package/src/web/src/adapters-panel.ts +3 -3
  289. package/src/web/src/assistant.ts +2 -36
  290. package/src/web/src/chat.ts +16 -9
  291. package/src/web/src/composer.ts +4 -4
  292. package/src/web/src/hub.ts +1 -1
  293. package/src/web/src/markdown.ts +0 -0
  294. package/src/web/src/memory-panel.ts +1 -1
  295. package/src/web/src/model-picker.ts +1 -1
  296. package/src/web/src/palette.ts +1 -1
  297. package/src/web/src/protocol.ts +3 -39
  298. package/src/web/src/sessions.ts +1 -1
  299. package/src/web/src/ui-catalog.ts +4 -18
  300. package/src/web-assets.ts +47 -0
  301. package/src/weights.ts +134 -33
  302. package/docs/archive/mlx-bun-lab-report.html +0 -275
  303. package/docs/archive/wwdc-mlx-bun.html +0 -848
  304. package/docs/design/adapters-end-to-end.md +0 -205
  305. package/docs/design/batching-perf-path.md +0 -255
  306. package/docs/design/batching-v2-plan.md +0 -529
  307. package/docs/design/bucketing-stage.md +0 -197
  308. package/docs/design/compat-cli-surface-design.md +0 -230
  309. package/docs/design/docs-reorg-plan.md +0 -165
  310. package/docs/design/dspark-serving-program.md +0 -371
  311. package/docs/design/dspark-speculative-decoding.md +0 -268
  312. package/docs/design/grammar-spec-batching-integration.md +0 -301
  313. package/docs/design/memory-inference-path.md +0 -422
  314. package/docs/design/memory-synthesis.md +0 -287
  315. package/docs/design/memory-system.md +0 -237
  316. package/docs/design/mlx-lm-tool-parity-plan.md +0 -545
  317. package/docs/design/omlx-adoption-map.md +0 -98
  318. package/docs/design/orpo-dynamic-lambda.md +0 -220
  319. package/docs/design/orpo-future-enhancements.md +0 -340
  320. package/docs/design/paged-kv-cache.md +0 -214
  321. package/docs/design/parallel-slots.md +0 -567
  322. package/docs/design/parity-tier-dag.md +0 -161
  323. package/docs/design/repo-cleanup-plan.md +0 -189
  324. package/docs/design/runtime-isolation.md +0 -263
  325. package/docs/design/segmented-backward-training.md +0 -543
  326. package/docs/design/spec-decode-larger-targets.md +0 -229
  327. package/docs/design/ssd-kv-cold-tier.md +0 -288
  328. package/docs/design/structured-output.md +0 -484
  329. package/docs/design/tauri-desktop-app.md +0 -127
  330. package/docs/design/the-dreaming-master-plan.md +0 -445
  331. package/docs/design/turboquant-kv.md +0 -235
  332. package/docs/design/w4a16-compute-precision-spike.md +0 -232
  333. package/docs/design/web-chat-beat-matrix.md +0 -315
  334. package/docs/design/write-pipeline-entity.md +0 -468
  335. package/docs/investigations/curve-runs/bisector-route.json +0 -98
  336. package/docs/investigations/curve-runs/bisector-trace.json +0 -1393
  337. package/docs/investigations/curve-runs/curve-terrain.json +0 -1179
  338. package/docs/investigations/curve-runs/curve-terrain.svg +0 -42
  339. package/docs/investigations/hlg-ab.html +0 -34
  340. package/docs/investigations/hlg-explorer.html +0 -238
  341. package/docs/investigations/hlg-figs/cliff.svg +0 -1
  342. package/docs/investigations/hlg-figs/cross.svg +0 -1
  343. package/docs/investigations/hlg-figs/edges.svg +0 -1
  344. package/docs/investigations/hlg-figs/k20-grids.svg +0 -1
  345. package/docs/investigations/hlg-figs/k20-peaks.svg +0 -1
  346. package/docs/investigations/hlg-figs/lw-curve.svg +0 -1
  347. package/docs/investigations/hlg-figs/terrain.svg +0 -1
  348. package/docs/investigations/hlg-report.html +0 -262
  349. package/docs/investigations/hlg-runs/hlg-ab.json +0 -149
  350. package/docs/investigations/hlg-runs/hlg-blind-prompts.md +0 -87
  351. package/docs/investigations/hlg-runs/hlg-blind.json +0 -107
  352. package/docs/investigations/hlg-runs/hlg-cliff.json +0 -197
  353. package/docs/investigations/hlg-runs/hlg-cross.json +0 -505
  354. package/docs/investigations/hlg-runs/hlg-edge.json +0 -388
  355. package/docs/investigations/hlg-runs/hlg-eval1.json +0 -25
  356. package/docs/investigations/hlg-runs/hlg-frontier.json +0 -86
  357. package/docs/investigations/hlg-runs/hlg-grid.json +0 -242
  358. package/docs/investigations/hlg-runs/hlg-grid2.json +0 -343
  359. package/docs/investigations/hlg-runs/hlg-lw-coarse.json +0 -110
  360. package/docs/investigations/hlg-runs/hlg-map.json +0 -383
  361. package/docs/investigations/hlg-runs/run0-original.log +0 -159
  362. package/docs/investigations/hlg-runs/runA-recommended.log +0 -131
  363. package/docs/investigations/hlg-runs/runAA-cliff-cpm5.log +0 -26
  364. package/docs/investigations/hlg-runs/runAB-grid2-e4b.log +0 -18
  365. package/docs/investigations/hlg-runs/runAC-peak-e4b-partial.log +0 -25
  366. package/docs/investigations/hlg-runs/runAD-ab-samples.log +0 -8
  367. package/docs/investigations/hlg-runs/runAE-edge-e4b.log +0 -51
  368. package/docs/investigations/hlg-runs/runAF-logit-calibration.log +0 -10
  369. package/docs/investigations/hlg-runs/runAG-eval-config2.log +0 -16
  370. package/docs/investigations/hlg-runs/runB-gain-variants.log +0 -192
  371. package/docs/investigations/hlg-runs/runC-pivots.log +0 -162
  372. package/docs/investigations/hlg-runs/runD-oetf.log +0 -132
  373. package/docs/investigations/hlg-runs/runE-eotf.log +0 -162
  374. package/docs/investigations/hlg-runs/runF-shaper-working.log +0 -86
  375. package/docs/investigations/hlg-runs/runG-shaper-sweep.log +0 -101
  376. package/docs/investigations/hlg-runs/runH-wsweep.log +0 -176
  377. package/docs/investigations/hlg-runs/runI-asweep.log +0 -176
  378. package/docs/investigations/hlg-runs/runJ-knobmap.log +0 -49
  379. package/docs/investigations/hlg-runs/runK-frontier.log +0 -19
  380. package/docs/investigations/hlg-runs/runL-widemap.log +0 -65
  381. package/docs/investigations/hlg-runs/runM-frontier-emb.log +0 -15
  382. package/docs/investigations/hlg-runs/runN-verify.log +0 -116
  383. package/docs/investigations/hlg-runs/runO-frontier-seed5000.log +0 -15
  384. package/docs/investigations/hlg-runs/runP-grid-AxSm.log +0 -15
  385. package/docs/investigations/hlg-runs/runQ-grid-tgW.log +0 -15
  386. package/docs/investigations/hlg-runs/runR-blind-transcript.log +0 -79
  387. package/docs/investigations/hlg-runs/runS-cross-coherence.log +0 -33
  388. package/docs/investigations/hlg-runs/runT-cross-cpm5.log +0 -33
  389. package/docs/investigations/hlg-runs/runU-cross-12b.log +0 -33
  390. package/docs/investigations/hlg-runs/runV-lw-e4b.log +0 -22
  391. package/docs/investigations/hlg-runs/runW-lw-12b.log +0 -22
  392. package/docs/investigations/hlg-runs/runX-lw-cpm5.log +0 -22
  393. package/docs/investigations/hlg-runs/runY-cliff-e4b.log +0 -26
  394. package/docs/investigations/hlg-runs/runZ-cliff-12b.log +0 -26
  395. package/docs/planning/IDEAS.md +0 -69
  396. package/docs/reference/embedding.md +0 -197
  397. package/docs/reference/features-matrix.md +0 -100
  398. package/docs/reference/orpo-quickstart.md +0 -135
  399. package/src/flags.ts +0 -13
  400. /package/docs/{investigations → archive/investigations}/chunk-finetune-experiment.md +0 -0
  401. /package/docs/{investigations → archive/investigations}/colibri-oracle-pin.md +0 -0
  402. /package/docs/{investigations → archive/investigations}/curve-bisector-routing.md +0 -0
  403. /package/docs/{investigations → archive/investigations}/decode-roofline-lookagain.md +0 -0
  404. /package/docs/{investigations → archive/investigations}/dspark-handoff.md +0 -0
  405. /package/docs/{investigations → archive/investigations}/expert-offload-single-user-moe.md +0 -0
  406. /package/docs/{investigations → archive/investigations}/indexshare-performance-spike.md +0 -0
  407. /package/docs/{investigations → archive/investigations}/kernel-perf-review-2026-07.md +0 -0
  408. /package/docs/{investigations → archive/investigations}/lab-build-journal.md +0 -0
  409. /package/docs/{investigations → archive/investigations}/openwiki-evaluation.md +0 -0
  410. /package/docs/{investigations → archive/investigations}/orpo-base-uf-experiment-and-directions.md +0 -0
  411. /package/docs/{investigations → archive/investigations}/orpo-flash-cce-pin-leak.md +0 -0
  412. /package/docs/{investigations → archive/investigations}/orpo-uf-testing-handoff.md +0 -0
  413. /package/docs/{investigations → archive/investigations}/pi-builtin-investigation.md +0 -0
  414. /package/docs/{investigations → archive/investigations}/segmented-backward-handoff.md +0 -0
  415. /package/docs/{investigations → archive/investigations}/starter-model-port-handoff.md +0 -0
  416. /package/docs/{investigations → archive/investigations}/steel-flash-cce-handoff.md +0 -0
  417. /package/docs/{investigations → archive/investigations}/trainer-validation-experiment.md +0 -0
  418. /package/docs/{planning → archive/planning}/chat-ui-vision-memory-first.md +0 -0
  419. /package/docs/{planning → archive/planning}/journal.md +0 -0
  420. /package/docs/{planning → archive/planning}/pi-integration-review.md +0 -0
  421. /package/docs/{planning → archive/planning}/release-notes-v0.0.10.md +0 -0
  422. /package/docs/{planning → archive/planning}/release-notes-v0.0.11.md +0 -0
  423. /package/docs/{planning → archive/planning}/release-notes-v0.0.12.md +0 -0
  424. /package/docs/{planning → archive/planning}/release-notes-v0.0.13.md +0 -0
  425. /package/docs/{planning → archive/planning}/web-ui-pass-plan.md +0 -0
  426. /package/{docs/investigations → src/serve/assets}/curve-terrain.html +0 -0
  427. /package/{docs/dag → src/serve/assets}/training-inference-map.html +0 -0
package/docs/investigations/hlg-report.html DELETED
@@ -1,262 +0,0 @@
1
- <!doctype html><html lang="en"><head><meta charset="utf-8">
2
- <meta name="viewport" content="width=device-width,initial-scale=1">
3
- <title>HLG Sampling — Investigation Report</title><style>
4
- :root{
5
- --text-primary:#1f2937; --text-secondary:#475569; --text-tertiary:#94a3b8;
6
- --bg:#fbfcfe; --bg-card:#ffffff; --bg-tertiary:#eef2f7; --border:#e2e8f0;
7
- --accent:#2563eb; --positive:#16a34a; --warn:#d97706; --cyan:#0891b2; --danger:#dc2626;
8
- }
9
- *{box-sizing:border-box}
10
- body{margin:0;background:var(--bg);color:var(--text-primary);
11
- font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",ui-sans-serif,system-ui,sans-serif;
12
- line-height:1.62;font-size:16px;-webkit-font-smoothing:antialiased}
13
- .wrap{max-width:920px;margin:0 auto;padding:56px 28px 120px}
14
- header.hero{border-bottom:2px solid var(--border);padding-bottom:28px;margin-bottom:8px}
15
- .kicker{font-size:12.5px;letter-spacing:.14em;text-transform:uppercase;color:var(--accent);font-weight:700}
16
- h1{font-size:34px;line-height:1.18;margin:.32em 0 .18em;letter-spacing:-.02em}
17
- .sub{color:var(--text-secondary);font-size:17px;max-width:680px}
18
- .meta{margin-top:14px;font-size:13px;color:var(--text-tertiary)}
19
- .thesis{background:linear-gradient(180deg,#f1f6ff,#fbfcfe);border:1px solid #dbe7ff;border-left:4px solid var(--accent);
20
- border-radius:12px;padding:18px 22px;margin:26px 0 8px;font-size:16.5px}
21
- .thesis b{color:var(--accent)}
22
- h2{font-size:24px;margin:54px 0 4px;letter-spacing:-.01em;padding-top:8px}
23
- h2 .n{color:var(--text-tertiary);font-weight:600;font-size:18px;margin-right:10px}
24
- h3{font-size:17px;margin:30px 0 6px;color:var(--text-primary)}
25
- p{margin:12px 0}
26
- .lead{font-size:17px;color:var(--text-secondary)}
27
- code{background:var(--bg-tertiary);border-radius:5px;padding:.08em .38em;font-size:.87em;
28
- font-family:ui-monospace,SFMono-Regular,Menlo,monospace;color:#0f172a}
29
- strong{font-weight:650}
30
- figure{margin:26px 0;background:var(--bg-card);border:1px solid var(--border);border-radius:14px;
31
- padding:18px 18px 10px;box-shadow:0 1px 2px rgba(15,23,42,.04),0 8px 24px -16px rgba(15,23,42,.18)}
32
- figure svg{width:100%;height:auto;display:block}
33
- figcaption{font-size:13px;color:var(--text-tertiary);margin-top:10px;padding-top:10px;border-top:1px solid var(--border)}
34
- figcaption b{color:var(--text-secondary)}
35
- table{border-collapse:collapse;width:100%;margin:20px 0;font-size:14.5px}
36
- th,td{text-align:left;padding:9px 12px;border-bottom:1px solid var(--border);vertical-align:top}
37
- thead th{background:var(--bg-tertiary);font-size:12.5px;letter-spacing:.02em;color:var(--text-secondary);border-bottom:2px solid var(--border)}
38
- tbody tr:hover{background:#f8fafc}
39
- .tag{display:inline-block;font-size:11.5px;font-weight:700;padding:2px 9px;border-radius:999px;line-height:1.5}
40
- .tag.cluster{background:#fef3c7;color:#92400e}
41
- .tag.free{background:#dcfce7;color:#166534}
42
- .tag.curve{background:#dbeafe;color:#1e40af}
43
- .callout{border:1px solid var(--border);border-left:4px solid var(--text-tertiary);background:var(--bg-card);
44
- border-radius:10px;padding:14px 18px;margin:20px 0;font-size:15px}
45
- .callout.terrain{border-left-color:var(--positive);background:#f6fdf9}
46
- .callout.rock{border-left-color:var(--danger);background:#fef6f6}
47
- .callout h4{margin:0 0 6px;font-size:13px;text-transform:uppercase;letter-spacing:.08em;color:var(--text-secondary)}
48
- .pending{background:var(--bg-tertiary);border:1px dashed var(--border);border-radius:10px;padding:30px;text-align:center;color:var(--text-tertiary)}
49
- ul.clean{margin:12px 0;padding-left:22px}
50
- ul.clean li{margin:7px 0}
51
- .foot{margin-top:70px;padding-top:22px;border-top:1px solid var(--border);font-size:13px;color:var(--text-tertiary)}
52
- .runidx{columns:2;column-gap:30px;font-size:13px;color:var(--text-secondary)}
53
- .runidx div{break-inside:avoid;margin:3px 0}
54
- .runidx code{font-size:12px}
55
- @media(max-width:680px){.runidx{columns:1}h1{font-size:27px}.wrap{padding:34px 18px 80px}}
56
- </style></head>
57
- <body><div class="wrap">
58
-
59
- <header class="hero">
60
- <div class="kicker">mlx-bun · sampling investigation</div>
61
- <h1>Transplanting Hybrid Log-Gamma onto LLM logit sampling</h1>
62
- <p class="sub">Mapping a piecewise HDR transfer function as a replacement sampler — what each control does, where the coherent region is walled, and whether the geometry is a property of the curve or of the model.</p>
63
- <div class="meta">Reference model gemma-4-e4b · cross-checked on gemma-4-12B and MiniCPM5-1B · June 2026</div>
64
- </header>
65
-
66
- <div class="thesis">
67
- Temperature is <b>one global slope</b> on the logits. It couples two things you might want to do separately:
68
- tamp down the over-confident top token, and lift the long tail. HLG (ITU-R BT.2100) is a <b>piecewise</b> curve —
69
- a toe in the shadows, a power region in the mids, a log shoulder in the highlights, plus a system gamma. The bet:
70
- transplant that shape onto logit sampling to <b>decouple</b> those moves — and get several controls where temperature gave one.
71
- </div>
72
-
73
- <h2><span class="n">1</span>The idea</h2>
74
- <p class="lead">A sampler's logits look, abstractly, like a tone curve: a bright "highlight" (the dominant token), a band of
75
- "midtone" plausible alternatives, and a dark "shadow" tail of unlikely tokens. Temperature scales that whole curve by a
76
- single exponent — raise it and you simultaneously dim the highlight <em>and</em> raise the shadows; you cannot do one without the other.</p>
77
- <p>HLG splits the curve into regions with independent behavior: a gamma/√ <strong>toe</strong>, a power <strong>mid</strong>, a logarithmic
78
- <strong>shoulder</strong>, and a separate system <strong>OOTF gamma</strong> (γ = 1.2 + 0.42·log₁₀(L_W/1000)). Transplanted onto sampling, those
79
- become: roll off the over-confident top (<code>shoulder</code> / <code>A</code>), sharpen the interesting middle (<code>s_m</code>), gate the
80
- junk tail (<code>window</code> / <code>target_gap</code>), and bend the global curvature (<code>L_W</code>). It is a <strong>replacement</strong> sampler —
81
- flag-gated (<code>--hlg-sampling</code>, default off), post-inference, model-agnostic — that stands in for temperature + top-p + top-k entirely.</p>
82
-
83
- <h3>Two cross-domain adaptations</h3>
84
- <p>The literal HDR curve does not work out of the box, because LM logits are not images:</p>
85
- <ul class="clean">
86
- <li><strong>Windowed anchor.</strong> A logit distribution is a spike-plus-tail, not an image histogram. Min-max normalization
87
- collapses every real candidate into the shoulder. Fix: anchor the input window <code>W</code> nats below the top token, so the
88
- candidates land across the curve instead of piling up at the top.</li>
89
- <li><strong>Inverted toe.</strong> HLG's toe <em>lifts</em> shadows (it describes how a display renders near-black). A sampler wants the
90
- opposite — to <em>crush</em> the tail. So the toe is inverted from lift to suppress.</li>
91
- <li><strong>Decoupled <code>out_scale</code>.</strong> The output scale auto-derives to pin the top→reference-token gap to <code>target_gap</code>,
92
- so changing the window doesn't silently change the sharpness.</li>
93
- </ul>
94
-
95
- <h2><span class="n">2</span>How we measured</h2>
96
- <p>Every configuration is compared against the model's <strong>own recommended recipe</strong> (its <code>generation_config.json</code>,
97
- run unchanged) — the only thing that varies is the sampling method. Two metrics, two stages:</p>
98
- <ul class="clean">
99
- <li><strong>Coherence</strong> — a factual "canary" prompt (the sharpest spike-to-tail; it breaks last) scored by <em>junk ratio</em>,
100
- the fraction of non-Latin-script letters, which is the word-salad signature. Cheap, so it screens the whole grid first.</li>
101
- <li><strong>Diversity</strong> — measured <em>only on coherent survivors</em> (so garbage can't win): <em>1−self-BLEU</em> on the divergent
102
- region (shared prefix stripped), backed by distinct-2 and an LM-embedding cosine. The factual prompt stays the coherence canary.</li>
103
- </ul>
104
- <div class="callout">
105
- <h4>Stance</h4>
106
- This is a <strong>map, not a verdict.</strong> Each run is a coordinate held loosely — we don't give up at the first rock or
107
- declare victory at the first tree. Small-sample diversity is noisy (self-BLEU swings ~±0.08 at K=6), so effect sizes near that
108
- scale are reported as terrain, not findings, and the decisive sweeps are re-run at K=20.
109
- </div>
110
-
111
- <h2><span class="n">3</span>The five knobs</h2>
112
- <p class="lead">HLG exposes five controls where temperature gave one. They are <em>not</em> five copies of the same lever — they
113
- play different roles, which is the whole point of the transplant.</p>
114
- <table>
115
- <thead><tr><th>Knob</th><th>What it does</th><th>Role on the coherence wall</th><th>Diversity</th></tr></thead>
116
- <tbody>
117
- <tr><td><code>target_gap</code></td><td>overall sharpness anchor (top→ref gap)</td><td><span class="tag cluster">gate cluster</span> graded cliff, vocab-shifted</td><td>sharpness lever</td></tr>
118
- <tr><td><code>W</code> (window)</td><td>candidate gate, nats below the top</td><td><span class="tag cluster">gate cluster</span> sharp edge at high A</td><td>candidate gate</td></tr>
119
- <tr><td><code>s_m</code></td><td>mid-region slope (sharpen the middle)</td><td><span class="tag cluster">gate cluster</span> the coupling hub</td><td>coupled lever</td></tr>
120
- <tr><td><code>A</code> (shoulder)</td><td>highlight roll-off / top-token confidence</td><td><span class="tag free">orthogonal</span> doesn't move the floor</td><td>the <b>free</b> lever</td></tr>
121
- <tr><td><code>L_W</code></td><td>OOTF curvature (γ of the whole curve)</td><td><span class="tag curve">outside cluster</span> robust; walls at γ extremes</td><td>non-monotone, model-specific</td></tr>
122
- </tbody>
123
- </table>
124
-
125
- <h2><span class="n">4</span>The coherent basin</h2>
126
- <p>Sweeping the knobs two at a time produces a coherent <strong>basin</strong> walled by cliffs, with a diversity gradient inside it.
127
- The left panel is the <code>A × s_m</code> plane; the right is <code>target_gap × W</code>. Darker = more diverse; ✗ = the canary broke;
128
- green-outlined cells beat the default's diversity.</p>
129
- <figure><svg viewBox="0 0 900 470" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="ht htd" font-family="ui-sans-serif,system-ui,sans-serif"><title id="ht">HLG diversity terrain — two planes</title><desc id="htd">Heatmaps of self-BLEU diversity across the A×s_m and target_gap×W planes; darker = more diverse; ✗ = incoherent; green outline = above the default contour.</desc><text x="450" y="28" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">HLG diversity terrain (e4b) — coherent basin + diversity (self-BLEU)</text><text x="235" y="60" text-anchor="middle" font-size="15" font-weight="700" fill="var(--text-primary,#1f2937)">A × s_m</text><text x="235" y="78" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">A (shoulder) → tighter</text><text x="84" y="215" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 84 215)">s_m →</text><text x="135" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.01</text><text x="185" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.05</text><text x="235" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">0.2</text><text x="285" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">1</text><text x="335" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">5</text><text x="102" y="119" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.05</text><text x="102" y="169" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.2</text><text x="102" y="219" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">0.7</text><text x="102" y="269" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">1.5</text><text x="102" y="319" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">3</text><rect x="110" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="160" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.82" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="184" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.83</text><rect x="210" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.90" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.86</text><rect x="260" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.80" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="284" y="118" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.82</text><rect x="310" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.15" stroke="var(--border,#e5e7eb)"/><text x="334" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.56</text><rect x="110" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.87" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="168" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.85</text><rect x="160" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.57" stroke="var(--border,#e5e7eb)"/><text x="184" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.73</text><rect x="210" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.90" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="168" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.86</text><rect x="260" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.65" stroke="var(--border,#e5e7eb)"/><text x="284" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.76</text><rect x="310" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="334" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><rect x="110" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.75" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="134" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.80</text><rect x="160" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="184" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="210" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="234" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="260" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.55" stroke="var(--border,#e5e7eb)"/><text x="284" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.72</text><rect x="310" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.43" stroke="var(--border,#e5e7eb)"/><text x="334" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.67</text><rect x="110" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.73" stroke="var(--border,#e5e7eb)"/><text x="134" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.79</text><rect x="160" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="184" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="210" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="234" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="260" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.40" stroke="var(--border,#e5e7eb)"/><text x="284" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.66</text><rect x="310" y="240" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="334" y="269" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="110" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="134" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="160" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="184" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="210" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="234" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="260" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="284" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="310" y="290" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="334" y="319" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><text x="725" y="60" text-anchor="middle" font-size="15" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap × W</text><text x="725" y="78" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">target_gap → sharper</text><text x="574" y="215" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 574 215)">W →</text><text x="625" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">10</text><text x="675" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">13</text><text x="725" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">16</text><text x="775" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">25</text><text x="825" y="356" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">50</text><text x="592" y="119" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">4</text><text x="592" y="169" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">5</text><text x="592" y="219" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">6</text><text x="592" y="269" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">10</text><text x="592" y="319" text-anchor="end" font-size="11" fill="var(--text-secondary,#6b7280)">20</text><rect x="600" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="674" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="700" y="90" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="724" y="119" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="750" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="774" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="800" y="90" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="118" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="140" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="169" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="140" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="674" y="169" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="700" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.63" stroke="var(--border,#e5e7eb)"/><text x="724" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.75</text><rect x="750" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="774" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="800" y="140" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="168" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="190" width="48" height="48" rx="4" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="624" y="219" text-anchor="middle" font-size="15" fill="var(--text-tertiary,#9ca3af)">✗</text><rect x="650" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.78" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="674" y="218" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.81</text><rect x="700" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="724" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="750" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.52" stroke="var(--border,#e5e7eb)"/><text x="774" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.71</text><rect x="800" y="190" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.07" stroke="var(--border,#e5e7eb)"/><text x="824" y="218" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.50</text><rect x="600" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.63" stroke="var(--border,#e5e7eb)"/><text x="624" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.75</text><rect x="650" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.70" stroke="var(--border,#e5e7eb)"/><text x="674" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.78</text><rect x="700" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.60" stroke="var(--border,#e5e7eb)"/><text x="724" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.74</text><rect x="750" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.57" stroke="var(--border,#e5e7eb)"/><text x="774" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="#fff">0.73</text><rect x="800" y="240" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.17" stroke="var(--border,#e5e7eb)"/><text x="824" y="268" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.57</text><rect x="600" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.95" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="624" y="318" text-anchor="middle" font-size="11" font-weight="700" fill="#fff">0.88</text><rect x="650" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="674" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><rect x="700" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.33" stroke="var(--border,#e5e7eb)"/><text x="724" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.63</text><rect x="750" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.25" stroke="var(--border,#e5e7eb)"/><text x="774" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.60</text><rect x="800" y="290" width="48" height="48" rx="4" fill="var(--accent,#2563eb)" fill-opacity="0.20" stroke="var(--border,#e5e7eb)"/><text x="824" y="318" text-anchor="middle" font-size="11" font-weight="400" fill="var(--text-primary,#1f2937)">0.58</text><g transform="translate(110,442)"><rect x="0" y="-10" width="16" height="16" rx="3" fill="var(--bg-tertiary,#e5e7eb)" stroke="var(--border,#d1d5db)"/><text x="22" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">✗ incoherent (canary broke)</text><rect x="200" y="-10" width="16" height="16" rx="3" fill="var(--accent,#2563eb)" fill-opacity="0.3"/><rect x="218" y="-10" width="16" height="16" rx="3" fill="var(--accent,#2563eb)" fill-opacity="0.85"/><text x="240" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">diversity: light → dark = more diverse</text><rect x="540" y="-10" width="16" height="16" rx="3" fill="none" stroke="var(--positive,#16a34a)" stroke-width="2"/><text x="562" y="3" font-size="11" fill="var(--text-secondary,#6b7280)">above default contour (0.799)</text></g></svg><figcaption><b>Diversity terrain (e4b).</b> The basin is walled by coupled diagonal cliffs — knobs trade off against each other at the edge. Diversity is a noisy plateau that rises toward the loose corner of the basin, hovering around the default level.</figcaption></figure>
130
-
131
- <h2><span class="n">5</span>The wall's geometry</h2>
132
- <p>Resolving every pairwise coherence boundary (two within-pair, four cross-pair) shows the wall is <strong>not</strong> a stack of
133
- independent thresholds. It is a single coupled surface — with one knob standing outside it.</p>
134
- <ul class="clean">
135
- <li><strong><code>A</code> is orthogonal to the wall.</strong> Crank it across four orders of magnitude and the gate cliffs barely move.
136
- Mechanism: the coherence floor is a <em>tail</em> phenomenon, and <code>A</code> only reshapes the <em>top</em> — it adds no tail mass, so it's free on coherence.</li>
137
- <li><strong><code>s_m</code> is the coupling hub.</strong> It trades off against both gates: a loose mid demands a tighter gate. At low <code>s_m</code>
138
- the cliff can vanish entirely; at high <code>s_m</code> it needs more gating to stay coherent.</li>
139
- <li><strong>The wall = a coupled <code>tg</code>/<code>W</code>/<code>s_m</code> cluster.</strong> Those three share one "tail-mass budget"; <code>A</code> sits outside it;
140
- <code>L_W</code> (below) sits outside it too. So the two diversity levers split by their relation to the wall — <code>A</code> is <em>free</em>, <code>s_m</code> is <em>coupled</em>.</li>
141
- </ul>
142
-
143
- <h2><span class="n">6</span>Does the geometry generalize?</h2>
144
- <p>The whole map above is one model. Re-running the cross-pair coherence boundary on <strong>12B</strong> (dense Gemma, same ~262k vocab)
145
- and <strong>CPM5</strong> (MiniCPM5-1B, Llama family, ~73k vocab) sorts the structure into what belongs to the <em>curve</em> versus the <em>vocab</em>.</p>
146
- <figure><svg viewBox="0 0 960 658" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG coherence geometry across three models</title><desc id="d">Cross-pair coherence grids for e4b, 12B and CPM5. The sharpness cluster (s_m×tg, A×tg) replicates across all three; the window axis (s_m×W, A×W) tracks vocab size — the two Gemmas agree, CPM5 diverges.</desc><text x="480" y="26" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">Does the geometry generalize? Cross-pair coherence across 3 models</text><text x="480" y="46" text-anchor="middle" font-size="12" fill="var(--text-secondary,#6b7280)">green = coherent · red ✗ = canary broke · each grid is 4×4 over the break-spanning ranges</text><text x="288" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">e4b</text><text x="288" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Gemma · 262k</text><text x="518" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">12B</text><text x="518" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Gemma · 262k</text><text x="748" y="78" text-anchor="middle" font-size="13" font-weight="700" fill="var(--text-primary,#1f2937)">CPM5</text><text x="748" y="93" text-anchor="middle" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">Llama · ~73k</text><rect x="14" y="108" width="932" height="244" rx="8" fill="var(--positive,#16a34a)" fill-opacity="0.05" stroke="var(--positive,#16a34a)" stroke-opacity="0.35"/><text x="26" y="124" font-size="12" font-weight="700" fill="var(--positive,#16a34a)">Replicates across all 3 — the sharpness cluster</text><text x="150" y="180" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">s_m × target_gap</text><rect x="262" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="281" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="165" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="177.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 184)">s_m →</text><text x="300" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="492" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="511" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="165" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="177.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 184)">s_m →</text><text x="530" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="722" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="146" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="165" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="184" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="196.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="184" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="203" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="215.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="203" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="184" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 184)">s_m →</text><text x="760" y="233" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><text x="150" y="298" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">A × target_gap</text><rect x="262" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 302)">A →</text><text x="300" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="492" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 302)">A →</text><text x="530" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="722" y="264" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="276.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="264" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="283" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="295.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="283" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="302" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="314.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="302" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="321" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="333.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="321" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="302" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 302)">A →</text><text x="760" y="351" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">tg →</text><rect x="14" y="366" width="932" height="244" rx="8" fill="var(--accent,#2563eb)" fill-opacity="0.05" stroke="var(--accent,#2563eb)" stroke-opacity="0.35"/><text x="26" y="382" font-size="12" font-weight="700" fill="var(--accent,#2563eb)">Vocab-dependent — the window axis (Gemmas agree, CPM5 diverges)</text><text x="150" y="438" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">s_m × W</text><rect x="262" y="404" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="416.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="423" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="435.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 442)">s_m →</text><text x="300" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="492" y="404" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="416.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="423" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="435.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="442" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="454.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="461" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="473.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="486" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 442)">s_m →</text><text x="530" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="722" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="404" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="423" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="442" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="461" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="716" y="442" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 442)">s_m →</text><text x="760" y="491" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><text x="150" y="556" text-anchor="end" font-size="12.5" font-weight="600" fill="var(--text-primary,#1f2937)">A × W</text><rect x="262" y="522" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="534.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="541" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="553.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="300" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="262" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="270.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="281" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="289.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="300" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="319" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="256" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 256 560)">A →</text><text x="300" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="492" y="522" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="534.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="541" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="553.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="530" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="492" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="500.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="511" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="519.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="530" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="549" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="557.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><text x="486" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 486 560)">A →</text><text x="530" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><rect x="722" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="522" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="741" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="541" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="722" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="760" y="560" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="560" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="787.75" y="572.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="722" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="730.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="741" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="749.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><rect x="760" y="579" width="17.5" height="17.5" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><rect x="779" y="579" width="17.5" height="17.5" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="787.75" y="591.25" text-anchor="middle" font-size="10" fill="#b91c1c">✗</text><text x="716" y="560" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 716 560)">A →</text><text x="760" y="609" text-anchor="middle" font-size="9" fill="var(--text-tertiary,#9ca3af)">W →</text><g transform="translate(26,644)"><rect x="0" y="-11" width="14" height="14" rx="2" fill="var(--positive,#16a34a)" fill-opacity="0.22" stroke="var(--positive,#16a34a)" stroke-opacity="0.4"/><text x="20" y="0" font-size="11" fill="var(--text-secondary,#6b7280)">coherent</text><rect x="100" y="-11" width="14" height="14" rx="2" fill="#ef4444" fill-opacity="0.34" stroke="#ef4444" stroke-opacity="0.4"/><text x="120" y="0" font-size="11" fill="var(--text-secondary,#6b7280)">canary broke</text><text x="240" y="0" font-size="11" font-style="italic" fill="var(--text-tertiary,#9ca3af)">Same red pattern across columns = the curve, not the model.</text></g></svg><figcaption><b>Cross-pair coherence across three models.</b> The sharpness cluster (top band) replicates everywhere; the window axis (bottom band) tracks vocab size — the two Gemmas agree, CPM5 diverges.</figcaption></figure>
147
- <table>
148
- <thead><tr><th>Cross-pair</th><th>e4b (Gemma 262k)</th><th>12B (Gemma 262k)</th><th>CPM5 (Llama ~73k)</th><th>Generalizes?</th></tr></thead>
149
- <tbody>
150
- <tr><td><code>s_m × target_gap</code></td><td>diagonal — low s_m tolerates low tg</td><td>same diagonal</td><td>same diagonal (shifted threshold)</td><td><b style="color:var(--positive)">yes</b></td></tr>
151
- <tr><td><code>A × target_gap</code></td><td>gate cliff A-independent</td><td>same</td><td>same</td><td><b style="color:var(--positive)">yes</b></td></tr>
152
- <tr><td><code>s_m × W</code></td><td>s_m≥2 breaks at W=5</td><td>same</td><td>fully clean (decoupled)</td><td><b style="color:var(--danger)">vocab</b></td></tr>
153
- <tr><td><code>A × W</code></td><td>W cliff A-independent</td><td>similar</td><td>high-A / wide-W break</td><td><b style="color:var(--danger)">vocab</b></td></tr>
154
- </tbody>
155
- </table>
156
- <div class="callout terrain">
157
- <h4>Result (terrain)</h4>
158
- The <strong>sharpness coupling — <code>s_m ↔ target_gap</code> coupled, <code>A</code> orthogonal — replicates across all three models and both
159
- architectures.</strong> That's a property of the HLG curve, not the model. The <strong>window axis is vocab-sensitive</strong>: the two
160
- same-vocab Gemmas behave identically, only CPM5 (less tail to inflate) diverges. 12B was the control, and it tracked e4b, not CPM5.
161
- </div>
162
-
163
- <h2><span class="n">7</span>L_W — the curvature knob</h2>
164
- <p>The <code>out_scale</code> derivation pins the top→reference anchor to <code>target_gap</code>, so <code>L_W</code> doesn't move the anchor — it bends
165
- the <strong>curvature</strong> of the mid/tail. Swept across six orders of magnitude (γ from −0.06 to 2.46):</p>
166
- <figure><svg viewBox="0 0 800 480" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">L_W (OOTF γ) — diversity curve</title><desc id="d">Diversity vs OOTF gamma for the L_W knob; coherent band shaded, walls at gamma below 0 and above ~2.4, interior diversity peak near gamma 1.</desc><text x="400" y="28" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">L_W across 3 models — a coherence-robust curvature knob; diversity response differs</text><text x="400" y="46" text-anchor="middle" font-size="11.5" fill="var(--text-secondary,#6b7280)">x = OOTF γ (= 1.2 + 0.42·log₁₀(L_W/1000)) · y = diversity (1−self-BLEU) · 3 models · coherent across ~5 decades, walls only at the extremes</text><rect x="165.78947368421052" y="70" width="466.66666666666663" height="326" fill="var(--positive,#16a34a)" fill-opacity="0.06"/><text x="399.12280701754383" y="84" text-anchor="middle" font-size="10.5" fill="var(--positive,#16a34a)" font-weight="600">coherent band (L_W 3 … 100k+)</text><line x1="131.4035087719298" y1="70" x2="131.4035087719298" y2="396" stroke="#ef4444" stroke-width="1.5" stroke-dasharray="4 3" stroke-opacity="0.7"/><text x="127.40350877192981" y="390" text-anchor="end" font-size="10" fill="#b91c1c">γ&lt;0 inverts → wall (all)</text><line x1="720.8771929824561" y1="70" x2="720.8771929824561" y2="396" stroke="#ef4444" stroke-width="1.5" stroke-dasharray="4 3" stroke-opacity="0.7"/><text x="715.8771929824561" y="98" text-anchor="end" font-size="10" fill="#b91c1c">over-sharpen wall (Gemmas only)</text><line x1="70" y1="375.625" x2="770" y2="375.625" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="379.625" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="70" y1="324.6875" x2="770" y2="324.6875" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="328.6875" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.55</text><line x1="70" y1="273.7499999999999" x2="770" y2="273.7499999999999" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="277.7499999999999" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="70" y1="222.8124999999999" x2="770" y2="222.8124999999999" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="226.8124999999999" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.65</text><line x1="70" y1="171.87499999999986" x2="770" y2="171.87499999999986" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="175.87499999999986" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.70</text><line x1="70" y1="120.93749999999983" x2="770" y2="120.93749999999983" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="124.93749999999983" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.75</text><line x1="70" y1="69.99999999999979" x2="770" y2="69.99999999999979" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="62" y="73.99999999999979" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0.80</text><line x1="131.4035087719298" y1="396" x2="131.4035087719298" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="131.4035087719298" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">0.0</text><text x="131.4035087719298" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 100</text><line x1="254.21052631578945" y1="396" x2="254.21052631578945" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="254.21052631578945" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">0.5</text><text x="254.21052631578945" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 21</text><line x1="377.0175438596491" y1="396" x2="377.0175438596491" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="377.0175438596491" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.0</text><text x="377.0175438596491" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 334</text><line x1="426.14035087719293" y1="396" x2="426.14035087719293" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="426.14035087719293" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.2</text><text x="426.14035087719293" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 1k</text><line x1="499.82456140350877" y1="396" x2="499.82456140350877" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="499.82456140350877" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">1.5</text><text x="499.82456140350877" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 5k</text><line x1="622.6315789473684" y1="396" x2="622.6315789473684" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="622.6315789473684" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">2.0</text><text x="622.6315789473684" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 80k</text><line x1="745.438596491228" y1="396" x2="745.438596491228" y2="401" stroke="var(--text-tertiary,#9ca3af)"/><text x="745.438596491228" y="414" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">2.5</text><text x="745.438596491228" y="427" text-anchor="middle" font-size="8.5" fill="var(--text-tertiary,#9ca3af)">L_W 1.4M</text><text x="420" y="466" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">OOTF γ → sharper</text><text x="18" y="233" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)" transform="rotate(-90 18 233)">diversity →</text><rect x="70" y="151.50000000000006" width="700" height="40.749999999999886" fill="var(--text-tertiary,#9ca3af)" fill-opacity="0.13"/><line x1="70" y1="192.24999999999994" x2="770" y2="192.24999999999994" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1" stroke-dasharray="6 4" stroke-opacity="0.7"/><line x1="70" y1="151.50000000000006" x2="770" y2="151.50000000000006" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1" stroke-dasharray="6 4" stroke-opacity="0.7"/><text x="766" y="146.50000000000006" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">default recipes (0.68–0.72)</text><path d="M165.8 202.4 L219.8 182.1 L268.9 192.2 L323.0 182.1 L372.1 110.8 L426.1 151.5 L475.3 283.9 L529.3 263.6 L578.4 263.6 L632.5 304.3" fill="none" stroke="#2563eb" stroke-width="2.5"/><circle cx="165.78947368421052" cy="202.43749999999997" r="3.5" fill="#2563eb"/><circle cx="219.82456140350877" cy="182.06250000000006" r="3.5" fill="#2563eb"/><circle cx="268.9473684210526" cy="192.24999999999994" r="3.5" fill="#2563eb"/><circle cx="322.9824561403509" cy="182.06250000000006" r="3.5" fill="#2563eb"/><circle cx="372.1052631578947" cy="110.75000000000003" r="3.5" fill="#2563eb"/><circle cx="426.14035087719293" cy="151.50000000000006" r="3.5" fill="#2563eb"/><circle cx="475.26315789473676" cy="283.9375" r="3.5" fill="#2563eb"/><circle cx="529.2982456140351" cy="263.5625" r="3.5" fill="#2563eb"/><circle cx="578.421052631579" cy="263.5625" r="3.5" fill="#2563eb"/><circle cx="632.4561403508771" cy="304.3125000000001" r="3.5" fill="#2563eb"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><text x="735.6140350877192" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><path d="M165.8 345.1 L219.8 365.4 L268.9 365.4 L323.0 365.4 L372.1 314.5 L426.1 334.9 L475.3 334.9 L529.3 324.7 L578.4 324.7 L632.5 324.7" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="165.78947368421052" cy="345.06249999999994" r="3.5" fill="#d97706"/><circle cx="219.82456140350877" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="268.9473684210526" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="322.9824561403509" cy="365.43749999999994" r="3.5" fill="#d97706"/><circle cx="372.1052631578947" cy="314.4999999999999" r="3.5" fill="#d97706"/><circle cx="426.14035087719293" cy="334.87499999999994" r="3.5" fill="#d97706"/><circle cx="475.26315789473676" cy="334.87499999999994" r="3.5" fill="#d97706"/><circle cx="529.2982456140351" cy="324.6875" r="3.5" fill="#d97706"/><circle cx="578.421052631579" cy="324.6875" r="3.5" fill="#d97706"/><circle cx="632.4561403508771" cy="324.6875" r="3.5" fill="#d97706"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><text x="735.6140350877192" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><path d="M165.8 233.0 L219.8 283.9 L268.9 263.6 L323.0 304.3 L372.1 304.3 L426.1 314.5 L475.3 324.7 L529.3 294.1 L578.4 314.5 L632.5 345.1 L735.6 314.5" fill="none" stroke="#0891b2" stroke-width="2.5"/><circle cx="165.78947368421052" cy="233" r="3.5" fill="#0891b2"/><circle cx="219.82456140350877" cy="283.9375" r="3.5" fill="#0891b2"/><circle cx="268.9473684210526" cy="263.5625" r="3.5" fill="#0891b2"/><circle cx="322.9824561403509" cy="304.3125000000001" r="3.5" fill="#0891b2"/><circle cx="372.1052631578947" cy="304.3125000000001" r="3.5" fill="#0891b2"/><circle cx="426.14035087719293" cy="314.4999999999999" r="3.5" fill="#0891b2"/><circle cx="475.26315789473676" cy="324.6875" r="3.5" fill="#0891b2"/><circle cx="529.2982456140351" cy="294.125" r="3.5" fill="#0891b2"/><circle cx="578.421052631579" cy="314.4999999999999" r="3.5" fill="#0891b2"/><circle cx="632.4561403508771" cy="345.06249999999994" r="3.5" fill="#0891b2"/><circle cx="735.6140350877192" cy="314.4999999999999" r="3.5" fill="#0891b2"/><text x="116.66666666666666" y="392" text-anchor="middle" font-size="13" fill="#b91c1c" font-weight="700">✗</text><line x1="295" y1="61" x2="315" y2="61" stroke="#2563eb" stroke-width="2.5"/><circle cx="305" cy="61" r="3.5" fill="#2563eb"/><text x="321" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">e4b</text><line x1="365" y1="61" x2="385" y2="61" stroke="#d97706" stroke-width="2.5"/><circle cx="375" cy="61" r="3.5" fill="#d97706"/><text x="391" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">12B</text><line x1="435" y1="61" x2="455" y2="61" stroke="#0891b2" stroke-width="2.5"/><circle cx="445" cy="61" r="3.5" fill="#0891b2"/><text x="461" y="65" font-size="11" fill="var(--text-secondary,#6b7280)">CPM5</text></svg><figcaption><b>L_W diversity curve, three models.</b> Coherence is robust across ~5 decades; the knob walls only at the extremes (γ<0 inverts the ranking; γ≳2.4 over-sharpens — Gemma-only). The coherence structure here is solid; the diversity <em>traces are the coarse K=6 sweep</em> and are revised downward at K=20 — see §9.</figcaption></figure>
167
- <ul class="clean">
168
- <li><strong>Not a gate.</strong> Coherent across <code>L_W ∈ [3, 10⁵]</code> — five decades — versus the gates' tight unit-scale breaks. It
169
- walls only at the <em>extremes</em>: low (γ&lt;0 inverts the token ranking → junk; universal) and high (γ≳2.4 over-sharpens → junk; Gemma-only, CPM5's smaller vocab passes).</li>
170
- <li><strong>Diversity: a retracted win.</strong> At K=6, e4b's curve looked like an interior peak that <em>beat</em> its default. At K=20
171
- (§9) that evaporates — every <code>L_W</code> setting sits well below the default. The honest read: <strong>L_W's diversity is uniformly below the
172
- recommended recipe</strong>; the apparent e4b win was small-sample noise. <code>L_W</code>'s real character is its coherence robustness, not a diversity gain.</li>
173
- </ul>
174
-
175
- <h2><span class="n">8</span>Resolving the cliffs</h2>
176
- <p>The coarse maps stepped <em>over</em> the steepest features. Stepping <code>target_gap</code> and <code>W</code> at unit resolution (with the
177
- junk% gradient, not just pass/fail) reveals two qualitatively different cliff <em>shapes</em>.</p>
178
- <figure><svg viewBox="0 0 920 450" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG cliff resolution — two shapes</title><desc id="d">Fine junk% gradient through the target_gap cliff (a graded ramp, position shifts by vocab) and the W lower edge at high A (a sharp model-invariant edge near 7.5), three models.</desc><text x="460" y="30" text-anchor="middle" font-size="16.5" font-weight="700" fill="var(--text-primary,#1f2937)">Fine cliff resolution — the coarse grid jumped over two different shapes</text><text x="460" y="49" text-anchor="middle" font-size="11.5" fill="var(--text-secondary,#6b7280)">unit steps · mean canary junk% (K=5 seeds) · the transition the 8/12 and 5/10 jumps hid</text><text x="244" y="42" text-anchor="middle" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap cliff — a graded ramp</text><text x="244" y="58" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">base (A=0.35, s_m=0.7, W=6) · position shifts by vocab</text><line x1="44" y1="380" x2="444" y2="380" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="384" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="44" y1="291.17647058823525" x2="444" y2="291.17647058823525" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="295.17647058823525" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">10%</text><line x1="44" y1="202.35294117647058" x2="444" y2="202.35294117647058" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="206.35294117647058" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">20%</text><line x1="44" y1="113.52941176470588" x2="444" y2="113.52941176470588" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="117.52941176470588" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">30%</text><line x1="44" y1="371.11764705882354" x2="444" y2="371.11764705882354" stroke="var(--positive,#16a34a)" stroke-width="1.2" stroke-dasharray="5 3" stroke-opacity="0.8"/><text x="444" y="367.11764705882354" text-anchor="end" font-size="9.5" fill="var(--positive,#16a34a)">coherent &lt;1%</text><line x1="44" y1="380" x2="44" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="44" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><line x1="110.66666666666666" y1="380" x2="110.66666666666666" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="110.66666666666666" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><line x1="177.33333333333331" y1="380" x2="177.33333333333331" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="177.33333333333331" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><line x1="244" y1="380" x2="244" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="244" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><line x1="310.66666666666663" y1="380" x2="310.66666666666663" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="310.66666666666663" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">11</text><line x1="377.33333333333337" y1="380" x2="377.33333333333337" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="377.33333333333337" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">12</text><line x1="444" y1="380" x2="444" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="444" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">13</text><text x="244" y="416" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">target_gap →</text><path d="M44.0 131.3 L110.7 104.6 L177.3 229.0 L244.0 371.1 L310.7 371.1 L377.3 380.0 L444.0 380.0" fill="none" stroke="#2563eb" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="131.29411764705884" r="3" fill="#2563eb"/><circle cx="110.66666666666666" cy="104.64705882352942" r="3" fill="#2563eb"/><circle cx="177.33333333333331" cy="229" r="3" fill="#2563eb"/><circle cx="244" cy="371.11764705882354" r="3" fill="#2563eb"/><circle cx="310.66666666666663" cy="371.11764705882354" r="3" fill="#2563eb"/><circle cx="377.33333333333337" cy="380" r="3" fill="#2563eb"/><circle cx="444" cy="380" r="3" fill="#2563eb"/><path d="M44.0 166.8 L110.7 229.0 L177.3 344.5 L244.0 371.1 L310.7 380.0 L377.3 380.0 L444.0 380.0" fill="none" stroke="#d97706" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="166.8235294117647" r="3" fill="#d97706"/><circle cx="110.66666666666666" cy="229" r="3" fill="#d97706"/><circle cx="177.33333333333331" cy="344.4705882352941" r="3" fill="#d97706"/><circle cx="244" cy="371.11764705882354" r="3" fill="#d97706"/><circle cx="310.66666666666663" cy="380" r="3" fill="#d97706"/><circle cx="377.33333333333337" cy="380" r="3" fill="#d97706"/><circle cx="444" cy="380" r="3" fill="#d97706"/><path d="M44.0 300.1 L110.7 371.1 L177.3 371.1 L244.0 362.2 L310.7 380.0 L377.3 380.0 L444.0 380.0" fill="none" stroke="#0891b2" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="44" cy="300.05882352941177" r="3" fill="#0891b2"/><circle cx="110.66666666666666" cy="371.11764705882354" r="3" fill="#0891b2"/><circle cx="177.33333333333331" cy="371.11764705882354" r="3" fill="#0891b2"/><circle cx="244" cy="362.2352941176471" r="3" fill="#0891b2"/><circle cx="310.66666666666663" cy="380" r="3" fill="#0891b2"/><circle cx="377.33333333333337" cy="380" r="3" fill="#0891b2"/><circle cx="444" cy="380" r="3" fill="#0891b2"/><text x="704" y="42" text-anchor="middle" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">W edge @ A=100 — a sharp cliff</text><text x="704" y="58" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">channel closes abruptly 7→8 in all three</text><line x1="504" y1="380" x2="904" y2="380" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="384" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="504" y1="291.17647058823525" x2="904" y2="291.17647058823525" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="295.17647058823525" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">10%</text><line x1="504" y1="202.35294117647058" x2="904" y2="202.35294117647058" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="206.35294117647058" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">20%</text><line x1="504" y1="113.52941176470588" x2="904" y2="113.52941176470588" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="496" y="117.52941176470588" text-anchor="end" font-size="10" fill="var(--text-tertiary,#9ca3af)">30%</text><line x1="504" y1="371.11764705882354" x2="904" y2="371.11764705882354" stroke="var(--positive,#16a34a)" stroke-width="1.2" stroke-dasharray="5 3" stroke-opacity="0.8"/><text x="904" y="367.11764705882354" text-anchor="end" font-size="9.5" fill="var(--positive,#16a34a)">coherent &lt;1%</text><line x1="504" y1="380" x2="504" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="504" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">3</text><line x1="561.1428571428571" y1="380" x2="561.1428571428571" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="561.1428571428571" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><line x1="618.2857142857142" y1="380" x2="618.2857142857142" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="618.2857142857142" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">5</text><line x1="675.4285714285714" y1="380" x2="675.4285714285714" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="675.4285714285714" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">6</text><line x1="732.5714285714286" y1="380" x2="732.5714285714286" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="732.5714285714286" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><line x1="789.7142857142858" y1="380" x2="789.7142857142858" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="789.7142857142858" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><line x1="846.8571428571429" y1="380" x2="846.8571428571429" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="846.8571428571429" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><line x1="904" y1="380" x2="904" y2="384" stroke="var(--text-tertiary,#9ca3af)"/><text x="904" y="397" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="704" y="416" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">window (W) →</text><path d="M504.0 166.8 L561.1 157.9 L618.3 202.4 L675.4 131.3 L732.6 237.9 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#2563eb" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="166.8235294117647" r="3" fill="#2563eb"/><circle cx="561.1428571428571" cy="157.94117647058823" r="3" fill="#2563eb"/><circle cx="618.2857142857142" cy="202.35294117647058" r="3" fill="#2563eb"/><circle cx="675.4285714285714" cy="131.29411764705884" r="3" fill="#2563eb"/><circle cx="732.5714285714286" cy="237.88235294117646" r="3" fill="#2563eb"/><circle cx="789.7142857142858" cy="380" r="3" fill="#2563eb"/><circle cx="846.8571428571429" cy="380" r="3" fill="#2563eb"/><circle cx="904" cy="380" r="3" fill="#2563eb"/><path d="M504.0 149.1 L561.1 149.1 L618.3 166.8 L675.4 220.1 L732.6 264.5 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#d97706" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="149.05882352941177" r="3" fill="#d97706"/><circle cx="561.1428571428571" cy="149.05882352941177" r="3" fill="#d97706"/><circle cx="618.2857142857142" cy="166.8235294117647" r="3" fill="#d97706"/><circle cx="675.4285714285714" cy="220.11764705882354" r="3" fill="#d97706"/><circle cx="732.5714285714286" cy="264.52941176470586" r="3" fill="#d97706"/><circle cx="789.7142857142858" cy="380" r="3" fill="#d97706"/><circle cx="846.8571428571429" cy="380" r="3" fill="#d97706"/><circle cx="904" cy="380" r="3" fill="#d97706"/><path d="M504.0 282.3 L561.1 282.3 L618.3 300.1 L675.4 344.5 L732.6 362.2 L789.7 380.0 L846.9 380.0 L904.0 380.0" fill="none" stroke="#0891b2" stroke-width="2.5" stroke-opacity="0.9"/><circle cx="504" cy="282.29411764705884" r="3" fill="#0891b2"/><circle cx="561.1428571428571" cy="282.29411764705884" r="3" fill="#0891b2"/><circle cx="618.2857142857142" cy="300.05882352941177" r="3" fill="#0891b2"/><circle cx="675.4285714285714" cy="344.4705882352941" r="3" fill="#0891b2"/><circle cx="732.5714285714286" cy="362.2352941176471" r="3" fill="#0891b2"/><circle cx="789.7142857142858" cy="380" r="3" fill="#0891b2"/><circle cx="846.8571428571429" cy="380" r="3" fill="#0891b2"/><circle cx="904" cy="380" r="3" fill="#0891b2"/><line x1="310" y1="436" x2="330" y2="436" stroke="#2563eb" stroke-width="2.5"/><circle cx="320" cy="436" r="3" fill="#2563eb"/><text x="336" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">e4b</text><line x1="410" y1="436" x2="430" y2="436" stroke="#d97706" stroke-width="2.5"/><circle cx="420" cy="436" r="3" fill="#d97706"/><text x="436" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">12B</text><line x1="510" y1="436" x2="530" y2="436" stroke="#0891b2" stroke-width="2.5"/><circle cx="520" cy="436" r="3" fill="#0891b2"/><text x="536" y="440" font-size="11" fill="var(--text-secondary,#6b7280)">CPM5</text></svg><figcaption><b>Fine cliff resolution.</b> target_gap is a graded ramp whose position slides with vocab; W at high A is a sharp edge that closes at 7→8 in every model. Two different shapes the coarse 8/12 and 5/10 jumps had hidden.</figcaption></figure>
179
- <ul class="clean">
180
- <li><strong><code>target_gap</code> is a graded ramp</strong>, not a step — a 2–3-step slope. Its <em>position</em> shifts by vocab (CPM5 coherent earliest, e4b latest).</li>
181
- <li><strong><code>W</code> at high <code>A</code> is a sharp edge</strong> — a high plateau then an abrupt close at W=8 in all three models. The <em>edge position is model-invariant</em>; only the plateau height varies by vocab.</li>
182
- </ul>
183
- <div class="callout rock">
184
- <h4>A disconfirmed prediction (logged, not buried)</h4>
185
- We expected 12B's <code>target_gap</code> cliff to be the <em>steepest</em>. It is not — e4b's is at least as steep. 12B's genuine
186
- "sensitivity" is in <em>diversity</em> (the L_W suppression), a different axis. The prior was a rock; it's recorded as a data point and we moved on.
187
- </div>
188
-
189
- <h2><span class="n">9</span>K=20 deep-dive — settling the noise</h2>
190
- <p>Four experiments re-run at K=20, where the noisy diversity metric finally settles. Two mixed variables to resolve how
191
- the cliffs bend; two re-measured the diversity claims that sat within K=6 noise.</p>
192
-
193
- <h3>The cliffs are tilted surfaces, not fixed walls</h3>
194
- <figure><svg viewBox="0 0 900 360" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">K=20 coherence surfaces</title><desc id="d">Two fine 2-D coherence grids at K=20. The target_gap cliff slides monotonically with s_m; the W edge slides with A. Cells show mean junk percent; dot = coherent.</desc><text x="450" y="26" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">Coherence is a tilted surface, not a fixed wall (K=20)</text><text x="450" y="45" text-anchor="middle" font-size="11" fill="var(--text-secondary,#6b7280)">cell = mean canary junk% over 20 seeds · green dot = coherent · red = junk, darker = worse</text><text x="215" y="69" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap ramp × s_m</text><text x="215" y="85" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">the cliff slides with the coupling hub</text><rect x="95" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="114" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="135" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="154" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="175" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="194" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="215" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="234" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="255" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="274" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="295" y="95" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="314" y="118" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="95" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="135" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.67" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">20</text><rect x="175" y="135" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.23" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="158" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">7</text><rect x="215" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="234" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="255" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="274" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="295" y="135" width="38" height="38" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="314" y="158" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="95" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="135" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="175" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.90" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">27</text><rect x="215" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.77" stroke="#dc2626" stroke-opacity="0.28"/><text x="234" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">23</text><rect x="255" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.50" stroke="#dc2626" stroke-opacity="0.28"/><text x="274" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">15</text><rect x="295" y="175" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.33" stroke="#dc2626" stroke-opacity="0.28"/><text x="314" y="198" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">10</text><rect x="95" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="114" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="135" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="154" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="175" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="194" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="215" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="234" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="255" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.80" stroke="#dc2626" stroke-opacity="0.28"/><text x="274" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">24</text><rect x="295" y="215" width="38" height="38" rx="3" fill="#dc2626" fill-opacity="0.67" stroke="#dc2626" stroke-opacity="0.28"/><text x="314" y="238" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">20</text><text x="114" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><text x="154" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><text x="194" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><text x="234" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="274" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">11</text><text x="314" y="268" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">12</text><text x="88" y="118" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">0.2</text><text x="88" y="158" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">0.7</text><text x="88" y="198" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">2</text><text x="88" y="238" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><text x="215" y="285" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">target_gap →</text><text x="65" y="175" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 65 175)">s_m →</text><text x="697" y="69" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">W sharp edge × A</text><text x="697" y="85" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">the channel-close slides with A (≈4 at low A, ≈8 at A=100)</text><rect x="545" y="95" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="117" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="583" y="95" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="117" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="621" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="639" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="659" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="677" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="697" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="715" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="735" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="95" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="117" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="545" y="133" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="155" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="583" y="133" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.18" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="155" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">5</text><rect x="621" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="639" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="659" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="677" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="697" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="715" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="735" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="133" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="155" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="545" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="563" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="583" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.83" stroke="#dc2626" stroke-opacity="0.28"/><text x="601" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">25</text><rect x="621" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.87" stroke="#dc2626" stroke-opacity="0.28"/><text x="639" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">26</text><rect x="659" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.53" stroke="#dc2626" stroke-opacity="0.28"/><text x="677" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="#fff">16</text><rect x="697" y="171" width="36" height="36" rx="3" fill="#dc2626" fill-opacity="0.20" stroke="#dc2626" stroke-opacity="0.28"/><text x="715" y="193" text-anchor="middle" font-size="10.5" font-weight="600" fill="var(--text-primary,#1f2937)">6</text><rect x="735" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="753" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="773" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="791" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><rect x="811" y="171" width="36" height="36" rx="3" fill="var(--positive,#16a34a)" fill-opacity="0.16" stroke="var(--positive,#16a34a)" stroke-opacity="0.28"/><text x="829" y="193" text-anchor="middle" font-size="10.5" font-weight="400" fill="var(--text-primary,#1f2937)">·</text><text x="563" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">3</text><text x="601" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">4</text><text x="639" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">5</text><text x="677" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">6</text><text x="715" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">7</text><text x="753" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">8</text><text x="791" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">9</text><text x="829" y="222" text-anchor="middle" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="538" y="117" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">1</text><text x="538" y="155" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">10</text><text x="538" y="193" text-anchor="end" font-size="10" fill="var(--text-secondary,#6b7280)">100</text><text x="697" y="239" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">window (W) →</text><text x="515" y="152" text-anchor="middle" font-size="10.5" fill="var(--text-tertiary,#9ca3af)" transform="rotate(-90 515 152)">A →</text></svg><figcaption><b>Fine 2-D coherence at K=20.</b> Left: the target_gap cliff slides monotonically with s_m — at s_m=0.2 there is no cliff at all; raise s_m and the tg needed for coherence climbs out of frame. Right: the W edge slides with A — it closes at W≈4–5 for low A but not until W≈8 at A=100, so the earlier 'invariant 7→8 edge' was specific to A=100.</figcaption></figure>
195
- <p>The "coupling hub" isn't a metaphor: <code>s_m</code> literally translates the <code>target_gap</code> cliff edge, and <code>A</code>
196
- translates the <code>W</code> edge. The base-config slices resolved in §8 were single rows through these tilted surfaces.</p>
197
-
198
- <h3>One diversity claim dies, one confirms</h3>
199
- <figure><svg viewBox="0 0 900 300" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t2 d2" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t2">K=20 diversity sweeps</title><desc id="d2">At K=20, L_W diversity sits uniformly below the default; the A gradient is a clean monotone that only beats default at the loosest A.</desc><text x="450" y="24" text-anchor="middle" font-size="16" font-weight="700" fill="var(--text-primary,#1f2937)">Settled diversity at K=20 — one claim dies, one confirms</text><text x="239" y="48" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">L_W around the supposed peak</text><text x="239" y="64" text-anchor="middle" font-size="10.5" fill="#2563eb">K=20: uniformly BELOW default — the K=6 peak was noise</text><line x1="42" y1="307.06666666666666" x2="436" y2="307.06666666666666" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="311.06666666666666" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.30</text><line x1="42" y1="245.73333333333332" x2="436" y2="245.73333333333332" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="249.73333333333332" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.40</text><line x1="42" y1="184.40000000000003" x2="436" y2="184.40000000000003" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="188.40000000000003" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="42" y1="123.06666666666669" x2="436" y2="123.06666666666669" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="36" y="127.06666666666669" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="42" y1="102.82666666666668" x2="436" y2="102.82666666666668" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1.3" stroke-dasharray="6 4"/><text x="436" y="97.82666666666668" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">default 0.633</text><line x1="82.7586206896552" y1="258" x2="82.7586206896552" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="82.7586206896552" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.8</text><line x1="232.20689655172413" y1="258" x2="232.20689655172413" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="232.20689655172413" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">1.0</text><line x1="368.06896551724134" y1="258" x2="368.06896551724134" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="368.06896551724134" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">1.2</text><text x="239" y="291" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">OOTF γ →</text><path d="M82.8 232.9 L130.3 234.7 L177.9 238.4 L225.4 226.1 L273.0 221.8 L320.5 217.5 L368.1 219.4 L415.6 220.6" fill="none" stroke="#2563eb" stroke-width="2.5"/><circle cx="82.7586206896552" cy="232.85333333333335" r="3.5" fill="#2563eb" /><circle cx="130.3103448275862" cy="234.69333333333336" r="3.5" fill="#2563eb" /><circle cx="177.86206896551727" cy="238.37333333333336" r="3.5" fill="#2563eb" /><circle cx="225.41379310344828" cy="226.10666666666668" r="3.5" fill="#2563eb" /><circle cx="272.9655172413793" cy="221.81333333333333" r="3.5" fill="#2563eb" /><circle cx="320.51724137931024" cy="217.52" r="3.5" fill="#2563eb" /><circle cx="368.06896551724134" cy="219.36" r="3.5" fill="#2563eb" /><circle cx="415.62068965517244" cy="220.58666666666667" r="3.5" fill="#2563eb" /><text x="689" y="48" text-anchor="middle" font-size="13.5" font-weight="700" fill="var(--text-primary,#1f2937)">A diversity gradient</text><text x="689" y="64" text-anchor="middle" font-size="10.5" fill="#16a34a">clean monotone — the free lever; only loosest A beats default</text><line x1="492" y1="248.8" x2="886" y2="248.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="252.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.30</text><line x1="492" y1="202.8" x2="886" y2="202.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="206.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.40</text><line x1="492" y1="156.8" x2="886" y2="156.8" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="160.8" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.50</text><line x1="492" y1="110.80000000000004" x2="886" y2="110.80000000000004" stroke="var(--border,#e5e7eb)" stroke-opacity="0.6"/><text x="486" y="114.80000000000004" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">0.60</text><line x1="492" y1="95.62" x2="886" y2="95.62" stroke="var(--text-tertiary,#9ca3af)" stroke-width="1.3" stroke-dasharray="6 4"/><text x="886" y="90.62" text-anchor="end" font-size="9.5" fill="var(--text-tertiary,#9ca3af)">default 0.633</text><line x1="510.76190476190476" y1="258" x2="510.76190476190476" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="510.76190476190476" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.01</text><line x1="641.9019912897102" y1="258" x2="641.9019912897102" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="641.9019912897102" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.05</text><line x1="698.3809523809524" y1="258" x2="698.3809523809524" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="698.3809523809524" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.1</text><line x1="800.4584807019089" y1="258" x2="800.4584807019089" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="800.4584807019089" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.35</text><line x1="856.937441793151" y1="258" x2="856.937441793151" y2="262" stroke="var(--text-tertiary,#9ca3af)"/><text x="856.937441793151" y="274" text-anchor="middle" font-size="9.5" fill="var(--text-secondary,#6b7280)">0.7</text><text x="689" y="291" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">A (shoulder) →</text><path d="M510.8 81.8 L641.9 140.2 L698.4 160.0 L754.9 180.7 L800.5 185.8 L856.9 242.4" fill="none" stroke="#16a34a" stroke-width="2.5"/><circle cx="510.76190476190476" cy="81.82" r="5" fill="#16a34a" stroke="#16a34a" stroke-width="2"/><circle cx="641.9019912897102" cy="140.24" r="3.5" fill="#16a34a" /><circle cx="698.3809523809524" cy="160.02000000000004" r="3.5" fill="#16a34a" /><circle cx="754.8599134721946" cy="180.72000000000003" r="3.5" fill="#16a34a" /><circle cx="800.4584807019089" cy="185.78000000000003" r="3.5" fill="#16a34a" /><circle cx="856.937441793151" cy="242.36" r="3.5" fill="#16a34a" /></svg><figcaption><b>Settled diversity at K=20 (e4b default = 0.633).</b> Left: every L_W setting sits ~0.19 below default — the K=6 '0.76 beats default' was small-sample noise. Right: the A gradient is a clean monotone, and only the loosest A (0.01, ringed) clears the default line.</figcaption></figure>
200
- <div class="callout rock">
201
- <h4>K=6 → K=20: a claim retracted</h4>
202
- At K=6, e4b's <code>L_W</code> curve appeared to peak <em>above</em> its default (0.76 vs 0.70). At K=20 it does not — the default
203
- is 0.633 and every <code>L_W</code> point sits at 0.42–0.45. The peak was noise. This brings e4b in line with what K=6 already
204
- showed for 12B and CPM5 (both below their defaults): across the board, <strong>HLG's curvature knob does not beat the recommended recipe on diversity.</strong>
205
- </div>
206
- <div class="callout terrain">
207
- <h4>What K=20 confirms</h4>
208
- <code>A</code> is the genuine <strong>free diversity lever</strong>: diversity falls cleanly and monotonically as <code>A</code> tightens
209
- (0.66 → 0.31 across A 0.01→0.7), and the <em>one</em> place HLG clears a model's default at all is the loosest <code>A</code> (+0.03 at A=0.01).
210
- Modest, but real and reproducible. <span style="color:var(--text-tertiary)">(The A sweep was cut at A=0.7 when the batch was stopped; the monotone trend and the diversity ceiling are captured.)</span>
211
- </div>
212
-
213
- <h3>The texture of the edges</h3>
214
- <p>Zooming sub-unit into the transitions (K=20, tracking break-<em>rate</em> and max, not just the mean) shows the "cliffs" are not
215
- all the same kind of thing.</p>
216
- <figure><svg viewBox="0 0 860 536" xmlns="http://www.w3.org/2000/svg" role="img" aria-labelledby="t d" font-family="ui-sans-serif,system-ui,sans-serif"><title id="t">HLG edge texture</title><desc id="d">Break-rate across the four transition zooms at K=20: the gate cliffs are soft probabilistic ramps, the L_W low wall is a hard threshold at gamma 0, the high wall is barely there.</desc><text x="430" y="26" text-anchor="middle" font-size="17" font-weight="700" fill="var(--text-primary,#1f2937)">Edge texture (K=20) — break-rate, not magnitude, is what slides</text><text x="46" y="58" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">target_gap ramp</text><text x="414" y="58" text-anchor="end" font-size="11.5" font-weight="700" fill="#d97706">soft · probabilistic</text><line x1="46" y1="240" x2="414" y2="240" stroke="var(--grid,#eef2f7)"/><text x="40" y="243" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="46" y1="200.5" x2="414" y2="200.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="203.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="46" y1="161" x2="414" y2="161" stroke="var(--grid,#eef2f7)"/><text x="40" y="164" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="46" y1="121.5" x2="414" y2="121.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="124.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="46" y1="82" x2="414" y2="82" stroke="var(--grid,#eef2f7)"/><text x="40" y="85" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="35.77777777777778" y="202.07999999999998" width="20.444444444444443" height="37.92" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="81.77777777777777" y="205.24" width="20.444444444444443" height="34.76" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="127.77777777777777" y="208.4" width="20.444444444444443" height="31.6" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="173.77777777777777" y="217.88" width="20.444444444444443" height="22.12" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="219.77777777777777" y="228.94" width="20.444444444444443" height="11.06" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="265.77777777777777" y="230.52" width="20.444444444444443" height="9.48" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="311.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="357.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="403.77777777777777" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M46.0 82.0 L92.0 82.0 L138.0 82.0 L184.0 105.7 L230.0 129.4 L276.0 161.0 L322.0 224.2 L368.0 224.2 L414.0 216.3" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="46" cy="82" r="3" fill="#d97706"/><circle cx="92" cy="82" r="3" fill="#d97706"/><circle cx="138" cy="82" r="3" fill="#d97706"/><circle cx="184" cy="105.7" r="3" fill="#d97706"/><circle cx="230" cy="129.4" r="3" fill="#d97706"/><circle cx="276" cy="161" r="3" fill="#d97706"/><circle cx="322" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="368" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="414" cy="216.29999999999998" r="3" fill="#d97706"/><text x="46" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7</text><text x="138" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">8</text><text x="230" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">9</text><text x="322" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">10</text><text x="414" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">11</text><text x="230" y="271" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">target_gap →</text><text x="476" y="58" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">W channel-close (A=100)</text><text x="844" y="58" text-anchor="end" font-size="11.5" font-weight="700" fill="#d97706">soft · steeper</text><line x1="476" y1="240" x2="844" y2="240" stroke="var(--grid,#eef2f7)"/><text x="470" y="243" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="476" y1="200.5" x2="844" y2="200.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="203.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="476" y1="161" x2="844" y2="161" stroke="var(--grid,#eef2f7)"/><text x="470" y="164" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="476" y1="121.5" x2="844" y2="121.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="124.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="476" y1="82" x2="844" y2="82" stroke="var(--grid,#eef2f7)"/><text x="470" y="85" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="465.77777777777777" y="214.72" width="20.444444444444443" height="25.28" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="527.1111111111112" y="225.78" width="20.444444444444443" height="14.219999999999999" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="588.4444444444445" y="230.52" width="20.444444444444443" height="9.48" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="619.1111111111112" y="232.1" width="20.444444444444443" height="7.9" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="649.7777777777778" y="232.1" width="20.444444444444443" height="7.9" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="680.4444444444446" y="238.42" width="20.444444444444443" height="1.58" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="711.1111111111111" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="772.4444444444446" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="833.7777777777778" y="240" width="20.444444444444443" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M476.0 97.8 L537.3 97.8 L598.7 161.0 L629.3 184.7 L660.0 208.4 L690.7 208.4 L721.3 224.2 L782.7 240.0 L844.0 240.0" fill="none" stroke="#d97706" stroke-width="2.5"/><circle cx="476" cy="97.8" r="3" fill="#d97706"/><circle cx="537.3333333333334" cy="97.8" r="3" fill="#d97706"/><circle cx="598.6666666666666" cy="161" r="3" fill="#d97706"/><circle cx="629.3333333333334" cy="184.7" r="3" fill="#d97706"/><circle cx="660" cy="208.4" r="3" fill="#d97706"/><circle cx="690.6666666666667" cy="208.4" r="3" fill="#d97706"/><circle cx="721.3333333333333" cy="224.20000000000002" r="3" fill="#d97706"/><circle cx="782.6666666666667" cy="240" r="3" fill="#d97706"/><circle cx="844" cy="240" r="3" fill="#d97706"/><text x="476" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">6</text><text x="598.6666666666666" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7</text><text x="660" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">7.5</text><text x="721.3333333333333" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">8</text><text x="844" y="255" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">9</text><text x="660" y="271" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">window W →</text><text x="46" y="308" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">L_W low wall (γ→0)</text><text x="414" y="308" text-anchor="end" font-size="11.5" font-weight="700" fill="#dc2626">HARD · at γ=0</text><line x1="46" y1="490" x2="414" y2="490" stroke="var(--grid,#eef2f7)"/><text x="40" y="493" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="46" y1="450.5" x2="414" y2="450.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="453.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="46" y1="411" x2="414" y2="411" stroke="var(--grid,#eef2f7)"/><text x="40" y="414" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="46" y1="371.5" x2="414" y2="371.5" stroke="var(--grid,#eef2f7)"/><text x="40" y="374.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="46" y1="332" x2="414" y2="332" stroke="var(--grid,#eef2f7)"/><text x="40" y="335" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="36.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="67.46666666666665" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="87.91111111111111" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="108.35555555555557" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="128.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="159.46666666666667" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="190.13333333333335" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="231.02222222222224" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="312.80000000000007" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="404.8" y="490" width="18.4" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M46.0 490.0 L76.7 490.0 L97.1 490.0 L117.6 490.0 L138.0 490.0 L168.7 490.0 L199.3 490.0 L240.2 490.0 L322.0 490.0 L414.0 490.0" fill="none" stroke="#dc2626" stroke-width="2.5"/><circle cx="46" cy="490" r="3" fill="#dc2626"/><circle cx="76.66666666666666" cy="490" r="3" fill="#dc2626"/><circle cx="97.11111111111111" cy="490" r="3" fill="#dc2626"/><circle cx="117.55555555555557" cy="490" r="3" fill="#dc2626"/><circle cx="138" cy="490" r="3" fill="#dc2626"/><circle cx="168.66666666666666" cy="490" r="3" fill="#dc2626"/><circle cx="199.33333333333334" cy="490" r="3" fill="#dc2626"/><circle cx="240.22222222222223" cy="490" r="3" fill="#dc2626"/><circle cx="322.00000000000006" cy="490" r="3" fill="#dc2626"/><circle cx="414" cy="490" r="3" fill="#dc2626"/><text x="46" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0</text><text x="97.11111111111111" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.05</text><text x="138" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.09</text><text x="199.33333333333334" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.15</text><text x="322.00000000000006" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">0.27</text><text x="230" y="521" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">γ →</text><text x="46" y="324" font-size="9.5" fill="var(--text-tertiary,#9ca3af)"><tspan x="46" dy="0">every point γ≥0 is clean — the wall is the sign flip at γ<0, a</tspan><tspan x="46" dy="11">deterministic discontinuity just off the left edge</tspan></text><text x="476" y="308" font-size="14" font-weight="700" fill="var(--text-primary,#1f2937)">L_W high wall (γ→2.4)</text><text x="844" y="308" text-anchor="end" font-size="11.5" font-weight="700" fill="#16a34a">barely a wall</text><line x1="476" y1="490" x2="844" y2="490" stroke="var(--grid,#eef2f7)"/><text x="470" y="493" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">0%</text><line x1="476" y1="450.5" x2="844" y2="450.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="453.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">25%</text><line x1="476" y1="411" x2="844" y2="411" stroke="var(--grid,#eef2f7)"/><text x="470" y="414" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">50%</text><line x1="476" y1="371.5" x2="844" y2="371.5" stroke="var(--grid,#eef2f7)"/><text x="470" y="374.5" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">75%</text><line x1="476" y1="332" x2="844" y2="332" stroke="var(--grid,#eef2f7)"/><text x="470" y="335" text-anchor="end" font-size="9" fill="var(--text-tertiary,#9ca3af)">100%</text><rect x="460.6666666666667" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="523.7523809523809" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="597.3523809523812" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="691.9809523809525" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="755.0666666666668" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><rect x="828.6666666666666" y="490" width="30.666666666666668" height="0" fill="var(--text-tertiary,#9ca3af)" opacity="0.28" rx="1"/><path d="M476.0 490.0 L539.1 482.1 L612.7 482.1 L707.3 474.2 L770.4 474.2 L844.0 466.3" fill="none" stroke="#16a34a" stroke-width="2.5"/><circle cx="476" cy="490" r="3" fill="#16a34a"/><circle cx="539.0857142857143" cy="482.1" r="3" fill="#16a34a"/><circle cx="612.6857142857145" cy="482.1" r="3" fill="#16a34a"/><circle cx="707.3142857142859" cy="474.20000000000005" r="3" fill="#16a34a"/><circle cx="770.4000000000002" cy="474.20000000000005" r="3" fill="#16a34a"/><circle cx="844" cy="466.29999999999995" r="3" fill="#16a34a"/><text x="476" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.11</text><text x="539.0857142857143" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.17</text><text x="612.6857142857145" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.24</text><text x="707.3142857142859" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.33</text><text x="770.4000000000002" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.39</text><text x="844" y="505" text-anchor="middle" font-size="9" fill="var(--text-secondary,#6b7280)">2.46</text><text x="660" y="521" text-anchor="middle" font-size="10.5" fill="var(--text-secondary,#6b7280)">γ →</text><text x="476" y="324" font-size="9.5" fill="var(--text-tertiary,#9ca3af)"><tspan x="476" dy="0">only 3/20 break even at γ=2.46 — the coarse 'REJECT' was a</tspan><tspan x="476" dy="11">1-of-2-seed artifact</tspan></text><text x="46" y="530" font-size="10.5" fill="var(--text-tertiary,#9ca3af)">line = % of 20 seeds that broke · faint bars = mean junk% · the cliffs are statistical edges (some seeds wander into junk), not hard thresholds</text></svg><figcaption><b>Edge texture (K=20).</b> Break-rate across the four transition zooms. The gate cliffs are soft probabilistic ramps (a declining fraction of seeds break, while the ones that do break hard); the L_W low wall is a hard deterministic threshold at γ=0 (the ranking sign-flip); the high wall is barely a wall (3/20 even at γ=2.46).</figcaption></figure>
217
- <ul class="clean">
218
- <li><strong>The gate cliffs (<code>tg</code>, <code>W</code>) are <em>statistical</em> edges.</strong> Per seed it's bimodal — clean or hard-break (max stays
219
- 43–88% mid-ramp) — so the smooth "ramp" is really the declining <em>fraction</em> of seeds that wander into junk, not a softening failure.</li>
220
- <li><strong>The <code>L_W</code> low wall is a <em>hard</em> threshold at γ=0</strong> — a sign flip of the ranking, deterministic. Every sampled γ≥0 is clean.</li>
221
- <li><strong>The <code>L_W</code> high wall is barely there</strong> — the coarse "REJECT" was a small-sample artifact.</li>
222
- </ul>
223
- <div class="callout">
224
- <h4>Play with it</h4>
225
- Two interactive companions: <strong><a href="hlg-explorer.html">hlg-explorer.html</a></strong> — drag the sliders and watch the
226
- transfer curve and the token distribution reshape live (a faithful port of the shaper; its top-1/entropy readout <em>predicts</em>
227
- coherence — a config whose HLG top-1 collapses below raw will salad). And <strong><a href="hlg-ab.html">hlg-ab.html</a></strong> —
228
- the same prompts sampled by the default recipe vs HLG-base vs HLG-loose-A, side by side, so the diversity differences are readable as text.
229
- </div>
230
-
231
- <h2><span class="n">10</span>Where it stands</h2>
232
- <p class="lead">A map, held loosely. The durable structural results:</p>
233
- <ul class="clean">
234
- <li>The coherence wall is a <strong>coupled <code>tg</code>/<code>W</code>/<code>s_m</code> cluster</strong>; <strong><code>A</code> is an orthogonal, free diversity lever</strong>;
235
- <strong><code>L_W</code> is a coherence-robust curvature knob</strong> outside the cluster.</li>
236
- <li>The <strong>sharpness coupling is invariant</strong> across models and architectures; the <strong>window axis is vocab-sensitive</strong>.</li>
237
- <li>Cliffs come in <strong>two shapes</strong>: <code>target_gap</code> a vocab-shifted ramp, <code>W</code>@highA a model-invariant sharp edge.</li>
238
- <li>Diversity wins are <strong>marginal</strong>, and K=20 trimmed them further: the only place HLG clears a model's default is the
239
- loosest <code>A</code> (+0.03), and <code>L_W</code> shaping sits below default everywhere. The value here is the <em>geometry</em>, not a diversity gain.</li>
240
- <li>The curve <strong>shape is secondary to the final sharpness</strong> (<code>out_scale</code>, set by <code>target_gap</code>). A heavily
241
- reshaped curve with <code>target_gap≈4</code> flattens the distribution (HLG top-1 25% vs raw 50%, entropy <em>up</em>) and salads on every seed —
242
- so the distribution's top-1/entropy, not the curve's looks, is the coherence oracle. The interactive explorer makes this checkable before you ever run the model.</li>
243
- </ul>
244
- <p>Open threads: a blind external-judge read of the actual text (the one instrument not yet collected); the <code>A</code> diversity
245
- gradient on 12B/CPM5 at K=20 (only e4b is settled); finishing the cut A sweep (≥1.5) and re-measuring 12B/CPM5's <code>L_W</code> diversity at K=20.</p>
246
-
247
- <div class="foot">
248
- <p><strong>Run index.</strong> Logs preserved under <code>docs/investigations/hlg-runs/</code>; full write-up in
249
- <code>docs/investigations/hlg-sampling-investigation.md</code>. Generators: <code>hlg-map</code>, <code>hlg-cross</code>, <code>hlg-lw</code>,
250
- <code>hlg-cliff</code>, <code>hlg-grid2</code>, <code>hlg-peak</code> (+ the <code>*-viz</code> figure builders).</p>
251
- <div class="runidx">
252
- <div><code>run0–O</code> — pivots, passes 1–4 (e4b)</div>
253
- <div><code>runP/Q/R</code> — A×s_m, tg×W grids, blind</div>
254
- <div><code>runS</code> — cross-pair coherence (e4b)</div>
255
- <div><code>runT/U</code> — cross-pair on CPM5 / 12B</div>
256
- <div><code>runV/W/X</code> — L_W sweep on e4b / 12B / CPM5</div>
257
- <div><code>runY/Z/AA</code> — cliff resolution, 3 models</div>
258
- <div><code>runAB/AC</code> — K=20 grids / peaks (e4b)</div>
259
- </div>
260
- </div>
261
-
262
- </div></body></html>