@torrent-tv/proxy 2.86.0 → 2.87.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (382) hide show
  1. package/CHANGELOG.md +2138 -1915
  2. package/CLAUDE.md +318 -197
  3. package/assets/calibration/NOTICE.md +2 -2
  4. package/bin/cli.js +684 -616
  5. package/biome.json +409 -233
  6. package/docs/container-architecture.md +218 -213
  7. package/docs/download-architecture.md +7 -7
  8. package/docs/encode-architecture.md +287 -11
  9. package/docs/encode-run-state.md +2 -2
  10. package/docs/logs.md +97 -97
  11. package/docs/{disk-architecture.md → storage-architecture.md} +107 -1
  12. package/openspec/changes/adaptive-bitrate/design.md +2 -2
  13. package/openspec/changes/adaptive-bitrate/proposal.md +1 -1
  14. package/openspec/changes/adaptive-bitrate/tasks.md +1 -1
  15. package/openspec/changes/chunked-request-bodies/design.md +1 -1
  16. package/openspec/changes/chunked-request-bodies/proposal.md +1 -1
  17. package/openspec/changes/chunked-request-bodies/tasks.md +1 -1
  18. package/openspec/changes/cold-start/design.md +1 -1
  19. package/openspec/changes/disk-cap/proposal.md +1 -1
  20. package/openspec/changes/proxy-observability/proposal.md +2 -2
  21. package/openspec/changes/track-selection/proposal.md +1 -1
  22. package/openspec/changes/transcode-quality/proposal.md +1 -1
  23. package/package.json +2 -2
  24. package/research/delivery-wedge-stand-ladder-2026-09-13.md +329 -329
  25. package/research/double-spawn-2026-09-10.md +171 -171
  26. package/routes/api/playback-plan/post.js +2 -2
  27. package/routes/api/sources/files/get.js +1 -1
  28. package/routes/api/sources/stats/get.js +1 -1
  29. package/routes/api/sources/warm/post.js +10 -3
  30. package/routes/api/subtitles/get.js +230 -230
  31. package/routes/api/transcode-sessions/fragment-far/post.js +3 -3
  32. package/routes/api/transcode-sessions/net-report/post.js +129 -94
  33. package/routes/api/transcode-sessions/post.js +160 -139
  34. package/routes/api/transcode-sessions/progress/get.js +3 -3
  35. package/routes/api/transcode-sessions/release/post.js +3 -3
  36. package/routes/api/transcode-sessions/seek/post.js +12 -3
  37. package/routes/stream/get.js +2 -2
  38. package/routes/transcode/audio-file/get.js +15 -6
  39. package/routes/transcode/audio-warm/get.js +8 -5
  40. package/routes/transcode/session-file/get.js +429 -268
  41. package/routes/transcode/variant-file/get.js +47 -7
  42. package/routes/transcode/variant-warm/get.js +18 -6
  43. package/scripts/render-run-graph.js +1 -1
  44. package/server.js +720 -465
  45. package/services/encode/CoverageMap.js +428 -428
  46. package/services/encode/CushionReport.js +345 -0
  47. package/services/encode/EncodeAdmission.js +332 -0
  48. package/services/{orchestrators → encode}/EncodeOrchestrator.js +285 -17
  49. package/services/encode/EncodeRun.js +16 -9
  50. package/services/encode/EncodeRuns.js +1219 -0
  51. package/services/encode/Encoder.js +18 -2
  52. package/services/encode/EncoderSelection.js +38 -0
  53. package/services/encode/LocalObservations.js +359 -0
  54. package/services/encode/NvencEncoder.js +5 -0
  55. package/services/encode/OutputOpening.js +745 -0
  56. package/services/encode/OutputTimes.js +579 -0
  57. package/services/encode/Renditions.js +2162 -0
  58. package/services/encode/RunProgress.js +84 -0
  59. package/services/encode/SoftwareEncoder.js +12 -7
  60. package/services/encode/args.js +402 -186
  61. package/services/encode/calibration.js +361 -0
  62. package/services/encode/contention.js +128 -128
  63. package/services/encode/encode-run-state.js +16 -20
  64. package/services/encode/fingerprint.js +322 -0
  65. package/services/{hwaccel.js → encode/hwaccel.js} +82 -42
  66. package/services/{learned-median.js → encode/learned-median.js} +11 -0
  67. package/services/encode/output/EncodedOutput.js +57 -0
  68. package/services/encode/output/Output.js +131 -0
  69. package/services/{output/LiveOutputs.js → encode/output/OutputCatalog.js} +141 -40
  70. package/services/encode/output/OutputSpec.js +390 -0
  71. package/services/{output → encode/output}/Timeline.js +12 -37
  72. package/services/encode/output/index.js +20 -0
  73. package/services/encode/output/ladder.js +32 -0
  74. package/services/{output → encode/output}/playlists.js +3 -0
  75. package/services/encode/output-key-format.js +21 -0
  76. package/services/encode/quality/EncodeCost.js +1083 -0
  77. package/services/encode/quality/HostLoad.js +525 -0
  78. package/services/encode/quality/HostTimings.js +249 -0
  79. package/services/encode/quality/OutputQualityState.js +28 -0
  80. package/services/encode/quality/QualityController.js +931 -0
  81. package/services/encode/quality/QualityOffer.js +416 -0
  82. package/services/encode/quality/drain-threat.js +47 -0
  83. package/services/encode/quality/link-budget.js +254 -0
  84. package/services/encode/quality/output-format.js +266 -0
  85. package/services/encode/quality/serving-output.js +216 -0
  86. package/services/encode/quality/visible-rung.js +57 -0
  87. package/services/encode/run-command.js +23 -20
  88. package/services/encode/run-inputs.js +42 -0
  89. package/services/{segment-formats → encode/segment-formats}/fmp4.js +63 -0
  90. package/services/{segment-formats → encode/segment-formats}/index.js +3 -3
  91. package/services/encode/segment-formats/init-compat.js +324 -0
  92. package/services/{segment-formats → encode/segment-formats}/mp4-boxes.js +8 -3
  93. package/services/encode/throughput.js +97 -0
  94. package/services/{orchestrators → media}/ContainerOrchestrator.js +45 -7
  95. package/services/media/KeyframeTables.js +316 -0
  96. package/services/{source → media}/SourceFile.js +7 -55
  97. package/services/{torrent-worker/subtitle-cues.js → media/SubtitleCues.js} +103 -132
  98. package/services/media/SubtitleOrchestrator.js +167 -0
  99. package/services/{audio-inventory.js → media/audio-inventory.js} +7 -1
  100. package/services/{container → media/container}/AviContainer.js +266 -266
  101. package/services/{container → media/container}/Container.js +596 -601
  102. package/services/media/container/ContainerFactory.js +56 -0
  103. package/services/media/container/KeyframeTable.js +272 -0
  104. package/services/{container → media/container}/MatroskaContainer.js +1485 -1485
  105. package/services/{container → media/container}/Mp4Container.js +1244 -1244
  106. package/services/{container → media/container}/SubtitleFileContainer.js +322 -322
  107. package/services/media/keyframe-probe.js +157 -0
  108. package/services/media/media-info-probe.js +93 -0
  109. package/services/{playback-planner.js → media/playback-planner.js} +82 -39
  110. package/services/{tracks → media/tracks}/AudioTrack.js +131 -131
  111. package/services/{tracks → media/tracks}/language-detect.js +174 -174
  112. package/services/server/OutputLifecycle.js +418 -0
  113. package/services/server/SegmentServing.js +1146 -0
  114. package/services/server/ViewerRequests.js +522 -0
  115. package/services/server/controllers/PlaybackController.js +36 -0
  116. package/services/{controllers → server/controllers}/SubtitleController.js +17 -33
  117. package/services/server/wire-outputs.js +958 -0
  118. package/services/storage/Diagnostics.js +202 -0
  119. package/services/storage/MachineBudget.js +235 -0
  120. package/services/{piece-store → storage}/allowance.js +107 -107
  121. package/services/{core-dumps.js → storage/core-dumps.js} +1 -1
  122. package/services/{files → storage/files}/CompletedFiles.js +116 -1
  123. package/services/{disk → storage}/free.js +33 -0
  124. package/services/storage/machine-memory.js +56 -0
  125. package/services/{memory-report.js → storage/memory-report.js} +575 -596
  126. package/services/{piece-store → storage/piece-store}/piece-disk-store.js +0 -7
  127. package/services/{piece-store → storage/piece-store}/shared-piece-store.js +28 -21
  128. package/services/{encode → storage/segment-store}/SegmentStore.js +395 -8
  129. package/services/storage/wire.js +175 -0
  130. package/services/{download → torrent/download}/SwarmSelection.js +2 -2
  131. package/services/{download → torrent/download}/registry.js +2 -2
  132. package/services/torrent/files.js +1 -1
  133. package/services/torrent/piece-store-of.js +29 -0
  134. package/services/{torrent-pool.js → torrent/torrent-pool.js} +26 -119
  135. package/services/{torrent-worker → torrent/worker}/background-fill.js +2 -2
  136. package/services/{torrent-worker → torrent/worker}/channel.js +271 -250
  137. package/services/{torrent-worker → torrent/worker}/client.js +77 -58
  138. package/services/torrent/worker/held-bytes.js +155 -0
  139. package/services/{torrent-worker → torrent/worker}/install-webrtc-shim.js +1 -1
  140. package/services/{torrent-worker → torrent/worker}/piece-reader.js +21 -30
  141. package/services/{torrent-worker → torrent/worker}/pool-adapter.js +101 -137
  142. package/services/{torrent-worker → torrent/worker}/protocol.js +26 -30
  143. package/services/torrent/worker/resume-warm.js +107 -0
  144. package/services/{torrent-worker → torrent/worker}/webrtc-shim.js +2 -2
  145. package/services/{torrent-worker → torrent/worker}/worker.js +68 -159
  146. package/services/{data-channel-handler.js → transport/data-channel-handler.js} +1356 -1356
  147. package/services/{delivery-probe.js → transport/delivery-probe.js} +842 -842
  148. package/services/{health-collector.js → transport/health-collector.js} +6 -35
  149. package/services/{packet-witness.js → transport/packet-witness.js} +808 -784
  150. package/services/{port-mapper.js → transport/port-mapper.js} +1 -1
  151. package/services/{usrsctp-state.js → transport/usrsctp-state.js} +1 -1
  152. package/services/{webrtc-manager.js → transport/webrtc-manager.js} +1 -1
  153. package/services/viewer/Assignments.js +340 -0
  154. package/services/{priority → viewer}/PriorityMap.js +390 -390
  155. package/services/{priority → viewer}/PriorityOrchestrator.js +325 -320
  156. package/services/viewer/Viewer.js +657 -483
  157. package/services/viewer/Viewers.js +368 -257
  158. package/services/viewer/active-output.js +37 -54
  159. package/services/viewer/audio-start.js +4 -3
  160. package/services/viewer/buffer-trend.js +81 -0
  161. package/services/viewer/choices.js +647 -0
  162. package/services/viewer/positions.js +126 -120
  163. package/services/viewer/report-intake.js +46 -45
  164. package/test/asset-paths.test.js +28 -0
  165. package/test/audio-inventory.test.js +3 -3
  166. package/test/audio-track-bitrate.test.js +40 -0
  167. package/test/auto-quality-step.test.js +707 -515
  168. package/test/available-share.test.js +1 -1
  169. package/test/background-fill.test.js +1 -1
  170. package/test/client-log-file.test.js +110 -110
  171. package/test/completed-files.test.js +1 -1
  172. package/test/concurrent-cost.test.js +13 -3
  173. package/test/container-media-info.test.js +3 -3
  174. package/test/core-dumps.test.js +1 -1
  175. package/test/coverage-follows-the-disk.test.js +40 -8
  176. package/test/cue-push-carries-what-the-walk-found.test.js +58 -0
  177. package/test/cut-times-timeline.test.js +2 -2
  178. package/test/cuts-follow-published-grid.test.js +9 -8
  179. package/test/data-channel-frame.test.js +1 -1
  180. package/test/dead-torrent-handle.test.js +1 -1
  181. package/test/declared-rates.test.js +2 -2
  182. package/test/declared-tracks.test.js +2 -2
  183. package/test/decode-cost-fit.test.js +1 -1
  184. package/test/decode-cost.test.js +34 -25
  185. package/test/delivery-probe.test.js +1 -1
  186. package/test/demand-register.test.js +4 -4
  187. package/test/dht-bootstrap.test.js +1 -1
  188. package/test/drain-threat.test.js +65 -0
  189. package/test/duplicate-add.test.js +1 -1
  190. package/test/encode-admission.test.js +146 -0
  191. package/test/encode-cost.test.js +199 -10
  192. package/test/encode-orchestrator.test.js +39 -1
  193. package/test/encode-plan-viewers.test.js +2 -2
  194. package/test/encode-run.test.js +2 -2
  195. package/test/encode-slope.test.js +1 -1
  196. package/test/encoded-output.test.js +39 -0
  197. package/test/encoder-readings.test.js +1 -1
  198. package/test/every-claimant-is-told-its-share.test.js +152 -0
  199. package/test/failed-encoder-still-serves-what-exists.test.js +354 -0
  200. package/test/failed-start-breaker.test.js +81 -30
  201. package/test/fastest-wires.test.js +1 -1
  202. package/test/ffmpeg-stream-counts.test.js +1 -1
  203. package/test/file-edges.test.js +3 -3
  204. package/test/fmp4-self-contained.test.js +1 -1
  205. package/test/fmp4-timestamps.test.js +1 -1
  206. package/test/fmp4-track-completeness.test.js +1 -1
  207. package/test/format-keyed-outputs.test.js +78 -0
  208. package/test/health-metrics.test.js +3 -2
  209. package/test/held-request-width.test.js +22 -23
  210. package/test/helpers/encode-run.js +136 -136
  211. package/test/helpers/held-file.js +29 -0
  212. package/test/helpers/manager.js +57 -0
  213. package/test/helpers/output-spec.js +63 -0
  214. package/test/host-load.test.js +1 -1
  215. package/test/index-accuracy-is-about-the-file.test.js +128 -0
  216. package/test/init-compat.test.js +219 -0
  217. package/test/input-lost-quiets-the-plan.test.js +1 -1
  218. package/test/input-unavailable.test.js +1 -1
  219. package/test/keeping-period.test.js +4 -4
  220. package/test/keyframe-index-accuracy.test.js +97 -45
  221. package/test/keyframe-table-budget.test.js +28 -33
  222. package/test/keyframes-belong-to-the-file.test.js +174 -57
  223. package/test/learned-median.test.js +1 -1
  224. package/test/letting-go-asks-who-is-watching.test.js +191 -0
  225. package/test/limit-row-by-area.test.js +60 -0
  226. package/test/link-budget.test.js +111 -0
  227. package/test/link-probe.test.js +56 -56
  228. package/test/local-encoding-data.test.js +273 -0
  229. package/test/look-ahead-coverage.test.js +1 -1
  230. package/test/manager-surface.test.js +294 -0
  231. package/test/matroska-blocks.test.js +0 -0
  232. package/test/matroska-cues-track.test.js +1 -1
  233. package/test/memory-budget.test.js +2 -2
  234. package/test/mp4-composition-times.test.js +0 -0
  235. package/test/mp4-subtitles.test.js +1 -1
  236. package/test/one-authority.test.js +45 -41
  237. package/test/one-budget.test.js +149 -0
  238. package/test/one-output-one-session.test.js +204 -0
  239. package/test/{disk-space.test.js → one-resource-divided.test.js} +30 -10
  240. package/test/one-serving-output-per-height.test.js +458 -0
  241. package/test/orchestrator-wired.test.js +46 -45
  242. package/test/output-catalog.test.js +39 -0
  243. package/test/output-shape.test.js +4 -51
  244. package/test/output-spec.test.js +251 -157
  245. package/test/output-speed.test.js +17 -15
  246. package/test/outputs-being-prepared.test.js +40 -0
  247. package/test/packet-witness-ring.test.js +2 -2
  248. package/test/packet-witness.test.js +1 -1
  249. package/test/piece-disk-store.test.js +2 -2
  250. package/test/piece-from-whole-file.test.js +1 -1
  251. package/test/piece-lru.test.js +1 -1
  252. package/test/piece-reader.test.js +2 -2
  253. package/test/piece-store-eviction.test.js +1 -1
  254. package/test/piece-store-never-refuses.test.js +1 -1
  255. package/test/piece-store-reservations.test.js +1 -1
  256. package/test/piece-store-slow-disk.test.js +1 -1
  257. package/test/piece-tail.test.js +1 -1
  258. package/test/plan-host-timings.test.js +1 -1
  259. package/test/plan-is-steady.test.js +225 -225
  260. package/test/priority-map-download.test.js +4 -4
  261. package/test/priority-map-emptied.test.js +204 -205
  262. package/test/priority-map-per-output.test.js +215 -209
  263. package/test/priority-map.test.js +1 -1
  264. package/test/probe-wedge-certainty.test.js +1 -1
  265. package/test/produced-copy-choice.test.js +15 -60
  266. package/test/quality-offer.test.js +162 -0
  267. package/test/quality-variants.test.js +1229 -1167
  268. package/test/rate-control-in-the-output.test.js +180 -0
  269. package/test/read-survives-withdrawal.test.js +2 -2
  270. package/test/read-window.test.js +10 -3
  271. package/test/resume-warm.test.js +1 -1
  272. package/test/run-inputs.test.js +80 -0
  273. package/test/run-position-follows-published-grid.test.js +13 -11
  274. package/test/run-progress.test.js +65 -0
  275. package/test/same-height-switch.test.js +664 -0
  276. package/test/seek-frees-the-viewers-requests.test.js +217 -0
  277. package/test/seek-landing.test.js +13 -13
  278. package/test/seek-target-not-superseded.test.js +28 -29
  279. package/test/segment-closed-on-both-branches.test.js +96 -0
  280. package/test/segment-cut-times.test.js +1 -1
  281. package/test/segment-hold-supersede.test.js +28 -35
  282. package/test/segment-judged-by-its-own-header.test.js +221 -0
  283. package/test/segment-serve-wiring.test.js +130 -39
  284. package/test/segment-store-eviction.test.js +22 -7
  285. package/test/segment-store.test.js +98 -14
  286. package/test/segment-true-start.test.js +1 -1
  287. package/test/segments-are-shared.test.js +17 -16
  288. package/test/send-chunk-bytes.test.js +1 -1
  289. package/test/serving-existing-output.test.js +102 -0
  290. package/test/serving-output.test.js +102 -0
  291. package/test/shared-piece-store.test.js +1 -1
  292. package/test/source-file.test.js +1 -1
  293. package/test/stale-request-after-seek.test.js +17 -21
  294. package/test/startup-readings.test.js +10 -5
  295. package/test/subtitle-cue-framing.test.js +5 -5
  296. package/test/subtitle-cue-source.test.js +36 -38
  297. package/test/subtitle-cue-walk.test.js +11 -10
  298. package/test/subtitle-defaults.test.js +1 -1
  299. package/test/subtitle-language.test.js +4 -4
  300. package/test/subtitle-track-numbering.test.js +5 -4
  301. package/test/supply-margin.test.js +1 -1
  302. package/test/swarm-follows-readers.test.js +3 -3
  303. package/test/swarm-reach.test.js +1 -1
  304. package/test/swarm-selection.test.js +3 -3
  305. package/test/tail-duplication.test.js +1 -1
  306. package/test/the-channel-has-both-ends.test.js +91 -0
  307. package/test/the-torrent-thread-serves-bytes.test.js +107 -0
  308. package/test/thread-pool.test.js +3 -3
  309. package/test/timeline.test.js +1 -12
  310. package/test/torrent-cost.test.js +1 -1
  311. package/test/tracks-begin-together.test.js +38 -24
  312. package/test/tunnel-renewal.test.js +1 -1
  313. package/test/two-viewers-one-picture.test.js +120 -87
  314. package/test/upload-hurry.test.js +3 -3
  315. package/test/usrsctp-state.test.js +1 -1
  316. package/test/video-facts.test.js +1 -1
  317. package/test/viewer-assignments.test.js +143 -0
  318. package/test/viewer-outputs.test.js +60 -52
  319. package/test/viewer-presence.test.js +22 -25
  320. package/test/viewer-requests-admission.test.js +89 -0
  321. package/test/viewer-states.test.js +189 -202
  322. package/test/viewer-subtitle-subscription.test.js +1 -1
  323. package/test/viewer.test.js +139 -136
  324. package/test/viewing-generations.test.js +390 -0
  325. package/test/visible-rung.test.js +37 -0
  326. package/test/wait-ledger.test.js +1 -1
  327. package/test/webrtc-shim.test.js +3 -3
  328. package/test/wedge-certainty.test.js +2 -2
  329. package/test/withdraw-piece-claim.test.js +2 -2
  330. package/test/worker-channel.test.js +1 -31
  331. package/utils/client-log-file.js +151 -151
  332. package/scripts/read-container-index.mjs +0 -108
  333. package/services/container/ContainerFactory.js +0 -122
  334. package/services/controllers/PlaybackController.js +0 -33
  335. package/services/disk/DiskSpace.js +0 -150
  336. package/services/disk/wire.js +0 -61
  337. package/services/hls-session-manager.js +0 -9608
  338. package/services/orchestrators/SubtitleOrchestrator.js +0 -160
  339. package/services/output/Output.js +0 -94
  340. package/services/output/OutputSpec.js +0 -202
  341. package/services/output/index.js +0 -1
  342. package/services/output/ladder.js +0 -26
  343. package/services/produced-index.js +0 -222
  344. package/services/quality/EncodeCost.js +0 -555
  345. package/services/torrent-worker/container-tracks.js +0 -414
  346. package/services/viewer/link-readings.js +0 -56
  347. package/test/produced-index.test.js +0 -142
  348. /package/{services → bin}/thread-pool.js +0 -0
  349. /package/services/{available-share.js → encode/available-share.js} +0 -0
  350. /package/services/{decode-cost-fit.js → encode/decode-cost-fit.js} +0 -0
  351. /package/services/{encoder-readings.js → encode/encoder-readings.js} +0 -0
  352. /package/services/{host-load.js → encode/host-load.js} +0 -0
  353. /package/services/{output → encode/output}/cut-grid.js +0 -0
  354. /package/services/{output → encode/output}/rates.js +0 -0
  355. /package/services/{segment-formats → encode/segment-formats}/mpegts.js +0 -0
  356. /package/services/{torrent-cost.js → encode/torrent-cost.js} +0 -0
  357. /package/services/{container → media/container}/ebml-reader.js +0 -0
  358. /package/services/{ffmpeg-banner.js → media/ffmpeg-banner.js} +0 -0
  359. /package/services/{tracks → media/tracks}/ContainerTrack.js +0 -0
  360. /package/services/{tracks → media/tracks}/ImageSubtitleTrack.js +0 -0
  361. /package/services/{tracks → media/tracks}/SubtitleTrack.js +0 -0
  362. /package/services/{tracks → media/tracks}/TextSubtitleTrack.js +0 -0
  363. /package/services/{tracks → media/tracks}/VideoTrack.js +0 -0
  364. /package/services/{tracks → media/tracks}/index.js +0 -0
  365. /package/services/{files → storage/files}/piece-from-whole-file.js +0 -0
  366. /package/services/{disk → storage}/keep.js +0 -0
  367. /package/services/{piece-store → storage/piece-store}/piece-lru.js +0 -0
  368. /package/services/{disk → storage}/returns.js +0 -0
  369. /package/services/{demand → torrent/demand}/DemandRegister.js +0 -0
  370. /package/services/{demand → torrent/demand}/Urgency.js +0 -0
  371. /package/services/{demand → torrent/demand}/Window.js +0 -0
  372. /package/services/{demand → torrent/demand}/index.js +0 -0
  373. /package/services/{demand → torrent/demand}/pieces.js +0 -0
  374. /package/services/{download → torrent/download}/withdraw-claim.js +0 -0
  375. /package/services/{supply-margin.js → torrent/supply-margin.js} +0 -0
  376. /package/services/{torrent-source-key.js → torrent/torrent-source-key.js} +0 -0
  377. /package/services/{torrent-worker → torrent/worker}/fastest-wires.js +0 -0
  378. /package/services/{torrent-worker → torrent/worker}/handle-state.js +0 -0
  379. /package/services/{nat-classifier.js → transport/nat-classifier.js} +0 -0
  380. /package/services/{registry-api.js → transport/registry-api.js} +0 -0
  381. /package/services/{tunnel-client.js → transport/tunnel-client.js} +0 -0
  382. /package/services/{priority → viewer}/WaitLedger.js +0 -0
@@ -1,213 +1,218 @@
1
- # Container & Track architecture
2
-
3
- Domain → Application → Interface, per RFC 9559 (Matroska) and ISO/IEC 14496-12 (MP4).
4
-
5
- ## Two axes, and what is NOT a third
6
-
7
- Everything here is placed on exactly two axes: **which container** a track lives
8
- in, and **what kind of track** it is (video / audio / subtitle). A file lying
9
- beside the video — a dub as `<name>.mka`, subtitles as `<name>.ass` — is not a
10
- third kind of anything:
11
-
12
- - a `.mka` **is** Matroska. `ContainerFactory` sniffs it, `MatroskaContainer`
13
- reads its `TrackEntry` list, and out comes an `AudioTrack` with its language,
14
- title and flags. It differs from the picture's own file only in having no
15
- video track. The same holds for `.m4a` and `Mp4Container`;
16
- - "external" is therefore not a TYPE. It is the answer to WHERE a track's bytes
17
- are, and that is torrent knowledge — which this layer must not have
18
- (`ContainerFactory`: no torrent knowledge; `ContainerOrchestrator`:
19
- transport-agnostic). The pairing of a sidecar file with a picture lives in
20
- `services/sidecar-files.js`, and the numbered list a viewer chooses from lives
21
- in `services/audio-inventory.js`. Both are pure and both are application-layer.
22
-
23
- A class called `ExternalSubtitleFile` used to sit in `tracks/` asserting the
24
- opposite. It did not extend `ContainerTrack`, duplicated four of its fields, and
25
- was imported by nothing; it was deleted rather than extended. Nothing replaced
26
- it — a subtitle file beside the video is a `TextSubtitleTrack` whose bytes are
27
- read from another file, and a raw `.srt` needs no `Container` subclass because
28
- it has no track table and no index to read: the whole file is the payload, and
29
- `SubtitleController` already reads it as such.
30
-
31
- ## Who answers what — the rule
32
-
33
- A fact the container DECLARES is read from the container. A fact only the media
34
- itself has is measured from the media, which means ffmpeg.
35
-
36
- That is the whole boundary, and it is not about speed. Speed is a consequence:
37
- this layer asks for the smallest region that holds the answer — 64 KB of header,
38
- the Cues block, a sample table — while ffmpeg cannot be asked for a bounded
39
- region at all. Its input analysis pulls megabytes before it will say anything,
40
- and over a torrent those megabytes may not exist yet. Measured 2026-09-03 on one
41
- `.mka`: this layer read its header in **8 ms**, and an ffmpeg reading the same
42
- header of the same file through the proxy's own `/stream`, in the same second,
43
- took **8121 ms** — and spent all of it waiting for a DURATION its caller did not
44
- want, because its early exit is gated on one.
45
-
46
- So ffmpeg keeps exactly three jobs, and nothing else:
47
-
48
- 1. producing media — the encode run;
49
- 2. measuring THIS MACHINE — encoder detection and its strict test, decode
50
- calibration, the contention penalty;
51
- 3. answering what the container does not declare — above all keyframe positions
52
- in a container with no index, where a packet scan is the only source. Even
53
- there the container is asked FIRST: measured, the container index gave 570
54
- keyframes in 0.8 s from two point reads of 16 KB, while a scan of the same
55
- file found 77 in 45 s and did not finish.
56
-
57
- `null` in `ContainerMediaInfo` means the container does not declare the field.
58
- That is a final answer about the container, and the point at which a caller may
59
- go to the media — not "unknown, ask again".
60
-
61
- ## Where byte access lives, and why not on a track
62
-
63
- A `ContainerTrack` is a DECLARATION. It carries no `readRange` and no file
64
- identity, and it should not: byte access is the `Container`'s, injected as
65
- `readRange(start, end)` and bound to one file.
66
-
67
- The obvious-looking improvement — hand the track a reader so it can fetch its own
68
- bytes — was reviewed on 2026-09-03 and is **not** the right shape:
69
-
70
- - for video and audio, this layer never reads the payload at all. It goes to
71
- ffmpeg by URL, where seeking and gigabytes belong. A `readRange` on a
72
- `VideoTrack` would be a capability with no consumer, inviting reads of a size
73
- this path is not built for;
74
- - tracks cross the worker boundary as PLAIN OBJECTS (`plainTrack()`), because a
75
- class instance does not survive it as a class. A back-reference to a container
76
- cannot cross either, so such a track would be able to read its own bytes only
77
- on the thread where the container is already at hand.
78
-
79
- **That split is closed.** `SubtitleTrack` carries `clusterPositions` and
80
- `samples` — byte POSITIONS — and the reading of those positions is now the
81
- container's: `MatroskaContainer.walkHeldClusters(plan, walked)` and
82
- `Mp4Container.readHeldSamples(track, harvested)`, beside `readTracks`,
83
- `readKeyframeIndex`, `readMediaInfo` and `cueTextOf`.
84
-
85
- The obstacle was real and this is how it was answered. The two readers want
86
- different read POLICIES over the same file: the track table fetches what is
87
- missing from the swarm, while the cue walk deliberately reads only what is
88
- already downloaded, so that turning subtitles on never pulls bytes the viewer is
89
- not waiting for. A container is now built with BOTH — `readRange` that fetches,
90
- `readHeld` that does not, and `isHeld` that says whether a range can be read
91
- without fetching — so one instance per file serves both readers and the per-file
92
- cache is kept.
93
-
94
- What the container is NOT given is the torrent. Those three functions are the
95
- whole of what the caller knows and the container does not, and reducing the
96
- torrent to them is what lets the reading live where the format is specified.
97
- `torrent-worker/subtitle-cues.js` supplies them (`containerOver`) and keeps only
98
- what is genuinely its own: the found-order cursor a browser follows, the
99
- per-file state, and one walk of a file at a time.
100
-
101
- ## Layers
102
-
103
- ```mermaid
104
- flowchart TB
105
- subgraph Domain
106
- C[Container<br/>abstract<br/>RFC9559 / 14496-12]
107
- MC[MatroskaContainer]
108
- MpC[Mp4Container]
109
- AC[AviContainer]
110
- CT[ContainerTrack<br/>isEnabled/isDefault/language]
111
- VT[VideoTrack]
112
- AT[AudioTrack]
113
- ST[SubtitleTrack]
114
- TST[TextSubtitleTrack<br/>S_TEXT/UTF8 tx3g wvtt]
115
- IST[ImageSubtitleTrack<br/>PGS VobSub subp]
116
- C --> MC & MpC & AC
117
- CT --> VT & AT & ST
118
- ST --> TST & IST
119
- MC & MpC & AC -- readTracks --> CT
120
- end
121
- subgraph Application
122
- CF[ContainerFactory<br/>detect 16 bytes]
123
- CO[ContainerOrchestrator<br/>cache + getTracks/getKeyframeIndex]
124
- SO[SubtitleOrchestrator<br/>cursor + per-file state]
125
- SF[sidecar-files.js<br/>which file goes with which]
126
- AI[audio-inventory.js<br/>one flat numbering]
127
- CF --> CO
128
- CO --> SO
129
- SF --> AI
130
- CO --> AI
131
- end
132
- subgraph Interface
133
- PC[PlaybackController]
134
- SC[SubtitleController]
135
- R1[routes/api/playback-plan]
136
- R2[routes/api/subtitles]
137
- PC --> R1
138
- SC --> R2
139
- CO --> PC
140
- SO --> SC
141
- end
142
- ```
143
-
144
- ## Class responsibilities (spec-grounded)
145
-
146
- | Class | Spec section | Fields | Not responsible |
147
- |---|---|---|---|
148
- | `ContainerTrack` | RFC9559 TrackEntry common + ISO 14496-12 tkhd/mdhd/hdlr/elng | `trackNumber`, `declaredIndex`, `codecId`, `language`/`languageBcp47` (MUST rule), `name`, `isEnabled` (0xB9 / track_enabled), `isDefault`+`declaresDefault` (0x88) | Type-specific flags |
149
- | `VideoTrack` | RFC9559 Video, ISO 14496-12 tkhd width/height, stsd | `width/height/display*`, `fps`, `isHdr`, `bitDepth` | Subtitle flags |
150
- | `AudioTrack` | RFC9559 FlagOriginal 0x55AE, FlagCommentary 0x55AF, FlagVisualImpaired 0x55AC | `isOriginal/isCommentary/isVisualImpaired`, `channels/samplingFrequency` | FlagForced |
151
- | `SubtitleTrack` | RFC9559 FlagForced 0x55AA (subtitle-only), FlagHearingImpaired 0x55AB | `isForced/isHearingImpaired`, `clusterPositions`/`samples` | Video dims |
152
- | `TextSubtitleTrack` | `S_TEXT/UTF8, S_TEXT/ASS, tx3g, wvtt` | `toVtt()` convertible | Image tracks |
153
- | `sidecar-files.js` | — (torrent naming) | which files of a torrent are one picture's sound and subtitles | what is inside them |
154
- | `audio-inventory.js` | RFC9559 audio flags, merged against ffmpeg's numbering | one flat number per soundtrack → `(fileIndex, 0:a:N)` | display labels |
155
- | `ImageSubtitleTrack` | `S_HDMV/PGS, S_VOBSUB, subp, clcp` | kept for `declaredIndex` alignment | Conversion |
156
- | `MatroskaContainer` | RFC9559 SeekHead, Tracks, Cues, Clusters | single Tracks walk for all types, EBML via `ebml-reader.js` | HTTP |
157
- | `Mp4Container` | ISO 14496-12 moov/trak/tkhd/mdhd/hdlr/elng/stbl | `alternate_group` grouping, packed language, `tx3g` forced bits | Torrent |
158
- | `AviContainer` | RIFF AVI idx1 | `AVIIF_KEYFRAME` keyframe times | Tracks beyond video |
159
-
160
- `VideoTrack` never carries `isForced` — spec states FlagForced "Applies only to subtitles". Placing it in base would pollute video with irrelevant state.
161
-
162
- ## Orchestrators & Controllers
163
-
164
- - `ContainerFactory.create({readRange,fileSize})` — sniffs 16 bytes, returns precise `Container` subclass. No torrent knowledge.
165
- - `ContainerOrchestrator` — per-file cache (`sourceKey:fileIndex`), `getTracks()` / `getMediaInfo()` / `getKeyframeIndex()`. Transport-agnostic.
166
- - **The keyframe table is read once per file**, like the other two. `Container.readKeyframeIndex` memoizes and each format implements `parseKeyframeIndex`, so the wait belongs to the FILE: two sessions created in the same moment join one read rather than making two, which is exactly what two viewers opening one film do. A read that THREW is not remembered — the bytes it needed may simply not have arrived. Who asks: `torrent-worker/container-tracks.js` `containerKeyframesOf`, over the torrent, reached from the session manager by the `container-keyframes` command. The manager's own HTTP read remains for a manager wired without that path (every unit test).
167
- - `SubtitleOrchestrator` — wraps `torrent-worker/subtitle-cues.js` (`planFor`, `cuesHeldFor`, `warmSubtitleCues`) behind the `ContainerTrack` abstraction. Routes depend on this, not on the worker directly. The reading itself is the containers' — that module supplies the torrent's read policy and keeps the cursor.
168
- - `PlaybackController` / `SubtitleController` — thin interface adapters; `routes/api/*` delegate to them, handle HTTP headers (`X-Subtitle-Language`, `X-Subtitle-Cursor`) only.
169
-
170
- ## Legacy
171
-
172
- Everything a container states about ITSELF is in its own class: the track table,
173
- the Cues, the keyframe times they name, the cluster positions, the blocks inside
174
- a cluster, the MP4 sample table. `services/container-index/` no longer exists.
175
- What was kept apart is `container/ebml-reader.js` — EBML element walking is the
176
- format's grammar rather than any of its statements.
177
-
178
- `ContainerFactory` is the one place that decides what a file IS. It sniffs the
179
- header, because that is what the muxer wrote while a name is what somebody
180
- typed, and it answers `readKeyframeIndex` for the same reason: doing it anywhere
181
- else meant a third place making that decision. `ContainerFactory.byName` exists
182
- for the one path that cannot sniff — the cue walk asks the swarm for nothing, so
183
- a file whose head is not downloaded has only its name.
184
-
185
- **Two readings of one file, and which answers.** ffmpeg's `-i` banner and the
186
- container's own table both describe a file's tracks, and the rule is stated once
187
- per media kind on `Container`. `alignWithBanner` lines them up by position and
188
- CHECKS each pair on language or title; one pair agreeing on neither, or a length
189
- that differs, drops the container reading whole, because a wrong flag is worse
190
- than a missing one. `mergeSubtitleFlags`, `mergeAudioFlags` and
191
- `mergeVideoFacts` then say which side answers for which field: flags the banner
192
- cannot express come from the container; the coded size and frame rate come from
193
- the probe, because the encoder receives what the decoder produced.
194
-
195
- Direct imports from routes are deprecated — use `orchestrators/` and
196
- `controllers/` instead.
197
-
198
- ## Flags matrix
199
-
200
- | Flag | Matroska ID | Applies to | Base or subclass |
201
- |---|---|---|---|
202
- | `FlagEnabled` | 0xB9 default 1 | all | `ContainerTrack` |
203
- | `FlagDefault` | 0x88 default 1 | all | `ContainerTrack` (`declaresDefault`) |
204
- | `Language` | 0x22B59C | all | `ContainerTrack` |
205
- | `LanguageBCP47` | 0x22B59D MUST | all | `ContainerTrack` |
206
- | `FlagForced` | 0x55AA | subtitle only | `SubtitleTrack` |
207
- | `FlagHearingImpaired` | 0x55AB | subtitle | `SubtitleTrack` |
208
- | `FlagVisualImpaired` | 0x55AC | audio (descriptive) + subtitle | `AudioTrack`/`SubtitleTrack` |
209
- | `FlagOriginal` | 0x55AE | audio | `AudioTrack` |
210
- | `FlagCommentary` | 0x55AF | audio | `AudioTrack` |
211
- | `track_enabled` | tkhd 0x000001 | all | `ContainerTrack` |
212
- | `alternate_group` | tkhd | audio/video alternates | `ContainerTrack.alternateGroup` |
213
- | `elng` | 14496-12 §8.4.6 | all | `ContainerTrack.languageBcp47` |
1
+ # Container & Track architecture
2
+
3
+ Domain → Application → Interface, per RFC 9559 (Matroska) and ISO/IEC 14496-12 (MP4).
4
+
5
+ ## Two axes, and what is NOT a third
6
+
7
+ Everything here is placed on exactly two axes: **which container** a track lives
8
+ in, and **what kind of track** it is (video / audio / subtitle). A file lying
9
+ beside the video — a dub as `<name>.mka`, subtitles as `<name>.ass` — is not a
10
+ third kind of anything:
11
+
12
+ - a `.mka` **is** Matroska. `ContainerFactory` sniffs it, `MatroskaContainer`
13
+ reads its `TrackEntry` list, and out comes an `AudioTrack` with its language,
14
+ title and flags. It differs from the picture's own file only in having no
15
+ video track. The same holds for `.m4a` and `Mp4Container`;
16
+ - "external" is therefore not a TYPE. It is the answer to WHERE a track's bytes
17
+ are, and that is torrent knowledge — which this layer must not have
18
+ (`ContainerFactory`: no torrent knowledge; `ContainerOrchestrator`:
19
+ transport-agnostic). The pairing of a sidecar file with a picture lives in
20
+ `services/sidecar-files.js`, and the numbered list a viewer chooses from lives
21
+ in `services/media/audio-inventory.js`. Both are pure and both are application-layer.
22
+
23
+ A class called `ExternalSubtitleFile` used to sit in `tracks/` asserting the
24
+ opposite. It did not extend `ContainerTrack`, duplicated four of its fields, and
25
+ was imported by nothing; it was deleted rather than extended. Nothing replaced
26
+ it — a subtitle file beside the video is a `TextSubtitleTrack` whose bytes are
27
+ read from another file, and a raw `.srt` needs no `Container` subclass because
28
+ it has no track table and no index to read: the whole file is the payload, and
29
+ `SubtitleController` already reads it as such.
30
+
31
+ ## Who answers what — the rule
32
+
33
+ A fact the container DECLARES is read from the container. A fact only the media
34
+ itself has is measured from the media, which means ffmpeg.
35
+
36
+ That is the whole boundary, and it is not about speed. Speed is a consequence:
37
+ this layer asks for the smallest region that holds the answer — 64 KB of header,
38
+ the Cues block, a sample table — while ffmpeg cannot be asked for a bounded
39
+ region at all. Its input analysis pulls megabytes before it will say anything,
40
+ and over a torrent those megabytes may not exist yet. Measured 2026-09-03 on one
41
+ `.mka`: this layer read its header in **8 ms**, and an ffmpeg reading the same
42
+ header of the same file through the proxy's own `/stream`, in the same second,
43
+ took **8121 ms** — and spent all of it waiting for a DURATION its caller did not
44
+ want, because its early exit is gated on one.
45
+
46
+ So ffmpeg keeps exactly three jobs, and nothing else:
47
+
48
+ 1. producing media — the encode run;
49
+ 2. measuring THIS MACHINE — encoder detection and its strict test, decode
50
+ calibration, the contention penalty;
51
+ 3. answering what the container does not declare — above all keyframe positions
52
+ in a container with no index, where a packet scan is the only source. Even
53
+ there the container is asked FIRST: measured, the container index gave 570
54
+ keyframes in 0.8 s from two point reads of 16 KB, while a scan of the same
55
+ file found 77 in 45 s and did not finish.
56
+
57
+ `null` in `ContainerMediaInfo` means the container does not declare the field.
58
+ That is a final answer about the container, and the point at which a caller may
59
+ go to the media — not "unknown, ask again".
60
+
61
+ ## Where byte access lives, and why not on a track
62
+
63
+ A `ContainerTrack` is a DECLARATION. It carries no `readRange` and no file
64
+ identity, and it should not: byte access is the `Container`'s, injected as
65
+ `readRange(start, end)` and bound to one file.
66
+
67
+ The obvious-looking improvement — hand the track a reader so it can fetch its own
68
+ bytes — was reviewed on 2026-09-03 and is **not** the right shape:
69
+
70
+ - for video and audio, this layer never reads the payload at all. It goes to
71
+ ffmpeg by URL, where seeking and gigabytes belong. A `readRange` on a
72
+ `VideoTrack` would be a capability with no consumer, inviting reads of a size
73
+ this path is not built for;
74
+ - tracks cross the worker boundary as PLAIN OBJECTS (`plainTrack()`), because a
75
+ class instance does not survive it as a class. A back-reference to a container
76
+ cannot cross either, so such a track would be able to read its own bytes only
77
+ on the thread where the container is already at hand.
78
+
79
+ **That split is closed.** `SubtitleTrack` carries `clusterPositions` and
80
+ `samples` — byte POSITIONS — and the reading of those positions is now the
81
+ container's: `MatroskaContainer.walkHeldClusters(plan, walked)` and
82
+ `Mp4Container.readHeldSamples(track, harvested)`, beside `readTracks`,
83
+ `readKeyframeIndex`, `readMediaInfo` and `cueTextOf`.
84
+
85
+ The obstacle was real and this is how it was answered. The two readers want
86
+ different read POLICIES over the same file: the track table fetches what is
87
+ missing from the swarm, while the cue walk deliberately reads only what is
88
+ already downloaded, so that turning subtitles on never pulls bytes the viewer is
89
+ not waiting for. A container is now built with BOTH — `readRange` that fetches,
90
+ `readHeld` that does not, and `isHeld` that says whether a range can be read
91
+ without fetching — so one instance per file serves both readers and the per-file
92
+ cache is kept.
93
+
94
+ What the container is NOT given is the torrent. Those three functions are the
95
+ whole of what the caller knows and the container does not, and reducing the
96
+ torrent to them is what lets the reading live where the format is specified.
97
+ `torrent-worker/subtitle-cues.js` supplies them (`containerOver`) and keeps only
98
+ what is genuinely its own: the found-order cursor a browser follows, the
99
+ per-file state, and one walk of a file at a time.
100
+
101
+ ## Layers
102
+
103
+ ```mermaid
104
+ flowchart TB
105
+ subgraph Domain
106
+ C[Container<br/>abstract<br/>RFC9559 / 14496-12]
107
+ MC[MatroskaContainer]
108
+ MpC[Mp4Container]
109
+ AC[AviContainer]
110
+ CT[ContainerTrack<br/>isEnabled/isDefault/language]
111
+ VT[VideoTrack]
112
+ AT[AudioTrack]
113
+ ST[SubtitleTrack]
114
+ TST[TextSubtitleTrack<br/>S_TEXT/UTF8 tx3g wvtt]
115
+ IST[ImageSubtitleTrack<br/>PGS VobSub subp]
116
+ C --> MC & MpC & AC
117
+ CT --> VT & AT & ST
118
+ ST --> TST & IST
119
+ MC & MpC & AC -- readTracks --> CT
120
+ end
121
+ subgraph Application
122
+ CF[ContainerFactory<br/>detect 16 bytes]
123
+ KT[KeyframeTables<br/>one read per file, bounded wait]
124
+ CO[ContainerOrchestrator<br/>cache + getTracks/getKeyframeIndex]
125
+ SO[SubtitleOrchestrator<br/>cursor + per-file state]
126
+ SF[sidecar-files.js<br/>which file goes with which]
127
+ AI[audio-inventory.js<br/>one flat numbering]
128
+ CF --> CO
129
+ CO --> KT
130
+ CO --> SO
131
+ SF --> AI
132
+ CO --> AI
133
+ end
134
+ subgraph Interface
135
+ PC[PlaybackController]
136
+ SC[SubtitleController]
137
+ R1[routes/api/playback-plan]
138
+ R2[routes/api/subtitles]
139
+ PC --> R1
140
+ SC --> R2
141
+ CO --> PC
142
+ SO --> SC
143
+ end
144
+ ```
145
+
146
+ ## Class responsibilities (spec-grounded)
147
+
148
+ | Class | Spec section | Fields | Not responsible |
149
+ |---|---|---|---|
150
+ | `ContainerTrack` | RFC9559 TrackEntry common + ISO 14496-12 tkhd/mdhd/hdlr/elng | `trackNumber`, `declaredIndex`, `codecId`, `language`/`languageBcp47` (MUST rule), `name`, `isEnabled` (0xB9 / track_enabled), `isDefault`+`declaresDefault` (0x88) | Type-specific flags |
151
+ | `VideoTrack` | RFC9559 Video, ISO 14496-12 tkhd width/height, stsd | `width/height/display*`, `fps`, `isHdr`, `bitDepth` | Subtitle flags |
152
+ | `AudioTrack` | RFC9559 FlagOriginal 0x55AE, FlagCommentary 0x55AF, FlagVisualImpaired 0x55AC | `isOriginal/isCommentary/isVisualImpaired`, `channels/samplingFrequency` | FlagForced |
153
+ | `SubtitleTrack` | RFC9559 FlagForced 0x55AA (subtitle-only), FlagHearingImpaired 0x55AB | `isForced/isHearingImpaired`, `clusterPositions`/`samples` | Video dims |
154
+ | `TextSubtitleTrack` | `S_TEXT/UTF8, S_TEXT/ASS, tx3g, wvtt` | `toVtt()` convertible | Image tracks |
155
+ | `sidecar-files.js` | — (torrent naming) | which files of a torrent are one picture's sound and subtitles | what is inside them |
156
+ | `audio-inventory.js` | RFC9559 audio flags, merged against ffmpeg's numbering | one flat number per soundtrack → `(fileIndex, 0:a:N)` | display labels |
157
+ | `ImageSubtitleTrack` | `S_HDMV/PGS, S_VOBSUB, subp, clcp` | kept for `declaredIndex` alignment | Conversion |
158
+ | `MatroskaContainer` | RFC9559 SeekHead, Tracks, Cues, Clusters | single Tracks walk for all types, EBML via `ebml-reader.js` | HTTP |
159
+ | `Mp4Container` | ISO 14496-12 moov/trak/tkhd/mdhd/hdlr/elng/stbl | `alternate_group` grouping, packed language, `tx3g` forced bits | Torrent |
160
+ | `AviContainer` | RIFF AVI idx1 | `AVIIF_KEYFRAME` keyframe times | Tracks beyond video |
161
+
162
+ `VideoTrack` never carries `isForced` — spec states FlagForced "Applies only to subtitles". Placing it in base would pollute video with irrelevant state.
163
+
164
+ ## Orchestrators & Controllers
165
+
166
+ - `ContainerFactory.create({readRange,fileSize})` — sniffs 16 bytes, returns precise `Container` subclass. No torrent knowledge.
167
+ - `ContainerOrchestrator` — per-file cache (`sourceKey:fileIndex`), `getTracks()` / `getMediaInfo()` / `getKeyframeIndex()`. Transport-agnostic.
168
+ - **The keyframe table is read once per file, and the container is not what remembers it.** `Container.readKeyframeIndex` parses and returns; each format implements `parseKeyframeIndex`. It used to keep the answer, and that made this the one fact stored in two places — here and in the file's `KeyframeTable` on the main thread. That copy had no reader, and since the parse itself moved to the main thread there is no second thread for a second copy to sit in.
169
+ - **`KeyframeTable` / `KeyframeTables` — the answer, and the policy around getting one.** The table is one object per file (`media/container/KeyframeTable.js`), held by everyone who reads that file rather than copied, so a read that lands after a session was made still reaches it. `media/KeyframeTables.js` reads it once per file whoever asks, joins the second asker to the read already running, bounds how long any one caller waits (`KEYFRAME_TABLE_BUDGET_MS`, measured), and never records a read that threw as an answer. Its reader is one function handed in at construction, so it knows nothing of torrents or HTTP. It is not `ContainerOrchestrator` because of the THREAD: that one needs byte ranges and lives in the worker, this one lives beside the sessions and reaches it across the channel.
170
+ - **`answered` and `readable` are different questions.** `answered` says a reader came back; `readable` says it came back with times. A file that answered nothing must be re-encoded for ever (MPEG-TS: 669 real keyframes, no index of any kind); a file that has not answered is a shortage of bytes off the swarm. Held as loose fields in a bag of probe results nothing told them apart, and a passing shortage was written onto the file as a property of the bytes.
171
+ - **The second reader is the packet probe** (`media/keyframe-probe.js`): it finds keyframes by decoding, for containers that state no index. It is never waited for, and `KeyframeTable.learn` keeps the fuller answer whichever arrives second — measured 2026-08-02, a scan found 77 keyframes in 45 s without finishing against all 570 in 0.8 s from the index.
172
+ - `SubtitleOrchestrator` — wraps `torrent-worker/subtitle-cues.js` (`planFor`, `cuesHeldFor`, `warmSubtitleCues`) behind the `ContainerTrack` abstraction. Routes depend on this, not on the worker directly. The reading itself is the containers' — that module supplies the torrent's read policy and keeps the cursor.
173
+ - `PlaybackController` / `SubtitleController` — thin interface adapters; `routes/api/*` delegate to them, handle HTTP headers (`X-Subtitle-Language`, `X-Subtitle-Cursor`) only.
174
+
175
+ ## Legacy
176
+
177
+ Everything a container states about ITSELF is in its own class: the track table,
178
+ the Cues, the keyframe times they name, the cluster positions, the blocks inside
179
+ a cluster, the MP4 sample table. `services/container-index/` no longer exists.
180
+ What was kept apart is `container/ebml-reader.js` — EBML element walking is the
181
+ format's grammar rather than any of its statements.
182
+
183
+ `ContainerFactory` is the one place that decides what a file IS. It sniffs the
184
+ header, because that is what the muxer wrote while a name is what somebody
185
+ typed, and it answers `readKeyframeIndex` for the same reason: doing it anywhere
186
+ else meant a third place making that decision. `ContainerFactory.byName` exists
187
+ for the one path that cannot sniff — the cue walk asks the swarm for nothing, so
188
+ a file whose head is not downloaded has only its name.
189
+
190
+ **Two readings of one file, and which answers.** ffmpeg's `-i` banner and the
191
+ container's own table both describe a file's tracks, and the rule is stated once
192
+ per media kind on `Container`. `alignWithBanner` lines them up by position and
193
+ CHECKS each pair on language or title; one pair agreeing on neither, or a length
194
+ that differs, drops the container reading whole, because a wrong flag is worse
195
+ than a missing one. `mergeSubtitleFlags`, `mergeAudioFlags` and
196
+ `mergeVideoFacts` then say which side answers for which field: flags the banner
197
+ cannot express come from the container; the coded size and frame rate come from
198
+ the probe, because the encoder receives what the decoder produced.
199
+
200
+ Direct imports from routes are deprecated — use `orchestrators/` and
201
+ `server/controllers/` instead.
202
+
203
+ ## Flags matrix
204
+
205
+ | Flag | Matroska ID | Applies to | Base or subclass |
206
+ |---|---|---|---|
207
+ | `FlagEnabled` | 0xB9 default 1 | all | `ContainerTrack` |
208
+ | `FlagDefault` | 0x88 default 1 | all | `ContainerTrack` (`declaresDefault`) |
209
+ | `Language` | 0x22B59C | all | `ContainerTrack` |
210
+ | `LanguageBCP47` | 0x22B59D MUST | all | `ContainerTrack` |
211
+ | `FlagForced` | 0x55AA | subtitle only | `SubtitleTrack` |
212
+ | `FlagHearingImpaired` | 0x55AB | subtitle | `SubtitleTrack` |
213
+ | `FlagVisualImpaired` | 0x55AC | audio (descriptive) + subtitle | `AudioTrack`/`SubtitleTrack` |
214
+ | `FlagOriginal` | 0x55AE | audio | `AudioTrack` |
215
+ | `FlagCommentary` | 0x55AF | audio | `AudioTrack` |
216
+ | `track_enabled` | tkhd 0x000001 | all | `ContainerTrack` |
217
+ | `alternate_group` | tkhd | audio/video alternates | `ContainerTrack.alternateGroup` |
218
+ | `elng` | 14496-12 §8.4.6 | all | `ContainerTrack.languageBcp47` |
@@ -5,11 +5,11 @@ Two questions, kept apart, and neither of them is "which file".
5
5
  ## Two axes, and what is NOT a third
6
6
 
7
7
  **What somebody needs** — a claimant, a file, a byte range, a level of urgency.
8
- Stated in `services/demand/`. Knows nothing about WebTorrent, nothing about
8
+ Stated in `services/torrent/demand/`. Knows nothing about WebTorrent, nothing about
9
9
  pieces, nothing about the piece store: it is numbers and rules, and it is
10
10
  testable without a torrent.
11
11
 
12
- **What the swarm is told** — one class, `services/download/SwarmSelection.js`,
12
+ **What the swarm is told** — one class, `services/torrent/download/SwarmSelection.js`,
13
13
  which reads the register and calls `select`, `deselect` and `critical`. It is
14
14
  the only thing in this proxy that calls them.
15
15
 
@@ -24,14 +24,14 @@ being fetched for as long as the viewer took to choose one.
24
24
 
25
25
  ```mermaid
26
26
  flowchart TB
27
- subgraph Statements["services/demand — what is wanted"]
27
+ subgraph Statements["services/torrent/demand — what is wanted"]
28
28
  W[Window<br/>claimant, file, bytes, urgency]
29
29
  U[Urgency<br/>BLOCKED NEAR AHEAD TAIL BEHIND]
30
30
  R[DemandRegister<br/>live windows by claimant]
31
31
  P[pieces.js<br/>the one bytes to pieces conversion]
32
32
  end
33
33
 
34
- subgraph Swarm["services/download — what the swarm is told"]
34
+ subgraph Swarm["services/torrent/download — what the swarm is told"]
35
35
  S[SwarmSelection<br/>select / deselect / critical]
36
36
  G[registry<br/>one per torrent + the cross-torrent rule]
37
37
  end
@@ -56,7 +56,7 @@ flowchart TB
56
56
  ## Who the claimants are, and what each of them knows
57
57
 
58
58
  **The priority map** states what should be downloaded AHEAD of the viewers, once
59
- per file, built in `services/priority/` from where they are and from nothing
59
+ per file, built in `services/viewer/` (`PriorityOrchestrator`) from where they are and from nothing
60
60
  else. It is the same map the encoding reads — the encoding reads it per OUTPUT
61
61
  and in segment numbers, this layer reads it per FILE and in bytes, and both
62
62
  scopes are right for what asks them (`encode-architecture.md`).
@@ -189,7 +189,7 @@ throughput at a time (`PIPELINE_MAX_DURATION = 1`).
189
189
  A withdrawn window is not in the download set at all, so there is nothing to
190
190
  fall through to.
191
191
 
192
- The condition is **global**, in `services/download/registry.js`, and not per
192
+ The condition is **global**, in `services/torrent/download/registry.js`, and not per
193
193
  torrent: two films on one proxy share the link, so filling the tail of one while
194
194
  a viewer of the other has a still picture spends the same bandwidth twice over.
195
195
 
@@ -234,7 +234,7 @@ object; a zero says the thresholds are not what we are short of.
234
234
 
235
235
  - `claimWindow`, `releaseWindow`, `markCritical`, `clearCritical` in
236
236
  `piece-reader.js` — the reader no longer speaks to the library.
237
- - `#reassertReaderWindows` in `torrent-pool.js` — it read the piece store's
237
+ - `#reassertReaderWindows` in `torrent/torrent-pool.js` — it read the piece store's
238
238
  MEMORY claims and rebuilt download claims from them, because WebTorrent
239
239
  deletes a selection once satisfied. `SwarmSelection.reconcile` does that from
240
240
  the register, which is where the statement lives.