@torrent-tv/proxy 2.89.5 → 2.89.7

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (447) hide show
  1. package/.claude/commands/opsx/apply.md +155 -155
  2. package/.claude/commands/opsx/archive.md +160 -160
  3. package/.claude/commands/opsx/explore.md +174 -174
  4. package/.claude/commands/opsx/propose.md +109 -109
  5. package/.claude/commands/opsx/sync.md +143 -143
  6. package/.claude/skills/openspec-apply-change/SKILL.md +159 -159
  7. package/.claude/skills/openspec-archive-change/SKILL.md +117 -117
  8. package/.claude/skills/openspec-explore/SKILL.md +289 -289
  9. package/.claude/skills/openspec-propose/SKILL.md +113 -113
  10. package/.claude/skills/openspec-sync-specs/SKILL.md +147 -147
  11. package/.dockerignore +5 -5
  12. package/AGENTS.md +338 -338
  13. package/CHANGELOG.md +16 -0
  14. package/Dockerfile +30 -30
  15. package/LICENSE +16 -16
  16. package/README.md +369 -369
  17. package/assets/calibration/NOTICE.md +100 -100
  18. package/assets/diagnostics/sctpstate.gdb +31 -31
  19. package/bin/cli.js +684 -684
  20. package/bin/thread-pool.js +30 -30
  21. package/docs/download-architecture.md +261 -261
  22. package/docs/encode-architecture.md +765 -765
  23. package/docs/encode-run-state.md +96 -96
  24. package/docs/logs.md +97 -97
  25. package/docs/playback-start-forecast.md +17 -2
  26. package/docs/socks5-egress-research.md +114 -114
  27. package/docs/storage-architecture.md +273 -273
  28. package/knip.json +14 -14
  29. package/openspec/changes/adaptive-bitrate/design.md +92 -92
  30. package/openspec/changes/adaptive-bitrate/proposal.md +56 -56
  31. package/openspec/changes/adaptive-bitrate/specs/adaptive-bitrate/spec.md +51 -51
  32. package/openspec/changes/adaptive-bitrate/tasks.md +40 -40
  33. package/openspec/changes/binary-distribution/.openspec.yaml +2 -2
  34. package/openspec/changes/binary-distribution/proposal.md +53 -53
  35. package/openspec/changes/chunked-request-bodies/design.md +81 -81
  36. package/openspec/changes/chunked-request-bodies/proposal.md +53 -53
  37. package/openspec/changes/chunked-request-bodies/specs/chunked-request-bodies/spec.md +30 -30
  38. package/openspec/changes/chunked-request-bodies/tasks.md +40 -40
  39. package/openspec/changes/cold-start/design.md +98 -98
  40. package/openspec/changes/cold-start/proposal.md +62 -62
  41. package/openspec/changes/cold-start/specs/cold-start/spec.md +47 -47
  42. package/openspec/changes/cold-start/tasks.md +48 -48
  43. package/openspec/changes/disk-cap/.openspec.yaml +2 -2
  44. package/openspec/changes/disk-cap/proposal.md +37 -37
  45. package/openspec/changes/disk-cap/specs/disk-cap/spec.md +25 -25
  46. package/openspec/changes/disk-cap/tasks.md +19 -19
  47. package/openspec/changes/proxy-observability/.openspec.yaml +2 -2
  48. package/openspec/changes/proxy-observability/design.md +38 -38
  49. package/openspec/changes/proxy-observability/proposal.md +49 -49
  50. package/openspec/changes/proxy-observability/specs/observability/spec.md +33 -33
  51. package/openspec/changes/proxy-observability/tasks.md +21 -21
  52. package/openspec/changes/seek-debounce/design.md +118 -118
  53. package/openspec/changes/seek-debounce/proposal.md +59 -59
  54. package/openspec/changes/seek-debounce/specs/seek-debounce/spec.md +41 -41
  55. package/openspec/changes/seek-debounce/tasks.md +33 -33
  56. package/openspec/changes/subtitle-language/.openspec.yaml +2 -2
  57. package/openspec/changes/subtitle-language/proposal.md +50 -50
  58. package/openspec/changes/subtitle-language/specs/subtitle-language/spec.md +34 -34
  59. package/openspec/changes/subtitle-language/tasks.md +26 -26
  60. package/openspec/changes/track-selection/.openspec.yaml +2 -2
  61. package/openspec/changes/track-selection/design.md +47 -47
  62. package/openspec/changes/track-selection/proposal.md +45 -45
  63. package/openspec/changes/track-selection/specs/track-selection/spec.md +41 -41
  64. package/openspec/changes/track-selection/tasks.md +20 -20
  65. package/openspec/changes/transcode-quality/.openspec.yaml +2 -2
  66. package/openspec/changes/transcode-quality/proposal.md +51 -51
  67. package/openspec/changes/transcode-quality/specs/transcode-quality/spec.md +139 -139
  68. package/openspec/changes/transcode-quality/tasks.md +63 -63
  69. package/openspec/config.yaml +38 -38
  70. package/package.json +1 -1
  71. package/public/.well-known/appspecific/com.chrome.devtools.json +1 -1
  72. package/research/delivery-wedge-stand-ladder-2026-09-13.md +329 -329
  73. package/research/double-spawn-2026-09-10.md +171 -171
  74. package/research/handover-2026-09-13.md +209 -209
  75. package/research/handover-reader-claims-removal-2026-09-12.md +166 -166
  76. package/research/piece-withdrawn-but-still-claimed-2026-09-12.md +175 -175
  77. package/research/preset-benchmark-size-scaling-2026-08-22.md +55 -55
  78. package/research/priority-map-is-the-truth-2026-09-12.md +225 -225
  79. package/routes/api/client-logs/post.js +86 -86
  80. package/routes/api/delivery-sink/get.js +72 -72
  81. package/routes/api/link-probe/get.js +51 -51
  82. package/routes/api/playback-plan/audio-tracks/post.js +29 -29
  83. package/routes/api/playback-plan/post.js +53 -53
  84. package/routes/api/sources/post.js +36 -36
  85. package/routes/api/sources/stats/get.js +132 -132
  86. package/routes/api/sources/warm/post.js +217 -217
  87. package/routes/api/subtitles/get.js +230 -230
  88. package/routes/api/transcode-sessions/fragment-far/post.js +60 -60
  89. package/routes/api/transcode-sessions/net-report/post.js +138 -138
  90. package/routes/api/transcode-sessions/post.js +178 -178
  91. package/routes/api/transcode-sessions/progress/get.js +27 -27
  92. package/routes/api/transcode-sessions/release/post.js +41 -41
  93. package/routes/api/transcode-sessions/seek/post.js +63 -63
  94. package/routes/health/get.js +13 -13
  95. package/routes/healthz/get.js +13 -13
  96. package/routes/stream/get.js +416 -416
  97. package/routes/transcode/audio-file/get.js +64 -64
  98. package/routes/transcode/audio-warm/get.js +95 -95
  99. package/routes/transcode/session-file/get.js +52 -52
  100. package/routes/transcode/variant-file/get.js +95 -95
  101. package/routes/transcode/variant-warm/get.js +84 -84
  102. package/scripts/render-run-graph.js +173 -173
  103. package/server.js +748 -748
  104. package/services/encode/CoverageMap.js +428 -428
  105. package/services/encode/CushionReport.js +345 -345
  106. package/services/encode/EncodeAdmission.js +376 -376
  107. package/services/encode/EncodeOrchestrator.js +1192 -1192
  108. package/services/encode/EncodePlan.js +1368 -1368
  109. package/services/encode/EncodeRun.js +32 -4
  110. package/services/encode/EncodeRuns.js +19 -7
  111. package/services/encode/Encoder.js +142 -142
  112. package/services/encode/EncoderSelection.js +38 -38
  113. package/services/encode/LocalObservations.js +359 -359
  114. package/services/encode/NvencEncoder.js +50 -50
  115. package/services/encode/OutputTimes.js +579 -579
  116. package/services/encode/QsvEncoder.js +58 -58
  117. package/services/encode/Renditions.js +2283 -2283
  118. package/services/encode/RunClock.js +87 -87
  119. package/services/encode/RunProgress.js +79 -79
  120. package/services/encode/SegmentDemand.js +95 -95
  121. package/services/encode/SoftwareEncoder.js +121 -121
  122. package/services/encode/V4l2m2mEncoder.js +53 -53
  123. package/services/encode/VaapiEncoder.js +66 -66
  124. package/services/encode/args.js +418 -418
  125. package/services/encode/available-share.js +89 -89
  126. package/services/encode/calibration.js +361 -361
  127. package/services/encode/contention.js +128 -128
  128. package/services/encode/decode-cost-fit.js +363 -363
  129. package/services/encode/encode-exit.js +116 -114
  130. package/services/encode/encode-run-state.js +551 -551
  131. package/services/encode/encoder-readings.js +43 -43
  132. package/services/encode/fingerprint.js +322 -322
  133. package/services/encode/host-load.js +174 -174
  134. package/services/encode/index.js +9 -9
  135. package/services/encode/learned-median.js +90 -90
  136. package/services/encode/output/EncodedOutput.js +57 -57
  137. package/services/encode/output/Output.js +131 -131
  138. package/services/encode/output/OutputCatalog.js +414 -414
  139. package/services/encode/output/OutputSpec.js +390 -390
  140. package/services/encode/output/Timeline.js +308 -308
  141. package/services/encode/output/cut-grid.js +107 -107
  142. package/services/encode/output/ladder.js +32 -32
  143. package/services/encode/output/playlists.js +284 -284
  144. package/services/encode/output/rates.js +125 -125
  145. package/services/encode/output-key-format.js +21 -21
  146. package/services/encode/piece-completeness.js +60 -2
  147. package/services/encode/quality/EncodeCost.js +1043 -1043
  148. package/services/encode/quality/HostLoad.js +525 -525
  149. package/services/encode/quality/HostTimings.js +249 -249
  150. package/services/encode/quality/OutputQualityState.js +24 -24
  151. package/services/encode/quality/QualityController.js +758 -758
  152. package/services/encode/quality/QualityOffer.js +416 -416
  153. package/services/encode/quality/drain-threat.js +47 -47
  154. package/services/encode/quality/link-budget.js +337 -337
  155. package/services/encode/quality/output-format.js +319 -319
  156. package/services/encode/quality/serving-output.js +216 -216
  157. package/services/encode/quality/visible-rung.js +57 -57
  158. package/services/encode/run-budget.js +97 -97
  159. package/services/encode/run-command.js +3 -1
  160. package/services/encode/run-costs.js +155 -155
  161. package/services/encode/run-inputs.js +53 -53
  162. package/services/encode/segment-formats/fmp4.js +476 -476
  163. package/services/encode/segment-formats/index.js +1 -0
  164. package/services/encode/segment-formats/init-compat.js +324 -324
  165. package/services/encode/segment-formats/mp4-boxes.js +8 -1
  166. package/services/encode/segment-formats/mpegts.js +134 -134
  167. package/services/encode/start-stop-cost.js +178 -178
  168. package/services/encode/throughput.js +97 -97
  169. package/services/encode/torrent-cost.js +88 -88
  170. package/services/identity/installation-id.js +38 -38
  171. package/services/media/SourceFile.js +298 -298
  172. package/services/media/SubtitleOrchestrator.js +167 -167
  173. package/services/media/container/KeyframeTable.js +272 -272
  174. package/services/media/container/ebml-reader.js +159 -159
  175. package/services/media/ffmpeg-banner.js +260 -260
  176. package/services/media/keyframe-probe.js +157 -157
  177. package/services/media/media-info-probe.js +93 -93
  178. package/services/media/playback-planner.js +931 -931
  179. package/services/media/tracks/AudioTrack.js +143 -143
  180. package/services/media/tracks/ImageSubtitleTrack.js +19 -19
  181. package/services/media/tracks/SubtitleTrack.js +38 -38
  182. package/services/media/tracks/VideoTrack.js +33 -33
  183. package/services/media/tracks/audio-bound.js +233 -233
  184. package/services/media/tracks/index.js +15 -15
  185. package/services/media/tracks/language-detect.js +174 -174
  186. package/services/server/OutputLifecycle.js +418 -418
  187. package/services/server/SegmentServing.js +1152 -1152
  188. package/services/server/ViewerRequests.js +785 -785
  189. package/services/server/WaitLedger.js +142 -142
  190. package/services/server/controllers/PlaybackController.js +40 -40
  191. package/services/server/controllers/SubtitleController.js +109 -109
  192. package/services/server/http-responses.js +60 -60
  193. package/services/server/transcode-session-files.js +325 -325
  194. package/services/server/wire-outputs.js +1029 -1029
  195. package/services/storage/Diagnostics.js +202 -202
  196. package/services/storage/MachineBudget.js +235 -235
  197. package/services/storage/allowance.js +107 -107
  198. package/services/storage/core-dumps.js +106 -106
  199. package/services/storage/files/CompletedFiles.js +391 -391
  200. package/services/storage/files/piece-from-whole-file.js +118 -118
  201. package/services/storage/free.js +71 -71
  202. package/services/storage/keep.js +48 -48
  203. package/services/storage/machine-memory.js +56 -56
  204. package/services/storage/memory-report.js +575 -575
  205. package/services/storage/piece-store/piece-disk-store.js +539 -539
  206. package/services/storage/piece-store/piece-lru.js +495 -495
  207. package/services/storage/returns.js +103 -103
  208. package/services/storage/wire.js +175 -175
  209. package/services/torrent/demand/DemandRegister.js +202 -202
  210. package/services/torrent/demand/Urgency.js +137 -137
  211. package/services/torrent/demand/Window.js +118 -118
  212. package/services/torrent/demand/index.js +8 -8
  213. package/services/torrent/demand/pieces.js +140 -140
  214. package/services/torrent/download/SwarmSelection.js +386 -386
  215. package/services/torrent/download/registry.js +102 -102
  216. package/services/torrent/download/withdraw-claim.js +80 -80
  217. package/services/torrent/files.js +455 -455
  218. package/services/torrent/naming.js +619 -619
  219. package/services/torrent/piece-store-of.js +29 -29
  220. package/services/torrent/supply-margin.js +264 -264
  221. package/services/torrent/worker/background-fill.js +213 -213
  222. package/services/torrent/worker/channel.js +271 -271
  223. package/services/torrent/worker/fastest-wires.js +342 -342
  224. package/services/torrent/worker/handle-state.js +23 -23
  225. package/services/torrent/worker/install-webrtc-shim.js +32 -32
  226. package/services/torrent/worker/piece-reader.js +1078 -1078
  227. package/services/torrent/worker/pool-adapter.js +371 -371
  228. package/services/torrent/worker/protocol.js +184 -184
  229. package/services/torrent/worker/resume-warm.js +107 -107
  230. package/services/torrent/worker/webrtc-shim.js +219 -219
  231. package/services/transport/delivery-probe.js +842 -842
  232. package/services/transport/health-collector.js +53 -53
  233. package/services/transport/nat-classifier.js +231 -231
  234. package/services/transport/packet-witness.js +808 -808
  235. package/services/transport/port-mapper.js +235 -235
  236. package/services/transport/registry-api.js +81 -81
  237. package/services/transport/tunnel-client.js +447 -447
  238. package/services/transport/usrsctp-state.js +175 -175
  239. package/services/transport/webrtc-manager.js +484 -484
  240. package/services/viewer/Assignments.js +340 -340
  241. package/services/viewer/PriorityOrchestrator.js +325 -325
  242. package/services/viewer/Viewer.js +691 -691
  243. package/services/viewer/Viewers.js +368 -368
  244. package/services/viewer/active-output.js +37 -37
  245. package/services/viewer/audio-start.js +46 -46
  246. package/services/viewer/buffer-trend.js +81 -81
  247. package/services/viewer/choices.js +647 -647
  248. package/services/viewer/media-time.js +355 -355
  249. package/services/viewer/playback-readiness.js +635 -635
  250. package/services/viewer/positions.js +126 -126
  251. package/services/viewer/report-intake.js +46 -46
  252. package/store/source-registry.js +71 -71
  253. package/test/asset-paths.test.js +28 -28
  254. package/test/audio-buffer-continuity.test.js +77 -77
  255. package/test/audio-inventory.test.js +212 -212
  256. package/test/audio-track-bitrate.test.js +40 -40
  257. package/test/auto-quality-step.test.js +762 -753
  258. package/test/available-share.test.js +76 -76
  259. package/test/background-fill.test.js +190 -190
  260. package/test/client-log-file.test.js +110 -110
  261. package/test/completed-files.test.js +115 -115
  262. package/test/concurrent-cost.test.js +148 -148
  263. package/test/container-media-info.test.js +228 -228
  264. package/test/contention.test.js +76 -76
  265. package/test/core-dumps.test.js +57 -57
  266. package/test/coverage-follows-the-disk.test.js +228 -228
  267. package/test/coverage-map.test.js +195 -195
  268. package/test/cue-push-carries-what-the-walk-found.test.js +58 -58
  269. package/test/cut-times-timeline.test.js +65 -65
  270. package/test/cuts-follow-published-grid.test.js +109 -109
  271. package/test/data-channel-frame.test.js +63 -63
  272. package/test/data-channel-viewer-lifecycle.test.js +92 -92
  273. package/test/dead-torrent-handle.test.js +52 -52
  274. package/test/declared-rates.test.js +116 -116
  275. package/test/declared-tracks.test.js +43 -43
  276. package/test/decode-cost-fit.test.js +202 -202
  277. package/test/decode-cost.test.js +475 -462
  278. package/test/delivery-probe.test.js +393 -393
  279. package/test/demand-register.test.js +206 -206
  280. package/test/dht-bootstrap.test.js +72 -72
  281. package/test/drain-threat.test.js +65 -65
  282. package/test/duplicate-add.test.js +48 -48
  283. package/test/encode-admission.test.js +146 -146
  284. package/test/encode-cost.test.js +275 -275
  285. package/test/encode-exit.test.js +111 -111
  286. package/test/encode-orchestrator.test.js +426 -426
  287. package/test/encode-plan-viewers.test.js +725 -725
  288. package/test/encode-plan.test.js +545 -545
  289. package/test/encode-run-state.test.js +314 -314
  290. package/test/encode-run.test.js +38 -0
  291. package/test/encode-slope.test.js +46 -46
  292. package/test/encoded-output.test.js +39 -39
  293. package/test/encoder-kinds.test.js +122 -122
  294. package/test/encoder-readings.test.js +68 -68
  295. package/test/every-claimant-is-told-its-share.test.js +152 -152
  296. package/test/failed-encoder-still-serves-what-exists.test.js +354 -354
  297. package/test/failed-start-breaker.test.js +202 -202
  298. package/test/fastest-wires.test.js +143 -143
  299. package/test/ffmpeg-stream-counts.test.js +78 -78
  300. package/test/file-edges.test.js +191 -191
  301. package/test/fixtures/refused-audio-20261002.json +10 -0
  302. package/test/fmp4-presentation-clock.test.js +4 -2
  303. package/test/fmp4-self-contained.test.js +80 -80
  304. package/test/fmp4-timestamps.test.js +140 -140
  305. package/test/fmp4-track-completeness.test.js +41 -41
  306. package/test/format-keyed-outputs.test.js +78 -78
  307. package/test/health-metrics.test.js +38 -38
  308. package/test/held-request-width.test.js +157 -157
  309. package/test/helpers/encode-run.js +240 -240
  310. package/test/helpers/manager.js +62 -57
  311. package/test/helpers/output-spec.js +63 -63
  312. package/test/host-load.test.js +68 -68
  313. package/test/index-accuracy-is-about-the-file.test.js +128 -128
  314. package/test/init-compat.test.js +219 -219
  315. package/test/input-lost-quiets-the-plan.test.js +261 -261
  316. package/test/input-unavailable.test.js +48 -48
  317. package/test/installation-id.test.js +39 -39
  318. package/test/keeping-period.test.js +83 -83
  319. package/test/keyframe-index-accuracy.test.js +188 -188
  320. package/test/keyframes-belong-to-the-file.test.js +249 -249
  321. package/test/learned-median.test.js +37 -37
  322. package/test/letting-go-asks-who-is-watching.test.js +191 -191
  323. package/test/limit-row-by-area.test.js +60 -60
  324. package/test/link-budget.test.js +111 -111
  325. package/test/link-probe.test.js +56 -56
  326. package/test/local-encoding-data.test.js +273 -273
  327. package/test/logger-repeats.test.js +134 -134
  328. package/test/look-ahead-coverage.test.js +56 -56
  329. package/test/manager-surface.test.js +291 -291
  330. package/test/matroska-cues-track.test.js +192 -192
  331. package/test/media-time.test.js +62 -62
  332. package/test/memory-budget.test.js +390 -390
  333. package/test/move-cost.test.js +216 -216
  334. package/test/mp4-subtitles.test.js +173 -173
  335. package/test/one-authority.test.js +285 -285
  336. package/test/one-budget.test.js +149 -149
  337. package/test/one-resource-divided.test.js +185 -185
  338. package/test/one-serving-output-per-height.test.js +458 -458
  339. package/test/orchestrator-wired.test.js +207 -207
  340. package/test/output-catalog.test.js +39 -39
  341. package/test/output-shape.test.js +21 -21
  342. package/test/output-spec.test.js +251 -251
  343. package/test/output-speed.test.js +87 -87
  344. package/test/outputs-being-prepared.test.js +40 -40
  345. package/test/packet-witness-ring.test.js +236 -236
  346. package/test/packet-witness.test.js +148 -148
  347. package/test/piece-completeness.test.js +37 -1
  348. package/test/piece-disk-store.test.js +401 -401
  349. package/test/piece-from-whole-file.test.js +129 -129
  350. package/test/piece-lru.test.js +319 -319
  351. package/test/piece-reader.test.js +162 -162
  352. package/test/piece-selection-offset.test.js +85 -85
  353. package/test/piece-store-eviction.test.js +595 -595
  354. package/test/piece-store-never-refuses.test.js +153 -153
  355. package/test/piece-store-reservations.test.js +403 -403
  356. package/test/piece-store-slow-disk.test.js +159 -159
  357. package/test/piece-tail.test.js +97 -97
  358. package/test/plan-host-timings.test.js +68 -68
  359. package/test/plan-is-steady.test.js +225 -225
  360. package/test/playback-readiness.test.js +518 -518
  361. package/test/playback-start-regressions.test.js +101 -101
  362. package/test/priority-map-download.test.js +174 -174
  363. package/test/priority-map-emptied.test.js +204 -204
  364. package/test/priority-map-per-output.test.js +215 -215
  365. package/test/priority-map.test.js +163 -163
  366. package/test/probe-wedge-certainty.test.js +60 -60
  367. package/test/produced-copy-choice.test.js +213 -213
  368. package/test/published-timeline.test.js +83 -83
  369. package/test/quality-offer.test.js +160 -160
  370. package/test/quality-variants.test.js +1270 -1257
  371. package/test/rate-control-in-the-output.test.js +180 -180
  372. package/test/read-survives-withdrawal.test.js +164 -164
  373. package/test/read-window.test.js +365 -365
  374. package/test/resume-warm.test.js +39 -39
  375. package/test/run-graph-drift.test.js +37 -37
  376. package/test/run-inputs.test.js +80 -80
  377. package/test/run-intervals.test.js +100 -100
  378. package/test/run-position-follows-published-grid.test.js +89 -89
  379. package/test/run-progress.test.js +64 -64
  380. package/test/same-height-switch.test.js +663 -663
  381. package/test/seek-frees-the-viewers-requests.test.js +217 -217
  382. package/test/seek-landing.test.js +109 -109
  383. package/test/seek-target-not-superseded.test.js +195 -195
  384. package/test/segment-cut-times.test.js +63 -63
  385. package/test/segment-demand.test.js +80 -80
  386. package/test/segment-hold-supersede.test.js +91 -91
  387. package/test/segment-judged-by-its-own-header.test.js +222 -221
  388. package/test/segment-serve-wiring.test.js +9 -3
  389. package/test/segment-store-eviction.test.js +247 -247
  390. package/test/segment-store.test.js +352 -352
  391. package/test/segment-true-start.test.js +86 -86
  392. package/test/segments-are-shared.test.js +176 -176
  393. package/test/send-chunk-bytes.test.js +86 -86
  394. package/test/serving-existing-output.test.js +111 -105
  395. package/test/serving-output.test.js +102 -102
  396. package/test/shared-piece-store.test.js +310 -310
  397. package/test/sidecar-naming.test.js +142 -142
  398. package/test/soundtrack-rate-bound.test.js +289 -289
  399. package/test/source-file.test.js +133 -133
  400. package/test/source-registry.test.js +18 -18
  401. package/test/split-a-stretch.test.js +139 -139
  402. package/test/stale-request-after-seek.test.js +158 -158
  403. package/test/startup-readings.test.js +124 -124
  404. package/test/stream-route.test.js +237 -237
  405. package/test/subtitle-cue-framing.test.js +200 -200
  406. package/test/subtitle-cue-source.test.js +102 -102
  407. package/test/subtitle-cursor.test.js +63 -63
  408. package/test/subtitle-defaults.test.js +118 -118
  409. package/test/subtitle-language.test.js +252 -252
  410. package/test/supply-margin.test.js +190 -190
  411. package/test/swarm-follows-readers.test.js +174 -174
  412. package/test/swarm-reach.test.js +130 -130
  413. package/test/swarm-selection.test.js +220 -220
  414. package/test/tail-duplication.test.js +167 -167
  415. package/test/the-channel-has-both-ends.test.js +91 -91
  416. package/test/the-torrent-thread-serves-bytes.test.js +107 -107
  417. package/test/thread-pool.test.js +53 -53
  418. package/test/timeline.test.js +84 -84
  419. package/test/torrent-contents.test.js +235 -235
  420. package/test/torrent-cost.test.js +71 -71
  421. package/test/torrent-files.test.js +221 -221
  422. package/test/torrent-naming.test.js +255 -255
  423. package/test/tracks-begin-together.test.js +209 -209
  424. package/test/tunnel-renewal.test.js +167 -167
  425. package/test/two-viewers-one-picture.test.js +508 -504
  426. package/test/upload-hurry.test.js +186 -186
  427. package/test/usrsctp-state.test.js +131 -131
  428. package/test/video-facts.test.js +102 -102
  429. package/test/viewer-assignments.test.js +143 -143
  430. package/test/viewer-outputs.test.js +285 -285
  431. package/test/viewer-presence.test.js +116 -116
  432. package/test/viewer-requests-admission.test.js +92 -89
  433. package/test/viewer-states.test.js +189 -189
  434. package/test/viewer-subtitle-subscription.test.js +96 -96
  435. package/test/viewer.test.js +139 -139
  436. package/test/viewing-generations.test.js +390 -390
  437. package/test/visible-rung.test.js +37 -37
  438. package/test/wait-ledger.test.js +100 -100
  439. package/test/webrtc-shim.test.js +149 -149
  440. package/test/wedge-certainty.test.js +131 -131
  441. package/test/withdraw-piece-claim.test.js +212 -212
  442. package/test/worker-channel.test.js +158 -158
  443. package/utils/client-log-file.js +151 -151
  444. package/utils/logger.js +312 -312
  445. package/utils/parse-range.js +25 -25
  446. package/utils/perf.js +59 -59
  447. package/utils/torrent-source-key.js +38 -38
package/AGENTS.md CHANGED
@@ -1,338 +1,338 @@
1
- # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
-
3
- Downloads a torrent and streams the chosen file to the browser, transcoding to
4
- HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
- and release process.
6
-
7
- ## Deployment-agnostic — important
8
-
9
- The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
- all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
- devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
- detection must probe at runtime and fall back gracefully; do not assume a
13
- Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
-
15
- ## Layout
16
-
17
- Browser request and response fields, compatibility defaults, and status meanings
18
- are recorded in `docs/browser-proxy-contract.md`.
19
-
20
- - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
21
- else bundled ffmpeg-static, else PATH `ffmpeg`).
22
- - `server.js` — the composition root: creates Fastify, initializes process-wide
23
- resources, calls `services/server/wire-outputs.js` for the output and encode
24
- service graph, registers each route explicitly, and passes its dependencies.
25
- `wire-outputs.js` is a subordinate assembler for that graph; it does not
26
- create the HTTP server or register routes.
27
- - `routes/<path>/<method>.js` — same convention as the server repo.
28
- - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
29
- - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
30
- - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
31
- long-polls while a segment is being produced, returns retryable 503 (never
32
- 202 — hls.js can't consume it).
33
- - `services/`:
34
- - `torrent/demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
35
- range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
36
- `DemandRegister` (live windows by claimant), `pieces.js` (the one place
37
- bytes become piece numbers). No WebTorrent, no piece store, no pieces.
38
- - `torrent/download/` — `SwarmSelection`, the ONLY thing that calls `select`,
39
- `deselect` or `critical`, and `registry.js`, which holds one per torrent and
40
- owns the cross-torrent rule that withholds the speculative levels while
41
- anything urgent is missing anywhere. See `docs/download-architecture.md`.
42
- - `encode/output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
43
- `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
44
- packaged how — and therefore its identity: two outputs whose parameters
45
- agree ARE the same output, and the encoded result is reused by definition.
46
- Nothing about a VIEWER appears in it (not the consumer id, not where they
47
- started, not their viewport), and nothing about the request that does not
48
- change a byte of the result. `server/ViewerRequests.js` builds one and keys
49
- the output on it.
50
- - **`media/` — THE MEDIA LAYER, one directory, and it answers ONE question:
51
- what does a FILE say about itself.** Its containers, its tracks, where its
52
- keyframes are, how long it runs, and the plan for playing it. Every fact in
53
- it is born when a header is read, dies when the file is forgotten, and is
54
- addressed by the file — which is the test that put them together. It used to
55
- be four places at two levels (`container/`, `tracks/`, half of
56
- `orchestrators/`, and `playback-planner.js` loose in `services/`), so the
57
- layer could not be put under an import rule and the rule was written per
58
- directory instead.
59
- Inside it, the DOMAIN is `media/container/` and `media/tracks/`: they import
60
- nothing but each other, this proxy's own logger included. The application
61
- files sit flat beside them — `ContainerOrchestrator`, `KeyframeTables`,
62
- `SubtitleOrchestrator`, `playback-planner.js`, `keyframe-probe.js`,
63
- `ffmpeg-banner.js`, `audio-inventory.js` — and may reach their own domain and
64
- the logger and nothing else. What a torrent CONTAINS, which clusters may be
65
- read, where a viewer stands, what an encoder costs: all handed in. Both
66
- reaches that existed are gone — `torrent-worker/subtitle-cues.js` is given to
67
- `SubtitleOrchestrator` by `server.js`, and `torrent/Contents.js` to the
68
- planner — so this layer can be exercised with plain values, no torrent, no
69
- thread and no disk. Checked by breaking it in every direction.
70
- - **The parse happens on the MAIN thread, and the torrent thread serves
71
- bytes.** It used to parse containers too — tracks, media info, keyframe
72
- index — and carry each answer back over the channel, on the stated ground
73
- that "the main thread cannot open a read stream on one of its files". True
74
- of WebTorrent's API, not of the bytes: a container is built from one
75
- function, `readRange(start, end)`, the pieces live in shared memory, and
76
- `WorkerTorrentPool.readRangeOf` is the read that serves every segment — it
77
- waits for what has not arrived and steers the swarm toward it. That split
78
- is what made "where is this fact kept" a question at all; with one thread it
79
- does not arise. NOTHING in that thread reaches into the media layer now —
80
- the subtitle cue walk was the last, and it is handed which byte ranges of a
81
- file are downloaded WHOLE (one list per pass, not a question per cluster)
82
- plus a store read that never fetches, both in
83
- `torrent/worker/held-bytes.js`. A piece arriving is ANNOUNCED
84
- (`PIECES_ARRIVED`) rather than acted on there. Pinned by
85
- `test/the-torrent-thread-serves-bytes.test.js`.
86
- - `media/container/` — domain: `Container` (abstract, RFC 9559 / ISO 14496-12),
87
- `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
88
- (sniff 16 bytes → precise subclass), `KeyframeTable`. See
89
- `docs/container-architecture.md`.
90
- - `media/tracks/` — domain: `ContainerTrack` (base: TrackNumber, declaredIndex,
91
- language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
92
- `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
93
- `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
94
- RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
95
- track_enabled / alternate_group, elng BCP47).
96
- - `media/` application files: `ContainerOrchestrator` (detect + the ONE
97
- container per file, `containerFor`/`getTracks`/`getMediaInfo`/`getKeyframeIndex`;
98
- the container keeps its own reading of each element it states — the Segment
99
- layout, Tracks, Cues, MP4's `moov` — once it has been read), `KeyframeTables`,
100
- `SubtitleOrchestrator` (the track list and the cues behind
101
- `Container` tracks, warm/push — it is handed the walk, and `server.js` is
102
- what puts the two together), `SubtitleCues` (the plan, the found-order
103
- cursor, one walk of a file at a time, taking back withdrawn cues). It uses
104
- the file's one container — it no longer builds its own. The walk itself is
105
- `MatroskaContainer.readHeldCues` over `container/matroska-clusters.js` (which
106
- also finds clusters the Cues table does not name) and
107
- `Mp4Container.readHeldSamples`; what the torrent supplies is `held-bytes.js`
108
- — which ranges are downloaded whole, and a read of one that never fetches
109
- and answers at once with nothing where the range is not whole.
110
- - **A read whose bytes have not arrived is not an answer about the file.**
111
- Every container read is strict (`container/unavailable.js`): every byte, or
112
- `BytesUnavailable`. A value, a proven absence, or a refusal of ours with its
113
- reason may be kept; "not here yet" never is — not by a container, not by
114
- `ContainerOrchestrator`, not by `KeyframeTables`, not by `SubtitleCues`.
115
- **`KeyframeTables` is where a file's keyframe table lives and the only thing
116
- that reads one.** The table is `container/KeyframeTable.js`, ONE object per
117
- file, handed out rather than copied — so a read that lands after a session
118
- was made still reaches it, which a value could not. It answers two questions
119
- that a bag of probe fields could not tell apart: `answered` (a reader came
120
- back) and `readable` (it came back with times). The first distinguishes a
121
- file that must be re-encoded for ever from a passing shortage of bytes off
122
- the swarm. One read per file whoever asks, the second asker joins the first,
123
- each caller's wait is bounded by the measured `KEYFRAME_TABLE_BUDGET_MS`
124
- while the READ is not, and a read that threw — `BytesUnavailable` included —
125
- is never recorded as an answer; it is read again when pieces of the file
126
- arrive (`readAgainIfUnanswered`). It is the ONLY store of the keyframe
127
- answer; the container keeps the Cues reading the times are taken from. The second reader is the packet probe in
128
- `media/keyframe-probe.js`, which decodes rather than parsing; the fuller of the
129
- two answers is the one that stands (`media/keyframe-probe.js`).
130
- - `server/controllers/` — interface layer: `PlaybackController` / `SubtitleController`
131
- (thin adapters over orchestrators; routes depend on controllers, not services).
132
- `routes/*` are now thin HTTP translators. A controller reaches every layer
133
- below it THROUGH its orchestrator and never around it, which biome checks —
134
- so what an orchestrator needs from another layer is composed in `server.js`
135
- and passed in.
136
- - Everything a container states about ITSELF lives in its own class: the
137
- track table, the Cues, the keyframe times they name, the cluster positions,
138
- the blocks inside a cluster, the MP4 sample table, and the walk of what is
139
- downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
140
- is the format's byte-level grammar, not its statements, and is the only
141
- piece kept apart. `ContainerFactory` is the ONE place that decides what a
142
- file is — by sniffing the header, since that is what the muxer wrote — and
143
- that is it. `ContainerFactory.readKeyframeIndex` is gone: it existed only for
144
- the session manager's own HTTP read of a container, which is deleted.
145
- - `docs/download-architecture.md` — the two axes of downloading: what is
146
- wanted (`demand/`) against what the swarm is told (`download/`), why urgency
147
- is not a number given to the library, and why the speculative levels are
148
- withdrawn rather than lowered.
149
- - **The storage layer — ONE layer, FOUR directories.** Bytes on a medium with
150
- a limit is the property they share; what holds them are three different
151
- things with different lifetimes, different addresses and different THREADS,
152
- so they are not flattened into one:
153
- - `storage/piece-store/` — the torrent's pieces: memory tier, spill tier, and the
154
- order they leave in (`shared-piece-store.js`, `piece-lru.js`,
155
- `piece-disk-store.js`). Lives in the torrent WORKER thread.
156
- - `storage/segment-store/` — the segments an encoder has produced
157
- (`SegmentStore.js`), addressed by the output's own key. Main thread.
158
- It keeps bytes and what is read from them; whether a piece is whole is
159
- decided by the encoding (`encode/piece-completeness.js`).
160
- - `storage/files/` — files downloaded whole and kept as files
161
- (`CompletedFiles.js`, `piece-from-whole-file.js`). Worker thread.
162
- - `storage/` — THE ONE BUDGET: how much of this machine the proxy may
163
- take, and how that is divided between everything that holds bytes.
164
- `MachineBudget.js` is the single owner; `allowance.js` the rule;
165
- `machine-memory.js` and `free.js` read the machine; `wire.js` says who
166
- the claimants are and which RESOURCE each takes; `keep.js` and
167
- `returns.js` say how long material nobody is using is kept. It holds no
168
- bytes itself.
169
- **One budget does not mean one number.** Memory cannot be paid for with
170
- disk, so what is divided is divided per resource — and "disk" is one
171
- resource per DEVICE, read with `statSync(dir).dev`, because two
172
- filesystems cannot pay for each other either (`/tmp` and `/data` on the
173
- addon host are two). What there is ONE of is the owner, the policy and
174
- the place that reads the machine. One owner because the claimants TRADE
175
- across resources: pieces that do not fit in memory are spilled to disk,
176
- so what memory is given decides how much disk is needed — 14 400 MB
177
- spilled in fifty minutes while the store held 312-424 MB.
178
- The policy is the operator's, stated once at startup — `--budget
179
- adaptive|share|fixed`, `--budget-share`, `--budget-bytes`,
180
- `--min-memory-bytes`, `--min-disk-bytes` — and those are the only
181
- chosen numbers in the proxy, because they are chosen by the person whose
182
- machine it is. The default is the measured one.
183
- They may import each other and nothing above, which `biome` checks as an
184
- EXCEPTION to `../**` rather than as a list of forbidden layers — a layer is
185
- not a directory, the blanket form cannot say "my siblings", and a list of
186
- names misses whatever it forgets.
187
- - `docs/storage-architecture.md` — the three things that write to one disk, the
188
- two rules that remove material (nobody needs it, or there is no room), the
189
- order the viewers give that removal, why a spilled piece is a file of its
190
- own, and what is still not solved.
191
- - `docs/encode-architecture.md` — who decides where encoders go, and the
192
- answer is one authority: `EncodePlan`, from what is made, what is being
193
- made, what is wanted and what the host can hold. Why no viewer reaches it,
194
- why the priority map is read at two scopes (per FILE for the swarm, per
195
- OUTPUT for the encoders), and what each of the eight other places that used
196
- to place or kill an encoder now states instead.
197
- - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
198
- is in TWO places split by phase: on the droplet while a transport is being
199
- acquired and at unload, on THIS proxy for the whole of a viewing
200
- (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
201
- Read both before concluding anything from a half-session.
202
- - `media/playback-planner.js` — single ffmpeg probe returns audioCodec,
203
- videoCodec, container, durationSeconds. `mode` is advisory; the browser
204
- decides. `media/keyframe-probe.js` beside it is the OTHER reading of the same
205
- file, by decoding rather than by parsing, for containers that state no index.
206
- - `server/` — what a request does, one operation at a time, and nothing
207
- that lives longer than the operation: `ViewerRequests` (open an output of a
208
- file and be placed on it, state a position, report progress),
209
- `SegmentServing` (answer a playlist, init or segment request from the store,
210
- or hold it until the piece is whole), `OutputLifecycle` (dispose an output
211
- nobody is on, all of them at shutdown, adopt what an earlier process left),
212
- and `wire-outputs.js`, which builds the components and hands each the narrow
213
- host it reads. `hls-session-manager.js` is gone (2.87.0): each of its members
214
- is a method of the component that owns it. The operations own no long-lived
215
- fact: the init served for an output is kept by `SegmentStore`, the bytes read
216
- for an output by `EncodeRuns`, the cold-start measurement by `HostTimings`.
217
- They import no component's implementation — only the name of an output and
218
- of its playlist (`encode/output/index.js`) and the keeping period
219
- (`storage/keep.js`); biome checks it. A held request waits for the store's
220
- publication event, as long as the requester states (`X-Hold-Ms`) and no
221
- longer than it stays.
222
- - `encode/` beside the orchestrator: `OutputOpening` (which output answers a
223
- request for a file, made if it is not here yet — without knowing who asked),
224
- `EncodeRuns` (build a run where the plan places it, follow it, account for
225
- its end, and what its input has received), `EncoderSelection` (the encoder
226
- in use and the move to software), `Renditions` (the steps of a picture and
227
- its soundtracks, the master playlist, and which rung a viewer's page says it
228
- plays), `OutputTimes` (where each segment begins and how the cut table is
229
- corrected), `CushionReport` (how much film is ready in front of the
230
- viewers), `output-key-format.js` (which container a key names).
231
- - `viewer/`: every viewer has a name (`Viewers.of` refuses an empty one); the
232
- relation to outputs is stored only in `Viewer.outputs` and read the other way
233
- by `Viewers.forOutput`. A quality request belongs to one viewer and exists
234
- only in AUTO (`Viewer.askQuality`). The playback start forecast
235
- (`playback-readiness.js`) is the viewer's, because it predicts how the
236
- viewer's browser will play; `ViewerRequests` is handed it by
237
- `wire-outputs.js`. `media-time.js` is exact media time and the rule by which
238
- every Media Source engine joins buffered ranges — see
239
- `docs/playback-start-forecast.md`.
240
- - `torrent/` reaches the piece store by what it does (`piece-store-of.js`) and
241
- is handed the store's class by `torrent/worker/worker.js`, where that thread
242
- is assembled. `transport/` imports nothing of another component; `bin/cli.js`
243
- hands it the memory reading and the rule for which captures are kept.
244
- - `encode/hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
245
- STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
246
- verify each segment decodes independently (catches non-IDR/corrupted hw
247
- output). Falls back to software libx264. Runtime fallback to software if a
248
- hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
249
- - `transport/data-channel-handler.js` — forwards WebRTC data-channel requests to the
250
- local HTTP server (loopback), so the same routes serve both transports.
251
-
252
- ## Gotchas
253
-
254
- - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
255
- - A transitive dep (`ip-set`, via webtorrent) ships a hostile
256
- `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
257
- around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
258
- if you ever change install flow, keep that in mind.
259
-
260
- ## Planned: public reachability (remote access)
261
-
262
- Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
263
-
264
- - **Auto port mapping** — IMPLEMENTED (`services/transport/port-mapper.js`, changelog
265
- 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
266
- same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
267
- auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
268
- Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
269
- `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
270
- **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
271
- mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
272
- Also pending (next iteration): a success log line in `transport/port-mapper.js` `stop()`
273
- (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
274
- clean unmap on shutdown is silent.
275
- - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
276
- is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
277
- mapping success and on every tunnel (re)connect; the server dial-back-verifies
278
- reachability (server 0.8.22, roadmap step 2).
279
- - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
280
- certificate delivered by the server through the tunnel (persist cert+key
281
- locally; ~90-day renewals are pushed the same way). Add CORS headers for the
282
- web-app origin so hls.js / `<video>` can fetch cross-origin.
283
- - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
284
- as fallback for hosts where no port could be opened.
285
- - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
286
- WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
287
- `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
288
- prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
289
- symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
290
- *global* v6) + STUN NAT pre-classification reported to the registry; then
291
- the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
292
- - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
293
- announcements via the `bittorrent-dht` already bundled with WebTorrent.
294
-
295
- All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
296
-
297
- ## Disk hygiene (open item — torrent data is NOT cleaned up today)
298
-
299
- HLS segments are handled (`server/OutputLifecycle.js`: idle TTL, `disposeSession`,
300
- `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
301
- (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
302
- hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
303
- removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
304
- left by a previous hard kill at startup.
305
-
306
- Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
307
- file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
308
- orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
309
- whole torrents. (Shutdown teardown ✅ done.)
310
- Level 2 (research): sliding-window chunk store. Full rationale in the parent
311
- `../CLAUDE.md` "Disk hygiene" section.
312
-
313
- ## Cloud proxy
314
-
315
- The same proxy code also runs as the company-hosted fallback when the user
316
- pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
317
- rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
318
- metered-egress clouds). Provider/economics analysis in the parent
319
- `../CLAUDE.md` "Cloud proxy" section.
320
-
321
- ## Changelog
322
-
323
- Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
324
- a new `## <version>` heading at the top, following the existing
325
- `- **New**/**Fix**/**Chore**:` format.
326
-
327
- **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
328
- version …` which bumps it. Write the CHANGELOG entry at the version that bump
329
- will produce: **current `package.json` version + 1 patch** (or + 1 minor).
330
- Accumulate bullets into that single pending entry until it's published. See the
331
- parent `../CLAUDE.md`.
332
-
333
- ## Release
334
-
335
- `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
336
- own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
337
-
338
- **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.
1
+ # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
+
3
+ Downloads a torrent and streams the chosen file to the browser, transcoding to
4
+ HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
+ and release process.
6
+
7
+ ## Deployment-agnostic — important
8
+
9
+ The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
+ all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
+ devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
+ detection must probe at runtime and fall back gracefully; do not assume a
13
+ Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
+
15
+ ## Layout
16
+
17
+ Browser request and response fields, compatibility defaults, and status meanings
18
+ are recorded in `docs/browser-proxy-contract.md`.
19
+
20
+ - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
21
+ else bundled ffmpeg-static, else PATH `ffmpeg`).
22
+ - `server.js` — the composition root: creates Fastify, initializes process-wide
23
+ resources, calls `services/server/wire-outputs.js` for the output and encode
24
+ service graph, registers each route explicitly, and passes its dependencies.
25
+ `wire-outputs.js` is a subordinate assembler for that graph; it does not
26
+ create the HTTP server or register routes.
27
+ - `routes/<path>/<method>.js` — same convention as the server repo.
28
+ - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
29
+ - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
30
+ - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
31
+ long-polls while a segment is being produced, returns retryable 503 (never
32
+ 202 — hls.js can't consume it).
33
+ - `services/`:
34
+ - `torrent/demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
35
+ range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
36
+ `DemandRegister` (live windows by claimant), `pieces.js` (the one place
37
+ bytes become piece numbers). No WebTorrent, no piece store, no pieces.
38
+ - `torrent/download/` — `SwarmSelection`, the ONLY thing that calls `select`,
39
+ `deselect` or `critical`, and `registry.js`, which holds one per torrent and
40
+ owns the cross-torrent rule that withholds the speculative levels while
41
+ anything urgent is missing anywhere. See `docs/download-architecture.md`.
42
+ - `encode/output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
43
+ `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
44
+ packaged how — and therefore its identity: two outputs whose parameters
45
+ agree ARE the same output, and the encoded result is reused by definition.
46
+ Nothing about a VIEWER appears in it (not the consumer id, not where they
47
+ started, not their viewport), and nothing about the request that does not
48
+ change a byte of the result. `server/ViewerRequests.js` builds one and keys
49
+ the output on it.
50
+ - **`media/` — THE MEDIA LAYER, one directory, and it answers ONE question:
51
+ what does a FILE say about itself.** Its containers, its tracks, where its
52
+ keyframes are, how long it runs, and the plan for playing it. Every fact in
53
+ it is born when a header is read, dies when the file is forgotten, and is
54
+ addressed by the file — which is the test that put them together. It used to
55
+ be four places at two levels (`container/`, `tracks/`, half of
56
+ `orchestrators/`, and `playback-planner.js` loose in `services/`), so the
57
+ layer could not be put under an import rule and the rule was written per
58
+ directory instead.
59
+ Inside it, the DOMAIN is `media/container/` and `media/tracks/`: they import
60
+ nothing but each other, this proxy's own logger included. The application
61
+ files sit flat beside them — `ContainerOrchestrator`, `KeyframeTables`,
62
+ `SubtitleOrchestrator`, `playback-planner.js`, `keyframe-probe.js`,
63
+ `ffmpeg-banner.js`, `audio-inventory.js` — and may reach their own domain and
64
+ the logger and nothing else. What a torrent CONTAINS, which clusters may be
65
+ read, where a viewer stands, what an encoder costs: all handed in. Both
66
+ reaches that existed are gone — `torrent-worker/subtitle-cues.js` is given to
67
+ `SubtitleOrchestrator` by `server.js`, and `torrent/Contents.js` to the
68
+ planner — so this layer can be exercised with plain values, no torrent, no
69
+ thread and no disk. Checked by breaking it in every direction.
70
+ - **The parse happens on the MAIN thread, and the torrent thread serves
71
+ bytes.** It used to parse containers too — tracks, media info, keyframe
72
+ index — and carry each answer back over the channel, on the stated ground
73
+ that "the main thread cannot open a read stream on one of its files". True
74
+ of WebTorrent's API, not of the bytes: a container is built from one
75
+ function, `readRange(start, end)`, the pieces live in shared memory, and
76
+ `WorkerTorrentPool.readRangeOf` is the read that serves every segment — it
77
+ waits for what has not arrived and steers the swarm toward it. That split
78
+ is what made "where is this fact kept" a question at all; with one thread it
79
+ does not arise. NOTHING in that thread reaches into the media layer now —
80
+ the subtitle cue walk was the last, and it is handed which byte ranges of a
81
+ file are downloaded WHOLE (one list per pass, not a question per cluster)
82
+ plus a store read that never fetches, both in
83
+ `torrent/worker/held-bytes.js`. A piece arriving is ANNOUNCED
84
+ (`PIECES_ARRIVED`) rather than acted on there. Pinned by
85
+ `test/the-torrent-thread-serves-bytes.test.js`.
86
+ - `media/container/` — domain: `Container` (abstract, RFC 9559 / ISO 14496-12),
87
+ `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
88
+ (sniff 16 bytes → precise subclass), `KeyframeTable`. See
89
+ `docs/container-architecture.md`.
90
+ - `media/tracks/` — domain: `ContainerTrack` (base: TrackNumber, declaredIndex,
91
+ language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
92
+ `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
93
+ `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
94
+ RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
95
+ track_enabled / alternate_group, elng BCP47).
96
+ - `media/` application files: `ContainerOrchestrator` (detect + the ONE
97
+ container per file, `containerFor`/`getTracks`/`getMediaInfo`/`getKeyframeIndex`;
98
+ the container keeps its own reading of each element it states — the Segment
99
+ layout, Tracks, Cues, MP4's `moov` — once it has been read), `KeyframeTables`,
100
+ `SubtitleOrchestrator` (the track list and the cues behind
101
+ `Container` tracks, warm/push — it is handed the walk, and `server.js` is
102
+ what puts the two together), `SubtitleCues` (the plan, the found-order
103
+ cursor, one walk of a file at a time, taking back withdrawn cues). It uses
104
+ the file's one container — it no longer builds its own. The walk itself is
105
+ `MatroskaContainer.readHeldCues` over `container/matroska-clusters.js` (which
106
+ also finds clusters the Cues table does not name) and
107
+ `Mp4Container.readHeldSamples`; what the torrent supplies is `held-bytes.js`
108
+ — which ranges are downloaded whole, and a read of one that never fetches
109
+ and answers at once with nothing where the range is not whole.
110
+ - **A read whose bytes have not arrived is not an answer about the file.**
111
+ Every container read is strict (`container/unavailable.js`): every byte, or
112
+ `BytesUnavailable`. A value, a proven absence, or a refusal of ours with its
113
+ reason may be kept; "not here yet" never is — not by a container, not by
114
+ `ContainerOrchestrator`, not by `KeyframeTables`, not by `SubtitleCues`.
115
+ **`KeyframeTables` is where a file's keyframe table lives and the only thing
116
+ that reads one.** The table is `container/KeyframeTable.js`, ONE object per
117
+ file, handed out rather than copied — so a read that lands after a session
118
+ was made still reaches it, which a value could not. It answers two questions
119
+ that a bag of probe fields could not tell apart: `answered` (a reader came
120
+ back) and `readable` (it came back with times). The first distinguishes a
121
+ file that must be re-encoded for ever from a passing shortage of bytes off
122
+ the swarm. One read per file whoever asks, the second asker joins the first,
123
+ each caller's wait is bounded by the measured `KEYFRAME_TABLE_BUDGET_MS`
124
+ while the READ is not, and a read that threw — `BytesUnavailable` included —
125
+ is never recorded as an answer; it is read again when pieces of the file
126
+ arrive (`readAgainIfUnanswered`). It is the ONLY store of the keyframe
127
+ answer; the container keeps the Cues reading the times are taken from. The second reader is the packet probe in
128
+ `media/keyframe-probe.js`, which decodes rather than parsing; the fuller of the
129
+ two answers is the one that stands (`media/keyframe-probe.js`).
130
+ - `server/controllers/` — interface layer: `PlaybackController` / `SubtitleController`
131
+ (thin adapters over orchestrators; routes depend on controllers, not services).
132
+ `routes/*` are now thin HTTP translators. A controller reaches every layer
133
+ below it THROUGH its orchestrator and never around it, which biome checks —
134
+ so what an orchestrator needs from another layer is composed in `server.js`
135
+ and passed in.
136
+ - Everything a container states about ITSELF lives in its own class: the
137
+ track table, the Cues, the keyframe times they name, the cluster positions,
138
+ the blocks inside a cluster, the MP4 sample table, and the walk of what is
139
+ downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
140
+ is the format's byte-level grammar, not its statements, and is the only
141
+ piece kept apart. `ContainerFactory` is the ONE place that decides what a
142
+ file is — by sniffing the header, since that is what the muxer wrote — and
143
+ that is it. `ContainerFactory.readKeyframeIndex` is gone: it existed only for
144
+ the session manager's own HTTP read of a container, which is deleted.
145
+ - `docs/download-architecture.md` — the two axes of downloading: what is
146
+ wanted (`demand/`) against what the swarm is told (`download/`), why urgency
147
+ is not a number given to the library, and why the speculative levels are
148
+ withdrawn rather than lowered.
149
+ - **The storage layer — ONE layer, FOUR directories.** Bytes on a medium with
150
+ a limit is the property they share; what holds them are three different
151
+ things with different lifetimes, different addresses and different THREADS,
152
+ so they are not flattened into one:
153
+ - `storage/piece-store/` — the torrent's pieces: memory tier, spill tier, and the
154
+ order they leave in (`shared-piece-store.js`, `piece-lru.js`,
155
+ `piece-disk-store.js`). Lives in the torrent WORKER thread.
156
+ - `storage/segment-store/` — the segments an encoder has produced
157
+ (`SegmentStore.js`), addressed by the output's own key. Main thread.
158
+ It keeps bytes and what is read from them; whether a piece is whole is
159
+ decided by the encoding (`encode/piece-completeness.js`).
160
+ - `storage/files/` — files downloaded whole and kept as files
161
+ (`CompletedFiles.js`, `piece-from-whole-file.js`). Worker thread.
162
+ - `storage/` — THE ONE BUDGET: how much of this machine the proxy may
163
+ take, and how that is divided between everything that holds bytes.
164
+ `MachineBudget.js` is the single owner; `allowance.js` the rule;
165
+ `machine-memory.js` and `free.js` read the machine; `wire.js` says who
166
+ the claimants are and which RESOURCE each takes; `keep.js` and
167
+ `returns.js` say how long material nobody is using is kept. It holds no
168
+ bytes itself.
169
+ **One budget does not mean one number.** Memory cannot be paid for with
170
+ disk, so what is divided is divided per resource — and "disk" is one
171
+ resource per DEVICE, read with `statSync(dir).dev`, because two
172
+ filesystems cannot pay for each other either (`/tmp` and `/data` on the
173
+ addon host are two). What there is ONE of is the owner, the policy and
174
+ the place that reads the machine. One owner because the claimants TRADE
175
+ across resources: pieces that do not fit in memory are spilled to disk,
176
+ so what memory is given decides how much disk is needed — 14 400 MB
177
+ spilled in fifty minutes while the store held 312-424 MB.
178
+ The policy is the operator's, stated once at startup — `--budget
179
+ adaptive|share|fixed`, `--budget-share`, `--budget-bytes`,
180
+ `--min-memory-bytes`, `--min-disk-bytes` — and those are the only
181
+ chosen numbers in the proxy, because they are chosen by the person whose
182
+ machine it is. The default is the measured one.
183
+ They may import each other and nothing above, which `biome` checks as an
184
+ EXCEPTION to `../**` rather than as a list of forbidden layers — a layer is
185
+ not a directory, the blanket form cannot say "my siblings", and a list of
186
+ names misses whatever it forgets.
187
+ - `docs/storage-architecture.md` — the three things that write to one disk, the
188
+ two rules that remove material (nobody needs it, or there is no room), the
189
+ order the viewers give that removal, why a spilled piece is a file of its
190
+ own, and what is still not solved.
191
+ - `docs/encode-architecture.md` — who decides where encoders go, and the
192
+ answer is one authority: `EncodePlan`, from what is made, what is being
193
+ made, what is wanted and what the host can hold. Why no viewer reaches it,
194
+ why the priority map is read at two scopes (per FILE for the swarm, per
195
+ OUTPUT for the encoders), and what each of the eight other places that used
196
+ to place or kill an encoder now states instead.
197
+ - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
198
+ is in TWO places split by phase: on the droplet while a transport is being
199
+ acquired and at unload, on THIS proxy for the whole of a viewing
200
+ (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
201
+ Read both before concluding anything from a half-session.
202
+ - `media/playback-planner.js` — single ffmpeg probe returns audioCodec,
203
+ videoCodec, container, durationSeconds. `mode` is advisory; the browser
204
+ decides. `media/keyframe-probe.js` beside it is the OTHER reading of the same
205
+ file, by decoding rather than by parsing, for containers that state no index.
206
+ - `server/` — what a request does, one operation at a time, and nothing
207
+ that lives longer than the operation: `ViewerRequests` (open an output of a
208
+ file and be placed on it, state a position, report progress),
209
+ `SegmentServing` (answer a playlist, init or segment request from the store,
210
+ or hold it until the piece is whole), `OutputLifecycle` (dispose an output
211
+ nobody is on, all of them at shutdown, adopt what an earlier process left),
212
+ and `wire-outputs.js`, which builds the components and hands each the narrow
213
+ host it reads. `hls-session-manager.js` is gone (2.87.0): each of its members
214
+ is a method of the component that owns it. The operations own no long-lived
215
+ fact: the init served for an output is kept by `SegmentStore`, the bytes read
216
+ for an output by `EncodeRuns`, the cold-start measurement by `HostTimings`.
217
+ They import no component's implementation — only the name of an output and
218
+ of its playlist (`encode/output/index.js`) and the keeping period
219
+ (`storage/keep.js`); biome checks it. A held request waits for the store's
220
+ publication event, as long as the requester states (`X-Hold-Ms`) and no
221
+ longer than it stays.
222
+ - `encode/` beside the orchestrator: `OutputOpening` (which output answers a
223
+ request for a file, made if it is not here yet — without knowing who asked),
224
+ `EncodeRuns` (build a run where the plan places it, follow it, account for
225
+ its end, and what its input has received), `EncoderSelection` (the encoder
226
+ in use and the move to software), `Renditions` (the steps of a picture and
227
+ its soundtracks, the master playlist, and which rung a viewer's page says it
228
+ plays), `OutputTimes` (where each segment begins and how the cut table is
229
+ corrected), `CushionReport` (how much film is ready in front of the
230
+ viewers), `output-key-format.js` (which container a key names).
231
+ - `viewer/`: every viewer has a name (`Viewers.of` refuses an empty one); the
232
+ relation to outputs is stored only in `Viewer.outputs` and read the other way
233
+ by `Viewers.forOutput`. A quality request belongs to one viewer and exists
234
+ only in AUTO (`Viewer.askQuality`). The playback start forecast
235
+ (`playback-readiness.js`) is the viewer's, because it predicts how the
236
+ viewer's browser will play; `ViewerRequests` is handed it by
237
+ `wire-outputs.js`. `media-time.js` is exact media time and the rule by which
238
+ every Media Source engine joins buffered ranges — see
239
+ `docs/playback-start-forecast.md`.
240
+ - `torrent/` reaches the piece store by what it does (`piece-store-of.js`) and
241
+ is handed the store's class by `torrent/worker/worker.js`, where that thread
242
+ is assembled. `transport/` imports nothing of another component; `bin/cli.js`
243
+ hands it the memory reading and the rule for which captures are kept.
244
+ - `encode/hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
245
+ STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
246
+ verify each segment decodes independently (catches non-IDR/corrupted hw
247
+ output). Falls back to software libx264. Runtime fallback to software if a
248
+ hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
249
+ - `transport/data-channel-handler.js` — forwards WebRTC data-channel requests to the
250
+ local HTTP server (loopback), so the same routes serve both transports.
251
+
252
+ ## Gotchas
253
+
254
+ - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
255
+ - A transitive dep (`ip-set`, via webtorrent) ships a hostile
256
+ `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
257
+ around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
258
+ if you ever change install flow, keep that in mind.
259
+
260
+ ## Planned: public reachability (remote access)
261
+
262
+ Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
263
+
264
+ - **Auto port mapping** — IMPLEMENTED (`services/transport/port-mapper.js`, changelog
265
+ 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
266
+ same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
267
+ auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
268
+ Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
269
+ `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
270
+ **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
271
+ mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
272
+ Also pending (next iteration): a success log line in `transport/port-mapper.js` `stop()`
273
+ (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
274
+ clean unmap on shutdown is silent.
275
+ - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
276
+ is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
277
+ mapping success and on every tunnel (re)connect; the server dial-back-verifies
278
+ reachability (server 0.8.22, roadmap step 2).
279
+ - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
280
+ certificate delivered by the server through the tunnel (persist cert+key
281
+ locally; ~90-day renewals are pushed the same way). Add CORS headers for the
282
+ web-app origin so hls.js / `<video>` can fetch cross-origin.
283
+ - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
284
+ as fallback for hosts where no port could be opened.
285
+ - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
286
+ WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
287
+ `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
288
+ prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
289
+ symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
290
+ *global* v6) + STUN NAT pre-classification reported to the registry; then
291
+ the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
292
+ - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
293
+ announcements via the `bittorrent-dht` already bundled with WebTorrent.
294
+
295
+ All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
296
+
297
+ ## Disk hygiene (open item — torrent data is NOT cleaned up today)
298
+
299
+ HLS segments are handled (`server/OutputLifecycle.js`: idle TTL, `disposeSession`,
300
+ `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
301
+ (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
302
+ hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
303
+ removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
304
+ left by a previous hard kill at startup.
305
+
306
+ Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
307
+ file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
308
+ orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
309
+ whole torrents. (Shutdown teardown ✅ done.)
310
+ Level 2 (research): sliding-window chunk store. Full rationale in the parent
311
+ `../CLAUDE.md` "Disk hygiene" section.
312
+
313
+ ## Cloud proxy
314
+
315
+ The same proxy code also runs as the company-hosted fallback when the user
316
+ pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
317
+ rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
318
+ metered-egress clouds). Provider/economics analysis in the parent
319
+ `../CLAUDE.md` "Cloud proxy" section.
320
+
321
+ ## Changelog
322
+
323
+ Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
324
+ a new `## <version>` heading at the top, following the existing
325
+ `- **New**/**Fix**/**Chore**:` format.
326
+
327
+ **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
328
+ version …` which bumps it. Write the CHANGELOG entry at the version that bump
329
+ will produce: **current `package.json` version + 1 patch** (or + 1 minor).
330
+ Accumulate bullets into that single pending entry until it's published. See the
331
+ parent `../CLAUDE.md`.
332
+
333
+ ## Release
334
+
335
+ `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
336
+ own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
337
+
338
+ **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.