@torrent-tv/proxy 2.87.21 → 2.88.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (474) hide show
  1. package/.claude/commands/opsx/apply.md +155 -155
  2. package/.claude/commands/opsx/archive.md +160 -160
  3. package/.claude/commands/opsx/explore.md +174 -174
  4. package/.claude/commands/opsx/propose.md +109 -109
  5. package/.claude/commands/opsx/sync.md +143 -143
  6. package/.claude/skills/openspec-apply-change/SKILL.md +159 -159
  7. package/.claude/skills/openspec-archive-change/SKILL.md +117 -117
  8. package/.claude/skills/openspec-explore/SKILL.md +289 -289
  9. package/.claude/skills/openspec-propose/SKILL.md +113 -113
  10. package/.claude/skills/openspec-sync-specs/SKILL.md +147 -147
  11. package/.dockerignore +5 -5
  12. package/AGENTS.md +322 -322
  13. package/CHANGELOG.md +4 -0
  14. package/Dockerfile +30 -30
  15. package/LICENSE +16 -16
  16. package/README.md +369 -369
  17. package/assets/calibration/NOTICE.md +100 -100
  18. package/assets/diagnostics/sctpstate.gdb +31 -31
  19. package/bin/cli.js +684 -684
  20. package/bin/thread-pool.js +30 -30
  21. package/biome.json +411 -411
  22. package/docs/browser-proxy-contract.md +133 -133
  23. package/docs/container-architecture.md +218 -218
  24. package/docs/download-architecture.md +261 -261
  25. package/docs/encode-architecture.md +729 -729
  26. package/docs/encode-run-state.md +96 -96
  27. package/docs/logs.md +97 -97
  28. package/docs/socks5-egress-research.md +114 -114
  29. package/docs/storage-architecture.md +267 -267
  30. package/knip.json +14 -14
  31. package/openspec/changes/adaptive-bitrate/design.md +92 -92
  32. package/openspec/changes/adaptive-bitrate/proposal.md +56 -56
  33. package/openspec/changes/adaptive-bitrate/specs/adaptive-bitrate/spec.md +51 -51
  34. package/openspec/changes/adaptive-bitrate/tasks.md +40 -40
  35. package/openspec/changes/binary-distribution/.openspec.yaml +2 -2
  36. package/openspec/changes/binary-distribution/proposal.md +53 -53
  37. package/openspec/changes/chunked-request-bodies/design.md +81 -81
  38. package/openspec/changes/chunked-request-bodies/proposal.md +53 -53
  39. package/openspec/changes/chunked-request-bodies/specs/chunked-request-bodies/spec.md +30 -30
  40. package/openspec/changes/chunked-request-bodies/tasks.md +40 -40
  41. package/openspec/changes/cold-start/design.md +98 -98
  42. package/openspec/changes/cold-start/proposal.md +62 -62
  43. package/openspec/changes/cold-start/specs/cold-start/spec.md +47 -47
  44. package/openspec/changes/cold-start/tasks.md +48 -48
  45. package/openspec/changes/disk-cap/.openspec.yaml +2 -2
  46. package/openspec/changes/disk-cap/proposal.md +37 -37
  47. package/openspec/changes/disk-cap/specs/disk-cap/spec.md +25 -25
  48. package/openspec/changes/disk-cap/tasks.md +19 -19
  49. package/openspec/changes/proxy-observability/.openspec.yaml +2 -2
  50. package/openspec/changes/proxy-observability/design.md +38 -38
  51. package/openspec/changes/proxy-observability/proposal.md +49 -49
  52. package/openspec/changes/proxy-observability/specs/observability/spec.md +33 -33
  53. package/openspec/changes/proxy-observability/tasks.md +21 -21
  54. package/openspec/changes/seek-debounce/design.md +118 -118
  55. package/openspec/changes/seek-debounce/proposal.md +59 -59
  56. package/openspec/changes/seek-debounce/specs/seek-debounce/spec.md +41 -41
  57. package/openspec/changes/seek-debounce/tasks.md +33 -33
  58. package/openspec/changes/subtitle-language/.openspec.yaml +2 -2
  59. package/openspec/changes/subtitle-language/proposal.md +50 -50
  60. package/openspec/changes/subtitle-language/specs/subtitle-language/spec.md +34 -34
  61. package/openspec/changes/subtitle-language/tasks.md +26 -26
  62. package/openspec/changes/track-selection/.openspec.yaml +2 -2
  63. package/openspec/changes/track-selection/design.md +47 -47
  64. package/openspec/changes/track-selection/proposal.md +45 -45
  65. package/openspec/changes/track-selection/specs/track-selection/spec.md +41 -41
  66. package/openspec/changes/track-selection/tasks.md +20 -20
  67. package/openspec/changes/transcode-quality/.openspec.yaml +2 -2
  68. package/openspec/changes/transcode-quality/proposal.md +51 -51
  69. package/openspec/changes/transcode-quality/specs/transcode-quality/spec.md +139 -139
  70. package/openspec/changes/transcode-quality/tasks.md +63 -63
  71. package/openspec/config.yaml +38 -38
  72. package/package.json +50 -50
  73. package/public/.well-known/appspecific/com.chrome.devtools.json +1 -1
  74. package/research/delivery-wedge-stand-ladder-2026-09-13.md +329 -329
  75. package/research/double-spawn-2026-09-10.md +171 -171
  76. package/research/handover-2026-09-13.md +209 -209
  77. package/research/handover-reader-claims-removal-2026-09-12.md +166 -166
  78. package/research/piece-withdrawn-but-still-claimed-2026-09-12.md +175 -175
  79. package/research/preset-benchmark-size-scaling-2026-08-22.md +55 -55
  80. package/research/priority-map-is-the-truth-2026-09-12.md +225 -225
  81. package/routes/api/client-logs/post.js +86 -86
  82. package/routes/api/delivery-sink/get.js +72 -72
  83. package/routes/api/link-probe/get.js +51 -51
  84. package/routes/api/playback-plan/audio-tracks/post.js +29 -29
  85. package/routes/api/playback-plan/post.js +53 -53
  86. package/routes/api/sources/files/get.js +106 -100
  87. package/routes/api/sources/post.js +36 -36
  88. package/routes/api/sources/stats/get.js +132 -132
  89. package/routes/api/sources/warm/post.js +217 -217
  90. package/routes/api/subtitles/get.js +230 -230
  91. package/routes/api/transcode-sessions/fragment-far/post.js +60 -60
  92. package/routes/api/transcode-sessions/net-report/post.js +138 -138
  93. package/routes/api/transcode-sessions/post.js +173 -173
  94. package/routes/api/transcode-sessions/progress/get.js +27 -27
  95. package/routes/api/transcode-sessions/release/post.js +41 -41
  96. package/routes/api/transcode-sessions/seek/post.js +63 -63
  97. package/routes/health/get.js +13 -13
  98. package/routes/healthz/get.js +13 -13
  99. package/routes/stream/get.js +380 -380
  100. package/routes/transcode/audio-file/get.js +64 -64
  101. package/routes/transcode/audio-warm/get.js +84 -84
  102. package/routes/transcode/session-file/get.js +52 -52
  103. package/routes/transcode/variant-file/get.js +95 -95
  104. package/routes/transcode/variant-warm/get.js +84 -84
  105. package/scripts/render-run-graph.js +173 -173
  106. package/server.js +725 -725
  107. package/services/encode/CoverageMap.js +428 -428
  108. package/services/encode/CushionReport.js +345 -345
  109. package/services/encode/EncodeAdmission.js +376 -376
  110. package/services/encode/EncodeOrchestrator.js +1217 -1217
  111. package/services/encode/EncodePlan.js +1366 -1366
  112. package/services/encode/EncodeRun.js +813 -813
  113. package/services/encode/EncodeRuns.js +1235 -1235
  114. package/services/encode/Encoder.js +142 -142
  115. package/services/encode/EncoderSelection.js +38 -38
  116. package/services/encode/LocalObservations.js +359 -359
  117. package/services/encode/NvencEncoder.js +50 -50
  118. package/services/encode/OutputOpening.js +758 -758
  119. package/services/encode/OutputTimes.js +579 -579
  120. package/services/encode/QsvEncoder.js +58 -58
  121. package/services/encode/Renditions.js +2184 -2184
  122. package/services/encode/RunProgress.js +84 -84
  123. package/services/encode/SegmentDemand.js +95 -95
  124. package/services/encode/SoftwareEncoder.js +121 -121
  125. package/services/encode/V4l2m2mEncoder.js +53 -53
  126. package/services/encode/VaapiEncoder.js +66 -66
  127. package/services/encode/args.js +416 -416
  128. package/services/encode/available-share.js +89 -89
  129. package/services/encode/calibration.js +361 -361
  130. package/services/encode/contention.js +128 -128
  131. package/services/encode/decode-cost-fit.js +363 -363
  132. package/services/encode/encode-exit.js +114 -114
  133. package/services/encode/encode-run-state.js +551 -551
  134. package/services/encode/encoder-readings.js +45 -45
  135. package/services/encode/fingerprint.js +322 -322
  136. package/services/encode/host-load.js +174 -174
  137. package/services/encode/hwaccel.js +1894 -1894
  138. package/services/encode/index.js +9 -9
  139. package/services/encode/learned-median.js +90 -90
  140. package/services/encode/output/EncodedOutput.js +57 -57
  141. package/services/encode/output/Output.js +131 -131
  142. package/services/encode/output/OutputCatalog.js +414 -414
  143. package/services/encode/output/OutputSpec.js +390 -390
  144. package/services/encode/output/Timeline.js +308 -308
  145. package/services/encode/output/cut-grid.js +107 -107
  146. package/services/encode/output/index.js +20 -20
  147. package/services/encode/output/ladder.js +32 -32
  148. package/services/encode/output/playlists.js +284 -284
  149. package/services/encode/output/rates.js +125 -125
  150. package/services/encode/output-key-format.js +21 -21
  151. package/services/encode/quality/EncodeCost.js +1141 -1141
  152. package/services/encode/quality/HostLoad.js +525 -525
  153. package/services/encode/quality/HostTimings.js +249 -249
  154. package/services/encode/quality/OutputQualityState.js +28 -28
  155. package/services/encode/quality/QualityController.js +935 -935
  156. package/services/encode/quality/QualityOffer.js +416 -416
  157. package/services/encode/quality/drain-threat.js +47 -47
  158. package/services/encode/quality/link-budget.js +254 -254
  159. package/services/encode/quality/output-format.js +315 -315
  160. package/services/encode/quality/serving-output.js +216 -216
  161. package/services/encode/quality/visible-rung.js +57 -57
  162. package/services/encode/run-budget.js +97 -97
  163. package/services/encode/run-command.js +754 -754
  164. package/services/encode/run-costs.js +155 -155
  165. package/services/encode/run-inputs.js +42 -42
  166. package/services/encode/segment-formats/fmp4.js +456 -456
  167. package/services/encode/segment-formats/index.js +85 -85
  168. package/services/encode/segment-formats/init-compat.js +324 -324
  169. package/services/encode/segment-formats/mp4-boxes.js +515 -515
  170. package/services/encode/segment-formats/mpegts.js +134 -134
  171. package/services/encode/start-stop-cost.js +178 -178
  172. package/services/encode/throughput.js +97 -97
  173. package/services/encode/torrent-cost.js +88 -88
  174. package/services/identity/installation-id.js +38 -38
  175. package/services/media/ContainerOrchestrator.js +149 -149
  176. package/services/media/KeyframeTables.js +316 -316
  177. package/services/media/SourceFile.js +298 -298
  178. package/services/media/SubtitleCues.js +520 -520
  179. package/services/media/SubtitleOrchestrator.js +167 -167
  180. package/services/media/audio-inventory.js +245 -245
  181. package/services/media/container/AviContainer.js +266 -266
  182. package/services/media/container/Container.js +603 -603
  183. package/services/media/container/ContainerFactory.js +56 -56
  184. package/services/media/container/KeyframeTable.js +272 -272
  185. package/services/media/container/MatroskaContainer.js +1494 -1494
  186. package/services/media/container/Mp4Container.js +1244 -1244
  187. package/services/media/container/SubtitleFileContainer.js +322 -322
  188. package/services/media/container/ebml-reader.js +159 -159
  189. package/services/media/ffmpeg-banner.js +260 -260
  190. package/services/media/keyframe-probe.js +157 -157
  191. package/services/media/media-info-probe.js +93 -93
  192. package/services/media/playback-planner.js +931 -931
  193. package/services/media/tracks/AudioTrack.js +131 -131
  194. package/services/media/tracks/ContainerTrack.js +75 -75
  195. package/services/media/tracks/ImageSubtitleTrack.js +19 -19
  196. package/services/media/tracks/SubtitleTrack.js +38 -38
  197. package/services/media/tracks/TextSubtitleTrack.js +287 -287
  198. package/services/media/tracks/VideoTrack.js +33 -33
  199. package/services/media/tracks/index.js +15 -15
  200. package/services/media/tracks/language-detect.js +174 -174
  201. package/services/server/OutputLifecycle.js +418 -418
  202. package/services/server/SegmentServing.js +1150 -1150
  203. package/services/server/ViewerRequests.js +760 -760
  204. package/services/server/WaitLedger.js +142 -142
  205. package/services/server/controllers/PlaybackController.js +40 -40
  206. package/services/server/controllers/SubtitleController.js +109 -109
  207. package/services/server/http-responses.js +60 -60
  208. package/services/server/playback-readiness.js +696 -696
  209. package/services/server/transcode-session-files.js +325 -325
  210. package/services/server/wire-outputs.js +992 -992
  211. package/services/storage/Diagnostics.js +202 -202
  212. package/services/storage/MachineBudget.js +235 -235
  213. package/services/storage/allowance.js +107 -107
  214. package/services/storage/core-dumps.js +106 -106
  215. package/services/storage/files/CompletedFiles.js +391 -391
  216. package/services/storage/files/piece-from-whole-file.js +118 -118
  217. package/services/storage/free.js +71 -71
  218. package/services/storage/keep.js +48 -48
  219. package/services/storage/machine-memory.js +56 -56
  220. package/services/storage/memory-report.js +575 -575
  221. package/services/storage/piece-store/piece-disk-store.js +539 -539
  222. package/services/storage/piece-store/piece-lru.js +495 -495
  223. package/services/storage/piece-store/shared-piece-store.js +1931 -1931
  224. package/services/storage/returns.js +103 -103
  225. package/services/storage/segment-store/SegmentStore.js +1240 -1240
  226. package/services/storage/wire.js +175 -175
  227. package/services/torrent/Contents.js +382 -324
  228. package/services/torrent/demand/DemandRegister.js +202 -202
  229. package/services/torrent/demand/Urgency.js +137 -137
  230. package/services/torrent/demand/Window.js +118 -118
  231. package/services/torrent/demand/index.js +8 -8
  232. package/services/torrent/demand/pieces.js +140 -140
  233. package/services/torrent/download/SwarmSelection.js +386 -386
  234. package/services/torrent/download/registry.js +102 -102
  235. package/services/torrent/download/withdraw-claim.js +80 -80
  236. package/services/torrent/episode-naming.js +182 -0
  237. package/services/torrent/files.js +455 -455
  238. package/services/torrent/naming.js +619 -619
  239. package/services/torrent/piece-store-of.js +29 -29
  240. package/services/torrent/supply-margin.js +262 -262
  241. package/services/torrent/torrent-pool.js +2675 -2675
  242. package/services/torrent/worker/background-fill.js +213 -213
  243. package/services/torrent/worker/channel.js +271 -271
  244. package/services/torrent/worker/client.js +765 -765
  245. package/services/torrent/worker/fastest-wires.js +342 -342
  246. package/services/torrent/worker/handle-state.js +23 -23
  247. package/services/torrent/worker/held-bytes.js +155 -155
  248. package/services/torrent/worker/install-webrtc-shim.js +32 -32
  249. package/services/torrent/worker/piece-reader.js +1078 -1078
  250. package/services/torrent/worker/pool-adapter.js +371 -371
  251. package/services/torrent/worker/protocol.js +184 -184
  252. package/services/torrent/worker/resume-warm.js +107 -107
  253. package/services/torrent/worker/webrtc-shim.js +219 -219
  254. package/services/torrent/worker/worker.js +1129 -1129
  255. package/services/transport/data-channel-handler.js +1369 -1369
  256. package/services/transport/delivery-probe.js +842 -842
  257. package/services/transport/health-collector.js +53 -53
  258. package/services/transport/nat-classifier.js +231 -231
  259. package/services/transport/packet-witness.js +808 -808
  260. package/services/transport/port-mapper.js +235 -235
  261. package/services/transport/registry-api.js +81 -81
  262. package/services/transport/tunnel-client.js +447 -447
  263. package/services/transport/usrsctp-state.js +175 -175
  264. package/services/transport/webrtc-manager.js +484 -484
  265. package/services/viewer/Assignments.js +340 -340
  266. package/services/viewer/PriorityMap.js +390 -390
  267. package/services/viewer/PriorityOrchestrator.js +325 -325
  268. package/services/viewer/Viewer.js +691 -691
  269. package/services/viewer/Viewers.js +368 -368
  270. package/services/viewer/active-output.js +37 -37
  271. package/services/viewer/audio-start.js +46 -46
  272. package/services/viewer/buffer-trend.js +81 -81
  273. package/services/viewer/choices.js +647 -647
  274. package/services/viewer/positions.js +126 -126
  275. package/services/viewer/report-intake.js +46 -46
  276. package/store/source-registry.js +71 -71
  277. package/test/asset-paths.test.js +28 -28
  278. package/test/audio-inventory.test.js +212 -212
  279. package/test/audio-track-bitrate.test.js +40 -40
  280. package/test/auto-quality-step.test.js +707 -707
  281. package/test/available-share.test.js +76 -76
  282. package/test/background-fill.test.js +190 -190
  283. package/test/client-log-file.test.js +110 -110
  284. package/test/completed-files.test.js +115 -115
  285. package/test/concurrent-cost.test.js +148 -148
  286. package/test/container-media-info.test.js +228 -228
  287. package/test/contention.test.js +76 -76
  288. package/test/core-dumps.test.js +57 -57
  289. package/test/coverage-follows-the-disk.test.js +228 -228
  290. package/test/coverage-map.test.js +195 -195
  291. package/test/cue-push-carries-what-the-walk-found.test.js +58 -58
  292. package/test/cut-times-timeline.test.js +65 -65
  293. package/test/cuts-follow-published-grid.test.js +109 -109
  294. package/test/data-channel-frame.test.js +63 -63
  295. package/test/data-channel-viewer-lifecycle.test.js +92 -92
  296. package/test/dead-torrent-handle.test.js +52 -52
  297. package/test/declared-rates.test.js +116 -116
  298. package/test/declared-tracks.test.js +43 -43
  299. package/test/decode-cost-fit.test.js +202 -202
  300. package/test/decode-cost.test.js +462 -462
  301. package/test/delivery-probe.test.js +393 -393
  302. package/test/demand-register.test.js +206 -206
  303. package/test/dht-bootstrap.test.js +72 -72
  304. package/test/drain-threat.test.js +65 -65
  305. package/test/duplicate-add.test.js +48 -48
  306. package/test/encode-admission.test.js +146 -146
  307. package/test/encode-cost.test.js +283 -283
  308. package/test/encode-exit.test.js +111 -111
  309. package/test/encode-orchestrator.test.js +419 -419
  310. package/test/encode-plan-viewers.test.js +718 -718
  311. package/test/encode-plan.test.js +545 -545
  312. package/test/encode-run-state.test.js +314 -314
  313. package/test/encode-run.test.js +162 -162
  314. package/test/encode-slope.test.js +46 -46
  315. package/test/encoded-output.test.js +39 -39
  316. package/test/encoder-kinds.test.js +122 -122
  317. package/test/encoder-readings.test.js +46 -46
  318. package/test/episode-naming.test.js +131 -0
  319. package/test/every-claimant-is-told-its-share.test.js +152 -152
  320. package/test/failed-encoder-still-serves-what-exists.test.js +354 -354
  321. package/test/failed-start-breaker.test.js +202 -202
  322. package/test/fastest-wires.test.js +143 -143
  323. package/test/ffmpeg-stream-counts.test.js +78 -78
  324. package/test/file-edges.test.js +191 -191
  325. package/test/fmp4-presentation-clock.test.js +147 -147
  326. package/test/fmp4-self-contained.test.js +80 -80
  327. package/test/fmp4-timestamps.test.js +140 -140
  328. package/test/fmp4-track-completeness.test.js +41 -41
  329. package/test/format-keyed-outputs.test.js +78 -78
  330. package/test/health-metrics.test.js +38 -38
  331. package/test/held-request-width.test.js +157 -157
  332. package/test/helpers/encode-run.js +136 -136
  333. package/test/helpers/held-file.js +29 -29
  334. package/test/helpers/manager.js +57 -57
  335. package/test/helpers/output-spec.js +63 -63
  336. package/test/host-load.test.js +68 -68
  337. package/test/index-accuracy-is-about-the-file.test.js +128 -128
  338. package/test/init-compat.test.js +219 -219
  339. package/test/input-lost-quiets-the-plan.test.js +261 -261
  340. package/test/input-unavailable.test.js +48 -48
  341. package/test/installation-id.test.js +39 -39
  342. package/test/keeping-period.test.js +83 -83
  343. package/test/keyframe-index-accuracy.test.js +188 -188
  344. package/test/keyframe-table-budget.test.js +102 -102
  345. package/test/keyframes-belong-to-the-file.test.js +249 -249
  346. package/test/learned-median.test.js +37 -37
  347. package/test/letting-go-asks-who-is-watching.test.js +191 -191
  348. package/test/limit-row-by-area.test.js +60 -60
  349. package/test/link-budget.test.js +111 -111
  350. package/test/link-probe.test.js +56 -56
  351. package/test/local-encoding-data.test.js +273 -273
  352. package/test/logger-repeats.test.js +134 -134
  353. package/test/look-ahead-coverage.test.js +56 -56
  354. package/test/manager-surface.test.js +292 -292
  355. package/test/matroska-cues-track.test.js +192 -192
  356. package/test/memory-budget.test.js +390 -390
  357. package/test/move-cost.test.js +216 -216
  358. package/test/mp4-subtitles.test.js +173 -173
  359. package/test/one-authority.test.js +285 -285
  360. package/test/one-budget.test.js +149 -149
  361. package/test/one-output-one-session.test.js +204 -204
  362. package/test/one-resource-divided.test.js +185 -185
  363. package/test/one-serving-output-per-height.test.js +458 -458
  364. package/test/orchestrator-wired.test.js +206 -206
  365. package/test/output-catalog.test.js +39 -39
  366. package/test/output-shape.test.js +21 -21
  367. package/test/output-spec.test.js +251 -251
  368. package/test/output-speed.test.js +88 -88
  369. package/test/outputs-being-prepared.test.js +40 -40
  370. package/test/packet-witness-ring.test.js +236 -236
  371. package/test/packet-witness.test.js +148 -148
  372. package/test/piece-disk-store.test.js +401 -401
  373. package/test/piece-from-whole-file.test.js +129 -129
  374. package/test/piece-lru.test.js +319 -319
  375. package/test/piece-reader.test.js +162 -162
  376. package/test/piece-selection-offset.test.js +85 -85
  377. package/test/piece-store-eviction.test.js +595 -595
  378. package/test/piece-store-never-refuses.test.js +153 -153
  379. package/test/piece-store-reservations.test.js +403 -403
  380. package/test/piece-store-slow-disk.test.js +159 -159
  381. package/test/piece-tail.test.js +97 -97
  382. package/test/plan-host-timings.test.js +68 -68
  383. package/test/plan-is-steady.test.js +225 -225
  384. package/test/playback-readiness.test.js +453 -453
  385. package/test/playback-start-regressions.test.js +99 -99
  386. package/test/priority-map-download.test.js +174 -174
  387. package/test/priority-map-emptied.test.js +204 -204
  388. package/test/priority-map-per-output.test.js +215 -215
  389. package/test/priority-map.test.js +163 -163
  390. package/test/probe-wedge-certainty.test.js +60 -60
  391. package/test/produced-copy-choice.test.js +213 -213
  392. package/test/published-timeline.test.js +83 -83
  393. package/test/quality-offer.test.js +162 -162
  394. package/test/quality-variants.test.js +1229 -1229
  395. package/test/rate-control-in-the-output.test.js +180 -180
  396. package/test/read-survives-withdrawal.test.js +164 -164
  397. package/test/read-window.test.js +365 -365
  398. package/test/resume-warm.test.js +39 -39
  399. package/test/run-graph-drift.test.js +37 -37
  400. package/test/run-inputs.test.js +80 -80
  401. package/test/run-intervals.test.js +100 -100
  402. package/test/run-position-follows-published-grid.test.js +89 -89
  403. package/test/run-progress.test.js +65 -65
  404. package/test/same-height-switch.test.js +664 -664
  405. package/test/seek-frees-the-viewers-requests.test.js +217 -217
  406. package/test/seek-landing.test.js +109 -109
  407. package/test/seek-target-not-superseded.test.js +195 -195
  408. package/test/segment-closed-on-both-branches.test.js +96 -96
  409. package/test/segment-cut-times.test.js +63 -63
  410. package/test/segment-demand.test.js +80 -80
  411. package/test/segment-hold-supersede.test.js +91 -91
  412. package/test/segment-judged-by-its-own-header.test.js +221 -221
  413. package/test/segment-serve-wiring.test.js +475 -475
  414. package/test/segment-store-eviction.test.js +247 -247
  415. package/test/segment-store.test.js +323 -323
  416. package/test/segment-true-start.test.js +86 -86
  417. package/test/segments-are-shared.test.js +176 -176
  418. package/test/send-chunk-bytes.test.js +86 -86
  419. package/test/serving-existing-output.test.js +102 -102
  420. package/test/serving-output.test.js +102 -102
  421. package/test/shared-piece-store.test.js +310 -310
  422. package/test/sidecar-naming.test.js +142 -142
  423. package/test/source-file.test.js +133 -133
  424. package/test/source-files-route.test.js +12 -2
  425. package/test/source-registry.test.js +18 -18
  426. package/test/split-a-stretch.test.js +139 -139
  427. package/test/stale-request-after-seek.test.js +158 -158
  428. package/test/startup-readings.test.js +124 -124
  429. package/test/stream-route.test.js +209 -209
  430. package/test/subtitle-cue-framing.test.js +200 -200
  431. package/test/subtitle-cue-source.test.js +102 -102
  432. package/test/subtitle-cue-walk.test.js +370 -370
  433. package/test/subtitle-cursor.test.js +63 -63
  434. package/test/subtitle-defaults.test.js +118 -118
  435. package/test/subtitle-language.test.js +252 -252
  436. package/test/subtitle-track-numbering.test.js +386 -386
  437. package/test/supply-margin.test.js +177 -177
  438. package/test/swarm-follows-readers.test.js +174 -174
  439. package/test/swarm-reach.test.js +130 -130
  440. package/test/swarm-selection.test.js +220 -220
  441. package/test/tail-duplication.test.js +167 -167
  442. package/test/the-channel-has-both-ends.test.js +91 -91
  443. package/test/the-torrent-thread-serves-bytes.test.js +107 -107
  444. package/test/thread-pool.test.js +53 -53
  445. package/test/timeline.test.js +84 -84
  446. package/test/torrent-contents.test.js +235 -235
  447. package/test/torrent-cost.test.js +71 -71
  448. package/test/torrent-files.test.js +221 -221
  449. package/test/torrent-naming.test.js +255 -255
  450. package/test/tracks-begin-together.test.js +209 -209
  451. package/test/tunnel-renewal.test.js +167 -167
  452. package/test/two-viewers-one-picture.test.js +407 -407
  453. package/test/upload-hurry.test.js +186 -186
  454. package/test/usrsctp-state.test.js +131 -131
  455. package/test/video-facts.test.js +102 -102
  456. package/test/viewer-assignments.test.js +143 -143
  457. package/test/viewer-outputs.test.js +285 -285
  458. package/test/viewer-presence.test.js +116 -116
  459. package/test/viewer-requests-admission.test.js +89 -89
  460. package/test/viewer-states.test.js +189 -189
  461. package/test/viewer-subtitle-subscription.test.js +96 -96
  462. package/test/viewer.test.js +139 -139
  463. package/test/viewing-generations.test.js +390 -390
  464. package/test/visible-rung.test.js +37 -37
  465. package/test/wait-ledger.test.js +100 -100
  466. package/test/webrtc-shim.test.js +149 -149
  467. package/test/wedge-certainty.test.js +131 -131
  468. package/test/withdraw-piece-claim.test.js +212 -212
  469. package/test/worker-channel.test.js +158 -158
  470. package/utils/client-log-file.js +151 -151
  471. package/utils/logger.js +312 -312
  472. package/utils/parse-range.js +25 -25
  473. package/utils/perf.js +59 -59
  474. package/utils/torrent-source-key.js +38 -38
package/AGENTS.md CHANGED
@@ -1,322 +1,322 @@
1
- # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
-
3
- Downloads a torrent and streams the chosen file to the browser, transcoding to
4
- HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
- and release process.
6
-
7
- ## Deployment-agnostic — important
8
-
9
- The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
- all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
- devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
- detection must probe at runtime and fall back gracefully; do not assume a
13
- Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
-
15
- ## Layout
16
-
17
- Browser request and response fields, compatibility defaults, and status meanings
18
- are recorded in `docs/browser-proxy-contract.md`.
19
-
20
- - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
21
- else bundled ffmpeg-static, else PATH `ffmpeg`).
22
- - `server.js` — the composition root: creates Fastify, initializes process-wide
23
- resources, calls `services/server/wire-outputs.js` for the output and encode
24
- service graph, registers each route explicitly, and passes its dependencies.
25
- `wire-outputs.js` is a subordinate assembler for that graph; it does not
26
- create the HTTP server or register routes.
27
- - `routes/<path>/<method>.js` — same convention as the server repo.
28
- - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
29
- - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
30
- - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
31
- long-polls while a segment is being produced, returns retryable 503 (never
32
- 202 — hls.js can't consume it).
33
- - `services/`:
34
- - `torrent/demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
35
- range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
36
- `DemandRegister` (live windows by claimant), `pieces.js` (the one place
37
- bytes become piece numbers). No WebTorrent, no piece store, no pieces.
38
- - `torrent/download/` — `SwarmSelection`, the ONLY thing that calls `select`,
39
- `deselect` or `critical`, and `registry.js`, which holds one per torrent and
40
- owns the cross-torrent rule that withholds the speculative levels while
41
- anything urgent is missing anywhere. See `docs/download-architecture.md`.
42
- - `encode/output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
43
- `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
44
- packaged how — and therefore its identity: two outputs whose parameters
45
- agree ARE the same output, and the encoded result is reused by definition.
46
- Nothing about a VIEWER appears in it (not the consumer id, not where they
47
- started, not their viewport), and nothing about the request that does not
48
- change a byte of the result. `server/ViewerRequests.js` builds one and keys
49
- the output on it.
50
- - **`media/` — THE MEDIA LAYER, one directory, and it answers ONE question:
51
- what does a FILE say about itself.** Its containers, its tracks, where its
52
- keyframes are, how long it runs, and the plan for playing it. Every fact in
53
- it is born when a header is read, dies when the file is forgotten, and is
54
- addressed by the file — which is the test that put them together. It used to
55
- be four places at two levels (`container/`, `tracks/`, half of
56
- `orchestrators/`, and `playback-planner.js` loose in `services/`), so the
57
- layer could not be put under an import rule and the rule was written per
58
- directory instead.
59
- Inside it, the DOMAIN is `media/container/` and `media/tracks/`: they import
60
- nothing but each other, this proxy's own logger included. The application
61
- files sit flat beside them — `ContainerOrchestrator`, `KeyframeTables`,
62
- `SubtitleOrchestrator`, `playback-planner.js`, `keyframe-probe.js`,
63
- `ffmpeg-banner.js`, `audio-inventory.js` — and may reach their own domain and
64
- the logger and nothing else. What a torrent CONTAINS, which clusters may be
65
- read, where a viewer stands, what an encoder costs: all handed in. Both
66
- reaches that existed are gone — `torrent-worker/subtitle-cues.js` is given to
67
- `SubtitleOrchestrator` by `server.js`, and `torrent/Contents.js` to the
68
- planner — so this layer can be exercised with plain values, no torrent, no
69
- thread and no disk. Checked by breaking it in every direction.
70
- - **The parse happens on the MAIN thread, and the torrent thread serves
71
- bytes.** It used to parse containers too — tracks, media info, keyframe
72
- index — and carry each answer back over the channel, on the stated ground
73
- that "the main thread cannot open a read stream on one of its files". True
74
- of WebTorrent's API, not of the bytes: a container is built from one
75
- function, `readRange(start, end)`, the pieces live in shared memory, and
76
- `WorkerTorrentPool.readRangeOf` is the read that serves every segment — it
77
- waits for what has not arrived and steers the swarm toward it. That split
78
- is what made "where is this fact kept" a question at all; with one thread it
79
- does not arise. NOTHING in that thread reaches into the media layer now —
80
- the subtitle cue walk was the last, and it is handed which byte ranges of a
81
- file are downloaded WHOLE (one list per pass, not a question per cluster)
82
- plus a store read that never fetches, both in
83
- `torrent/worker/held-bytes.js`. A piece arriving is ANNOUNCED
84
- (`PIECES_ARRIVED`) rather than acted on there. Pinned by
85
- `test/the-torrent-thread-serves-bytes.test.js`.
86
- - `media/container/` — domain: `Container` (abstract, RFC 9559 / ISO 14496-12),
87
- `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
88
- (sniff 16 bytes → precise subclass), `KeyframeTable`. See
89
- `docs/container-architecture.md`.
90
- - `media/tracks/` — domain: `ContainerTrack` (base: TrackNumber, declaredIndex,
91
- language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
92
- `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
93
- `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
94
- RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
95
- track_enabled / alternate_group, elng BCP47).
96
- - `media/` application files: `ContainerOrchestrator` (detect + per-file
97
- cache of CONTAINERS, `getTracks`/`getMediaInfo`/`getKeyframeIndex` — it
98
- caches the container, never the answers, so nothing here is a second store
99
- of a fact somebody else owns), `KeyframeTables`,
100
- `SubtitleOrchestrator` (the track list and the cues behind
101
- `Container` tracks, warm/push — it is handed the walk, and `server.js` is
102
- what puts the two together), `SubtitleCues` (the walk itself: the plan, the
103
- found-order cursor, one walk of a file at a time). The walk
104
- itself is `MatroskaContainer.walkHeldClusters` / `Mp4Container.readHeldSamples`;
105
- what the torrent supplies is `held-bytes.js` — which ranges are downloaded
106
- whole, and a read of one that never fetches.
107
- **`KeyframeTables` is where a file's keyframe table lives and the only thing
108
- that reads one.** The table is `container/KeyframeTable.js`, ONE object per
109
- file, handed out rather than copied — so a read that lands after a session
110
- was made still reaches it, which a value could not. It answers two questions
111
- that a bag of probe fields could not tell apart: `answered` (a reader came
112
- back) and `readable` (it came back with times). The first distinguishes a
113
- file that must be re-encoded for ever from a passing shortage of bytes off
114
- the swarm. One read per file whoever asks, the second asker joins the first,
115
- each caller's wait is bounded by the measured `KEYFRAME_TABLE_BUDGET_MS`
116
- while the READ is not, and a read that threw is never recorded as an answer.
117
- It is the ONLY store of the table: the container reads and does not
118
- remember, so there is one object per file and nothing to keep in step. The second reader is the packet probe in
119
- `media/keyframe-probe.js`, which decodes rather than parsing; the fuller of the
120
- two answers is the one that stands (`media/keyframe-probe.js`).
121
- - `server/controllers/` — interface layer: `PlaybackController` / `SubtitleController`
122
- (thin adapters over orchestrators; routes depend on controllers, not services).
123
- `routes/*` are now thin HTTP translators. A controller reaches every layer
124
- below it THROUGH its orchestrator and never around it, which biome checks —
125
- so what an orchestrator needs from another layer is composed in `server.js`
126
- and passed in.
127
- - Everything a container states about ITSELF lives in its own class: the
128
- track table, the Cues, the keyframe times they name, the cluster positions,
129
- the blocks inside a cluster, the MP4 sample table, and the walk of what is
130
- downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
131
- is the format's byte-level grammar, not its statements, and is the only
132
- piece kept apart. `ContainerFactory` is the ONE place that decides what a
133
- file is — by sniffing the header, since that is what the muxer wrote — and
134
- that is it. `ContainerFactory.readKeyframeIndex` is gone: it existed only for
135
- the session manager's own HTTP read of a container, which is deleted.
136
- - `docs/download-architecture.md` — the two axes of downloading: what is
137
- wanted (`demand/`) against what the swarm is told (`download/`), why urgency
138
- is not a number given to the library, and why the speculative levels are
139
- withdrawn rather than lowered.
140
- - **The storage layer — ONE layer, FOUR directories.** Bytes on a medium with
141
- a limit is the property they share; what holds them are three different
142
- things with different lifetimes, different addresses and different THREADS,
143
- so they are not flattened into one:
144
- - `storage/piece-store/` — the torrent's pieces: memory tier, spill tier, and the
145
- order they leave in (`shared-piece-store.js`, `piece-lru.js`,
146
- `piece-disk-store.js`). Lives in the torrent WORKER thread.
147
- - `storage/segment-store/` — the segments an encoder has produced
148
- (`SegmentStore.js`), addressed by the output's own key. Main thread.
149
- - `storage/files/` — files downloaded whole and kept as files
150
- (`CompletedFiles.js`, `piece-from-whole-file.js`). Worker thread.
151
- - `storage/` — THE ONE BUDGET: how much of this machine the proxy may
152
- take, and how that is divided between everything that holds bytes.
153
- `MachineBudget.js` is the single owner; `allowance.js` the rule;
154
- `machine-memory.js` and `free.js` read the machine; `wire.js` says who
155
- the claimants are and which RESOURCE each takes; `keep.js` and
156
- `returns.js` say how long material nobody is using is kept. It holds no
157
- bytes itself.
158
- **One budget does not mean one number.** Memory cannot be paid for with
159
- disk, so what is divided is divided per resource — and "disk" is one
160
- resource per DEVICE, read with `statSync(dir).dev`, because two
161
- filesystems cannot pay for each other either (`/tmp` and `/data` on the
162
- addon host are two). What there is ONE of is the owner, the policy and
163
- the place that reads the machine. One owner because the claimants TRADE
164
- across resources: pieces that do not fit in memory are spilled to disk,
165
- so what memory is given decides how much disk is needed — 14 400 MB
166
- spilled in fifty minutes while the store held 312-424 MB.
167
- The policy is the operator's, stated once at startup — `--budget
168
- adaptive|share|fixed`, `--budget-share`, `--budget-bytes`,
169
- `--min-memory-bytes`, `--min-disk-bytes` — and those are the only
170
- chosen numbers in the proxy, because they are chosen by the person whose
171
- machine it is. The default is the measured one.
172
- They may import each other and nothing above, which `biome` checks as an
173
- EXCEPTION to `../**` rather than as a list of forbidden layers — a layer is
174
- not a directory, the blanket form cannot say "my siblings", and a list of
175
- names misses whatever it forgets.
176
- - `docs/storage-architecture.md` — the three things that write to one disk, the
177
- two rules that remove material (nobody needs it, or there is no room), the
178
- order the viewers give that removal, why a spilled piece is a file of its
179
- own, and what is still not solved.
180
- - `docs/encode-architecture.md` — who decides where encoders go, and the
181
- answer is one authority: `EncodePlan`, from what is made, what is being
182
- made, what is wanted and what the host can hold. Why no viewer reaches it,
183
- why the priority map is read at two scopes (per FILE for the swarm, per
184
- OUTPUT for the encoders), and what each of the eight other places that used
185
- to place or kill an encoder now states instead.
186
- - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
187
- is in TWO places split by phase: on the droplet while a transport is being
188
- acquired and at unload, on THIS proxy for the whole of a viewing
189
- (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
190
- Read both before concluding anything from a half-session.
191
- - `media/playback-planner.js` — single ffmpeg probe returns audioCodec,
192
- videoCodec, container, durationSeconds. `mode` is advisory; the browser
193
- decides. `media/keyframe-probe.js` beside it is the OTHER reading of the same
194
- file, by decoding rather than by parsing, for containers that state no index.
195
- - `server/` — what a request does, one operation at a time, and nothing
196
- that lives longer than the operation: `ViewerRequests` (open an output of a
197
- file and be placed on it, state a position, report progress),
198
- `SegmentServing` (answer a playlist, init or segment request from the store,
199
- or hold it until the piece is whole), `OutputLifecycle` (dispose an output
200
- nobody is on, all of them at shutdown, adopt what an earlier process left),
201
- and `wire-outputs.js`, which builds the components and hands each the narrow
202
- host it reads. `hls-session-manager.js` is gone (2.87.0): each of its members
203
- is a method of the component that owns it. The operations own no long-lived
204
- fact: the init served for an output is kept by `SegmentStore`, the bytes read
205
- for an output by `EncodeRuns`, the cold-start measurement by `HostTimings`.
206
- They import no component's implementation — only the name of an output and
207
- of its playlist (`encode/output/index.js`) and the keeping period
208
- (`storage/keep.js`); biome checks it. A held request waits for the store's
209
- publication event, as long as the requester states (`X-Hold-Ms`) and no
210
- longer than it stays.
211
- - `encode/` beside the orchestrator: `OutputOpening` (which output answers a
212
- request for a file, made if it is not here yet — without knowing who asked),
213
- `EncodeRuns` (build a run where the plan places it, follow it, account for
214
- its end, and what its input has received), `EncoderSelection` (the encoder
215
- in use and the move to software), `Renditions` (the steps of a picture and
216
- its soundtracks, the master playlist, and which rung a viewer's page says it
217
- plays), `OutputTimes` (where each segment begins and how the cut table is
218
- corrected), `CushionReport` (how much film is ready in front of the
219
- viewers), `output-key-format.js` (which container a key names).
220
- - `viewer/`: every viewer has a name (`Viewers.of` refuses an empty one); the
221
- relation to outputs is stored only in `Viewer.outputs` and read the other way
222
- by `Viewers.forOutput`. A quality request belongs to one viewer and exists
223
- only in AUTO (`Viewer.askQuality`).
224
- - `torrent/` reaches the piece store by what it does (`piece-store-of.js`) and
225
- is handed the store's class by `torrent/worker/worker.js`, where that thread
226
- is assembled. `transport/` imports nothing of another component; `bin/cli.js`
227
- hands it the memory reading and the rule for which captures are kept.
228
- - `encode/hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
229
- STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
230
- verify each segment decodes independently (catches non-IDR/corrupted hw
231
- output). Falls back to software libx264. Runtime fallback to software if a
232
- hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
233
- - `transport/data-channel-handler.js` — forwards WebRTC data-channel requests to the
234
- local HTTP server (loopback), so the same routes serve both transports.
235
-
236
- ## Gotchas
237
-
238
- - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
239
- - A transitive dep (`ip-set`, via webtorrent) ships a hostile
240
- `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
241
- around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
242
- if you ever change install flow, keep that in mind.
243
-
244
- ## Planned: public reachability (remote access)
245
-
246
- Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
247
-
248
- - **Auto port mapping** — IMPLEMENTED (`services/transport/port-mapper.js`, changelog
249
- 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
250
- same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
251
- auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
252
- Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
253
- `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
254
- **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
255
- mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
256
- Also pending (next iteration): a success log line in `transport/port-mapper.js` `stop()`
257
- (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
258
- clean unmap on shutdown is silent.
259
- - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
260
- is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
261
- mapping success and on every tunnel (re)connect; the server dial-back-verifies
262
- reachability (server 0.8.22, roadmap step 2).
263
- - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
264
- certificate delivered by the server through the tunnel (persist cert+key
265
- locally; ~90-day renewals are pushed the same way). Add CORS headers for the
266
- web-app origin so hls.js / `<video>` can fetch cross-origin.
267
- - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
268
- as fallback for hosts where no port could be opened.
269
- - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
270
- WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
271
- `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
272
- prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
273
- symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
274
- *global* v6) + STUN NAT pre-classification reported to the registry; then
275
- the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
276
- - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
277
- announcements via the `bittorrent-dht` already bundled with WebTorrent.
278
-
279
- All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
280
-
281
- ## Disk hygiene (open item — torrent data is NOT cleaned up today)
282
-
283
- HLS segments are handled (`server/OutputLifecycle.js`: idle TTL, `disposeSession`,
284
- `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
285
- (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
286
- hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
287
- removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
288
- left by a previous hard kill at startup.
289
-
290
- Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
291
- file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
292
- orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
293
- whole torrents. (Shutdown teardown ✅ done.)
294
- Level 2 (research): sliding-window chunk store. Full rationale in the parent
295
- `../CLAUDE.md` "Disk hygiene" section.
296
-
297
- ## Cloud proxy
298
-
299
- The same proxy code also runs as the company-hosted fallback when the user
300
- pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
301
- rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
302
- metered-egress clouds). Provider/economics analysis in the parent
303
- `../CLAUDE.md` "Cloud proxy" section.
304
-
305
- ## Changelog
306
-
307
- Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
308
- a new `## <version>` heading at the top, following the existing
309
- `- **New**/**Fix**/**Chore**:` format.
310
-
311
- **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
312
- version …` which bumps it. Write the CHANGELOG entry at the version that bump
313
- will produce: **current `package.json` version + 1 patch** (or + 1 minor).
314
- Accumulate bullets into that single pending entry until it's published. See the
315
- parent `../CLAUDE.md`.
316
-
317
- ## Release
318
-
319
- `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
320
- own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
321
-
322
- **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.
1
+ # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
+
3
+ Downloads a torrent and streams the chosen file to the browser, transcoding to
4
+ HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
+ and release process.
6
+
7
+ ## Deployment-agnostic — important
8
+
9
+ The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
+ all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
+ devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
+ detection must probe at runtime and fall back gracefully; do not assume a
13
+ Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
+
15
+ ## Layout
16
+
17
+ Browser request and response fields, compatibility defaults, and status meanings
18
+ are recorded in `docs/browser-proxy-contract.md`.
19
+
20
+ - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
21
+ else bundled ffmpeg-static, else PATH `ffmpeg`).
22
+ - `server.js` — the composition root: creates Fastify, initializes process-wide
23
+ resources, calls `services/server/wire-outputs.js` for the output and encode
24
+ service graph, registers each route explicitly, and passes its dependencies.
25
+ `wire-outputs.js` is a subordinate assembler for that graph; it does not
26
+ create the HTTP server or register routes.
27
+ - `routes/<path>/<method>.js` — same convention as the server repo.
28
+ - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
29
+ - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
30
+ - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
31
+ long-polls while a segment is being produced, returns retryable 503 (never
32
+ 202 — hls.js can't consume it).
33
+ - `services/`:
34
+ - `torrent/demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
35
+ range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
36
+ `DemandRegister` (live windows by claimant), `pieces.js` (the one place
37
+ bytes become piece numbers). No WebTorrent, no piece store, no pieces.
38
+ - `torrent/download/` — `SwarmSelection`, the ONLY thing that calls `select`,
39
+ `deselect` or `critical`, and `registry.js`, which holds one per torrent and
40
+ owns the cross-torrent rule that withholds the speculative levels while
41
+ anything urgent is missing anywhere. See `docs/download-architecture.md`.
42
+ - `encode/output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
43
+ `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
44
+ packaged how — and therefore its identity: two outputs whose parameters
45
+ agree ARE the same output, and the encoded result is reused by definition.
46
+ Nothing about a VIEWER appears in it (not the consumer id, not where they
47
+ started, not their viewport), and nothing about the request that does not
48
+ change a byte of the result. `server/ViewerRequests.js` builds one and keys
49
+ the output on it.
50
+ - **`media/` — THE MEDIA LAYER, one directory, and it answers ONE question:
51
+ what does a FILE say about itself.** Its containers, its tracks, where its
52
+ keyframes are, how long it runs, and the plan for playing it. Every fact in
53
+ it is born when a header is read, dies when the file is forgotten, and is
54
+ addressed by the file — which is the test that put them together. It used to
55
+ be four places at two levels (`container/`, `tracks/`, half of
56
+ `orchestrators/`, and `playback-planner.js` loose in `services/`), so the
57
+ layer could not be put under an import rule and the rule was written per
58
+ directory instead.
59
+ Inside it, the DOMAIN is `media/container/` and `media/tracks/`: they import
60
+ nothing but each other, this proxy's own logger included. The application
61
+ files sit flat beside them — `ContainerOrchestrator`, `KeyframeTables`,
62
+ `SubtitleOrchestrator`, `playback-planner.js`, `keyframe-probe.js`,
63
+ `ffmpeg-banner.js`, `audio-inventory.js` — and may reach their own domain and
64
+ the logger and nothing else. What a torrent CONTAINS, which clusters may be
65
+ read, where a viewer stands, what an encoder costs: all handed in. Both
66
+ reaches that existed are gone — `torrent-worker/subtitle-cues.js` is given to
67
+ `SubtitleOrchestrator` by `server.js`, and `torrent/Contents.js` to the
68
+ planner — so this layer can be exercised with plain values, no torrent, no
69
+ thread and no disk. Checked by breaking it in every direction.
70
+ - **The parse happens on the MAIN thread, and the torrent thread serves
71
+ bytes.** It used to parse containers too — tracks, media info, keyframe
72
+ index — and carry each answer back over the channel, on the stated ground
73
+ that "the main thread cannot open a read stream on one of its files". True
74
+ of WebTorrent's API, not of the bytes: a container is built from one
75
+ function, `readRange(start, end)`, the pieces live in shared memory, and
76
+ `WorkerTorrentPool.readRangeOf` is the read that serves every segment — it
77
+ waits for what has not arrived and steers the swarm toward it. That split
78
+ is what made "where is this fact kept" a question at all; with one thread it
79
+ does not arise. NOTHING in that thread reaches into the media layer now —
80
+ the subtitle cue walk was the last, and it is handed which byte ranges of a
81
+ file are downloaded WHOLE (one list per pass, not a question per cluster)
82
+ plus a store read that never fetches, both in
83
+ `torrent/worker/held-bytes.js`. A piece arriving is ANNOUNCED
84
+ (`PIECES_ARRIVED`) rather than acted on there. Pinned by
85
+ `test/the-torrent-thread-serves-bytes.test.js`.
86
+ - `media/container/` — domain: `Container` (abstract, RFC 9559 / ISO 14496-12),
87
+ `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
88
+ (sniff 16 bytes → precise subclass), `KeyframeTable`. See
89
+ `docs/container-architecture.md`.
90
+ - `media/tracks/` — domain: `ContainerTrack` (base: TrackNumber, declaredIndex,
91
+ language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
92
+ `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
93
+ `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
94
+ RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
95
+ track_enabled / alternate_group, elng BCP47).
96
+ - `media/` application files: `ContainerOrchestrator` (detect + per-file
97
+ cache of CONTAINERS, `getTracks`/`getMediaInfo`/`getKeyframeIndex` — it
98
+ caches the container, never the answers, so nothing here is a second store
99
+ of a fact somebody else owns), `KeyframeTables`,
100
+ `SubtitleOrchestrator` (the track list and the cues behind
101
+ `Container` tracks, warm/push — it is handed the walk, and `server.js` is
102
+ what puts the two together), `SubtitleCues` (the walk itself: the plan, the
103
+ found-order cursor, one walk of a file at a time). The walk
104
+ itself is `MatroskaContainer.walkHeldClusters` / `Mp4Container.readHeldSamples`;
105
+ what the torrent supplies is `held-bytes.js` — which ranges are downloaded
106
+ whole, and a read of one that never fetches.
107
+ **`KeyframeTables` is where a file's keyframe table lives and the only thing
108
+ that reads one.** The table is `container/KeyframeTable.js`, ONE object per
109
+ file, handed out rather than copied — so a read that lands after a session
110
+ was made still reaches it, which a value could not. It answers two questions
111
+ that a bag of probe fields could not tell apart: `answered` (a reader came
112
+ back) and `readable` (it came back with times). The first distinguishes a
113
+ file that must be re-encoded for ever from a passing shortage of bytes off
114
+ the swarm. One read per file whoever asks, the second asker joins the first,
115
+ each caller's wait is bounded by the measured `KEYFRAME_TABLE_BUDGET_MS`
116
+ while the READ is not, and a read that threw is never recorded as an answer.
117
+ It is the ONLY store of the table: the container reads and does not
118
+ remember, so there is one object per file and nothing to keep in step. The second reader is the packet probe in
119
+ `media/keyframe-probe.js`, which decodes rather than parsing; the fuller of the
120
+ two answers is the one that stands (`media/keyframe-probe.js`).
121
+ - `server/controllers/` — interface layer: `PlaybackController` / `SubtitleController`
122
+ (thin adapters over orchestrators; routes depend on controllers, not services).
123
+ `routes/*` are now thin HTTP translators. A controller reaches every layer
124
+ below it THROUGH its orchestrator and never around it, which biome checks —
125
+ so what an orchestrator needs from another layer is composed in `server.js`
126
+ and passed in.
127
+ - Everything a container states about ITSELF lives in its own class: the
128
+ track table, the Cues, the keyframe times they name, the cluster positions,
129
+ the blocks inside a cluster, the MP4 sample table, and the walk of what is
130
+ downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
131
+ is the format's byte-level grammar, not its statements, and is the only
132
+ piece kept apart. `ContainerFactory` is the ONE place that decides what a
133
+ file is — by sniffing the header, since that is what the muxer wrote — and
134
+ that is it. `ContainerFactory.readKeyframeIndex` is gone: it existed only for
135
+ the session manager's own HTTP read of a container, which is deleted.
136
+ - `docs/download-architecture.md` — the two axes of downloading: what is
137
+ wanted (`demand/`) against what the swarm is told (`download/`), why urgency
138
+ is not a number given to the library, and why the speculative levels are
139
+ withdrawn rather than lowered.
140
+ - **The storage layer — ONE layer, FOUR directories.** Bytes on a medium with
141
+ a limit is the property they share; what holds them are three different
142
+ things with different lifetimes, different addresses and different THREADS,
143
+ so they are not flattened into one:
144
+ - `storage/piece-store/` — the torrent's pieces: memory tier, spill tier, and the
145
+ order they leave in (`shared-piece-store.js`, `piece-lru.js`,
146
+ `piece-disk-store.js`). Lives in the torrent WORKER thread.
147
+ - `storage/segment-store/` — the segments an encoder has produced
148
+ (`SegmentStore.js`), addressed by the output's own key. Main thread.
149
+ - `storage/files/` — files downloaded whole and kept as files
150
+ (`CompletedFiles.js`, `piece-from-whole-file.js`). Worker thread.
151
+ - `storage/` — THE ONE BUDGET: how much of this machine the proxy may
152
+ take, and how that is divided between everything that holds bytes.
153
+ `MachineBudget.js` is the single owner; `allowance.js` the rule;
154
+ `machine-memory.js` and `free.js` read the machine; `wire.js` says who
155
+ the claimants are and which RESOURCE each takes; `keep.js` and
156
+ `returns.js` say how long material nobody is using is kept. It holds no
157
+ bytes itself.
158
+ **One budget does not mean one number.** Memory cannot be paid for with
159
+ disk, so what is divided is divided per resource — and "disk" is one
160
+ resource per DEVICE, read with `statSync(dir).dev`, because two
161
+ filesystems cannot pay for each other either (`/tmp` and `/data` on the
162
+ addon host are two). What there is ONE of is the owner, the policy and
163
+ the place that reads the machine. One owner because the claimants TRADE
164
+ across resources: pieces that do not fit in memory are spilled to disk,
165
+ so what memory is given decides how much disk is needed — 14 400 MB
166
+ spilled in fifty minutes while the store held 312-424 MB.
167
+ The policy is the operator's, stated once at startup — `--budget
168
+ adaptive|share|fixed`, `--budget-share`, `--budget-bytes`,
169
+ `--min-memory-bytes`, `--min-disk-bytes` — and those are the only
170
+ chosen numbers in the proxy, because they are chosen by the person whose
171
+ machine it is. The default is the measured one.
172
+ They may import each other and nothing above, which `biome` checks as an
173
+ EXCEPTION to `../**` rather than as a list of forbidden layers — a layer is
174
+ not a directory, the blanket form cannot say "my siblings", and a list of
175
+ names misses whatever it forgets.
176
+ - `docs/storage-architecture.md` — the three things that write to one disk, the
177
+ two rules that remove material (nobody needs it, or there is no room), the
178
+ order the viewers give that removal, why a spilled piece is a file of its
179
+ own, and what is still not solved.
180
+ - `docs/encode-architecture.md` — who decides where encoders go, and the
181
+ answer is one authority: `EncodePlan`, from what is made, what is being
182
+ made, what is wanted and what the host can hold. Why no viewer reaches it,
183
+ why the priority map is read at two scopes (per FILE for the swarm, per
184
+ OUTPUT for the encoders), and what each of the eight other places that used
185
+ to place or kill an encoder now states instead.
186
+ - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
187
+ is in TWO places split by phase: on the droplet while a transport is being
188
+ acquired and at unload, on THIS proxy for the whole of a viewing
189
+ (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
190
+ Read both before concluding anything from a half-session.
191
+ - `media/playback-planner.js` — single ffmpeg probe returns audioCodec,
192
+ videoCodec, container, durationSeconds. `mode` is advisory; the browser
193
+ decides. `media/keyframe-probe.js` beside it is the OTHER reading of the same
194
+ file, by decoding rather than by parsing, for containers that state no index.
195
+ - `server/` — what a request does, one operation at a time, and nothing
196
+ that lives longer than the operation: `ViewerRequests` (open an output of a
197
+ file and be placed on it, state a position, report progress),
198
+ `SegmentServing` (answer a playlist, init or segment request from the store,
199
+ or hold it until the piece is whole), `OutputLifecycle` (dispose an output
200
+ nobody is on, all of them at shutdown, adopt what an earlier process left),
201
+ and `wire-outputs.js`, which builds the components and hands each the narrow
202
+ host it reads. `hls-session-manager.js` is gone (2.87.0): each of its members
203
+ is a method of the component that owns it. The operations own no long-lived
204
+ fact: the init served for an output is kept by `SegmentStore`, the bytes read
205
+ for an output by `EncodeRuns`, the cold-start measurement by `HostTimings`.
206
+ They import no component's implementation — only the name of an output and
207
+ of its playlist (`encode/output/index.js`) and the keeping period
208
+ (`storage/keep.js`); biome checks it. A held request waits for the store's
209
+ publication event, as long as the requester states (`X-Hold-Ms`) and no
210
+ longer than it stays.
211
+ - `encode/` beside the orchestrator: `OutputOpening` (which output answers a
212
+ request for a file, made if it is not here yet — without knowing who asked),
213
+ `EncodeRuns` (build a run where the plan places it, follow it, account for
214
+ its end, and what its input has received), `EncoderSelection` (the encoder
215
+ in use and the move to software), `Renditions` (the steps of a picture and
216
+ its soundtracks, the master playlist, and which rung a viewer's page says it
217
+ plays), `OutputTimes` (where each segment begins and how the cut table is
218
+ corrected), `CushionReport` (how much film is ready in front of the
219
+ viewers), `output-key-format.js` (which container a key names).
220
+ - `viewer/`: every viewer has a name (`Viewers.of` refuses an empty one); the
221
+ relation to outputs is stored only in `Viewer.outputs` and read the other way
222
+ by `Viewers.forOutput`. A quality request belongs to one viewer and exists
223
+ only in AUTO (`Viewer.askQuality`).
224
+ - `torrent/` reaches the piece store by what it does (`piece-store-of.js`) and
225
+ is handed the store's class by `torrent/worker/worker.js`, where that thread
226
+ is assembled. `transport/` imports nothing of another component; `bin/cli.js`
227
+ hands it the memory reading and the rule for which captures are kept.
228
+ - `encode/hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
229
+ STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
230
+ verify each segment decodes independently (catches non-IDR/corrupted hw
231
+ output). Falls back to software libx264. Runtime fallback to software if a
232
+ hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
233
+ - `transport/data-channel-handler.js` — forwards WebRTC data-channel requests to the
234
+ local HTTP server (loopback), so the same routes serve both transports.
235
+
236
+ ## Gotchas
237
+
238
+ - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
239
+ - A transitive dep (`ip-set`, via webtorrent) ships a hostile
240
+ `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
241
+ around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
242
+ if you ever change install flow, keep that in mind.
243
+
244
+ ## Planned: public reachability (remote access)
245
+
246
+ Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
247
+
248
+ - **Auto port mapping** — IMPLEMENTED (`services/transport/port-mapper.js`, changelog
249
+ 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
250
+ same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
251
+ auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
252
+ Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
253
+ `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
254
+ **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
255
+ mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
256
+ Also pending (next iteration): a success log line in `transport/port-mapper.js` `stop()`
257
+ (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
258
+ clean unmap on shutdown is silent.
259
+ - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
260
+ is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
261
+ mapping success and on every tunnel (re)connect; the server dial-back-verifies
262
+ reachability (server 0.8.22, roadmap step 2).
263
+ - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
264
+ certificate delivered by the server through the tunnel (persist cert+key
265
+ locally; ~90-day renewals are pushed the same way). Add CORS headers for the
266
+ web-app origin so hls.js / `<video>` can fetch cross-origin.
267
+ - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
268
+ as fallback for hosts where no port could be opened.
269
+ - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
270
+ WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
271
+ `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
272
+ prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
273
+ symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
274
+ *global* v6) + STUN NAT pre-classification reported to the registry; then
275
+ the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
276
+ - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
277
+ announcements via the `bittorrent-dht` already bundled with WebTorrent.
278
+
279
+ All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
280
+
281
+ ## Disk hygiene (open item — torrent data is NOT cleaned up today)
282
+
283
+ HLS segments are handled (`server/OutputLifecycle.js`: idle TTL, `disposeSession`,
284
+ `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
285
+ (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
286
+ hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
287
+ removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
288
+ left by a previous hard kill at startup.
289
+
290
+ Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
291
+ file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
292
+ orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
293
+ whole torrents. (Shutdown teardown ✅ done.)
294
+ Level 2 (research): sliding-window chunk store. Full rationale in the parent
295
+ `../CLAUDE.md` "Disk hygiene" section.
296
+
297
+ ## Cloud proxy
298
+
299
+ The same proxy code also runs as the company-hosted fallback when the user
300
+ pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
301
+ rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
302
+ metered-egress clouds). Provider/economics analysis in the parent
303
+ `../CLAUDE.md` "Cloud proxy" section.
304
+
305
+ ## Changelog
306
+
307
+ Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
308
+ a new `## <version>` heading at the top, following the existing
309
+ `- **New**/**Fix**/**Chore**:` format.
310
+
311
+ **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
312
+ version …` which bumps it. Write the CHANGELOG entry at the version that bump
313
+ will produce: **current `package.json` version + 1 patch** (or + 1 minor).
314
+ Accumulate bullets into that single pending entry until it's published. See the
315
+ parent `../CLAUDE.md`.
316
+
317
+ ## Release
318
+
319
+ `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
320
+ own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
321
+
322
+ **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.