@torrent-tv/proxy 2.85.1 → 2.87.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (381) hide show
  1. package/CHANGELOG.md +2138 -1909
  2. package/CLAUDE.md +318 -197
  3. package/assets/calibration/NOTICE.md +2 -2
  4. package/bin/cli.js +684 -616
  5. package/biome.json +409 -233
  6. package/docs/container-architecture.md +218 -213
  7. package/docs/download-architecture.md +7 -7
  8. package/docs/encode-architecture.md +287 -11
  9. package/docs/encode-run-state.md +2 -2
  10. package/docs/logs.md +97 -97
  11. package/docs/{disk-architecture.md → storage-architecture.md} +107 -1
  12. package/openspec/changes/adaptive-bitrate/design.md +2 -2
  13. package/openspec/changes/adaptive-bitrate/proposal.md +1 -1
  14. package/openspec/changes/adaptive-bitrate/tasks.md +1 -1
  15. package/openspec/changes/chunked-request-bodies/design.md +1 -1
  16. package/openspec/changes/chunked-request-bodies/proposal.md +1 -1
  17. package/openspec/changes/chunked-request-bodies/tasks.md +1 -1
  18. package/openspec/changes/cold-start/design.md +1 -1
  19. package/openspec/changes/disk-cap/proposal.md +1 -1
  20. package/openspec/changes/proxy-observability/proposal.md +2 -2
  21. package/openspec/changes/track-selection/proposal.md +1 -1
  22. package/openspec/changes/transcode-quality/proposal.md +1 -1
  23. package/package.json +2 -2
  24. package/research/delivery-wedge-stand-ladder-2026-09-13.md +329 -329
  25. package/research/double-spawn-2026-09-10.md +171 -171
  26. package/routes/api/playback-plan/post.js +2 -2
  27. package/routes/api/sources/files/get.js +1 -1
  28. package/routes/api/sources/stats/get.js +1 -1
  29. package/routes/api/sources/warm/post.js +10 -3
  30. package/routes/api/subtitles/get.js +230 -230
  31. package/routes/api/transcode-sessions/fragment-far/post.js +3 -3
  32. package/routes/api/transcode-sessions/net-report/post.js +129 -94
  33. package/routes/api/transcode-sessions/post.js +160 -139
  34. package/routes/api/transcode-sessions/progress/get.js +3 -3
  35. package/routes/api/transcode-sessions/release/post.js +3 -3
  36. package/routes/api/transcode-sessions/seek/post.js +12 -3
  37. package/routes/stream/get.js +2 -2
  38. package/routes/transcode/audio-file/get.js +15 -6
  39. package/routes/transcode/audio-warm/get.js +8 -5
  40. package/routes/transcode/session-file/get.js +429 -268
  41. package/routes/transcode/variant-file/get.js +47 -7
  42. package/routes/transcode/variant-warm/get.js +18 -6
  43. package/scripts/render-run-graph.js +1 -1
  44. package/server.js +720 -465
  45. package/services/encode/CoverageMap.js +428 -428
  46. package/services/encode/CushionReport.js +345 -0
  47. package/services/encode/EncodeAdmission.js +332 -0
  48. package/services/{orchestrators → encode}/EncodeOrchestrator.js +285 -17
  49. package/services/encode/EncodeRun.js +16 -9
  50. package/services/encode/EncodeRuns.js +1219 -0
  51. package/services/encode/Encoder.js +18 -2
  52. package/services/encode/EncoderSelection.js +38 -0
  53. package/services/encode/LocalObservations.js +359 -0
  54. package/services/encode/NvencEncoder.js +5 -0
  55. package/services/encode/OutputOpening.js +745 -0
  56. package/services/encode/OutputTimes.js +579 -0
  57. package/services/encode/Renditions.js +2162 -0
  58. package/services/encode/RunProgress.js +84 -0
  59. package/services/encode/SoftwareEncoder.js +12 -7
  60. package/services/encode/args.js +402 -186
  61. package/services/encode/calibration.js +361 -0
  62. package/services/encode/contention.js +128 -128
  63. package/services/encode/encode-run-state.js +16 -20
  64. package/services/encode/fingerprint.js +322 -0
  65. package/services/{hwaccel.js → encode/hwaccel.js} +82 -42
  66. package/services/{learned-median.js → encode/learned-median.js} +11 -0
  67. package/services/encode/output/EncodedOutput.js +57 -0
  68. package/services/encode/output/Output.js +131 -0
  69. package/services/{output/LiveOutputs.js → encode/output/OutputCatalog.js} +141 -40
  70. package/services/encode/output/OutputSpec.js +390 -0
  71. package/services/{output → encode/output}/Timeline.js +12 -37
  72. package/services/encode/output/index.js +20 -0
  73. package/services/encode/output/ladder.js +32 -0
  74. package/services/{output → encode/output}/playlists.js +3 -0
  75. package/services/encode/output-key-format.js +21 -0
  76. package/services/encode/quality/EncodeCost.js +1083 -0
  77. package/services/encode/quality/HostLoad.js +525 -0
  78. package/services/encode/quality/HostTimings.js +249 -0
  79. package/services/encode/quality/OutputQualityState.js +28 -0
  80. package/services/encode/quality/QualityController.js +931 -0
  81. package/services/encode/quality/QualityOffer.js +416 -0
  82. package/services/encode/quality/drain-threat.js +47 -0
  83. package/services/encode/quality/link-budget.js +254 -0
  84. package/services/encode/quality/output-format.js +266 -0
  85. package/services/encode/quality/serving-output.js +216 -0
  86. package/services/encode/quality/visible-rung.js +57 -0
  87. package/services/encode/run-command.js +23 -20
  88. package/services/encode/run-inputs.js +42 -0
  89. package/services/{segment-formats → encode/segment-formats}/fmp4.js +63 -0
  90. package/services/{segment-formats → encode/segment-formats}/index.js +3 -3
  91. package/services/encode/segment-formats/init-compat.js +324 -0
  92. package/services/{segment-formats → encode/segment-formats}/mp4-boxes.js +8 -3
  93. package/services/encode/throughput.js +97 -0
  94. package/services/{orchestrators → media}/ContainerOrchestrator.js +45 -7
  95. package/services/media/KeyframeTables.js +316 -0
  96. package/services/{source → media}/SourceFile.js +7 -55
  97. package/services/{torrent-worker/subtitle-cues.js → media/SubtitleCues.js} +103 -132
  98. package/services/media/SubtitleOrchestrator.js +167 -0
  99. package/services/{audio-inventory.js → media/audio-inventory.js} +7 -1
  100. package/services/{container → media/container}/AviContainer.js +266 -266
  101. package/services/{container → media/container}/Container.js +596 -601
  102. package/services/media/container/ContainerFactory.js +56 -0
  103. package/services/media/container/KeyframeTable.js +272 -0
  104. package/services/{container → media/container}/MatroskaContainer.js +1485 -1485
  105. package/services/{container → media/container}/Mp4Container.js +1244 -1244
  106. package/services/{container → media/container}/SubtitleFileContainer.js +322 -322
  107. package/services/media/keyframe-probe.js +157 -0
  108. package/services/media/media-info-probe.js +93 -0
  109. package/services/{playback-planner.js → media/playback-planner.js} +82 -39
  110. package/services/{tracks → media/tracks}/AudioTrack.js +131 -131
  111. package/services/{tracks → media/tracks}/language-detect.js +174 -174
  112. package/services/server/OutputLifecycle.js +418 -0
  113. package/services/server/SegmentServing.js +1146 -0
  114. package/services/server/ViewerRequests.js +522 -0
  115. package/services/server/controllers/PlaybackController.js +36 -0
  116. package/services/{controllers → server/controllers}/SubtitleController.js +17 -33
  117. package/services/server/wire-outputs.js +958 -0
  118. package/services/storage/Diagnostics.js +202 -0
  119. package/services/storage/MachineBudget.js +235 -0
  120. package/services/{piece-store → storage}/allowance.js +107 -107
  121. package/services/{core-dumps.js → storage/core-dumps.js} +1 -1
  122. package/services/{files → storage/files}/CompletedFiles.js +116 -1
  123. package/services/{disk → storage}/free.js +33 -0
  124. package/services/storage/machine-memory.js +56 -0
  125. package/services/{memory-report.js → storage/memory-report.js} +575 -596
  126. package/services/{piece-store → storage/piece-store}/piece-disk-store.js +0 -7
  127. package/services/{piece-store → storage/piece-store}/shared-piece-store.js +28 -21
  128. package/services/{encode → storage/segment-store}/SegmentStore.js +395 -8
  129. package/services/storage/wire.js +175 -0
  130. package/services/{download → torrent/download}/SwarmSelection.js +2 -2
  131. package/services/{download → torrent/download}/registry.js +2 -2
  132. package/services/torrent/files.js +1 -1
  133. package/services/torrent/piece-store-of.js +29 -0
  134. package/services/{torrent-pool.js → torrent/torrent-pool.js} +26 -119
  135. package/services/{torrent-worker → torrent/worker}/background-fill.js +2 -2
  136. package/services/{torrent-worker → torrent/worker}/channel.js +271 -250
  137. package/services/{torrent-worker → torrent/worker}/client.js +77 -58
  138. package/services/torrent/worker/held-bytes.js +155 -0
  139. package/services/{torrent-worker → torrent/worker}/install-webrtc-shim.js +1 -1
  140. package/services/{torrent-worker → torrent/worker}/piece-reader.js +21 -30
  141. package/services/{torrent-worker → torrent/worker}/pool-adapter.js +101 -137
  142. package/services/{torrent-worker → torrent/worker}/protocol.js +26 -30
  143. package/services/torrent/worker/resume-warm.js +107 -0
  144. package/services/{torrent-worker → torrent/worker}/webrtc-shim.js +2 -2
  145. package/services/{torrent-worker → torrent/worker}/worker.js +68 -159
  146. package/services/{data-channel-handler.js → transport/data-channel-handler.js} +1356 -1356
  147. package/services/{delivery-probe.js → transport/delivery-probe.js} +842 -842
  148. package/services/{health-collector.js → transport/health-collector.js} +6 -35
  149. package/services/{packet-witness.js → transport/packet-witness.js} +808 -784
  150. package/services/{port-mapper.js → transport/port-mapper.js} +1 -1
  151. package/services/{usrsctp-state.js → transport/usrsctp-state.js} +1 -1
  152. package/services/{webrtc-manager.js → transport/webrtc-manager.js} +1 -1
  153. package/services/viewer/Assignments.js +340 -0
  154. package/services/{priority → viewer}/PriorityMap.js +390 -390
  155. package/services/{priority → viewer}/PriorityOrchestrator.js +325 -320
  156. package/services/viewer/Viewer.js +657 -489
  157. package/services/viewer/Viewers.js +368 -257
  158. package/services/viewer/active-output.js +37 -54
  159. package/services/viewer/audio-start.js +46 -0
  160. package/services/viewer/buffer-trend.js +81 -0
  161. package/services/viewer/choices.js +647 -0
  162. package/services/viewer/positions.js +126 -120
  163. package/services/viewer/report-intake.js +46 -44
  164. package/test/asset-paths.test.js +28 -0
  165. package/test/audio-inventory.test.js +3 -3
  166. package/test/audio-track-bitrate.test.js +40 -0
  167. package/test/auto-quality-step.test.js +707 -518
  168. package/test/available-share.test.js +1 -1
  169. package/test/background-fill.test.js +1 -1
  170. package/test/client-log-file.test.js +110 -110
  171. package/test/completed-files.test.js +1 -1
  172. package/test/concurrent-cost.test.js +13 -3
  173. package/test/container-media-info.test.js +3 -3
  174. package/test/core-dumps.test.js +1 -1
  175. package/test/coverage-follows-the-disk.test.js +40 -8
  176. package/test/cue-push-carries-what-the-walk-found.test.js +58 -0
  177. package/test/cut-times-timeline.test.js +2 -2
  178. package/test/cuts-follow-published-grid.test.js +9 -8
  179. package/test/data-channel-frame.test.js +1 -1
  180. package/test/dead-torrent-handle.test.js +1 -1
  181. package/test/declared-rates.test.js +2 -2
  182. package/test/declared-tracks.test.js +2 -2
  183. package/test/decode-cost-fit.test.js +1 -1
  184. package/test/decode-cost.test.js +34 -25
  185. package/test/delivery-probe.test.js +1 -1
  186. package/test/demand-register.test.js +4 -4
  187. package/test/dht-bootstrap.test.js +1 -1
  188. package/test/drain-threat.test.js +65 -0
  189. package/test/duplicate-add.test.js +1 -1
  190. package/test/encode-admission.test.js +146 -0
  191. package/test/encode-cost.test.js +199 -10
  192. package/test/encode-orchestrator.test.js +39 -1
  193. package/test/encode-plan-viewers.test.js +2 -2
  194. package/test/encode-run.test.js +2 -2
  195. package/test/encode-slope.test.js +1 -1
  196. package/test/encoded-output.test.js +39 -0
  197. package/test/encoder-readings.test.js +1 -1
  198. package/test/every-claimant-is-told-its-share.test.js +152 -0
  199. package/test/failed-encoder-still-serves-what-exists.test.js +354 -0
  200. package/test/failed-start-breaker.test.js +81 -30
  201. package/test/fastest-wires.test.js +1 -1
  202. package/test/ffmpeg-stream-counts.test.js +1 -1
  203. package/test/file-edges.test.js +3 -3
  204. package/test/fmp4-self-contained.test.js +1 -1
  205. package/test/fmp4-timestamps.test.js +1 -1
  206. package/test/fmp4-track-completeness.test.js +1 -1
  207. package/test/format-keyed-outputs.test.js +78 -0
  208. package/test/health-metrics.test.js +3 -2
  209. package/test/held-request-width.test.js +22 -23
  210. package/test/helpers/encode-run.js +136 -136
  211. package/test/helpers/held-file.js +29 -0
  212. package/test/helpers/manager.js +57 -0
  213. package/test/helpers/output-spec.js +63 -0
  214. package/test/host-load.test.js +1 -1
  215. package/test/index-accuracy-is-about-the-file.test.js +128 -0
  216. package/test/init-compat.test.js +219 -0
  217. package/test/input-lost-quiets-the-plan.test.js +1 -1
  218. package/test/input-unavailable.test.js +1 -1
  219. package/test/keeping-period.test.js +4 -4
  220. package/test/keyframe-index-accuracy.test.js +97 -45
  221. package/test/keyframe-table-budget.test.js +28 -33
  222. package/test/keyframes-belong-to-the-file.test.js +174 -57
  223. package/test/learned-median.test.js +1 -1
  224. package/test/letting-go-asks-who-is-watching.test.js +191 -0
  225. package/test/limit-row-by-area.test.js +60 -0
  226. package/test/link-budget.test.js +111 -0
  227. package/test/link-probe.test.js +56 -56
  228. package/test/local-encoding-data.test.js +273 -0
  229. package/test/look-ahead-coverage.test.js +1 -1
  230. package/test/manager-surface.test.js +294 -0
  231. package/test/matroska-blocks.test.js +0 -0
  232. package/test/matroska-cues-track.test.js +1 -1
  233. package/test/memory-budget.test.js +2 -2
  234. package/test/mp4-composition-times.test.js +0 -0
  235. package/test/mp4-subtitles.test.js +1 -1
  236. package/test/one-authority.test.js +45 -41
  237. package/test/one-budget.test.js +149 -0
  238. package/test/one-output-one-session.test.js +204 -0
  239. package/test/{disk-space.test.js → one-resource-divided.test.js} +30 -10
  240. package/test/one-serving-output-per-height.test.js +458 -0
  241. package/test/orchestrator-wired.test.js +46 -45
  242. package/test/output-catalog.test.js +39 -0
  243. package/test/output-shape.test.js +4 -51
  244. package/test/output-spec.test.js +251 -157
  245. package/test/output-speed.test.js +17 -15
  246. package/test/outputs-being-prepared.test.js +40 -0
  247. package/test/packet-witness-ring.test.js +2 -2
  248. package/test/packet-witness.test.js +1 -1
  249. package/test/piece-disk-store.test.js +2 -2
  250. package/test/piece-from-whole-file.test.js +1 -1
  251. package/test/piece-lru.test.js +1 -1
  252. package/test/piece-reader.test.js +2 -2
  253. package/test/piece-store-eviction.test.js +1 -1
  254. package/test/piece-store-never-refuses.test.js +1 -1
  255. package/test/piece-store-reservations.test.js +1 -1
  256. package/test/piece-store-slow-disk.test.js +1 -1
  257. package/test/piece-tail.test.js +1 -1
  258. package/test/plan-host-timings.test.js +1 -1
  259. package/test/plan-is-steady.test.js +225 -225
  260. package/test/priority-map-download.test.js +4 -4
  261. package/test/priority-map-emptied.test.js +204 -205
  262. package/test/priority-map-per-output.test.js +215 -209
  263. package/test/priority-map.test.js +1 -1
  264. package/test/probe-wedge-certainty.test.js +1 -1
  265. package/test/produced-copy-choice.test.js +15 -60
  266. package/test/quality-offer.test.js +162 -0
  267. package/test/quality-variants.test.js +1229 -1167
  268. package/test/rate-control-in-the-output.test.js +180 -0
  269. package/test/read-survives-withdrawal.test.js +2 -2
  270. package/test/read-window.test.js +10 -3
  271. package/test/resume-warm.test.js +1 -1
  272. package/test/run-inputs.test.js +80 -0
  273. package/test/run-position-follows-published-grid.test.js +13 -11
  274. package/test/run-progress.test.js +65 -0
  275. package/test/same-height-switch.test.js +664 -0
  276. package/test/seek-frees-the-viewers-requests.test.js +217 -0
  277. package/test/seek-landing.test.js +13 -13
  278. package/test/seek-target-not-superseded.test.js +28 -29
  279. package/test/segment-closed-on-both-branches.test.js +96 -0
  280. package/test/segment-cut-times.test.js +1 -1
  281. package/test/segment-hold-supersede.test.js +28 -35
  282. package/test/segment-judged-by-its-own-header.test.js +221 -0
  283. package/test/segment-serve-wiring.test.js +130 -39
  284. package/test/segment-store-eviction.test.js +22 -7
  285. package/test/segment-store.test.js +98 -14
  286. package/test/segment-true-start.test.js +1 -1
  287. package/test/segments-are-shared.test.js +17 -16
  288. package/test/send-chunk-bytes.test.js +1 -1
  289. package/test/serving-existing-output.test.js +102 -0
  290. package/test/serving-output.test.js +102 -0
  291. package/test/shared-piece-store.test.js +1 -1
  292. package/test/source-file.test.js +1 -1
  293. package/test/stale-request-after-seek.test.js +17 -21
  294. package/test/startup-readings.test.js +10 -5
  295. package/test/subtitle-cue-framing.test.js +5 -5
  296. package/test/subtitle-cue-source.test.js +36 -38
  297. package/test/subtitle-cue-walk.test.js +11 -10
  298. package/test/subtitle-defaults.test.js +1 -1
  299. package/test/subtitle-language.test.js +4 -4
  300. package/test/subtitle-track-numbering.test.js +5 -4
  301. package/test/supply-margin.test.js +1 -1
  302. package/test/swarm-follows-readers.test.js +3 -3
  303. package/test/swarm-reach.test.js +1 -1
  304. package/test/swarm-selection.test.js +3 -3
  305. package/test/tail-duplication.test.js +1 -1
  306. package/test/the-channel-has-both-ends.test.js +91 -0
  307. package/test/the-torrent-thread-serves-bytes.test.js +107 -0
  308. package/test/thread-pool.test.js +3 -3
  309. package/test/timeline.test.js +1 -12
  310. package/test/torrent-cost.test.js +1 -1
  311. package/test/tracks-begin-together.test.js +38 -24
  312. package/test/tunnel-renewal.test.js +1 -1
  313. package/test/two-viewers-one-picture.test.js +120 -87
  314. package/test/upload-hurry.test.js +3 -3
  315. package/test/usrsctp-state.test.js +1 -1
  316. package/test/video-facts.test.js +1 -1
  317. package/test/viewer-assignments.test.js +143 -0
  318. package/test/viewer-outputs.test.js +60 -52
  319. package/test/viewer-presence.test.js +22 -25
  320. package/test/viewer-requests-admission.test.js +89 -0
  321. package/test/viewer-states.test.js +189 -172
  322. package/test/viewer-subtitle-subscription.test.js +1 -1
  323. package/test/viewer.test.js +139 -136
  324. package/test/viewing-generations.test.js +390 -0
  325. package/test/visible-rung.test.js +37 -0
  326. package/test/wait-ledger.test.js +1 -1
  327. package/test/webrtc-shim.test.js +3 -3
  328. package/test/wedge-certainty.test.js +2 -2
  329. package/test/withdraw-piece-claim.test.js +2 -2
  330. package/test/worker-channel.test.js +1 -31
  331. package/utils/client-log-file.js +151 -151
  332. package/scripts/read-container-index.mjs +0 -108
  333. package/services/container/ContainerFactory.js +0 -122
  334. package/services/controllers/PlaybackController.js +0 -33
  335. package/services/disk/DiskSpace.js +0 -150
  336. package/services/disk/wire.js +0 -61
  337. package/services/hls-session-manager.js +0 -9689
  338. package/services/orchestrators/SubtitleOrchestrator.js +0 -160
  339. package/services/output/Output.js +0 -94
  340. package/services/output/OutputSpec.js +0 -202
  341. package/services/output/index.js +0 -1
  342. package/services/output/ladder.js +0 -26
  343. package/services/produced-index.js +0 -222
  344. package/services/quality/EncodeCost.js +0 -555
  345. package/services/torrent-worker/container-tracks.js +0 -414
  346. package/test/produced-index.test.js +0 -142
  347. /package/{services → bin}/thread-pool.js +0 -0
  348. /package/services/{available-share.js → encode/available-share.js} +0 -0
  349. /package/services/{decode-cost-fit.js → encode/decode-cost-fit.js} +0 -0
  350. /package/services/{encoder-readings.js → encode/encoder-readings.js} +0 -0
  351. /package/services/{host-load.js → encode/host-load.js} +0 -0
  352. /package/services/{output → encode/output}/cut-grid.js +0 -0
  353. /package/services/{output → encode/output}/rates.js +0 -0
  354. /package/services/{segment-formats → encode/segment-formats}/mpegts.js +0 -0
  355. /package/services/{torrent-cost.js → encode/torrent-cost.js} +0 -0
  356. /package/services/{container → media/container}/ebml-reader.js +0 -0
  357. /package/services/{ffmpeg-banner.js → media/ffmpeg-banner.js} +0 -0
  358. /package/services/{tracks → media/tracks}/ContainerTrack.js +0 -0
  359. /package/services/{tracks → media/tracks}/ImageSubtitleTrack.js +0 -0
  360. /package/services/{tracks → media/tracks}/SubtitleTrack.js +0 -0
  361. /package/services/{tracks → media/tracks}/TextSubtitleTrack.js +0 -0
  362. /package/services/{tracks → media/tracks}/VideoTrack.js +0 -0
  363. /package/services/{tracks → media/tracks}/index.js +0 -0
  364. /package/services/{files → storage/files}/piece-from-whole-file.js +0 -0
  365. /package/services/{disk → storage}/keep.js +0 -0
  366. /package/services/{piece-store → storage/piece-store}/piece-lru.js +0 -0
  367. /package/services/{disk → storage}/returns.js +0 -0
  368. /package/services/{demand → torrent/demand}/DemandRegister.js +0 -0
  369. /package/services/{demand → torrent/demand}/Urgency.js +0 -0
  370. /package/services/{demand → torrent/demand}/Window.js +0 -0
  371. /package/services/{demand → torrent/demand}/index.js +0 -0
  372. /package/services/{demand → torrent/demand}/pieces.js +0 -0
  373. /package/services/{download → torrent/download}/withdraw-claim.js +0 -0
  374. /package/services/{supply-margin.js → torrent/supply-margin.js} +0 -0
  375. /package/services/{torrent-source-key.js → torrent/torrent-source-key.js} +0 -0
  376. /package/services/{torrent-worker → torrent/worker}/fastest-wires.js +0 -0
  377. /package/services/{torrent-worker → torrent/worker}/handle-state.js +0 -0
  378. /package/services/{nat-classifier.js → transport/nat-classifier.js} +0 -0
  379. /package/services/{registry-api.js → transport/registry-api.js} +0 -0
  380. /package/services/{tunnel-client.js → transport/tunnel-client.js} +0 -0
  381. /package/services/{priority → viewer}/WaitLedger.js +0 -0
package/CLAUDE.md CHANGED
@@ -1,197 +1,318 @@
1
- # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
-
3
- Downloads a torrent and streams the chosen file to the browser, transcoding to
4
- HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
- and release process.
6
-
7
- ## Deployment-agnostic — important
8
-
9
- The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
- all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
- devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
- detection must probe at runtime and fall back gracefully; do not assume a
13
- Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
-
15
- ## Layout
16
-
17
- - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
18
- else bundled ffmpeg-static, else PATH `ffmpeg`).
19
- - `server.js` — Fastify setup; detects the video encoder at startup
20
- (`detectVideoEncoder`) and passes it to `HlsSessionManager`.
21
- - `routes/<path>/<method>.js` — same convention as the server repo.
22
- - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
23
- - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
24
- - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
25
- long-polls while a segment is being produced, returns retryable 503 (never
26
- 202 — hls.js can't consume it).
27
- - `services/`:
28
- - `demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
29
- range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
30
- `DemandRegister` (live windows by claimant), `pieces.js` (the one place
31
- bytes become piece numbers). No WebTorrent, no piece store, no pieces.
32
- - `download/` — `SwarmSelection`, the ONLY thing that calls `select`,
33
- `deselect` or `critical`, and `registry.js`, which holds one per torrent and
34
- owns the cross-torrent rule that withholds the speculative levels while
35
- anything urgent is missing anywhere. See `docs/download-architecture.md`.
36
- - `output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
37
- `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
38
- packaged how — and therefore its identity: two outputs whose parameters
39
- agree ARE the same output, and the encoded result is reused by definition.
40
- Nothing about a VIEWER appears in it (not the consumer id, not where they
41
- started, not their viewport), and nothing about the request that does not
42
- change a byte of the result. `hls-session-manager` builds one and keys the
43
- session on it.
44
- - `container/` — domain layer: `Container` (abstract, RFC 9559 / ISO 14496-12),
45
- `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
46
- (sniff 16 bytes → precise subclass). See `docs/container-architecture.md`.
47
- - `tracks/` — domain layer: `ContainerTrack` (base: TrackNumber, declaredIndex,
48
- language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
49
- `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
50
- `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
51
- RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
52
- track_enabled / alternate_group, elng BCP47).
53
- - `orchestrators/` — application layer: `ContainerOrchestrator` (detect + per-file
54
- cache, `getTracks`/`getMediaInfo`/`getKeyframeIndex` — the keyframe table is
55
- a property of immutable bytes like the other two, memoized on the container
56
- and read once per file by whoever asks), `SubtitleOrchestrator` (wraps
57
- `torrent-worker/subtitle-cues.js` + `Container` tracks, warm/push). The walk
58
- itself is `MatroskaContainer.walkHeldClusters` / `Mp4Container.readHeldSamples`;
59
- `subtitle-cues.js` supplies the torrent's read policy and keeps the cursor.
60
- - `controllers/` — interface layer: `PlaybackController` / `SubtitleController`
61
- (thin adapters over orchestrators; routes depend on controllers, not services).
62
- `routes/*` are now thin HTTP translators.
63
- - Everything a container states about ITSELF lives in its own class: the
64
- track table, the Cues, the keyframe times they name, the cluster positions,
65
- the blocks inside a cluster, the MP4 sample table, and the walk of what is
66
- downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
67
- is the format's byte-level grammar, not its statements, and is the only
68
- piece kept apart. `ContainerFactory` is the ONE place that decides what a
69
- file is — by sniffing the header, since that is what the muxer wrote — and
70
- it also answers `readKeyframeIndex`.
71
- - `docs/download-architecture.md` — the two axes of downloading: what is
72
- wanted (`demand/`) against what the swarm is told (`download/`), why urgency
73
- is not a number given to the library, and why the speculative levels are
74
- withdrawn rather than lowered.
75
- - `disk/` — one owner of the disk, read by everything that takes any of it.
76
- `DiskSpace` reads the free space once and divides it between claimants by
77
- the rule memory already uses; `wire.js` says who the claimants are (the
78
- produced segments, and the pieces the memory store spills, which live on the
79
- torrent thread and are told their share over its channel); `free.js` reads
80
- the nearest directory that exists, because the segments' own is made at the
81
- first session and removed at a clean stop.
82
- - `docs/disk-architecture.md` — the three things that write to one disk, the
83
- two rules that remove material (nobody needs it, or there is no room), the
84
- order the viewers give that removal, why a spilled piece is a file of its
85
- own, and what is still not solved.
86
- - `docs/encode-architecture.md` — who decides where encoders go, and the
87
- answer is one authority: `EncodePlan`, from what is made, what is being
88
- made, what is wanted and what the host can hold. Why no viewer reaches it,
89
- why the priority map is read at two scopes (per FILE for the swarm, per
90
- OUTPUT for the encoders), and what each of the eight other places that used
91
- to place or kill an encoder now states instead.
92
- - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
93
- is in TWO places split by phase: on the droplet while a transport is being
94
- acquired and at unload, on THIS proxy for the whole of a viewing
95
- (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
96
- Read both before concluding anything from a half-session.
97
- - `playback-planner.js` — single ffmpeg probe returns audioCodec, videoCodec,
98
- container, durationSeconds. `mode` is advisory; the browser decides.
99
- - `hls-session-manager.js` — one ffmpeg per (source, file, settings). Serves a
100
- synthetic full-duration VOD playlist; produces segments on demand; restarts
101
- ffmpeg at the requested segment for server-side seeking. Short idle TTL.
102
- Uses the detected `videoEncoder` for video re-encode (copy otherwise).
103
- - `hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
104
- STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
105
- verify each segment decodes independently (catches non-IDR/corrupted hw
106
- output). Falls back to software libx264. Runtime fallback to software if a
107
- hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
108
- - `data-channel-handler.js` — forwards WebRTC data-channel requests to the
109
- local HTTP server (loopback), so the same routes serve both transports.
110
-
111
- ## Gotchas
112
-
113
- - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
114
- - A transitive dep (`ip-set`, via webtorrent) ships a hostile
115
- `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
116
- around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
117
- if you ever change install flow, keep that in mind.
118
-
119
- ## Planned: public reachability (remote access)
120
-
121
- Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
122
-
123
- - **Auto port mapping** — IMPLEMENTED (`services/port-mapper.js`, changelog
124
- 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
125
- same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
126
- auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
127
- Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
128
- `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
129
- **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
130
- mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
131
- Also pending (next iteration): a success log line in `port-mapper.js` `stop()`
132
- (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
133
- clean unmap on shutdown is silent.
134
- - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
135
- is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
136
- mapping success and on every tunnel (re)connect; the server dial-back-verifies
137
- reachability (server 0.8.22, roadmap step 2).
138
- - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
139
- certificate delivered by the server through the tunnel (persist cert+key
140
- locally; ~90-day renewals are pushed the same way). Add CORS headers for the
141
- web-app origin so hls.js / `<video>` can fetch cross-origin.
142
- - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
143
- as fallback for hosts where no port could be opened.
144
- - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
145
- WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
146
- `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
147
- prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
148
- symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
149
- *global* v6) + STUN NAT pre-classification reported to the registry; then
150
- the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
151
- - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
152
- announcements via the `bittorrent-dht` already bundled with WebTorrent.
153
-
154
- All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
155
-
156
- ## Disk hygiene (open item — torrent data is NOT cleaned up today)
157
-
158
- HLS segments are handled (`hls-session-manager.js`: idle TTL, `disposeSession`,
159
- `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
160
- (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
161
- hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
162
- removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
163
- left by a previous hard kill at startup.
164
-
165
- Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
166
- file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
167
- orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
168
- whole torrents. (Shutdown teardown ✅ done.)
169
- Level 2 (research): sliding-window chunk store. Full rationale in the parent
170
- `../CLAUDE.md` "Disk hygiene" section.
171
-
172
- ## Cloud proxy
173
-
174
- The same proxy code also runs as the company-hosted fallback when the user
175
- pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
176
- rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
177
- metered-egress clouds). Provider/economics analysis in the parent
178
- `../CLAUDE.md` "Cloud proxy" section.
179
-
180
- ## Changelog
181
-
182
- Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
183
- a new `## <version>` heading at the top, following the existing
184
- `- **New**/**Fix**/**Chore**:` format.
185
-
186
- **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
187
- version …` which bumps it. Write the CHANGELOG entry at the version that bump
188
- will produce: **current `package.json` version + 1 patch** (or + 1 minor).
189
- Accumulate bullets into that single pending entry until it's published. See the
190
- parent `../CLAUDE.md`.
191
-
192
- ## Release
193
-
194
- `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
195
- own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
196
-
197
- **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.
1
+ # proxy — @torrent-tv/proxy (WebTorrent + ffmpeg)
2
+
3
+ Downloads a torrent and streams the chosen file to the browser, transcoding to
4
+ HLS only when needed. See the parent `../CLAUDE.md` for the overall architecture
5
+ and release process.
6
+
7
+ ## Deployment-agnostic — important
8
+
9
+ The HA addon is only ONE way to run this; bare npm and Docker are planned. Keep
10
+ all code free of Home-Assistant assumptions. Anything host-specific (GPU
11
+ devices, ffmpeg build, CLI flags) belongs in the `ha-addon` layer. Hardware
12
+ detection must probe at runtime and fall back gracefully; do not assume a
13
+ Linux-only host (e.g. POSIX-only signals must degrade elsewhere).
14
+
15
+ ## Layout
16
+
17
+ - `bin/cli.js` — CLI entry; resolves `ffmpegBin` (uses `--ffmpeg-bin` if given,
18
+ else bundled ffmpeg-static, else PATH `ffmpeg`).
19
+ - `server.js` — Fastify setup; detects the video encoder at startup
20
+ (`detectVideoEncoder`), builds the outputs, viewers and encoding with
21
+ `services/server/wire-outputs.js`, and hands each route the components it
22
+ asks of.
23
+ - `routes/<path>/<method>.js` — same convention as the server repo.
24
+ - `routes/stream/get.js` — byte-range torrent file streaming (HTTP 206).
25
+ - `routes/api/playback-plan/post.js` — codec/container/duration probe result.
26
+ - `routes/transcode/session-file/get.js` — serves HLS playlist/segments;
27
+ long-polls while a segment is being produced, returns retryable 503 (never
28
+ 202 — hls.js can't consume it).
29
+ - `services/`:
30
+ - `torrent/demand/` — what anybody wants, in BYTES: `Window` (claimant, file, byte
31
+ range, urgency), `Urgency` (BLOCKED / NEAR / AHEAD / TAIL / BEHIND),
32
+ `DemandRegister` (live windows by claimant), `pieces.js` (the one place
33
+ bytes become piece numbers). No WebTorrent, no piece store, no pieces.
34
+ - `torrent/download/` — `SwarmSelection`, the ONLY thing that calls `select`,
35
+ `deselect` or `critical`, and `registry.js`, which holds one per torrent and
36
+ owns the cross-torrent rule that withholds the speculative levels while
37
+ anything urgent is missing anywhere. See `docs/download-architecture.md`.
38
+ - `encode/output/` — domain layer: `OutputSpec`, `VideoOutput`, `AudioOutput`,
39
+ `CutGrid`. What a session PRODUCES — which tracks, in what form, cut how,
40
+ packaged how — and therefore its identity: two outputs whose parameters
41
+ agree ARE the same output, and the encoded result is reused by definition.
42
+ Nothing about a VIEWER appears in it (not the consumer id, not where they
43
+ started, not their viewport), and nothing about the request that does not
44
+ change a byte of the result. `server/ViewerRequests.js` builds one and keys
45
+ the output on it.
46
+ - **`media/` — THE MEDIA LAYER, one directory, and it answers ONE question:
47
+ what does a FILE say about itself.** Its containers, its tracks, where its
48
+ keyframes are, how long it runs, and the plan for playing it. Every fact in
49
+ it is born when a header is read, dies when the file is forgotten, and is
50
+ addressed by the file — which is the test that put them together. It used to
51
+ be four places at two levels (`container/`, `tracks/`, half of
52
+ `orchestrators/`, and `playback-planner.js` loose in `services/`), so the
53
+ layer could not be put under an import rule and the rule was written per
54
+ directory instead.
55
+ Inside it, the DOMAIN is `media/container/` and `media/tracks/`: they import
56
+ nothing but each other, this proxy's own logger included. The application
57
+ files sit flat beside them — `ContainerOrchestrator`, `KeyframeTables`,
58
+ `SubtitleOrchestrator`, `playback-planner.js`, `keyframe-probe.js`,
59
+ `ffmpeg-banner.js`, `audio-inventory.js` — and may reach their own domain and
60
+ the logger and nothing else. What a torrent CONTAINS, which clusters may be
61
+ read, where a viewer stands, what an encoder costs: all handed in. Both
62
+ reaches that existed are gone — `torrent-worker/subtitle-cues.js` is given to
63
+ `SubtitleOrchestrator` by `server.js`, and `torrent/Contents.js` to the
64
+ planner — so this layer can be exercised with plain values, no torrent, no
65
+ thread and no disk. Checked by breaking it in every direction.
66
+ - **The parse happens on the MAIN thread, and the torrent thread serves
67
+ bytes.** It used to parse containers too — tracks, media info, keyframe
68
+ index — and carry each answer back over the channel, on the stated ground
69
+ that "the main thread cannot open a read stream on one of its files". True
70
+ of WebTorrent's API, not of the bytes: a container is built from one
71
+ function, `readRange(start, end)`, the pieces live in shared memory, and
72
+ `WorkerTorrentPool.readRangeOf` is the read that serves every segment — it
73
+ waits for what has not arrived and steers the swarm toward it. That split
74
+ is what made "where is this fact kept" a question at all; with one thread it
75
+ does not arise. NOTHING in that thread reaches into the media layer now —
76
+ the subtitle cue walk was the last, and it is handed which byte ranges of a
77
+ file are downloaded WHOLE (one list per pass, not a question per cluster)
78
+ plus a store read that never fetches, both in
79
+ `torrent/worker/held-bytes.js`. A piece arriving is ANNOUNCED
80
+ (`PIECES_ARRIVED`) rather than acted on there. Pinned by
81
+ `test/the-torrent-thread-serves-bytes.test.js`.
82
+ - `media/container/` — domain: `Container` (abstract, RFC 9559 / ISO 14496-12),
83
+ `MatroskaContainer` / `Mp4Container` / `AviContainer`, `ContainerFactory`
84
+ (sniff 16 bytes → precise subclass), `KeyframeTable`. See
85
+ `docs/container-architecture.md`.
86
+ - `media/tracks/` — domain: `ContainerTrack` (base: TrackNumber, declaredIndex,
87
+ language/BCP47, isEnabled/isDefault) → `VideoTrack` / `AudioTrack` /
88
+ `SubtitleTrack` → `TextSubtitleTrack` / `ImageSubtitleTrack`,
89
+ `ExternalSubtitleFile`. Spec-accurate flags (FlagForced only on subtitles per
90
+ RFC 9559 §5.1.4.1, FlagOriginal/Commentary only on audio, tkhd
91
+ track_enabled / alternate_group, elng BCP47).
92
+ - `media/` application files: `ContainerOrchestrator` (detect + per-file
93
+ cache of CONTAINERS, `getTracks`/`getMediaInfo`/`getKeyframeIndex` — it
94
+ caches the container, never the answers, so nothing here is a second store
95
+ of a fact somebody else owns), `KeyframeTables`,
96
+ `SubtitleOrchestrator` (the track list and the cues behind
97
+ `Container` tracks, warm/push — it is handed the walk, and `server.js` is
98
+ what puts the two together), `SubtitleCues` (the walk itself: the plan, the
99
+ found-order cursor, one walk of a file at a time). The walk
100
+ itself is `MatroskaContainer.walkHeldClusters` / `Mp4Container.readHeldSamples`;
101
+ what the torrent supplies is `held-bytes.js` — which ranges are downloaded
102
+ whole, and a read of one that never fetches.
103
+ **`KeyframeTables` is where a file's keyframe table lives and the only thing
104
+ that reads one.** The table is `container/KeyframeTable.js`, ONE object per
105
+ file, handed out rather than copied — so a read that lands after a session
106
+ was made still reaches it, which a value could not. It answers two questions
107
+ that a bag of probe fields could not tell apart: `answered` (a reader came
108
+ back) and `readable` (it came back with times). The first distinguishes a
109
+ file that must be re-encoded for ever from a passing shortage of bytes off
110
+ the swarm. One read per file whoever asks, the second asker joins the first,
111
+ each caller's wait is bounded by the measured `KEYFRAME_TABLE_BUDGET_MS`
112
+ while the READ is not, and a read that threw is never recorded as an answer.
113
+ It is the ONLY store of the table: the container reads and does not
114
+ remember, so there is one object per file and nothing to keep in step. The second reader is the packet probe in
115
+ `media/keyframe-probe.js`, which decodes rather than parsing; the fuller of the
116
+ two answers is the one that stands (`media/keyframe-probe.js`).
117
+ - `server/controllers/` — interface layer: `PlaybackController` / `SubtitleController`
118
+ (thin adapters over orchestrators; routes depend on controllers, not services).
119
+ `routes/*` are now thin HTTP translators. A controller reaches every layer
120
+ below it THROUGH its orchestrator and never around it, which biome checks —
121
+ so what an orchestrator needs from another layer is composed in `server.js`
122
+ and passed in.
123
+ - Everything a container states about ITSELF lives in its own class: the
124
+ track table, the Cues, the keyframe times they name, the cluster positions,
125
+ the blocks inside a cluster, the MP4 sample table, and the walk of what is
126
+ downloaded. `services/container-index/` is gone; `container/ebml-reader.js`
127
+ is the format's byte-level grammar, not its statements, and is the only
128
+ piece kept apart. `ContainerFactory` is the ONE place that decides what a
129
+ file is — by sniffing the header, since that is what the muxer wrote — and
130
+ that is it. `ContainerFactory.readKeyframeIndex` is gone: it existed only for
131
+ the session manager's own HTTP read of a container, which is deleted.
132
+ - `docs/download-architecture.md` — the two axes of downloading: what is
133
+ wanted (`demand/`) against what the swarm is told (`download/`), why urgency
134
+ is not a number given to the library, and why the speculative levels are
135
+ withdrawn rather than lowered.
136
+ - **The storage layer — ONE layer, FOUR directories.** Bytes on a medium with
137
+ a limit is the property they share; what holds them are three different
138
+ things with different lifetimes, different addresses and different THREADS,
139
+ so they are not flattened into one:
140
+ - `storage/piece-store/` — the torrent's pieces: memory tier, spill tier, and the
141
+ order they leave in (`shared-piece-store.js`, `piece-lru.js`,
142
+ `piece-disk-store.js`). Lives in the torrent WORKER thread.
143
+ - `storage/segment-store/` — the segments an encoder has produced
144
+ (`SegmentStore.js`), addressed by the output's own key. Main thread.
145
+ - `storage/files/` — files downloaded whole and kept as files
146
+ (`CompletedFiles.js`, `piece-from-whole-file.js`). Worker thread.
147
+ - `storage/` — THE ONE BUDGET: how much of this machine the proxy may
148
+ take, and how that is divided between everything that holds bytes.
149
+ `MachineBudget.js` is the single owner; `allowance.js` the rule;
150
+ `machine-memory.js` and `free.js` read the machine; `wire.js` says who
151
+ the claimants are and which RESOURCE each takes; `keep.js` and
152
+ `returns.js` say how long material nobody is using is kept. It holds no
153
+ bytes itself.
154
+ **One budget does not mean one number.** Memory cannot be paid for with
155
+ disk, so what is divided is divided per resource — and "disk" is one
156
+ resource per DEVICE, read with `statSync(dir).dev`, because two
157
+ filesystems cannot pay for each other either (`/tmp` and `/data` on the
158
+ addon host are two). What there is ONE of is the owner, the policy and
159
+ the place that reads the machine. One owner because the claimants TRADE
160
+ across resources: pieces that do not fit in memory are spilled to disk,
161
+ so what memory is given decides how much disk is needed — 14 400 MB
162
+ spilled in fifty minutes while the store held 312-424 MB.
163
+ The policy is the operator's, stated once at startup — `--budget
164
+ adaptive|share|fixed`, `--budget-share`, `--budget-bytes`,
165
+ `--min-memory-bytes`, `--min-disk-bytes` — and those are the only
166
+ chosen numbers in the proxy, because they are chosen by the person whose
167
+ machine it is. The default is the measured one.
168
+ They may import each other and nothing above, which `biome` checks as an
169
+ EXCEPTION to `../**` rather than as a list of forbidden layers — a layer is
170
+ not a directory, the blanket form cannot say "my siblings", and a list of
171
+ names misses whatever it forgets.
172
+ - `docs/storage-architecture.md` — the three things that write to one disk, the
173
+ two rules that remove material (nobody needs it, or there is no room), the
174
+ order the viewers give that removal, why a spilled piece is a file of its
175
+ own, and what is still not solved.
176
+ - `docs/encode-architecture.md` — who decides where encoders go, and the
177
+ answer is one authority: `EncodePlan`, from what is made, what is being
178
+ made, what is wanted and what the host can hold. Why no viewer reaches it,
179
+ why the priority map is read at two scopes (per FILE for the swarm, per
180
+ OUTPUT for the encoders), and what each of the eight other places that used
181
+ to place or kill an encoder now states instead.
182
+ - `docs/logs.md` — where to find logs, and the fact that the BROWSER's own log
183
+ is in TWO places split by phase: on the droplet while a transport is being
184
+ acquired and at unload, on THIS proxy for the whole of a viewing
185
+ (`/data/client-<start>-<session>-<torrent>.log`, one file per session).
186
+ Read both before concluding anything from a half-session.
187
+ - `media/playback-planner.js` — single ffmpeg probe returns audioCodec,
188
+ videoCodec, container, durationSeconds. `mode` is advisory; the browser
189
+ decides. `media/keyframe-probe.js` beside it is the OTHER reading of the same
190
+ file, by decoding rather than by parsing, for containers that state no index.
191
+ - `server/` — what a request does, one operation at a time, and nothing
192
+ that lives longer than the operation: `ViewerRequests` (open an output of a
193
+ file and be placed on it, state a position, report progress),
194
+ `SegmentServing` (answer a playlist, init or segment request from the store,
195
+ or hold it until the piece is whole), `OutputLifecycle` (dispose an output
196
+ nobody is on, all of them at shutdown, adopt what an earlier process left),
197
+ and `wire-outputs.js`, which builds the components and hands each the narrow
198
+ host it reads. `hls-session-manager.js` is gone (2.87.0): each of its members
199
+ is a method of the component that owns it. The operations own no long-lived
200
+ fact: the init served for an output is kept by `SegmentStore`, the bytes read
201
+ for an output by `EncodeRuns`, the cold-start measurement by `HostTimings`.
202
+ They import no component's implementation — only the name of an output and
203
+ of its playlist (`encode/output/index.js`) and the keeping period
204
+ (`storage/keep.js`); biome checks it. A held request waits for the store's
205
+ publication event, as long as the requester states (`X-Hold-Ms`) and no
206
+ longer than it stays.
207
+ - `encode/` beside the orchestrator: `OutputOpening` (which output answers a
208
+ request for a file, made if it is not here yet — without knowing who asked),
209
+ `EncodeRuns` (build a run where the plan places it, follow it, account for
210
+ its end, and what its input has received), `EncoderSelection` (the encoder
211
+ in use and the move to software), `Renditions` (the steps of a picture and
212
+ its soundtracks, the master playlist, and which rung a viewer's page says it
213
+ plays), `OutputTimes` (where each segment begins and how the cut table is
214
+ corrected), `CushionReport` (how much film is ready in front of the
215
+ viewers), `output-key-format.js` (which container a key names).
216
+ - `viewer/`: every viewer has a name (`Viewers.of` refuses an empty one); the
217
+ relation to outputs is stored only in `Viewer.outputs` and read the other way
218
+ by `Viewers.forOutput`. A quality request belongs to one viewer and exists
219
+ only in AUTO (`Viewer.askQuality`).
220
+ - `torrent/` reaches the piece store by what it does (`piece-store-of.js`) and
221
+ is handed the store's class by `torrent/worker/worker.js`, where that thread
222
+ is assembled. `transport/` imports nothing of another component; `bin/cli.js`
223
+ hands it the memory reading and the rule for which captures are kept.
224
+ - `encode/hwaccel.js` — detect best H.264 encoder (NVENC/QSV/VAAPI/V4L2M2M) with a
225
+ STRICT startup test: encode `testsrc2` through the real HLS pipeline, then
226
+ verify each segment decodes independently (catches non-IDR/corrupted hw
227
+ output). Falls back to software libx264. Runtime fallback to software if a
228
+ hw encode later fails. v4l2m2m is gated by this test (fails on HA Yellow).
229
+ - `transport/data-channel-handler.js` — forwards WebRTC data-channel requests to the
230
+ local HTTP server (loopback), so the same routes serve both transports.
231
+
232
+ ## Gotchas
233
+
234
+ - Do NOT use `-hls_playlist_type event` — it breaks duration/seek. VOD only.
235
+ - A transitive dep (`ip-set`, via webtorrent) ships a hostile
236
+ `preinstall: npx only-allow pnpm` that breaks `npm install`. The addon works
237
+ around it with `--ignore-scripts` + a targeted rebuild of `node-datachannel`;
238
+ if you ever change install flow, keep that in mind.
239
+
240
+ ## Planned: public reachability (remote access)
241
+
242
+ Decided direction — full plan in the parent `../CLAUDE.md`. Proxy-side pieces:
243
+
244
+ - **Auto port mapping** — IMPLEMENTED (`services/transport/port-mapper.js`, changelog
245
+ 2.9.16). UPnP IGD / NAT-PMP via `@silentbot1/nat-api` (now a direct dep; the
246
+ same lib WebTorrent uses for the torrent port). Maps TCP 9090 with a 2 h
247
+ auto-renewed lease, removed on shutdown (lease expiry covers hard kills).
248
+ Best-effort + start/stop timeouts; `--no-port-mapping` opts out;
249
+ `getMappedEndpoint()` exposes the external endpoint. NOT yet done: mapping the
250
+ **UDP** port WebRTC actually uses (it binds ephemeral UDP ports, so this TCP
251
+ mapping does not yet help WebRTC — roadmap step 3 in the parent CLAUDE.md).
252
+ Also pending (next iteration): a success log line in `transport/port-mapper.js` `stop()`
253
+ (`removed mapping for TCP <port>`) — today stop() only logs on failure, so a
254
+ clean unmap on shutdown is silent.
255
+ - **Report endpoint to server** — ✅ DONE (proxy 2.9.17). The mapped endpoint
256
+ is sent over the tunnel (`tunnel-client.sendEndpoint` → `proxy-endpoint`) on
257
+ mapping success and on every tunnel (re)connect; the server dial-back-verifies
258
+ reachability (server 0.8.22, roadmap step 2).
259
+ - **HTTPS listener**: serve the existing routes over TLS with a per-proxy
260
+ certificate delivered by the server through the tunnel (persist cert+key
261
+ locally; ~90-day renewals are pushed the same way). Add CORS headers for the
262
+ web-app origin so hls.js / `<video>` can fetch cross-origin.
263
+ - Plain HTTPS becomes the preferred video transport; WebRTC data channel stays
264
+ as fallback for hosts where no port could be opened.
265
+ - **Later roadmap steps** (single staged roadmap in parent `../CLAUDE.md`,
266
+ WebRTC-first ordering): step 3 map the WebRTC UDP port (fixed
267
+ `portRangeBegin`/`End` + UPnP-map UDP); step 4 birthday-paradox port
268
+ prediction (open ~256 UDP sockets, inject predicted-port ICE candidates) for
269
+ symmetric NAT; step 5 IPv6-first (audit the candidate filter — do not drop
270
+ *global* v6) + STUN NAT pre-classification reported to the registry; then
271
+ the DNS+TLS path (steps 6–7); step 8 relay-then-upgrade (deferred).
272
+ - Future: ed25519 proxy identity (sign announcements), BEP 44 endpoint
273
+ announcements via the `bittorrent-dht` already bundled with WebTorrent.
274
+
275
+ All of this must stay deployment-agnostic (HA addon, bare npm, Docker).
276
+
277
+ ## Disk hygiene (open item — torrent data is NOT cleaned up today)
278
+
279
+ HLS segments are handled (`server/OutputLifecycle.js`: idle TTL, `disposeSession`,
280
+ `disposeAll`). Torrent data is **partially** handled: shutdown cleanup is done
281
+ (`TorrentPool.destroyAll()` with `destroyStore: true`, wired into the `onClose`
282
+ hook — proxy 2.9.15), but `deselect()` only stops further download and nothing
283
+ removes a torrent's data **while the proxy keeps running**, nor sweeps orphans
284
+ left by a previous hard kill at startup.
285
+
286
+ Level 1 — remaining: `client.remove(torrent, { destroyStore: true })` on last-
287
+ file refcount 0 + idle TTL (mirror the HLS session model); startup sweep of
288
+ orphaned store dirs under `os.tmpdir()`; global disk cap with LRU eviction of
289
+ whole torrents. (Shutdown teardown ✅ done.)
290
+ Level 2 (research): sliding-window chunk store. Full rationale in the parent
291
+ `../CLAUDE.md` "Disk hygiene" section.
292
+
293
+ ## Cloud proxy
294
+
295
+ The same proxy code also runs as the company-hosted fallback when the user
296
+ pool can't serve a viewer. Keep the proxy host-agnostic so it runs unchanged on
297
+ rented infra (flat-rate/unmetered bandwidth — Hetzner dedicated / OVH; NOT
298
+ metered-egress clouds). Provider/economics analysis in the parent
299
+ `../CLAUDE.md` "Cloud proxy" section.
300
+
301
+ ## Changelog
302
+
303
+ Every behavioural change must be recorded in `CHANGELOG.md` — add an entry under
304
+ a new `## <version>` heading at the top, following the existing
305
+ `- **New**/**Fix**/**Chore**:` format.
306
+
307
+ **Do NOT edit `package.json` version.** `npm run patch`/`minor` runs `npm
308
+ version …` which bumps it. Write the CHANGELOG entry at the version that bump
309
+ will produce: **current `package.json` version + 1 patch** (or + 1 minor).
310
+ Accumulate bullets into that single pending entry until it's published. See the
311
+ parent `../CLAUDE.md`.
312
+
313
+ ## Release
314
+
315
+ `npm run patch` (publishes to npm + pushes tags). The HA addon then needs its
316
+ own version bump to pull the new package. Publish proxy BEFORE bumping the addon.
317
+
318
+ **Any proxy change requires bumping the ha-addon version** (`ha-addon/torrent_tv_proxy/config.yaml`). The addon installs the proxy from npm at build time and the build is cached; without a version bump the plugin will NOT update and keeps running the old proxy. So after `npm run patch`, always bump the addon `config.yaml` version, push, and update the addon.
@@ -19,9 +19,9 @@ H.264 High, 24 fps, 2 s each, no audio:
19
19
 
20
20
  ## Why six, and why this grid
21
21
 
22
- `services/hwaccel.js` decodes them at startup and fits the host's decode cost,
22
+ `services/encode/hwaccel.js` decodes them at startup and fits the host's decode cost,
23
23
  `a × Mpixel/s + b × Mbit/s + c`, from the measurements
24
- (`services/decode-cost-fit.js`).
24
+ (`services/encode/decode-cost-fit.js`).
25
25
 
26
26
  The set before this one was three clips for three unknowns — an EXACT system,
27
27
  with two of the clips sharing a pixel count. Such a system cannot fail visibly: