humanish 0.107.0 → 0.108.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (521) hide show
  1. package/ARCHITECTURE.md +22 -17
  2. package/CHANGELOG.md +14 -0
  3. package/CONTEXT.md +51 -44
  4. package/README.md +145 -172
  5. package/SECURITY.md +16 -26
  6. package/TELEMETRY.md +8 -6
  7. package/dist/actors/affordance.d.ts +4 -4
  8. package/dist/actors/affordance.js +12 -12
  9. package/dist/actors/agent-session.d.ts +2 -2
  10. package/dist/actors/agent-session.js +7 -7
  11. package/dist/actors/codex/app-server-actor-trace.d.ts +1 -1
  12. package/dist/actors/codex/app-server-actor-trace.js +1 -1
  13. package/dist/actors/codex/app-server-ui.js +1 -1
  14. package/dist/actors/codex/codex-admission.d.ts +91 -0
  15. package/dist/actors/codex/codex-admission.js +150 -0
  16. package/dist/actors/codex/restricted-executable.d.ts +4 -4
  17. package/dist/actors/codex/restricted-executable.js +8 -8
  18. package/dist/actors/codex/restricted-launch.d.ts +2 -1
  19. package/dist/actors/codex/restricted-launch.js +1 -1
  20. package/dist/actors/codex/restricted-participant.js +8 -6
  21. package/dist/actors/codex/restricted-policy.d.ts +2 -2
  22. package/dist/actors/codex/restricted-policy.js +2 -2
  23. package/dist/actors/codex/restricted-session.d.ts +2 -2
  24. package/dist/actors/codex/restricted-session.js +10 -5
  25. package/dist/actors/computer-use/actor.d.ts +16 -16
  26. package/dist/actors/computer-use/actor.js +2 -2
  27. package/dist/actors/computer-use/admission-limit.d.ts +1 -1
  28. package/dist/actors/computer-use/admission-limit.js +1 -1
  29. package/dist/actors/computer-use/loop/actions.d.ts +3 -3
  30. package/dist/actors/computer-use/loop/actions.js +10 -10
  31. package/dist/actors/computer-use/loop/backstop.d.ts +3 -3
  32. package/dist/actors/computer-use/loop/backstop.js +14 -12
  33. package/dist/actors/computer-use/loop/ending.d.ts +5 -5
  34. package/dist/actors/computer-use/loop/ending.js +7 -7
  35. package/dist/actors/computer-use/loop/observation.d.ts +2 -2
  36. package/dist/actors/computer-use/loop/observation.js +9 -9
  37. package/dist/actors/computer-use/loop/provider-call.d.ts +1 -1
  38. package/dist/actors/computer-use/loop/provider-call.js +1 -1
  39. package/dist/actors/computer-use/loop/session.js +3 -3
  40. package/dist/actors/computer-use/loop/spend.d.ts +1 -1
  41. package/dist/actors/computer-use/loop/spend.js +1 -1
  42. package/dist/actors/computer-use/loop/trace.js +9 -8
  43. package/dist/actors/computer-use/loop/types.d.ts +25 -23
  44. package/dist/actors/computer-use/loop/usage.js +2 -2
  45. package/dist/actors/computer-use/openai-context.d.ts +37 -0
  46. package/dist/actors/computer-use/openai-context.js +214 -0
  47. package/dist/actors/computer-use/openai-provider.d.ts +11 -8
  48. package/dist/actors/computer-use/openai-provider.js +45 -34
  49. package/dist/actors/computer-use/openai-requests.d.ts +36 -10
  50. package/dist/actors/computer-use/openai-requests.js +82 -15
  51. package/dist/actors/computer-use/openai-wire.d.ts +19 -7
  52. package/dist/actors/computer-use/openai-wire.js +36 -34
  53. package/dist/actors/contract.d.ts +78 -43
  54. package/dist/actors/contract.js +29 -23
  55. package/dist/actors/local-agent/claude-session.d.ts +1 -1
  56. package/dist/actors/local-agent/claude-session.js +10 -9
  57. package/dist/actors/local-agent/cli.d.ts +8 -6
  58. package/dist/actors/local-agent/cli.js +24 -28
  59. package/dist/actors/local-agent/readiness.d.ts +2 -2
  60. package/dist/actors/local-agent/readiness.js +4 -4
  61. package/dist/actors/reasoning-effort.js +6 -6
  62. package/dist/actors/registry.d.ts +10 -10
  63. package/dist/actors/registry.js +18 -17
  64. package/dist/actors/scripted-browser/actor.d.ts +8 -8
  65. package/dist/actors/scripted-browser/actor.js +16 -16
  66. package/dist/actors/scripted-browser/browser-command.js +1 -1
  67. package/dist/actors/scripted-browser/steps.js +1 -1
  68. package/dist/actors/scripted-browser/types.d.ts +1 -1
  69. package/dist/actors/stop-conditions.d.ts +1 -1
  70. package/dist/analysis/codex-config.d.ts +6 -2
  71. package/dist/analysis/codex-config.js +22 -14
  72. package/dist/analysis/service.js +5 -5
  73. package/dist/cli/commands/analyze.js +19 -16
  74. package/dist/cli/commands/codex.js +9 -9
  75. package/dist/cli/commands/comms.js +54 -33
  76. package/dist/cli/commands/feedback.js +20 -21
  77. package/dist/cli/commands/lab-format.d.ts +5 -4
  78. package/dist/cli/commands/lab-format.js +35 -23
  79. package/dist/cli/commands/lab-route-computer-use.js +6 -7
  80. package/dist/cli/commands/lab-route-preview.js +4 -3
  81. package/dist/cli/commands/lab-route-shared-world.js +3 -3
  82. package/dist/cli/commands/lab-run.js +10 -11
  83. package/dist/cli/commands/lab-scorer.d.ts +2 -2
  84. package/dist/cli/commands/lab-scorer.js +1 -1
  85. package/dist/cli/commands/migrate.d.ts +4 -0
  86. package/dist/cli/commands/migrate.js +65 -0
  87. package/dist/cli/commands/observe.js +147 -108
  88. package/dist/cli/commands/run-command.d.ts +10 -0
  89. package/dist/cli/commands/run-command.js +85 -0
  90. package/dist/cli/commands/runs.js +137 -138
  91. package/dist/cli/commands/setup.d.ts +2 -2
  92. package/dist/cli/commands/setup.js +26 -21
  93. package/dist/cli/commands/study.d.ts +3 -0
  94. package/dist/cli/commands/study.js +182 -0
  95. package/dist/cli/commands/tui.d.ts +4 -4
  96. package/dist/cli/commands/tui.js +21 -21
  97. package/dist/cli/commands/watch.js +60 -75
  98. package/dist/cli/deprecations.d.ts +18 -0
  99. package/dist/cli/deprecations.js +48 -0
  100. package/dist/cli/doctor.d.ts +15 -5
  101. package/dist/cli/doctor.js +103 -48
  102. package/dist/cli/first-run-path.d.ts +12 -10
  103. package/dist/cli/first-run-path.js +30 -28
  104. package/dist/cli/io.d.ts +41 -6
  105. package/dist/cli/io.js +97 -22
  106. package/dist/cli/observer-follow.d.ts +2 -2
  107. package/dist/cli/observer-follow.js +5 -6
  108. package/dist/cli/orientation.d.ts +6 -3
  109. package/dist/cli/orientation.js +43 -39
  110. package/dist/cli/product-sentence.d.ts +6 -0
  111. package/dist/cli/product-sentence.js +6 -0
  112. package/dist/cli/program.d.ts +6 -1
  113. package/dist/cli/program.js +109 -40
  114. package/dist/cli/telemetry.d.ts +15 -15
  115. package/dist/cli/telemetry.js +48 -40
  116. package/dist/cli.js +1 -1
  117. package/dist/comms/capture-surface.d.ts +13 -12
  118. package/dist/comms/capture-surface.js +23 -22
  119. package/dist/comms/catch-host.d.ts +7 -7
  120. package/dist/comms/catch-host.js +14 -14
  121. package/dist/comms/email-catch.d.ts +3 -3
  122. package/dist/comms/email-catch.js +8 -8
  123. package/dist/comms/external-evidence.js +2 -2
  124. package/dist/comms/extract.js +2 -2
  125. package/dist/comms/fake-inbox.d.ts +2 -2
  126. package/dist/comms/fake-inbox.js +2 -2
  127. package/dist/comms/receiving-render.d.ts +1 -1
  128. package/dist/comms/receiving-render.js +2 -2
  129. package/dist/comms/sandbox-catch-script.d.ts +6 -6
  130. package/dist/comms/sandbox-catch-script.js +6 -6
  131. package/dist/comms/sandbox-catch.d.ts +36 -37
  132. package/dist/comms/sandbox-catch.js +34 -35
  133. package/dist/comms/setup.js +42 -8
  134. package/dist/comms/thread-evidence.d.ts +1 -1
  135. package/dist/comms/thread-evidence.js +6 -6
  136. package/dist/comms/types.d.ts +6 -6
  137. package/dist/comms/types.js +3 -3
  138. package/dist/evidence/frame-signature.d.ts +1 -1
  139. package/dist/evidence/frame-signature.js +4 -4
  140. package/dist/evidence/redaction.d.ts +3 -3
  141. package/dist/evidence/redaction.js +4 -4
  142. package/dist/feedback/draft.js +36 -78
  143. package/dist/feedback/export-bundle.js +1 -1
  144. package/dist/feedback/export.d.ts +5 -1
  145. package/dist/feedback/export.js +7 -8
  146. package/dist/feedback/feedback.d.ts +2 -2
  147. package/dist/feedback/feedback.js +21 -3
  148. package/dist/guest/chromium-text.js +2 -2
  149. package/dist/guest/desktop-native.d.ts +1 -1
  150. package/dist/guest/runtime.js +1 -1
  151. package/dist/index.d.ts +12 -10
  152. package/dist/index.js +8 -6
  153. package/dist/keys/key-resolution.d.ts +5 -5
  154. package/dist/keys/key-resolution.js +23 -23
  155. package/dist/lab/adapter-extension.d.ts +7 -7
  156. package/dist/lab/adapter-extension.js +13 -36
  157. package/dist/lab/adapter-scorer-loader.d.ts +7 -7
  158. package/dist/lab/adapter-scorer-loader.js +32 -32
  159. package/dist/lab/composition-rules.js +42 -42
  160. package/dist/lab/config.js +65 -25
  161. package/dist/lab/deprecated-fields.d.ts +10 -0
  162. package/dist/lab/deprecated-fields.js +24 -0
  163. package/dist/lab/device-presets.d.ts +8 -8
  164. package/dist/lab/device-presets.js +11 -11
  165. package/dist/lab/discover.d.ts +13 -9
  166. package/dist/lab/discover.js +117 -57
  167. package/dist/lab/doctor.d.ts +10 -3
  168. package/dist/lab/doctor.js +47 -9
  169. package/dist/lab/init-templates.js +147 -147
  170. package/dist/lab/init.d.ts +1 -1
  171. package/dist/lab/init.js +41 -9
  172. package/dist/lab/keys.d.ts +2 -0
  173. package/dist/lab/keys.js +42 -8
  174. package/dist/lab/lab-deps.d.ts +7 -12
  175. package/dist/lab/parse/actors.js +9 -9
  176. package/dist/lab/parse/comms.js +5 -5
  177. package/dist/lab/parse/execution.js +13 -13
  178. package/dist/lab/parse/study-v3.d.ts +23 -0
  179. package/dist/lab/parse/study-v3.js +259 -0
  180. package/dist/lab/parse/subject-state.d.ts +7 -7
  181. package/dist/lab/parse/subject-state.js +16 -16
  182. package/dist/lab/parse/subject.js +28 -28
  183. package/dist/lab/parse/values.d.ts +1 -1
  184. package/dist/lab/parse/values.js +3 -3
  185. package/dist/lab/persona-resolve.d.ts +4 -4
  186. package/dist/lab/persona-resolve.js +4 -4
  187. package/dist/lab/plan-participants.d.ts +2 -2
  188. package/dist/lab/plan-types.d.ts +4 -4
  189. package/dist/lab/plan.d.ts +1 -7
  190. package/dist/lab/plan.js +10 -41
  191. package/dist/lab/preflight-probes.js +11 -11
  192. package/dist/lab/preflight-result.d.ts +2 -1
  193. package/dist/lab/preflight-result.js +5 -4
  194. package/dist/lab/preflight.d.ts +7 -5
  195. package/dist/lab/preflight.js +5 -5
  196. package/dist/lab/routing.d.ts +31 -25
  197. package/dist/lab/routing.js +60 -29
  198. package/dist/lab/run-lab-events.d.ts +0 -3
  199. package/dist/lab/run-lab-events.js +0 -6
  200. package/dist/lab/run-lab-homes.d.ts +22 -10
  201. package/dist/lab/run-lab-homes.js +5 -1
  202. package/dist/lab/run-lab-options.d.ts +1 -1
  203. package/dist/lab/run-lab-options.js +16 -13
  204. package/dist/lab/summary.d.ts +7 -6
  205. package/dist/lab/summary.js +10 -10
  206. package/dist/lab/tasks.d.ts +15 -15
  207. package/dist/lab/tasks.js +14 -14
  208. package/dist/lab/types.d.ts +101 -95
  209. package/dist/lab/types.js +2 -0
  210. package/dist/lab/validation.d.ts +13 -13
  211. package/dist/lab/validation.js +44 -42
  212. package/dist/lab/warnings.d.ts +10 -0
  213. package/dist/lab/warnings.js +61 -33
  214. package/dist/library-aliases.d.ts +56 -0
  215. package/dist/library-aliases.js +22 -0
  216. package/dist/observer/artifact.d.ts +1 -1
  217. package/dist/observer/artifact.js +6 -6
  218. package/dist/observer/data.d.ts +6 -6
  219. package/dist/observer/data.js +5 -4
  220. package/dist/observer/exposure.d.ts +1 -1
  221. package/dist/observer/exposure.js +11 -11
  222. package/dist/observer/http.js +1 -1
  223. package/dist/observer/library.d.ts +1 -1
  224. package/dist/observer/library.js +4 -2
  225. package/dist/observer/listen.js +5 -4
  226. package/dist/observer/render.d.ts +1 -1
  227. package/dist/observer/render.js +10 -5
  228. package/dist/observer/run-routes.d.ts +3 -3
  229. package/dist/observer/run-routes.js +1 -1
  230. package/dist/observer/serve.js +7 -3
  231. package/dist/observer/tunnel.js +1 -1
  232. package/dist/observer-app.html +4 -4
  233. package/dist/routes/computer-use/bundle-parts.d.ts +9 -9
  234. package/dist/routes/computer-use/bundle-parts.js +15 -15
  235. package/dist/routes/computer-use/bundle.js +3 -3
  236. package/dist/routes/computer-use/e2b-desktop/comms.d.ts +1 -1
  237. package/dist/routes/computer-use/e2b-desktop/comms.js +14 -14
  238. package/dist/routes/computer-use/e2b-desktop/desktop.js +4 -4
  239. package/dist/routes/computer-use/e2b-desktop/fidelity.d.ts +4 -3
  240. package/dist/routes/computer-use/e2b-desktop/fidelity.js +11 -10
  241. package/dist/routes/computer-use/e2b-desktop/prepare.js +7 -7
  242. package/dist/routes/computer-use/e2b-desktop/start.js +9 -8
  243. package/dist/routes/computer-use/e2b-desktop/teardown.js +5 -4
  244. package/dist/routes/computer-use/external-comms.d.ts +1 -1
  245. package/dist/routes/computer-use/external-comms.js +1 -1
  246. package/dist/routes/computer-use/fanout-bundle.js +18 -18
  247. package/dist/routes/computer-use/fanout-records.js +10 -11
  248. package/dist/routes/computer-use/live-flush.d.ts +1 -1
  249. package/dist/routes/computer-use/live-flush.js +6 -6
  250. package/dist/routes/computer-use/live-phase.d.ts +4 -2
  251. package/dist/routes/computer-use/live-phase.js +6 -6
  252. package/dist/routes/computer-use/local-vm.js +1 -1
  253. package/dist/routes/computer-use/participant-desktop.d.ts +4 -4
  254. package/dist/routes/computer-use/participant-desktop.js +4 -4
  255. package/dist/routes/computer-use/participant-execution.d.ts +4 -4
  256. package/dist/routes/computer-use/participant-execution.js +9 -9
  257. package/dist/routes/computer-use/participant-model.d.ts +6 -0
  258. package/dist/routes/computer-use/participant-model.js +31 -13
  259. package/dist/routes/computer-use/participant-prompt.d.ts +11 -11
  260. package/dist/routes/computer-use/participant-prompt.js +6 -6
  261. package/dist/routes/computer-use/participant-runs.d.ts +7 -7
  262. package/dist/routes/computer-use/participant-runs.js +13 -13
  263. package/dist/routes/computer-use/plan.js +22 -22
  264. package/dist/routes/computer-use/preflight.js +21 -21
  265. package/dist/routes/computer-use/rerun-selection.js +1 -1
  266. package/dist/routes/computer-use/result.js +11 -11
  267. package/dist/routes/computer-use/route.d.ts +2 -1
  268. package/dist/routes/computer-use/route.js +15 -14
  269. package/dist/routes/computer-use/self-report.d.ts +7 -7
  270. package/dist/routes/computer-use/self-report.js +31 -31
  271. package/dist/routes/computer-use/setup.d.ts +1 -1
  272. package/dist/routes/computer-use/setup.js +17 -18
  273. package/dist/routes/computer-use/single-bundle.d.ts +7 -7
  274. package/dist/routes/computer-use/single-bundle.js +28 -30
  275. package/dist/routes/computer-use/subject-projection.d.ts +1 -1
  276. package/dist/routes/computer-use/subject-projection.js +6 -6
  277. package/dist/routes/computer-use/types.d.ts +40 -42
  278. package/dist/routes/computer-use/types.js +10 -10
  279. package/dist/routes/preview.d.ts +8 -2
  280. package/dist/routes/preview.js +8 -4
  281. package/dist/routes/scripted/bundle.d.ts +2 -2
  282. package/dist/routes/scripted/bundle.js +13 -12
  283. package/dist/routes/scripted/plan.d.ts +1 -1
  284. package/dist/routes/scripted/plan.js +9 -9
  285. package/dist/routes/scripted/result.js +5 -5
  286. package/dist/routes/scripted/route.js +5 -6
  287. package/dist/routes/scripted/scenario.js +2 -2
  288. package/dist/routes/scripted/setup.js +7 -7
  289. package/dist/routes/scripted/subject.js +1 -1
  290. package/dist/routes/scripted/surface-records.js +3 -3
  291. package/dist/routes/scripted/types.d.ts +3 -5
  292. package/dist/routes/scripted/types.js +1 -1
  293. package/dist/routes/shared-world/bundle-records.js +9 -8
  294. package/dist/routes/shared-world/bundle.d.ts +5 -5
  295. package/dist/routes/shared-world/bundle.js +40 -38
  296. package/dist/routes/shared-world/checkpoints.d.ts +1 -1
  297. package/dist/routes/shared-world/checkpoints.js +1 -1
  298. package/dist/routes/shared-world/comms.d.ts +5 -5
  299. package/dist/routes/shared-world/comms.js +14 -14
  300. package/dist/routes/shared-world/external-public.d.ts +4 -3
  301. package/dist/routes/shared-world/external-public.js +16 -12
  302. package/dist/routes/shared-world/handoff.d.ts +7 -6
  303. package/dist/routes/shared-world/handoff.js +65 -57
  304. package/dist/routes/shared-world/lobby-code.d.ts +2 -2
  305. package/dist/routes/shared-world/lobby-code.js +9 -9
  306. package/dist/routes/shared-world/participant-specs.d.ts +7 -6
  307. package/dist/routes/shared-world/participant-specs.js +31 -24
  308. package/dist/routes/shared-world/plan.js +7 -7
  309. package/dist/routes/shared-world/provenance.d.ts +2 -2
  310. package/dist/routes/shared-world/provenance.js +2 -2
  311. package/dist/routes/shared-world/provisioned.js +14 -13
  312. package/dist/routes/shared-world/result.js +20 -21
  313. package/dist/routes/shared-world/route.js +23 -22
  314. package/dist/routes/shared-world/setup.d.ts +3 -3
  315. package/dist/routes/shared-world/setup.js +4 -4
  316. package/dist/routes/shared-world/types.d.ts +30 -28
  317. package/dist/routes/shared-world/types.js +4 -4
  318. package/dist/routes/terminal/adapter.d.ts +3 -3
  319. package/dist/routes/terminal/adapter.js +5 -5
  320. package/dist/routes/terminal/bundle.d.ts +3 -3
  321. package/dist/routes/terminal/bundle.js +22 -21
  322. package/dist/routes/terminal/credentials.d.ts +4 -4
  323. package/dist/routes/terminal/credentials.js +7 -7
  324. package/dist/routes/terminal/dry-run.js +4 -4
  325. package/dist/routes/terminal/encoding.js +2 -2
  326. package/dist/routes/terminal/ledger.d.ts +3 -3
  327. package/dist/routes/terminal/ledger.js +14 -14
  328. package/dist/routes/terminal/live-finish.js +3 -3
  329. package/dist/routes/terminal/live-sandbox.js +12 -13
  330. package/dist/routes/terminal/persona.js +1 -1
  331. package/dist/routes/terminal/plan.js +11 -11
  332. package/dist/routes/terminal/recorder.js +2 -2
  333. package/dist/routes/terminal/result.js +8 -8
  334. package/dist/routes/terminal/route.js +6 -7
  335. package/dist/routes/terminal/sandbox.d.ts +1 -1
  336. package/dist/routes/terminal/sandbox.js +1 -1
  337. package/dist/routes/terminal/session.js +8 -7
  338. package/dist/routes/terminal/token-usage.d.ts +1 -1
  339. package/dist/routes/terminal/token-usage.js +7 -8
  340. package/dist/routes/terminal/trace.d.ts +2 -2
  341. package/dist/routes/terminal/trace.js +2 -2
  342. package/dist/routes/terminal/types.d.ts +26 -28
  343. package/dist/routes/terminal/types.js +3 -3
  344. package/dist/run/bundle-shape.js +3 -3
  345. package/dist/run/bundle.d.ts +46 -46
  346. package/dist/run/bundle.js +2 -1
  347. package/dist/run/cost-summary.js +3 -3
  348. package/dist/run/costs.js +7 -1
  349. package/dist/run/detail.d.ts +6 -6
  350. package/dist/run/detail.js +4 -4
  351. package/dist/run/dry-run-inputs.js +1 -1
  352. package/dist/run/dry-run.js +18 -18
  353. package/dist/run/judge.d.ts +19 -13
  354. package/dist/run/judge.js +18 -8
  355. package/dist/run/paths.d.ts +1 -1
  356. package/dist/run/paths.js +1 -1
  357. package/dist/run/pricing.d.ts +11 -6
  358. package/dist/run/pricing.js +20 -13
  359. package/dist/run/projection.d.ts +14 -14
  360. package/dist/run/projection.js +15 -15
  361. package/dist/run/reclaim.js +2 -2
  362. package/dist/run/results.d.ts +5 -5
  363. package/dist/run/run-index.d.ts +8 -6
  364. package/dist/run/run-index.js +15 -16
  365. package/dist/run/run-not-found.d.ts +5 -0
  366. package/dist/run/run-not-found.js +15 -0
  367. package/dist/run/run.d.ts +5 -4
  368. package/dist/run/run.js +1 -1
  369. package/dist/run/sandbox-receipts.d.ts +2 -2
  370. package/dist/run/sandbox-receipts.js +3 -3
  371. package/dist/run/shared-world-evidence.d.ts +36 -35
  372. package/dist/run/shared-world-evidence.js +4 -4
  373. package/dist/run/shared-world-shape.d.ts +1 -1
  374. package/dist/run/shared-world-shape.js +6 -6
  375. package/dist/run/stats.d.ts +12 -6
  376. package/dist/run/stats.js +116 -58
  377. package/dist/run/status.d.ts +8 -29
  378. package/dist/run/status.js +5 -27
  379. package/dist/run/stored-runs.js +2 -1
  380. package/dist/run/stream-shape.js +1 -1
  381. package/dist/run/streams.d.ts +6 -6
  382. package/dist/run/study-provenance.d.ts +47 -0
  383. package/dist/run/study-provenance.js +63 -0
  384. package/dist/run/study-result.d.ts +16 -0
  385. package/dist/run/study-result.js +9 -0
  386. package/dist/run/text.d.ts +2 -0
  387. package/dist/run/text.js +4 -0
  388. package/dist/run-lab.d.ts +7 -7
  389. package/dist/run-lab.js +1 -3
  390. package/dist/study/convert.d.ts +33 -0
  391. package/dist/study/convert.js +432 -0
  392. package/dist/study/field-paths.d.ts +12 -0
  393. package/dist/study/field-paths.js +126 -0
  394. package/dist/study/files.d.ts +26 -0
  395. package/dist/study/files.js +43 -0
  396. package/dist/study/migrate.d.ts +48 -0
  397. package/dist/study/migrate.js +408 -0
  398. package/dist/study/owned-files.d.ts +38 -0
  399. package/dist/study/owned-files.js +182 -0
  400. package/dist/subject/clone.d.ts +1 -1
  401. package/dist/subject/desktop-cli.d.ts +1 -1
  402. package/dist/subject/desktop-cli.js +2 -2
  403. package/dist/subject/local-tree-archive.js +1 -1
  404. package/dist/subject/local-tree.d.ts +1 -1
  405. package/dist/subject/node-bootstrap.js +1 -1
  406. package/dist/subject/runtime.js +8 -9
  407. package/dist/subject/serve.d.ts +1 -1
  408. package/dist/subject/serve.js +3 -3
  409. package/dist/subject/state.d.ts +1 -1
  410. package/dist/subject/steps.d.ts +5 -5
  411. package/dist/subject/steps.js +4 -4
  412. package/dist/substrates/command-failure.d.ts +3 -3
  413. package/dist/substrates/command-failure.js +3 -3
  414. package/dist/substrates/detached.d.ts +6 -6
  415. package/dist/substrates/detached.js +7 -7
  416. package/dist/substrates/e2b/cdp-probe.d.ts +9 -9
  417. package/dist/substrates/e2b/cdp-probe.js +14 -17
  418. package/dist/substrates/e2b/desktop-browser.d.ts +2 -2
  419. package/dist/substrates/e2b/desktop-browser.js +8 -8
  420. package/dist/substrates/e2b/desktop-cdp.d.ts +9 -9
  421. package/dist/substrates/e2b/desktop-cdp.js +8 -8
  422. package/dist/substrates/e2b/desktop-executor.d.ts +1 -1
  423. package/dist/substrates/e2b/desktop-executor.js +1 -1
  424. package/dist/substrates/e2b/desktop-geometry.d.ts +3 -3
  425. package/dist/substrates/e2b/desktop-geometry.js +7 -7
  426. package/dist/substrates/e2b/desktop-media.d.ts +1 -1
  427. package/dist/substrates/e2b/desktop-media.js +1 -1
  428. package/dist/substrates/e2b/desktop-screenshot-cleanup.d.ts +3 -3
  429. package/dist/substrates/e2b/desktop-screenshot-cleanup.js +3 -3
  430. package/dist/substrates/e2b/sandbox.d.ts +1 -1
  431. package/dist/substrates/e2b/sandbox.js +1 -1
  432. package/dist/substrates/e2b/sdk.d.ts +11 -11
  433. package/dist/substrates/e2b/sdk.js +6 -6
  434. package/dist/tui/actions.d.ts +1 -1
  435. package/dist/tui/actions.js +13 -13
  436. package/dist/tui/contract.d.ts +16 -16
  437. package/dist/tui/contract.js +10 -10
  438. package/dist/tui/launch.d.ts +4 -4
  439. package/dist/tui/launch.js +18 -19
  440. package/dist/tui/project.js +5 -5
  441. package/dist/tui-app.js +82 -82
  442. package/dist/verify/actor.d.ts +8 -8
  443. package/dist/verify/actor.js +36 -36
  444. package/dist/verify/artifacts.d.ts +2 -2
  445. package/dist/verify/artifacts.js +3 -3
  446. package/dist/verify/context-growth.d.ts +9 -0
  447. package/dist/verify/context-growth.js +62 -0
  448. package/dist/verify/costs.d.ts +6 -6
  449. package/dist/verify/costs.js +8 -8
  450. package/dist/verify/shared-world-concurrent.d.ts +2 -2
  451. package/dist/verify/shared-world-concurrent.js +79 -76
  452. package/dist/verify/shared-world.d.ts +2 -2
  453. package/dist/verify/shared-world.js +16 -16
  454. package/dist/verify/subject.d.ts +4 -4
  455. package/dist/verify/subject.js +18 -18
  456. package/dist/verify/verify.js +92 -43
  457. package/docs/README.md +25 -32
  458. package/docs/architecture/actor-contract.md +56 -87
  459. package/docs/architecture/desktop-sessions.md +7 -7
  460. package/docs/architecture/external-public-shared-world.md +61 -59
  461. package/docs/architecture/github-feedback-loop.md +1 -4
  462. package/docs/architecture/guest-desktop.md +2 -2
  463. package/docs/architecture/observer.md +34 -34
  464. package/docs/architecture/restricted-codex-analysis.md +34 -28
  465. package/docs/architecture/serve.md +34 -37
  466. package/docs/architecture/state-driven-executor.md +55 -58
  467. package/docs/architecture/task-protocol-support.md +5 -5
  468. package/docs/architecture/terminal-product-route.md +67 -107
  469. package/docs/contracts/README.md +24 -0
  470. package/docs/contracts/adapter-admission.md +3 -3
  471. package/docs/contracts/adapter-fixtures.md +2 -5
  472. package/docs/contracts/core.md +1 -3
  473. package/docs/contracts/errors.md +62 -0
  474. package/docs/contracts/feedback.md +8 -9
  475. package/docs/contracts/policy.md +7 -12
  476. package/docs/contracts/run-bundle.md +45 -44
  477. package/docs/contracts/schemas.md +421 -362
  478. package/docs/contracts/study-analysis.md +3 -3
  479. package/docs/contracts/study-costs.md +11 -7
  480. package/docs/decisions/0001-run-bundle-is-the-source-of-truth.md +1 -1
  481. package/docs/decisions/0002-observer-is-one-self-contained-file.md +2 -2
  482. package/docs/decisions/0003-contained-paths-and-cleanup-authority.md +3 -3
  483. package/docs/principles/actor-fidelity.md +4 -4
  484. package/docs/principles/engineering.md +3 -3
  485. package/docs/principles/invariants-and-defaults.md +38 -38
  486. package/docs/principles/self-driving-harness.md +1 -5
  487. package/docs/principles/three-roles.md +1 -1
  488. package/docs/product/automatic-analysis.md +7 -7
  489. package/examples/participant/README.md +5 -5
  490. package/examples/participant/run.mjs +11 -10
  491. package/examples/scorer/README.md +3 -3
  492. package/examples/scorer/run.mjs +11 -12
  493. package/package.json +16 -17
  494. package/skills/humanish/SKILL.md +60 -58
  495. package/skills/humanish/agents/openai.yaml +1 -1
  496. package/AGENTS.md +0 -99
  497. package/CONTRIBUTING.md +0 -148
  498. package/dist/actors/codex/qualified-versions.d.ts +0 -72
  499. package/dist/actors/codex/qualified-versions.js +0 -132
  500. package/dist/cli/commands/lab.d.ts +0 -3
  501. package/dist/cli/commands/lab.js +0 -199
  502. package/dist/cli/renamed-options.d.ts +0 -11
  503. package/dist/cli/renamed-options.js +0 -18
  504. package/dist/observer/static.d.ts +0 -39
  505. package/dist/observer/static.js +0 -369
  506. package/docs/architecture/comms-inbox.md +0 -122
  507. package/docs/architecture/desktop-recording.md +0 -80
  508. package/docs/architecture/local-browser-runtime.md +0 -178
  509. package/docs/architecture/observer-review.md +0 -144
  510. package/docs/architecture/participant-media.md +0 -90
  511. package/docs/architecture/project-layout.md +0 -62
  512. package/docs/architecture/real-email-receiving.md +0 -136
  513. package/docs/assets/humanish-drawdb-hero.png +0 -0
  514. package/docs/assets/humanish-observer-hero.png +0 -0
  515. package/docs/goals/current.md +0 -207
  516. package/docs/product/lobby-trivia-3player-external-public.md +0 -77
  517. package/docs/product/open-source-install-experience.md +0 -240
  518. package/docs/ramp/README.md +0 -295
  519. package/docs/release/open-source-readiness.md +0 -222
  520. package/docs/release/public-readiness-standard.md +0 -210
  521. package/docs/roadmap/world-class-open-source-v0.md +0 -311
@@ -1,178 +0,0 @@
1
- # Local browser studies
2
-
3
- Linux x64 and supported Apple Silicon Mac users can run isolated Firecracker
4
- browser participants from the installed CLI or TUI. Docker manages their
5
- containers and private state volumes; the normal study runner supplies
6
- scheduling, recordings, Observer and findings.
7
- No separate host service is installed.
8
-
9
- ## Start a study
10
-
11
- Both platforms need a signed-in, supported Codex CLI. Linux needs a local,
12
- rootful Docker Engine, KVM (`/dev/kvm`) and TUN (`/dev/net/tun`). Macs need an
13
- M3-or-newer chip, native ARM64 Node, Lima 2.2+ (`brew install lima`) and a macOS
14
- version supporting nested virtualization; see [Mac setup](#apple-silicon-macs).
15
- Docker Desktop is unnecessary. See
16
- [Codex account setup](restricted-codex-analysis.md) for the qualified version
17
- and account restrictions. Docker access is an administrative capability.
18
- humanish does not install Docker on Linux or change host permissions. On Mac,
19
- setup installs Docker only inside the dedicated Lima host.
20
-
21
- Configure the starter while initializing the project, then start your app on
22
- the same loopback URL:
23
-
24
- ```sh
25
- npx humanish init --yes \
26
- --local-browser http://127.0.0.1:3000 \
27
- --local-mission "Create a note and explain anything confusing about saving it"
28
- npx humanish doctor --lab local-browser
29
- npx humanish run local-browser
30
- npx humanish verify
31
- ```
32
-
33
- `verify` checks the saved run bundle, and its share-safety line says whether the evidence can be
34
- shared as-is. `init` also adds `humanish:*` scripts to `package.json`; `humanish:run` among them
35
- is `humanish run --dry-run`, a contract-proof dry run rather than this live study. `init` also
36
- writes `humanish/labs/local-browser.yaml` with safe defaults when the two options are omitted.
37
- The options provide the normal setup path for the app URL and mission on first setup. If the
38
- file already exists, `init` preserves it and warns that these options were skipped; edit the
39
- existing manifest to change its URL or mission. The commands above write this lab (its
40
- `description` is omitted here):
41
-
42
- ```yaml
43
- schema: humanish.lab.v2
44
- id: local-browser
45
- title: Local browser · your app · Codex account
46
- subject:
47
- source: app-url
48
- appUrl: "http://127.0.0.1:3000"
49
- actors:
50
- - type: local-agent
51
- localAgent: codex
52
- persona: synthetic-new-user
53
- mission: "Create a note and explain anything confusing about saving it"
54
- execution:
55
- target: local
56
- concurrency: 1
57
- timeoutMs: 120000
58
- scenario:
59
- mode: live
60
- defaults:
61
- open: true
62
- ```
63
-
64
- ```sh
65
- npx humanish runtime status --json
66
- npx humanish doctor --lab local-browser --json
67
- npx humanish run local-browser
68
- npx humanish verify
69
- ```
70
-
71
- The first live run downloads the pinned runtime archive (about 569 MiB on x64 or
72
- 556 MiB on ARM64), verifies its exact size and SHA-256, and loads it into Docker.
73
- Later runs reuse the image.
74
- `humanish runtime setup` prepares it in advance. Status, doctor and dry-run never
75
- download an image or launch a participant. Preparation does not consume the
76
- participant's task-time budget. The TUI lists the same lab and runtime readiness;
77
- starting it uses the same preparation and execution path.
78
-
79
- This configuration needs neither an E2B key nor an OpenAI API key. Participants
80
- and the separate post-run analyst use Codex account quota and **remote model
81
- inference**. It is not an offline model. The restricted participant has no host
82
- shell, checkout mount or credential files. Account dollar cost and output-token
83
- ceilings are unknown; numeric dollar/token caps are rejected. Set
84
- `review.analysis: false` to skip analysis.
85
-
86
- For API billing and its supported caps, use `type: openai-computer-use`, remove
87
- `localAgent`, and provide `OPENAI_API_KEY`. Its analysis retains the existing API
88
- default. Neither path silently falls back to another provider or hosted desktop.
89
- Existing labs without `execution.target: local` retain their previous behavior.
90
-
91
- Before handing the desktop to the participant, the guest opens the
92
- selected app and waits up to 30 seconds for the initial document's
93
- `DOMContentLoaded` event, then allows a bounded paint. It does not wait for app
94
- data, images or network idle: the app's own loading screen remains observable.
95
- Navigation failures and timeouts fail startup and release the owned desktop.
96
- Later participant actions and observations do not use this startup wait.
97
-
98
- ## Current limits
99
-
100
- - Linux x64 or M3-or-newer Mac with native ARM64 Node and Lima. Linux ARM64 is
101
- refused: the local participant, the restricted Codex participant, runs only on
102
- Linux x64 and Apple-silicon macOS. The installed Mac setup was tested on an M5
103
- Max; smaller machines are not capacity-qualified.
104
- - On Linux, a local Docker Engine; remote contexts, rootless Docker and Docker
105
- Desktop are unsupported. The Mac adapter uses Docker inside its own Lima host.
106
- - Loopback HTTP(S) app URLs on explicit ports above 1023. Each participant can
107
- reach its selected app port, its assigned captured inbox when declared, and public destinations over ordinary TCP/UDP.
108
- Other private host/LAN destinations and cloud metadata are blocked.
109
- - Chromium at 960×720, 2 vCPUs and 2 GiB guest RAM per participant. Docker's
110
- enclosing memory limit is 3 GiB. Start with a small concurrency for your host;
111
- these allocations are not a promise of measured peak memory or capacity.
112
- - Browser-only by default. [Optional camera and spoken conversation](participant-media.md)
113
- use a separate media image and the same study loop.
114
- - [Captured inboxes](comms-inbox.md#local-browser-studies) use an operator-run mail catch.
115
- Real email receiving remains unsupported on the local route.
116
- - A 20-minute default and maximum participant session budget, within the runtime
117
- image's 30-minute process lifetime. A shorter `execution.timeoutMs` is supported.
118
- - Codex participants currently use `gpt-6-astra` at low effort. Hosted templates,
119
- device presets and hosted sandbox timeouts do not apply.
120
-
121
- Normal close and cooperative startup cancellation remove the owned container
122
- and its private state volume. After a desktop connects, controller death
123
- disconnects the guest, which reboots; Firecracker exits and Docker removes both.
124
- A small host socket directory can remain after abrupt death.
125
- Run evidence remains in `.humanish/` under the normal local capture and sharing
126
- rules. An unconfirmed release is reported as such.
127
-
128
- ## Runtime maintenance
129
-
130
- The npm build pins a release URL, byte count, SHA-256 and immutable Docker image
131
- ID in `src/substrates/local/runtime-release.ts`. It has no moving `latest` image dependency.
132
- Runtime releases include source archives and notices separately; study users do
133
- not download those archives. Updating a runtime requires a reviewed catalog
134
- change and a new CLI release.
135
-
136
- Source builders can use the
137
- [maintained recipes](https://github.com/danielgwilson/humanish/blob/main/runtime/local-firecracker/README.md) and set
138
- `HUMANISH_LOCAL_RUNTIME_IMAGE` to an already-built compatible local image. An
139
- invalid override fails; it does not cause an implicit registry pull.
140
-
141
- ## Apple Silicon Macs
142
-
143
- The Mac adapter uses a dedicated `humanish-runtime` Lima/VZ host on M3 or
144
- newer Macs, with Lima 2.2+ and macOS supporting nested virtualization. Docker
145
- runs inside that host; Docker Desktop is unnecessary. Setup creates the host
146
- with 6 CPUs, 8 GiB RAM and an 80 GiB growable disk. It mounts no Mac directories.
147
- Start with two participants; larger concurrency has not been qualified by this
148
- integration. Use Lima's normal resource configuration for subsequent capacity
149
- experiments, without changing study concurrency behind the user's back.
150
-
151
- The scheduler and study loop remain shared. Standard OpenSSH forwards the
152
- browser-control Unix socket to the Mac, and the selected app port back into the
153
- Linux host. It preserves HTTP(S)/WebSocket bytes without parsing them. Codex
154
- runs on the Mac and retains the same separate participant/analyst profiles and
155
- file-backed login requirement. Keychain-only authentication is not supported.
156
-
157
- The installed CLI passed first-attempt public image setup and two-participant
158
- studies on an M5 Max: distinct app-side saves, overlapping participants,
159
- verified recordings and automatic account analysis. A fresh Lima instance used
160
- the public ARM64 catalog without a development image override. The separately
161
- available source archives match that native build. The manually dispatched ARM64
162
- job in `browser-appliance-proof.yml` builds images and sources; compilation alone
163
- does not establish Mac execution.
164
-
165
- Status and doctor do not create or start Lima. Explicit setup/first live use
166
- starts the owned host; closing a study removes its participant containers and
167
- volumes, but keeps the reusable Lima host running. Stop it with
168
- `limactl stop humanish-runtime` when no studies are running. An interrupted
169
- first provision remains inspectable through Lima and can be retried. humanish
170
- does not replace a conflicting instance or stop unrelated instances.
171
-
172
- Normal close, cancellation and controller death were exercised on established
173
- Mac desktops. Shared startup cancellation and interrupted create-reply recovery
174
- were exercised against real Linux Docker/Firecracker, with a separate regression
175
- check for Lima cleanup. Forced controller death during startup, full-study
176
- cancellation, host sleep/wake and higher concurrency remain unqualified. A forced
177
- kill before a desktop connects can leave resources requiring inspection; this
178
- adapter adds no suspend detector that unconditionally destroys a study.
@@ -1,144 +0,0 @@
1
- # Watching and reviewing evidence
2
-
3
- Observer shows a study's participants, their recorded screens, and the events
4
- that explain those screens. The grid, player and exported HTML use the same
5
- current renderer. Screens fit their actual aspect ratio; a portrait capture is
6
- never cropped to fill a wide tile.
7
-
8
- ## Choose the right entry point
9
-
10
- `humanish watch <lab>` starts a study and keeps its viewer attached. The process
11
- that owns a hosted desktop can offer its live stream while it runs. `--no-open`
12
- keeps that attachment without launching a browser. `--json` is the machine-result
13
- path and does not keep an interactive stream server attached.
14
-
15
- `humanish observe --run <id>` opens an existing study without starting another. The
16
- TUI's **Open in Observer** action does the same through its session-owned loopback
17
- library. These entry points follow saved captures; they cannot recover live desktop
18
- credentials owned by another process. Keep the owning CLI or TUI open while using its
19
- viewer. Exported HTML is an independent offline recording.
20
-
21
- ## Read status without guessing
22
-
23
- The top band separates the run's current status from evidence freshness. A
24
- finished study never uses its execution mode (`live`, as opposed to `dry-run`)
25
- as a claim that it is still running. When updates fail, the last usable evidence
26
- stays visible, the band reports the failure, and **Retry** requests another
27
- snapshot. A stale process heartbeat does not prove that the process died.
28
-
29
- A player's **Live desktop** label identifies what it displays. An iframe loading
30
- is not a connection-health signal: the provider owns that connection. **Reload
31
- stream** reloads the desktop viewer without restarting a participant. **Latest capture**
32
- follows the latest saved screenshot without a desktop stream. **Replay** means
33
- the researcher has chosen a recorded moment. Offline exports say so explicitly.
34
-
35
- Freshness uses recorded activity and capture timestamps, not the time the server
36
- reserialized the same data. Browser tabs poll less frequently while hidden and
37
- refresh when visible again. Requests are serialized, bounded by a timeout and
38
- cancelled when the viewer closes.
39
-
40
- ## Work through a study
41
-
42
- Previews share a height and wrap into rows; desktop cards are wider and portrait
43
- cards narrower. Complete screens remain contained when the available width is
44
- smaller than a preview. Sparse rows keep their chosen size. Open **View and filter
45
- participants** in the top right to search, change **Preview size**, or enter
46
- **Monitor** for a larger evidence area. **Exit monitor** stays beside the run status.
47
- Open a card's **Participant details** to **Pin** it at the beginning. Ordering changes only
48
- when the researcher changes it. Large studies have reachable participant pages.
49
- At most four desktop previews attach in the grid; allocation prioritizes screens
50
- that are actually visible, with the hovered or keyboard-focused participant taking
51
- priority. Other cards show their latest saved capture.
52
-
53
- Each card follows its screen's aspect ratio without a minimum width that adds
54
- portrait gutters. Its 44px caption holds the participant name, a short preview
55
- source (**Live**, **Capture**, or **Snapshot**) or finished outcome, and a stable
56
- **Participant details** button. Labels and controls never cover captured pixels.
57
- Details contains labeled **Pin** and **Compare** toggles, the full source and
58
- freshness, final messages, recorded notices, duration and dimensions. Historical
59
- notices do not turn the details control into a warning; exceptional outcomes
60
- remain in the caption. Comparison permits three participants and explains the
61
- limit while keeping selected participants removable.
62
-
63
- Icon buttons use Lucide glyphs, accessible names, hover/focus hints and visible
64
- keyboard focus. Touch targets expand to 44px. Popovers have explicit close buttons;
65
- Escape dismisses a hint without moving the player. These conventions follow
66
- [Carbon icon usage](https://carbondesignsystem.com/elements/icons/usage/),
67
- [ARIA toggle-button semantics](https://www.w3.org/WAI/ARIA/apg/patterns/button/),
68
- and [WCAG target sizing](https://www.w3.org/WAI/WCAG22/Understanding/target-size-minimum.html).
69
- The bookmark icon in the top bar opens **Saved moments**; recalling an available
70
- moment closes the popover, while an unavailable moment leaves the error visible.
71
-
72
- Opening a participant provides elapsed-time seeking, the original frame number,
73
- playback speed, **Fit**, **Actual size**, zoom/pan and fullscreen. The inspector can
74
- be hidden or resized. Click markers use the recorded desktop coordinate system
75
- and the image's rendered rectangle, including at zoomed sizes.
76
-
77
- Arrow keys, mouse controls, same-participant links, browser navigation and reload
78
- agree about the selected moment. Seeking leaves live mode. Pausing on the newest
79
- frame stays paused when new evidence arrives; **Go live** explicitly resumes
80
- following. A missing addressed moment is reported instead of silently replaced.
81
-
82
- Screenshot playback is sparse evidence, not a video recording. Capture gaps stay
83
- visible. **Skip waits** compresses intervals associated with recorded waits and
84
- reports the skipped duration. **Next action**, **Next flagged frame**, activity
85
- filters and grouped waits make long traces easier to inspect without deleting events.
86
- Older unstamped recordings use labeled estimated pacing. Long feeds, filmstrips,
87
- terminal output and event lists stay bounded while earlier/later content remains
88
- reachable.
89
-
90
- **Copy moment link** creates a frame address; denied clipboard access exposes a
91
- selectable link. **Original frame** opens/downloads the captured raster. **Saved
92
- moments** keeps bounded run/participant/frame identifiers in this browser. It does
93
- not save credentials, publish annotations or change the evidence bundle. Storage
94
- failure leaves the controls usable for the current visit.
95
-
96
- ## Compare recorded evidence
97
-
98
- Select participants and open **Compare selected**. Capture-time alignment chooses
99
- the latest frame at or before the cursor, never a future frame. Before/after
100
- coverage and each frame's age are explicit. Clock differences between desktops
101
- remain an uncertainty; matching timestamps alone do not establish causality.
102
-
103
- Elapsed-time alignment starts each participant at its first capture and compares
104
- progress rather than simultaneous events. Missing or descending timestamps cannot
105
- be used as a shared clock. Another run can be loaded from the available library
106
- as recorded evidence. The address retains the chosen runs, participants, clock
107
- and cursor so reopening it restores the comparison.
108
-
109
- ## Boundaries and checks
110
-
111
- Only the attached process can grant a desktop iframe its own origin for provider
112
- module loading. Stored grants are removed, exports contain no runtime grants,
113
- and every local viewer response refuses to be framed. Generic imported embeds
114
- retain an opaque sandbox. Artifact and history links cannot introduce arbitrary
115
- URL schemes or traverse outside their evidence roots.
116
-
117
- `pnpm observer:browser:proof` exercises generated synthetic evidence in the
118
- production artifact. `pnpm observer:iframe:proof`, after `pnpm build`, checks the
119
- actual serving boundary against direct, redirected and scripted iframe attacks.
120
- CI retains their screenshots and JSON receipts. These Chromium checks do not
121
- claim physical-device or non-Chromium coverage. Actual provider checks and their
122
- resource-cleanup receipts are separate acceptance evidence.
123
-
124
- Interaction references rechecked September 8, 2026:
125
- [Base UI popover](https://base-ui.com/react/components/popover),
126
- [React state structure](https://react.dev/learn/choosing-the-state-structure),
127
- [WAI-ARIA tabs](https://www.w3.org/WAI/ARIA/apg/patterns/tabs/),
128
- [iframe sandboxing](https://developer.mozilla.org/en-US/docs/Web/HTML/Reference/Elements/iframe),
129
- [Playwright Trace Viewer](https://playwright.dev/docs/trace-viewer), and
130
- [PostHog recording controls](https://posthog.com/docs/session-replay/how-to-watch-recordings).
131
-
132
- ### Moving between review views
133
-
134
- The library button opens a drawer while reviewing a participant or comparison,
135
- including on desktop. Comparison panels use the same participant names as the
136
- grid. **Open frame** opens the displayed capture in the player, where it can be
137
- saved; **Back to comparison** restores that comparison's selection, alignment and
138
- cursor. Browser Back also returns to the addressed comparison. Comparing another
139
- run needs a free slot within the three-participant limit.
140
-
141
- **Reported thinking** is an explicit filter; the Thinking checkbox controls only
142
- All evidence. **Warnings & findings** includes a separate Run and setup notices
143
- section. These recorded operational notices retain their source timestamps and
144
- are not assigned invented screenshot positions or counted as participant findings.
@@ -1,90 +0,0 @@
1
- # Optional participant media
2
-
3
- Media belongs to the desktop. The participant still works through screenshots
4
- and the shared computer-use loop, using one continuing Codex conversation for
5
- clicks, listening and spoken replies.
6
-
7
- ```yaml
8
- actors:
9
- - type: local-agent
10
- localAgent: codex
11
- execution:
12
- target: local
13
- desktop:
14
- media:
15
- camera: { source: synthetic }
16
- microphone: { source: speech }
17
- policies:
18
- mediaPermission: prompt
19
- ```
20
-
21
- Omit `media` and `recording` for ordinary browser studies. They keep the smaller
22
- browser image and start no audio server, camera producer or speech worker. Camera and speech
23
- can also be requested separately. Local media setup uses a separately pinned
24
- image, prepared by the first live study or `humanish runtime setup --media`.
25
-
26
- The local camera is an animated test pattern behind a native V4L2 device. Speech
27
- uses a synthetic microphone and a separate speaker sink. Chromium uses its
28
- ordinary devices and permission dialog. `mediaPermission: granted` bypasses the
29
- dialog explicitly; it does not replace the devices.
30
-
31
- ## Speaking and listening
32
-
33
- With speech enabled, `humanish_ui` accepts `{kind: "speak", text: "..."}` in
34
- addition to browser actions. It plays into the microphone; the participant must
35
- join and unmute through the app. Tool narration is never automatically spoken.
36
- Keep each utterance within 400 characters. Playback acknowledgement establishes
37
- local microphone input, not delivery to another caller.
38
-
39
- The desktop captures actual speaker audio. Finalized English transcriptions
40
- arrive as `heardSpeech` observations with an utterance ID, `speaker_audio` source
41
- and duration. A participant can use the existing `wait` action while listening.
42
- Hearing something counts as progress even when the screen stays unchanged.
43
-
44
- Transcription and synthetic speech run inside the Linux desktop, without a
45
- speech API key or a host Python installation. Codex inference still runs remotely
46
- using the selected account. The first voice uses espeak-ng and sounds robotic;
47
- whisper.cpp uses the pinned English `base.en` model for recognition. This is bounded turn-taking, with recognition
48
- latency and possible transcription errors, not a streaming voice conversation
49
- with interruption handling.
50
-
51
- Spoken text and heard observations pass through the existing evidence redaction
52
- before being retained in the trace. Analysis reads that evidence alongside screenshots and actions; it does not
53
- inspect raw audio or video. Raw audio is not saved by default. [Optional desktop recording](desktop-recording.md)
54
- can retain actual screen and audio playback alongside this evidence.
55
-
56
- ## Hosted desktops
57
-
58
- The same worker and participant loop support hosted speech. humanish selects a
59
- versioned public E2B media template when speech is requested; ordinary browser
60
- studies keep the stock desktop. The usual E2B credentials and Codex login are
61
- sufficient. `execution.desktop.template` remains an explicit override for your
62
- own compatible image; see the [build recipe](https://github.com/danielgwilson/humanish/blob/main/runtime/browser-media/E2B.md).
63
- The host starts the worker through the SDK's streaming command interface, and
64
- model credentials stay on the host. Missing dependencies fail desktop preparation
65
- before a participant starts.
66
-
67
- Existing hosted synthetic cameras use Chromium's fake-device flags. Those flags
68
- also replace its microphone, so hosted camera and speech cannot currently be
69
- combined. Use a local native-media desktop for both, or a hosted audio-only
70
- study. Microphone files and speech through other participant providers are not
71
- supported. A template alone cannot add camera support to a kernel without V4L2.
72
-
73
- ## Runtime maintenance
74
-
75
- `runtime/local-firecracker/build.py --media` extends the maintained browser image
76
- with native devices and the speech worker. The published media image must carry
77
- `to.humanish.runtime.media=1`; a cached browser image cannot satisfy a media
78
- request. Source builds can select an already-built media image with
79
- `HUMANISH_LOCAL_MEDIA_RUNTIME_IMAGE`.
80
-
81
- The media worker owns its subprocesses and buffers. Failed speech recognition,
82
- worker exit and queue overflow stop the media session instead of appearing as
83
- successful silence. Closing the desktop stops media and reclaims its isolated
84
- state. No conferencing vendor or room-specific behavior is implemented in core.
85
-
86
- Retain the matching media sources and package notices when publishing runtime
87
- assets. Pass `--media-browser` and `--media-inputs` to the existing
88
- `runtime/local-firecracker/sources.py` collector alongside its ordinary inputs.
89
- Hardware capacity and conferencing topology require their own measured proof;
90
- requesting media does not qualify twenty concurrent participants or TURN.
@@ -1,62 +0,0 @@
1
- # Project Layout
2
-
3
- `humanish init` gives a project two roots:
4
-
5
- ```text
6
- humanish/ # committed lab source
7
- .humanish/ # ignored runtime state, evidence and local overrides
8
- ```
9
-
10
- ## Committed lab source: `humanish/`
11
-
12
- `init` writes:
13
-
14
- ```text
15
- humanish/
16
- README.md
17
- labs/
18
- first-run.yaml # keyless preview
19
- try-live.yaml # first live lab
20
- cua-browser.yaml # computer-use participants on a hosted desktop
21
- local-browser.yaml # computer-use participants on a local desktop
22
- lobby-trivia-3player.yaml
23
- personas/
24
- synthetic-new-user.yaml
25
- skeptical-power-user.yaml
26
- scenarios/
27
- first-run-smoke.yaml
28
- onboarding-regression.yaml
29
- coverage-map.md
30
- coverage-matrix.md
31
- ```
32
-
33
- Labs select their subject, actors, personas, scenarios, tasks, budgets and
34
- policies. Personas and scenarios are referenced by id. An adopter scorer is an
35
- `.mjs` module that a lab names under `review.scorer.ref`.
36
-
37
- Keep this directory reviewable and reproducible from a clean clone. Everything in
38
- it is public-safe: synthetic personas and fixtures, env var names without values.
39
-
40
- ## Ignored runtime state: `.humanish/`
41
-
42
- ```text
43
- .humanish/
44
- runs/ # run bundles, screenshots, transcripts, Observer output
45
- labs/ # private labs; a committed lab with the same id wins
46
- local/labs/ # machine-local labs
47
- local/personas/ # machine-local personas; a committed persona with the same id wins
48
- cache/ tmp/ logs/
49
- ```
50
-
51
- Never commit run bundles, raw screenshots, transcripts, local overrides or
52
- secrets. `init` adds `.humanish/` to `.gitignore`.
53
-
54
- ## Formats
55
-
56
- - `.yaml` for human-authored source: labs, personas, scenarios.
57
- Prefer `.yaml` over `.yml`.
58
- - `.mjs` for executable adopter scorers.
59
- - `.json` for generated artifacts and synthetic fixtures; `.ndjson` for
60
- appendable event and transcript streams.
61
- - `.yml` only where an outside tool expects it, such as
62
- `.github/workflows/*.yml`.
@@ -1,136 +0,0 @@
1
- # Real email receiving
2
-
3
- A supported browser study can give each participant a fresh AgentMail inbox. The
4
- application sends real email to that address; humanish polls it on the host and
5
- publishes a private inbox surface on that participant's desktop. The participant
6
- can read the original email, switch to a plain view and follow an approved link.
7
-
8
- Use local capture when you can redirect the app's send configuration and want to
9
- avoid hosted mail. Use real receiving when the app must send normally or delivery
10
- itself is part of the flow. These are separate modes; do not combine their settings.
11
- SMS and participant outbound mail are not supported.
12
-
13
- ## Setup
14
-
15
- Open `humanish tui`, press **c** for Connections, and choose **Add API key** to add an
16
- AgentMail key. Hidden entry saves it in the existing user key store and checks
17
- authentication without creating an inbox; Ctrl+C cancels entry and returns to the TUI.
18
- The project profile, `.humanish/local/comms.yaml`, stores only the provider and
19
- environment-variable name.
20
- Environment and explicit env-file values retain precedence over saved keys.
21
- A rejected or unavailable authentication check does not delete the saved key.
22
- Authentication does not prove inbox creation/deletion permissions, quota or delivery.
23
- This release requires an organization-scoped key.
24
-
25
- Connections can preview and save a receiving-enabled local lab copy. The preview
26
- discloses hosted email, model processing, local review and separate provider charges.
27
- The original manifest is preserved. Select the new exact path when launching.
28
-
29
- The same operations are available to agents:
30
-
31
- ```bash
32
- humanish keys set agentmail
33
- humanish comms connections add agentmail --json
34
- humanish comms check --online --json
35
- humanish comms configure --lab humanish/labs/signup.yaml --json
36
- # Review the returned path, disclosures and planToken, then:
37
- humanish comms configure --lab humanish/labs/signup.yaml --apply --plan-token <digest> --json
38
- humanish lab run .humanish/local/labs/signup-receiving.yaml --json --no-open
39
- ```
40
-
41
- Direct manifest authoring selects a saved connection:
42
-
43
- ```yaml
44
- comms:
45
- email:
46
- connection: agentmail
47
- # Optional: additional trusted email-link destinations, exact origins only.
48
- allowedOrigins:
49
- - https://accounts.example.test
50
- ```
51
-
52
- The target origin is automatically allowed. On provisioned subjects, the declared
53
- serve origin and optional `linkOrigin` use the existing target-origin rewrite.
54
- Review additional origins as destinations the participant is allowed to open from
55
- mail. This policy governs the inbox surface, not all later browser navigation.
56
-
57
- Supported execution is hosted computer use with app-url, clone or local-tree
58
- subjects, including shared-world studies. Local-agent, scripted, terminal, desktop-cli, in-process and local-app routes reject
59
- real receiving before allocation. Connection mode cannot declare capture options,
60
- recipients or borrowed mailbox IDs. A fresh address is not an existing account;
61
- assignments must allow signup or arranging mail to the new identity.
62
-
63
- ## What a run does
64
-
65
- 1. Resolve the selected connection and host credential. Reject forwarding that
66
- management credential through target environment names, aliases or literals.
67
- 2. Authenticate and durably record each acquisition intent in private host state.
68
- Acquire all participant addresses before starting desktops.
69
- 3. Give each participant its address and loopback inbox URL. No management key or
70
- other participant's mailbox is installed in its desktop. Each surface has only
71
- its own list/message/plain/JSON routes, with no send endpoint or aggregate inbox.
72
- 4. Poll received mail, register scrub targets, sanitize/render and atomically
73
- publish the complete inbox snapshot. Repeated reads can fill temporarily missing
74
- bodies and inline images without changing local message identity.
75
- 5. Before desktop teardown, perform a bounded final read, save evidence, stop the
76
- inbox surface and request deletion. Confirm provider absence; otherwise retain
77
- unresolved cleanup for recovery. Provider deletion is not an erasure guarantee.
78
-
79
- The original view preserves supported email structure and inline PNG/JPEG/GIF/WebP
80
- images. Parsed HTML removes active content; response CSP blocks scripts, forms,
81
- frames and remote assets. Remote images show an explicit unavailable placeholder.
82
- Links use the same origin policy in original, plain and JSON views. Attachment
83
- bytes are fetched only through the fixed provider API and its observed CDN host;
84
- provider authorization never goes to the CDN. General attachments, arbitrary remote
85
- images and raw-MIME fallback are unsupported. Raster checks are bounded signature
86
- checks, not a guarantee that every malformed image will decode in a browser.
87
-
88
- Collection is bounded by request time, request/page count, bytes, images and a
89
- 100-message retained inbox limit. Limits, failed reads, blocked content and failed
90
- publication are recorded as coverage limitations. Inbox pages require reload to
91
- show later messages. No webhook/public mail ingress is required on the host.
92
-
93
- ## Evidence and publication
94
-
95
- `comms/receiving.json` uses `humanish.comms-receiving.v2`. It records local IDs,
96
- counts, timestamps and lifecycle/coverage status, without raw mail, provider IDs,
97
- addresses or stable content digests. The final run bundle embeds that projection.
98
- Receipt, successful inbox publication, participant reading and target success are
99
- separate claims; analysis receives this distinction and the harness limitations.
100
- A missing message alone does not establish that the application failed to send.
101
- Immediate automatic analysis scrubs known exact values from generated narration
102
- using a bounded, invocation-local registry. It never saves that registry. Later
103
- analysis cannot reconstruct it; screenshots may still expose mail content, and the
104
- publication restriction applies to both immediate and later findings.
105
-
106
- Mail is hosted by AgentMail. Its content can reach the hosted desktop, actor model,
107
- screenshots, narration and analysis model. Such runs carry a durable
108
- `real-communications` publication restriction: verification returns `local_only`,
109
- public feedback/exposure and shareable exports remain gated, and screenshot
110
- blurring does not clear the restriction. Local Observer review and explicitly local
111
- HTML export remain available. Local-only publication is not local-only processing.
112
-
113
- ## Interrupted-run recovery
114
-
115
- Process interruption can bypass normal final reads and teardown. Inspect recovery
116
- state after stopping a run; do not assume Ctrl+C or killing a process deleted its
117
- inboxes:
118
-
119
- ```bash
120
- humanish comms recover --json
121
- humanish comms recover --run <run-id> --apply --json
122
- ```
123
-
124
- Connections also exposes pending cleanup. Recovery only uses private host journals
125
- under `$XDG_STATE_HOME/humanish/comms` (default `~/.local/state/humanish/comms`),
126
- with private directories/files and bound project, connection, account and scope.
127
- A live or unknown owner blocks takeover. The adapter checks resource/client identity
128
- before deletion; it cannot delete an inbox named only in a run artifact. Lost
129
- creation responses can be reconciled through the recorded idempotent client ID.
130
- Do not delete private journals while resources remain unresolved. Moving/replacing
131
- the project or changing account/scope can intentionally prevent recovery.
132
-
133
- If final evidence persistence fails, the provider inbox is retained as unresolved
134
- rather than discarding the last retrievable copy. Explicit recovery is a deletion
135
- operation, not message-history reconstruction. Sandbox reclamation remains a
136
- separate operation.