humanish 0.142.0 → 0.144.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +21 -0
- package/README.md +1 -1
- package/dist/analysis/automatic-config.d.ts +12 -1
- package/dist/analysis/automatic-config.js +35 -6
- package/dist/analysis/execute.d.ts +1 -11
- package/dist/analysis/execute.js +4 -21
- package/dist/analysis/gemini-wire.d.ts +2 -1
- package/dist/analysis/gemini-wire.js +3 -2
- package/dist/analysis/models.d.ts +12 -0
- package/dist/analysis/models.js +47 -0
- package/dist/analysis/openai-wire.d.ts +2 -1
- package/dist/analysis/openai-wire.js +3 -2
- package/dist/analysis/provider.d.ts +4 -0
- package/dist/analysis/types.d.ts +4 -0
- package/dist/analysis/validation.js +4 -3
- package/dist/cli/commands/analyze.js +5 -3
- package/dist/cli/commands/run-command.js +2 -1
- package/dist/cli/commands/study-remote.d.ts +34 -2
- package/dist/cli/commands/study-remote.js +103 -52
- package/dist/cli/commands/study-route-run.d.ts +3 -2
- package/dist/cli/commands/study-route-run.js +7 -2
- package/dist/cli/commands/study-run.js +19 -9
- package/dist/cli/findings.d.ts +2 -1
- package/dist/cli/findings.js +31 -9
- package/dist/cli/io.d.ts +2 -0
- package/dist/remote/launch.d.ts +17 -2
- package/dist/remote/launch.js +108 -29
- package/dist/remote/plan.d.ts +2 -0
- package/dist/remote/plan.js +12 -0
- package/dist/remote/runner.d.ts +21 -0
- package/dist/remote/runner.js +42 -5
- package/dist/run/results.d.ts +9 -1
- package/dist/study/keys.d.ts +1 -0
- package/dist/study/keys.js +1 -0
- package/dist/study/parse/execution.js +5 -0
- package/dist/study/types.d.ts +6 -0
- package/dist/tui/launch.js +3 -0
- package/docs/contracts/study-analysis.md +35 -2
- package/docs/product/automatic-analysis.md +17 -7
- package/package.json +1 -1
- package/skills/humanish/SKILL.md +16 -1
package/skills/humanish/SKILL.md
CHANGED
|
@@ -98,7 +98,8 @@ exact returned path, not a basename that could resolve to another manifest.
|
|
|
98
98
|
Analysis is separate from the participant. A study that declares no analyst
|
|
99
99
|
gets one from its participant: a Codex `local-agent` participant, local or
|
|
100
100
|
hosted, defaults to a separate Codex account analyst; every other participant,
|
|
101
|
-
Claude Code included, defaults to the OpenAI API
|
|
101
|
+
Claude Code included, defaults to the OpenAI API (`gpt-6.1-sol` at medium
|
|
102
|
+
reasoning effort) with a $10 admission budget.
|
|
102
103
|
Without `OPENAI_API_KEY` that OpenAI analysis is skipped, and the run output
|
|
103
104
|
names the next command: `analyze --provider codex` when Codex is signed in. To
|
|
104
105
|
select the restricted Codex ChatGPT account analyst on any supported study,
|
|
@@ -118,6 +119,12 @@ and a missing Gemini key never falls back to OpenAI. On a free-tier key, Google
|
|
|
118
119
|
may use the content to improve its products; tell the user before a study with
|
|
119
120
|
private evidence runs on one.
|
|
120
121
|
|
|
122
|
+
`review.analysis.reasoningEffort` (or `analyze --reasoning-effort <level>`)
|
|
123
|
+
sets an OpenAI or Gemini analyst's reasoning effort. When unset it is `medium`
|
|
124
|
+
for the default analyst, which names no model, and `high` for a named model.
|
|
125
|
+
Each model takes only the levels its provider documents, and `analyze` refuses
|
|
126
|
+
the others before any request with the levels the model takes.
|
|
127
|
+
|
|
121
128
|
When post-run analysis is refused for its cost, the run output and `humanish
|
|
122
129
|
review` give its expected cost, its worst case and the command that runs it,
|
|
123
130
|
`humanish analyze --run <id> --max-cost <n>`. Show the user those costs and run
|
|
@@ -546,6 +553,14 @@ has finished. A participant with `endAfterMs` can keep a study running for up to
|
|
|
546
553
|
analysis usually adds 1 to 4 minutes after the last participant ends. A shell timeout that sends
|
|
547
554
|
SIGTERM stops the run: humanish marks it interrupted and stops its sandboxes.
|
|
548
555
|
|
|
556
|
+
- A computer-use study on `e2b-desktop` or `modal-desktop` with a public `app-url` runs remotely
|
|
557
|
+
by default: its own process runs in a sandbox on that provider, so a sleeping machine does not
|
|
558
|
+
stop it. `run` still blocks and exits with the run's code; SIGTERM still stops the run. Until its
|
|
559
|
+
bundle is copied back it is not in `runs --json`; `npx humanish observe --run <id>` follows it.
|
|
560
|
+
If its terminal closes, the command exits 129 with `HUMANISH_REMOTE_DETACHED` and the run goes
|
|
561
|
+
on; `observe --run <id>` copies it back. `--local` keeps one run on this machine,
|
|
562
|
+
`execution.remote: false` every run of a study. The JSON result's `remote.keys` names the keys
|
|
563
|
+
the runner received.
|
|
549
564
|
- Start a study that can outlive your shell call in tmux, for example
|
|
550
565
|
`tmux new -d -s study 'npx humanish run <study> --json --no-open > run-result.json 2> run.log'`.
|
|
551
566
|
`--detach` only skips the Observer server at the end; it does not move the run to the background.
|