bullswarm 0.38.0 → 0.38.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (43) hide show
  1. package/AGENTS.md +6 -0
  2. package/CHANGELOG.md +76 -0
  3. package/data/openrouter-benchmarks.json +8783 -8591
  4. package/docs/reference/cli.md +44 -6
  5. package/docs/reference/program.md +5 -3
  6. package/docs/reference/providers.md +1 -0
  7. package/package.json +1 -1
  8. package/providers/contrib/command-code/connector-history.json +36 -0
  9. package/providers/contrib/command-code/connector.json +78 -27
  10. package/skill/SKILL.md +23 -25
  11. package/skill/references/operations.md +13 -0
  12. package/skill/references/program.md +24 -1
  13. package/src/help.js +35 -6
  14. package/src/lib/cli-flags.js +1 -0
  15. package/src/lib/config.js +11 -2
  16. package/src/lib/model-pin.js +9 -1
  17. package/src/lib/provider-errors.js +26 -1
  18. package/src/lib/run-delegate.js +15 -0
  19. package/src/lib/strategy.js +161 -9
  20. package/src/lib/watch.js +43 -1
  21. package/src/provider-cli.js +5 -0
  22. package/src/providers/_schema.json +4 -0
  23. package/src/strategy-cli.js +83 -7
  24. package/src/workflow/action-validator.js +37 -4
  25. package/src/workflow/attempt-record.js +3 -0
  26. package/src/workflow/cli-goal.js +8 -3
  27. package/src/workflow/cli-launch.js +4 -3
  28. package/src/workflow/cli-plan.js +1 -1
  29. package/src/workflow/cli-steps.js +14 -2
  30. package/src/workflow/contract-v3.js +2 -2
  31. package/src/workflow/goal-column.js +24 -2
  32. package/src/workflow/no-pool-why.js +8 -4
  33. package/src/workflow/pick-preview.js +7 -5
  34. package/src/workflow/revision-v3.js +128 -13
  35. package/src/workflow/run-verdict.js +11 -2
  36. package/src/workflow/step-route.js +7 -3
  37. package/src/workflow/step-vocabulary.js +5 -2
  38. package/src/workflow/time-box.js +15 -0
  39. package/src/workflow/v2-dispatch.js +114 -4
  40. package/src/workflow/v2-outcome.js +2 -0
  41. package/src/workflow/v2-planner.js +1 -0
  42. package/src/workflow/v2-revision.js +21 -1
  43. package/src/workflow/v2-state.js +5 -0
package/AGENTS.md CHANGED
@@ -51,6 +51,12 @@ before doing anything. Their readers and stored formats are unchanged.
51
51
  outlives a step is the 100% refusal marker a usage limit writes when the
52
52
  meter cannot be read, and it counts only when its reset was named or
53
53
  measured, never guessed (`refusalResetKnown` in `src/meters/framework.js`).
54
+ Beside it sits one plan fact: `state.strategy.planExcludedModels[pool]`,
55
+ the models a provider said that pool's subscription does not include
56
+ (failure kind `model-not-in-plan`). It is a fact about the plan, like its
57
+ price, not a spent or dead pool: the pool stays pickable with its other
58
+ models, and the record ends when the subscription changes or the operator
59
+ turns the model back on (`src/lib/strategy.js`).
54
60
  Recursion depth is core-owned via env (`BULLSWARM_DEPTH`).
55
61
  5. Workflow dispatches honor the same guarantees as single runs, in
56
62
  `src/workflow/v2-dispatch.js`: `BULLSWARM_DEPTH` is checked and propagated
package/CHANGELOG.md CHANGED
@@ -2,6 +2,82 @@
2
2
 
3
3
  ## Unreleased
4
4
 
5
+ ## 0.38.1 — Fewer wasted retries, honest no-pool reasons
6
+
7
+ - no eligible pool: when a pool lacks a tier only because free models are
8
+ off for it, or because its plan was seen not to include the tier's model,
9
+ the reason now says so (`free models are off for <pool>`, `<pool> has no
10
+ <tier>-tier model its plan includes (plan excludes <models>)`, or `<model>
11
+ is not in <pool>'s plan` for a model the step names), also under a step's
12
+ route and in `run --dry-run`. Before, a routed step read only `no
13
+ enabled pool left has a model on the <tier> tier`.
14
+ - dispatch: a worker can mark a blocker it may not change by starting a `##
15
+ Not done` line with `outside:` (`- outside: tests/router.test.js fails on
16
+ main before this change`); work tasks now ask for this. A step that fails
17
+ `failed-evidence`, `not-produced` or `semantic` with such a line skips its
18
+ one automatic retry and comes back to you at once, its `why` ending `retry
19
+ skipped: the worker reported a blocker outside this step: <item>`; the saved
20
+ attempt lists every such item as `outsideBlockers`. `schema` and process
21
+ failures keep their retry.
22
+ - workflow add: a fragment may carry `blocks: {"<new step id>": ["<existing
23
+ step id>", ...]}` to make existing steps that have not started also wait for
24
+ a step it adds, for example a fix in front of a report (then `step accept`
25
+ the failed step). It is the one change a fragment may make to an existing
26
+ step; a started step, a loop's step, a gate, a loop or a cycle is refused in
27
+ fragment words. A step already blocked behind a failed step stays blocked
28
+ (it is not reset and blocked again). The output prints `waits step <id>
29
+ now also waits for <ids>`, and `--json` carries `waits`.
30
+ - advisories: a new `suite-wider-than-files` advisory names a step that owns
31
+ files but runs a command check naming none of them (a bare `npm test`),
32
+ because a failure elsewhere in the suite would fail a step that cannot fix
33
+ it. Scope the command, or run the suite in a check step. Like every advisory
34
+ it never refuses a program or changes an exit code.
35
+ - advisories: with `--json`, `workflow goal` and `workflow plan validate` no
36
+ longer print advisory text; the advisories are in the JSON as `advisories`
37
+ (the detached launch document always, a foreground result when there are
38
+ any). In human mode `plan validate` now prints them on stderr, as `workflow
39
+ goal` does.
40
+ - run --json: the verdict has top-level `pool` and `model`, the last attempt's
41
+ (null when nothing was dispatched). `pick` keeps them too. Small flat
42
+ objects such as the reasoning record now print on one line, so the verdict
43
+ stays within 60 lines.
44
+ - workflow runs: the goal column skips constraint sentences that follow a
45
+ dropped leading folder (`Work in /abs/path (git branch x). Do not commit.
46
+ Fix the parser crash.` shows `Fix the parser crash.`); a goal that is only
47
+ constraints shows the folder name.
48
+ - strategy: new `bullswarm strategy set-free <allow|never> [--pool <name>]
49
+ --yes` (and `set-free reset --pool <name>`) stops free models being
50
+ suggested, applied or dispatched, for every pool or one; a pool's own
51
+ setting wins. A pool left with only free models for a tier is out of that
52
+ tier with the reason `free models are off for <pool>`: a step no pool can
53
+ take says it in its `why` and `routeCandidates`, `run --dry-run` says it
54
+ too, and `strategy show` prints it under the tier. A model you name
55
+ yourself is still allowed. `strategy show` prints a `free models:` line, and
56
+ the low tier's basis stops putting free models first when every pool has
57
+ them off.
58
+ - providers: a connector may list `modelPlanSignatures`, the text its CLI
59
+ prints when the subscription's plan does not include the requested model
60
+ (Command Code: `MODEL_NOT_IN_PLAN`). Only the provider's error output is
61
+ read: stderr, and on an event stream the records the provider flags as
62
+ errors (read even when the worker exits 0), so a worker's reply that quotes
63
+ the code, even on a line starting `Error:` or in a clean final record, is
64
+ still a reply. A hit is the new failure kind
65
+ `model-not-in-plan` (a process failure, labelled `model not in plan`): the
66
+ step's retry goes to another pool, and `state.strategy.planExcludedModels`
67
+ records the model for that pool. The pool keeps running its other models;
68
+ strategy, rungs, pins and dispatch pass that model over on that pool only.
69
+ `strategy show` prints `not in plan: <pool>: <model>`. `strategy
70
+ include-model <model>`, a changed `strategy set-subscription`, or turning
71
+ the model back on for the pool clears it, and `workflow resume` reruns such
72
+ a step.
73
+ - command-code: models are ranked by family (astra, sol, gpt, terra, luna,
74
+ mini, fable, opus, sonnet, haiku, grok), so a newly listed model is ranked
75
+ the day it appears and the newer version of a family ranks first
76
+ (`gpt-6.1-sol` above `gpt-5.6-sol`, `claude-opus-5-5` above
77
+ `claude-opus-4-7`). Dated prices and the deliberate overrides (`gpt-5.4` and
78
+ `grok-4.5` medium, `minimax-m3` high) stay as rows; kimi and glm stay
79
+ unranked.
80
+
5
81
  ## 0.38.0 — The removals release: v3 only, saved runs view-only, less code
6
82
 
7
83
  - removed: the mechanisms program v3 replaced (0.37.0) no longer run. The