opencrowd 0.3.2 → 0.5.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/README.md CHANGED
@@ -84,30 +84,47 @@ There is one wallet: AgentCash's. OpenCrowd shows public addresses,
84
84
  balances, and funding links (`/wallet`, `/fund`) and never manages, copies,
85
85
  or exports keys. See [SECURITY.md](SECURITY.md) for the enforcement model.
86
86
 
87
- ## Budget
87
+ ## Spending limits
88
88
 
89
- The session budget is a local cumulative cap on value consumed — LLM
90
- inference and paid services both count against it. Reservations are local,
91
- a budget change never moves money, and the cap can never drop below already
92
- finalized spend. Defaults come from configuration
93
- (`opencrowd config set budget 20`); session creation never needs a network
94
- lookup.
89
+ By default, each model or paid tool call can spend up to **$1** automatically,
90
+ and each user query can spend up to **$10** across its model calls, tools,
91
+ retries and subagents. Every new query receives a fresh allowance; conversation
92
+ history and lifetime spending remain available.
95
93
 
96
- ## Approval
94
+ Open **/wallet → spending limits** to save defaults, or use:
95
+
96
+ ```sh
97
+ opencrowd wallet limits --per-call 1 --per-query 10
98
+ ```
99
+
100
+ A call above either threshold pauses before payment. Approve that call once,
101
+ approve it and increase the current query budget, or decline. Increasing a
102
+ query budget leaves saved defaults unchanged; later calls still respect the
103
+ per-call limit. Changing a budget does not move funds.
104
+
105
+ Headless runs return `waiting_for_approval` with the pending amount. Resume the
106
+ saved query without repeating completed work:
97
107
 
98
- Approval governs external service purchases only (LLM calls are governed by
99
- the budget):
108
+ ```sh
109
+ opencrowd resume <session-id> --approve-once --workspace <dir>
110
+ opencrowd resume <session-id> --query-budget 20 --workspace <dir>
111
+ opencrowd resume <session-id> --decline --workspace <dir>
112
+ ```
113
+
114
+ Cloud applies the same thresholds in its payment gateway and exposes them in
115
+ Wallet → spending limits. Cloud and CLI save settings independently.
100
116
 
101
- - `ask` (default) — a human approves each new service: allow once,
102
- always-allow with per-call/session caps, deny, or block.
103
- - `auto` — no prompts; blocks, caps, reputation checks, the payment
104
- lifecycle, and the budget still apply.
105
- - `off` — external purchases are prohibited; local tools and inference keep
106
- working.
117
+ ## Approval
118
+
119
+ Spending thresholds apply to model and paid tool calls. External services also
120
+ retain reputation checks, explicit service blocks and method restrictions.
121
+ `auto` is the default and still asks for spending above either threshold.
122
+ Legacy `ask` adds service confirmations; `off` disables external-service
123
+ purchases in the CLI. Stored rules remain available through `/approvals`;
124
+ old monetary service/session caps are replaced by query spending limits.
107
125
 
108
- Stored rules are managed with `/approvals`. Every confirmed paid call —
109
- success or failure — requires a signed CrowdCode review before the next
110
- purchase; pending reviews survive restarts.
126
+ Every confirmed paid service call requires a signed CrowdCode review before
127
+ the next purchase; pending reviews survive restarts.
111
128
 
112
129
  ## Commands
113
130
 
@@ -122,8 +139,27 @@ opencrowd config show
122
139
  opencrowd wallet balance
123
140
  opencrowd doctor
124
141
  opencrowd evals gaia --tier smoke --harness opencrowd,claude,codex
142
+ opencrowd evals suite --set all --tag baseline --model openai/gpt-5.6-luna --subagent-model off
143
+ opencrowd evals evolve --baseline-report <run>/report.json --generations 2 --candidates 2
125
144
  ```
126
145
 
146
+ `evals suite` runs the 40-task suite (15 real-usage tasks derived from
147
+ CrowdCode demand, 15 seeded GAIA level 2/3, 10 seeded AssistantBench) and
148
+ reports accuracy alongside on-chain LLM and service spend, turns, paid calls,
149
+ and unnecessary purchases. `evals evolve` is the meta-harness: it derives a
150
+ service knowledge tree (`L0.md` in the prompt, `INDEX.md` + category pages
151
+ under `artifacts/knowledge/`) from CrowdCode review evidence, mutates it
152
+ against held-in failures, keeps the quality-vs-cost Pareto frontier, and
153
+ never shows the proposer a held-out task. `evals suite` uses the runtime's
154
+ knowledge tree by default (the snapshot bundled with `@opencrowd/agent-runtime`,
155
+ or `OPENCROWD_KNOWLEDGE_DIR`); pass `--knowledge <tree dir>` to evaluate a
156
+ candidate or `--knowledge none` for the static-prompt baseline.
157
+
158
+ The agent loads the same tree in normal runs: `L0.md` becomes the prompt's
159
+ capability index and the category pages land under `artifacts/knowledge/`.
160
+ Set `OPENCROWD_KNOWLEDGE_DIR=none` to disable it or point it at another tree;
161
+ the loaded version is recorded on the session.
162
+
127
163
  ## Headless runs
128
164
 
129
165
  ```sh