smooth-operator-mcp 2.4.6 → 2.4.8

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
package/.env.example CHANGED
@@ -1,6 +1,9 @@
1
1
  # Native MCP transport
2
2
  SMOOTH_OPERATOR_TRANSPORT=stdio
3
3
  SMOOTH_OPERATOR_DATA_DIR=~/.smooth-operator
4
+ # Optional explicit JSON config path. The installer-created
5
+ # ~/.smooth-operator/config.json is loaded automatically when this is unset.
6
+ # SMOOTH_OPERATOR_CONFIG=~/.smooth-operator/config.json
4
7
 
5
8
  # Managed agent Chrome is the zero-setup default. It discovers Google Chrome,
6
9
  # then creates one private persistent profile under SMOOTH_OPERATOR_DATA_DIR.
package/README.md CHANGED
@@ -53,4 +53,20 @@ Talk to your harness normally. It will call `browser_navigate` → `browser_snap
53
53
  - Safe — domain policy, bounded outputs, JS off by default (`SMOOTH_OPERATOR_ALLOW_EVAL`)
54
54
  - Works — stdio default, HTTP optional
55
55
 
56
- Details: [AGENTS.md](AGENTS.md) · [MCP guide](docs/mcp-server.md) · [harnesses](docs/harnesses.md)
56
+ ## Benchmarks
57
+
58
+ | Benchmark | Metric | SmoothOperator | Browser Use MCP |
59
+ | --- | --- | ---: | ---: |
60
+ | Live Web (8 sites, 32 episodes) | URL success | **32/32** | 23/32 |
61
+ | Live Web | Page-text quality | **26/32** | 21/32 |
62
+ | Live Web | Combined success | **26/32** | 18/32 |
63
+ | Live Web | Task latency mean / p95 | **1,357.697 / 2,957.241 ms** | 4,603.811 / 30,780.107 ms |
64
+ | Live Web | Navigation p95 | **2,130.255 ms** | 4,320.076 ms |
65
+ | Live Web | Click p95 | 919.812 ms | **142.231 ms** |
66
+ | Live Web | MCP call p95 | **942.979 ms** | 2,095.407 ms |
67
+ | Live Web | Trace errors | **0** | 10 |
68
+ | MiniWoB++ 0.14.3 (125 tasks) | Reward = 1 | **124/125** | 89/125 |
69
+ | MiniWoB++ | Attempts | **125** | 125 |
70
+ | MiniWoB++ | MCP errors | **0** | 29 |
71
+ | MiniWoB++ | Transport errors | **0** | **0** |
72
+ | MiniWoB++ | Timeouts | **0** | **0** |