unbrowse 2.12.2 → 2.12.7

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (64) hide show
  1. package/README.md +8 -44
  2. package/dist/cli.js +514 -20723
  3. package/package.json +4 -10
  4. package/runtime-src/api/routes.ts +15 -801
  5. package/runtime-src/auth/index.ts +32 -142
  6. package/runtime-src/capture/index.ts +101 -436
  7. package/runtime-src/cli.ts +371 -956
  8. package/runtime-src/client/index.ts +29 -622
  9. package/runtime-src/execution/index.ts +85 -345
  10. package/runtime-src/graph/index.ts +10 -128
  11. package/runtime-src/intent-match.ts +27 -27
  12. package/runtime-src/kuri/client.ts +82 -543
  13. package/runtime-src/orchestrator/index.ts +462 -2246
  14. package/runtime-src/reverse-engineer/index.ts +22 -220
  15. package/runtime-src/runtime/local-server.ts +16 -149
  16. package/runtime-src/runtime/paths.ts +5 -9
  17. package/runtime-src/runtime/setup.ts +1 -52
  18. package/runtime-src/server.ts +11 -6
  19. package/runtime-src/transform/schema-hints.ts +358 -0
  20. package/runtime-src/types/skill.ts +2 -49
  21. package/runtime-src/verification/index.ts +0 -15
  22. package/runtime-src/version.ts +13 -13
  23. package/vendor/kuri/darwin-arm64/kuri +0 -0
  24. package/vendor/kuri/darwin-x64/kuri +0 -0
  25. package/vendor/kuri/linux-arm64/kuri +0 -0
  26. package/vendor/kuri/linux-x64/kuri +0 -0
  27. package/bin/unbrowse-wrapper.mjs +0 -39
  28. package/bin/unbrowse.js +0 -38
  29. package/runtime-src/analytics-session.ts +0 -33
  30. package/runtime-src/api/browse-index.ts +0 -254
  31. package/runtime-src/api/browse-session.ts +0 -179
  32. package/runtime-src/api/browse-submit.ts +0 -455
  33. package/runtime-src/auth/runtime.ts +0 -116
  34. package/runtime-src/browser/index.ts +0 -635
  35. package/runtime-src/browser/types.ts +0 -41
  36. package/runtime-src/capture/prefetch.ts +0 -122
  37. package/runtime-src/capture/rsc.ts +0 -45
  38. package/runtime-src/cli/shortcuts.ts +0 -273
  39. package/runtime-src/client/graph-client.ts +0 -99
  40. package/runtime-src/execution/robots.ts +0 -167
  41. package/runtime-src/execution/search-forms.ts +0 -188
  42. package/runtime-src/graph/planner.ts +0 -411
  43. package/runtime-src/graph/session.ts +0 -294
  44. package/runtime-src/graph/trace-store.ts +0 -136
  45. package/runtime-src/indexer/index.ts +0 -480
  46. package/runtime-src/orchestrator/browser-agent.ts +0 -374
  47. package/runtime-src/orchestrator/dag-advisor.ts +0 -59
  48. package/runtime-src/orchestrator/dag-feedback.ts +0 -256
  49. package/runtime-src/orchestrator/first-pass-action.ts +0 -362
  50. package/runtime-src/orchestrator/passive-publish.ts +0 -152
  51. package/runtime-src/orchestrator/timing-economics.ts +0 -80
  52. package/runtime-src/payments/cascade.ts +0 -137
  53. package/runtime-src/payments/index.ts +0 -268
  54. package/runtime-src/payments/wallet.ts +0 -33
  55. package/runtime-src/reverse-engineer/description-prompt.ts +0 -132
  56. package/runtime-src/router.ts +0 -17
  57. package/runtime-src/runtime/browser-access.ts +0 -11
  58. package/runtime-src/runtime/browser-host.ts +0 -48
  59. package/runtime-src/runtime/lifecycle.ts +0 -17
  60. package/runtime-src/runtime/supervisor.ts +0 -69
  61. package/runtime-src/single-binary.ts +0 -141
  62. package/runtime-src/telemetry.ts +0 -253
  63. package/runtime-src/verification/matrix.ts +0 -30
  64. package/scripts/postinstall.mjs +0 -81
package/README.md CHANGED
@@ -6,25 +6,18 @@ Turn any website into a reusable API interface for agents. Unbrowse captures net
6
6
 
7
7
  One agent learns a site once. Every later agent gets the fast path.
8
8
 
9
- Unbrowse is a drop-in replacement for OpenClaw / `agent-browser` browser flows for agents: on the API-native path it is typically ~30x faster, ~90% cheaper, and turns repeated browser work into reusable route assets.
10
-
11
9
  > Security note: capture and execution stay local by default. Credentials stay on your machine. Learned API contracts are published to the shared marketplace only after capture. See [SKILL.md](./SKILL.md) for the full agent-facing API reference and tool-policy guidance.
12
10
 
13
11
  ## Quick start
14
12
 
15
13
  ```bash
16
- # Deterministic setup from a repo clone
17
- git clone --single-branch --depth 1 https://github.com/unbrowse-ai/unbrowse.git ~/unbrowse
18
- cd ~/unbrowse && ./setup --host off
14
+ # Fastest full setup
15
+ npx unbrowse setup
19
16
  ```
20
17
 
21
- `./setup` installs repo dependencies, prebuilds the packaged CLI runtime, installs a stable `unbrowse` shim, and then runs the real first-time bootstrap: ToS acceptance, agent registration + API-key caching, and wallet detection when present.
22
-
23
- If a wallet is configured, that wallet address becomes the contributor/payment truth: it is synced onto your agent profile, used as the destination for contributor payouts when your routes earn, and used as the spending wallet for paid marketplace routes.
24
-
25
- Unbrowse supports wallet providers such as `lobster.cash` for x402-gated routes. If you use `lobster.cash`, set `LOBSTER_WALLET_ADDRESS`. Other providers can use `AGENT_WALLET_ADDRESS` and optional `AGENT_WALLET_PROVIDER`.
18
+ `npx unbrowse setup` downloads the CLI on demand, verifies the bundled Kuri runtime, lets you register with an email-shaped display identity, registers the Open Code `/unbrowse` command when Open Code is detected, and starts the local server.
26
19
 
27
- For repeat npm use after a healthy publish:
20
+ For daily use:
28
21
 
29
22
  ```bash
30
23
  npm install -g unbrowse
@@ -41,12 +34,11 @@ npx skills add unbrowse-ai/unbrowse
41
34
 
42
35
  Unbrowse no longer self-updates at runtime. If you already have Unbrowse installed, upgrade to the latest version after each release or the new flow may not work on your machine.
43
36
 
44
- If you installed from a repo clone:
37
+ If you installed the CLI globally:
45
38
 
46
39
  ```bash
47
- cd ~/unbrowse
48
- git pull --ff-only
49
- ./setup --host off
40
+ npm install -g unbrowse@latest
41
+ unbrowse setup
50
42
  ```
51
43
 
52
44
  If your agent host uses skills, rerun its skill install/update command too:
@@ -58,17 +50,14 @@ npx skills add unbrowse-ai/unbrowse
58
50
  Need help or want release updates? Join the Discord: [discord.gg/VWugEeFNsG](https://discord.gg/VWugEeFNsG)
59
51
 
60
52
  Every CLI command auto-starts the local server on `http://localhost:6969` by default. Override with `UNBROWSE_URL`, `PORT`, or `HOST`. On first startup it auto-registers as an agent with the marketplace and caches credentials in `~/.unbrowse/config.json`. `unbrowse setup` now prompts for an email-shaped identity first; headless setups can provide `UNBROWSE_AGENT_EMAIL`.
61
- Canonical docs: [docs.unbrowse.ai](https://docs.unbrowse.ai)
62
53
 
63
54
  Works with Claude Code, Open Code, Cursor, Codex, Windsurf, and any agent host that can call a local CLI or skill.
64
55
 
65
56
  ## What setup does
66
57
 
67
- - Checks the local runtime/package-manager environment for the repo bootstrap or packaged CLI path.
68
- - Prebuilds the packaged CLI runtime and installs the stable `unbrowse` shim for the repo bootstrap path.
58
+ - Checks local prerequisites for the npm/npx flow.
69
59
  - Verifies the bundled Kuri binary, or builds it from the vendored Kuri source when working from repo source with Zig installed.
70
60
  - Registers the Open Code `/unbrowse` command when Open Code is present.
71
- - Runs the first-use flow: ToS, agent registration/API-key caching, and wallet detection.
72
61
  - Starts the local Unbrowse server unless `--no-start` is passed.
73
62
 
74
63
  ## Common commands
@@ -91,21 +80,6 @@ unbrowse search --intent "get stock prices"
91
80
 
92
81
  If you tried Unbrowse on a site or API and could not get it to work, add it to [Discussion #53](https://github.com/unbrowse-ai/unbrowse/discussions/53). We use that thread to collect missing or broken targets so we can turn them into requirements for the next eval pass.
93
82
 
94
- ## Docs
95
-
96
- The synced skill repo also carries the public docs set:
97
-
98
- - [Quickstart](./docs/guides/quickstart.md)
99
- - [API reference](./docs/api.md)
100
- - [Deployment guide](./docs/deployment.md)
101
- - [Release checklist](./docs/RELEASING.md)
102
-
103
- Whitepaper companion docs:
104
-
105
- - [Whitepaper companion index](./docs/whitepaper/README.md)
106
- - [For Technical Readers](./docs/whitepaper/for-technical-readers.md)
107
- - [For Investors](./docs/whitepaper/for-investors.md)
108
-
109
83
  ## How it works
110
84
 
111
85
  When an agent asks for something, Unbrowse first searches the marketplace for an existing skill. If one exists with enough confidence, it executes immediately. If not, Unbrowse captures the site, learns the APIs behind it, publishes a reusable skill, and executes that instead.
@@ -183,16 +157,6 @@ See [SKILL.md](./SKILL.md) for the full API reference including all endpoints, s
183
157
  | GET | `/v1/stats/summary` | Platform stats |
184
158
  | GET | `/health` | Health check |
185
159
 
186
- ## Docs
187
-
188
- The standalone skill repo also carries the core repo docs:
189
-
190
- - [Quickstart guide](./docs/guides/quickstart.md)
191
- - [API notes](./docs/api.md)
192
- - [Codex eval harness](./docs/codex-eval-harness.md)
193
- - [Deployment notes](./docs/deployment.md)
194
- - [Release checklist](./docs/RELEASING.md)
195
-
196
160
  ## Configuration
197
161
 
198
162
  ### Runtime directories