@opendatalabs/connect 0.8.1-canary.f89b72a → 0.8.1-canary.f8bb3ba

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (59) hide show
  1. package/README.md +24 -255
  2. package/dist/cli/index.d.ts.map +1 -1
  3. package/dist/cli/index.js +1642 -621
  4. package/dist/cli/index.js.map +1 -1
  5. package/dist/cli/render/connect-renderer.d.ts +18 -0
  6. package/dist/cli/render/connect-renderer.d.ts.map +1 -0
  7. package/dist/cli/render/connect-renderer.js +223 -0
  8. package/dist/cli/render/connect-renderer.js.map +1 -0
  9. package/dist/cli/render/format.d.ts +6 -0
  10. package/dist/cli/render/format.d.ts.map +1 -1
  11. package/dist/cli/render/format.js +48 -3
  12. package/dist/cli/render/format.js.map +1 -1
  13. package/dist/cli/render/index.d.ts +2 -0
  14. package/dist/cli/render/index.d.ts.map +1 -1
  15. package/dist/cli/render/index.js +2 -0
  16. package/dist/cli/render/index.js.map +1 -1
  17. package/dist/cli/render/progress.d.ts +11 -0
  18. package/dist/cli/render/progress.d.ts.map +1 -0
  19. package/dist/cli/render/progress.js +56 -0
  20. package/dist/cli/render/progress.js.map +1 -0
  21. package/dist/cli/render/theme.js +1 -1
  22. package/dist/cli/render/theme.js.map +1 -1
  23. package/dist/connectors/registry.d.ts +22 -0
  24. package/dist/connectors/registry.d.ts.map +1 -1
  25. package/dist/connectors/registry.js +58 -0
  26. package/dist/connectors/registry.js.map +1 -1
  27. package/dist/core/cli-types.d.ts +241 -3
  28. package/dist/core/cli-types.d.ts.map +1 -1
  29. package/dist/core/cli-types.js +93 -1
  30. package/dist/core/cli-types.js.map +1 -1
  31. package/dist/core/index.d.ts +2 -1
  32. package/dist/core/index.d.ts.map +1 -1
  33. package/dist/core/index.js +1 -1
  34. package/dist/core/index.js.map +1 -1
  35. package/dist/core/state-store.d.ts +20 -0
  36. package/dist/core/state-store.d.ts.map +1 -1
  37. package/dist/core/state-store.js +81 -3
  38. package/dist/core/state-store.js.map +1 -1
  39. package/dist/personal-server/client.d.ts +34 -0
  40. package/dist/personal-server/client.d.ts.map +1 -0
  41. package/dist/personal-server/client.js +94 -0
  42. package/dist/personal-server/client.js.map +1 -0
  43. package/dist/personal-server/index.d.ts +10 -0
  44. package/dist/personal-server/index.d.ts.map +1 -1
  45. package/dist/personal-server/index.js +79 -32
  46. package/dist/personal-server/index.js.map +1 -1
  47. package/dist/personal-server/scope-resolver.d.ts +22 -0
  48. package/dist/personal-server/scope-resolver.d.ts.map +1 -0
  49. package/dist/personal-server/scope-resolver.js +68 -0
  50. package/dist/personal-server/scope-resolver.js.map +1 -0
  51. package/dist/runtime/managed-playwright.d.ts +7 -0
  52. package/dist/runtime/managed-playwright.d.ts.map +1 -1
  53. package/dist/runtime/managed-playwright.js +74 -11
  54. package/dist/runtime/managed-playwright.js.map +1 -1
  55. package/dist/runtime/playwright/browser.d.ts +1 -0
  56. package/dist/runtime/playwright/browser.d.ts.map +1 -1
  57. package/dist/runtime/playwright/browser.js +14 -4
  58. package/dist/runtime/playwright/browser.js.map +1 -1
  59. package/package.json +5 -2
package/README.md CHANGED
@@ -6,7 +6,12 @@ Let your users bring their own data to your app.
6
6
 
7
7
  This branch also carries the new `vana` collection CLI preview.
8
8
 
9
- - install the current canary on macOS with Homebrew:
9
+ Start with the dedicated CLI README:
10
+
11
+ - [CLI README](./docs/CLI-README.md)
12
+ - [CLI review surface](./docs/CLI-REVIEW-SURFACE.md)
13
+
14
+ Install the current canary on macOS with Homebrew:
10
15
 
11
16
  ```bash
12
17
  brew tap vana-com/vana
@@ -14,18 +19,15 @@ brew install vana
14
19
  vana status
15
20
  ```
16
21
 
17
- - or use the hosted prerelease installer on macOS/Linux:
22
+ Or use the hosted prerelease installer on macOS/Linux:
18
23
 
19
24
  ```bash
20
25
  curl -fsSL https://raw.githubusercontent.com/vana-com/vana-connect/feat/connect-cli-v1/install/install.sh | sh -s -- --version canary-feat-connect-cli-v1
21
26
  ```
22
27
 
23
- - branch release page:
24
- `https://github.com/vana-com/vana-connect/releases/tag/canary-feat-connect-cli-v1`
25
- - demo media:
26
- [`status-and-sources.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/status-and-sources.gif),
27
- [`data-inspection.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/data-inspection.gif),
28
- [`connect-success.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/connect-success.gif)
28
+ Branch prerelease:
29
+
30
+ - `https://github.com/vana-com/vana-connect/releases/tag/canary-feat-connect-cli-v1`
29
31
 
30
32
  Once installed, the best way to evaluate the CLI quickly is:
31
33
 
@@ -35,24 +37,18 @@ vana doctor
35
37
  vana status
36
38
  vana sources
37
39
  vana connect github
40
+ vana data list
38
41
  vana data show github
42
+ vana logs github
39
43
  ```
40
44
 
41
- Current reviewable transcripts:
42
-
43
- - [`status`](./docs/transcripts/status.txt)
44
- - [`doctor`](./docs/transcripts/doctor.txt)
45
- - [`setup`](./docs/transcripts/setup.txt)
46
- - [`sources`](./docs/transcripts/sources.txt)
47
- - [`data list`](./docs/transcripts/data-list.txt)
48
- - [`data list (empty)`](./docs/transcripts/data-list-empty.txt)
49
- - [`data show github`](./docs/transcripts/data-show-github.txt)
50
- - [`data show github (missing)`](./docs/transcripts/data-show-github-missing.txt)
51
- - [`data path github`](./docs/transcripts/data-path-github.txt)
52
- - [`connect github`](./docs/transcripts/connect-github-success.txt)
53
- - [`connect github --no-input`](./docs/transcripts/connect-github-no-input.txt)
54
- - [`connect shop --no-input`](./docs/transcripts/connect-shop-no-input.txt)
55
- - [`connect steam --no-input`](./docs/transcripts/connect-steam-no-input.txt)
45
+ Key demo media:
46
+
47
+ <img src="https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/status.gif" width="800" alt="vana status" />
48
+
49
+ <img src="https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/connect-github-success.gif" width="800" alt="vana connect github" />
50
+
51
+ <img src="https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/data-show-github.gif" width="600" alt="vana data show github" />
56
52
 
57
53
  ## What problem this solves
58
54
 
@@ -128,240 +124,13 @@ If you prefer to integrate the SDK into an existing project, follow the steps be
128
124
 
129
125
  `vana-connect` now also ships a local collection CLI for connector setup and data export flows.
130
126
 
131
- ### Install
132
-
133
- If you are evaluating this branch before it lands on `main`, use the prerelease path in the next section. The stable install commands below are the intended post-merge install path.
134
-
135
- macOS with Homebrew:
136
-
137
- ```bash
138
- brew tap vana-com/vana
139
- brew install vana
140
- ```
141
-
142
- macOS and Linux:
143
-
144
- ```bash
145
- curl -fsSL https://raw.githubusercontent.com/vana-com/vana-connect/main/install/install.sh | sh
146
- ```
147
-
148
- Windows PowerShell:
149
-
150
- ```powershell
151
- iwr https://raw.githubusercontent.com/vana-com/vana-connect/main/install/install.ps1 -useb | iex
152
- ```
153
-
154
- Both installers fetch the latest GitHub release asset for your platform, verify its checksum, and install `vana` without requiring Node or npm.
155
-
156
- ### Canary / prerelease testing
127
+ If you only care about the CLI, start with [docs/CLI-README.md](./docs/CLI-README.md).
157
128
 
158
- If you are testing an unreleased branch build, install from the branch installer and pass the prerelease tag explicitly.
129
+ For the full CLI review surface, use:
159
130
 
160
- macOS with Homebrew:
161
-
162
- ```bash
163
- brew tap vana-com/vana
164
- brew install vana
165
- ```
166
-
167
- The current Homebrew tap is following the latest `vana-connect` canary while this CLI is still rolling out.
168
-
169
- macOS and Linux:
170
-
171
- ```bash
172
- curl -fsSL https://raw.githubusercontent.com/vana-com/vana-connect/feat/connect-cli-v1/install/install.sh | sh -s -- --version canary-feat-connect-cli-v1
173
- ```
174
-
175
- Windows PowerShell:
176
-
177
- ```powershell
178
- & ([scriptblock]::Create((iwr https://raw.githubusercontent.com/vana-com/vana-connect/feat/connect-cli-v1/install/install.ps1 -useb).Content)) --version canary-feat-connect-cli-v1
179
- ```
180
-
181
- The current hosted prerelease is:
182
-
183
- `canary-feat-connect-cli-v1`
184
-
185
- Release page:
186
-
187
- `https://github.com/vana-com/vana-connect/releases/tag/canary-feat-connect-cli-v1`
188
-
189
- If you want the npm package path as a fallback:
190
-
191
- ```bash
192
- npx -y @opendatalabs/connect status
193
- ```
194
-
195
- ### Commands
196
-
197
- ```bash
198
- vana --version
199
- vana version
200
- vana doctor
201
- vana connect
202
- vana sources
203
- vana connect github
204
- vana connect github --json --no-input
205
- vana status
206
- vana setup
207
- vana data list
208
- vana data path github --json
209
- vana data show github --json | jq '.summary.lines'
210
- ```
211
-
212
- - `vana connect` opens a guided source picker in human mode.
213
- - `vana connect <source>` runs the end-to-end collection flow.
214
- - `vana connect <source> --json --no-input` is the strict machine-safe path for agents and shell automation.
215
- - `vana sources` groups sources into ready-now vs manual-step flows.
216
- - `vana status` prioritizes sources that need attention before already-connected sources.
217
- - `vana doctor` checks the local install, browser runtime, and state directories.
218
- - `vana data ...` lets you inspect collected local datasets without opening the raw JSON file yourself.
219
-
220
- ### Shell contract
221
-
222
- - `--json` mode writes machine-readable output to stdout without human narration.
223
- - Successful command completion returns exit code `0`.
224
- - Actionable failures like missing source selection, unavailable connectors, or disabled prompting return exit code `1`.
225
- - `vana --version`, `vana version`, and `vana --help` return exit code `0`.
226
- - `vana doctor --json` includes `installMethod`, `channel`, and upgrade/uninstall commands so scripts can surface the right lifecycle guidance.
227
-
228
- ### Shell examples
229
-
230
- ```bash
231
- vana status --json | jq '.channel, .installMethod, .summary'
232
- vana sources --json | jq '.summary, .recommendedSource'
233
- vana data list --json | jq '.summary, .datasets[] | {source, dataState, path}'
234
- vana doctor --json | jq '.paths.executable, .paths.appRoot, .lifecycle'
235
- ```
236
-
237
- ### Upgrade, channels, and uninstall
238
-
239
- Upgrade with the same channel you installed from:
240
-
241
- You can always confirm the current install method and exact lifecycle commands with:
242
-
243
- ```bash
244
- vana doctor
245
- ```
246
-
247
- - Homebrew:
248
- ```bash
249
- brew update
250
- brew upgrade vana
251
- ```
252
- - macOS/Linux installer:
253
- ```bash
254
- curl -fsSL https://raw.githubusercontent.com/vana-com/vana-connect/main/install/install.sh | sh
255
- ```
256
- - Windows PowerShell installer:
257
- ```powershell
258
- iwr https://raw.githubusercontent.com/vana-com/vana-connect/main/install/install.ps1 -useb | iex
259
- ```
260
-
261
- Current channels:
262
-
263
- - `stable`: install from `main` or the eventual stable Homebrew tap state
264
- - `canary`: install from the latest prerelease assets while this CLI is still rolling out
265
-
266
- To remove the installed CLI:
267
-
268
- - Homebrew:
269
- ```bash
270
- brew uninstall vana
271
- ```
272
- - macOS/Linux installer:
273
- ```bash
274
- rm -f ~/.local/bin/vana
275
- rm -rf ~/.local/share/vana
276
- ```
277
- - Windows PowerShell installer:
278
- - remove `%USERPROFILE%\AppData\Local\Microsoft\WinGet\Links\vana.cmd`
279
- - remove `%USERPROFILE%\AppData\Local\Vana`
280
-
281
- To remove local runtime and collected state as well:
282
-
283
- ```bash
284
- rm -rf ~/.dataconnect
285
- ```
286
-
287
- ### CLI demos
288
-
289
- The branch also includes deterministic VHS demo scaffolding under
290
- [`docs/vhs/`](./docs/vhs/README.md).
291
-
292
- Branch prerelease preview media:
293
-
294
- - [`status-and-sources.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/status-and-sources.gif)
295
- - [`data-inspection.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/data-inspection.gif)
296
- - [`connect-success.gif`](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/connect-success.gif)
297
-
298
- ![Vana status and sources demo](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/status-and-sources.gif)
299
-
300
- ![Vana data inspection demo](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/data-inspection.gif)
301
-
302
- ![Vana successful connect demo](https://github.com/vana-com/vana-connect/releases/download/canary-feat-connect-cli-v1/connect-success.gif)
303
-
304
- Current reviewable transcripts:
305
-
306
- - [`status`](./docs/transcripts/status.txt)
307
- - [`doctor`](./docs/transcripts/doctor.txt)
308
- - [`setup`](./docs/transcripts/setup.txt)
309
- - [`sources`](./docs/transcripts/sources.txt)
310
- - [`data list`](./docs/transcripts/data-list.txt)
311
- - [`data list (empty)`](./docs/transcripts/data-list-empty.txt)
312
- - [`data show github`](./docs/transcripts/data-show-github.txt)
313
- - [`data show github (missing)`](./docs/transcripts/data-show-github-missing.txt)
314
- - [`data path github`](./docs/transcripts/data-path-github.txt)
315
- - [`connect github`](./docs/transcripts/connect-github-success.txt)
316
- - [`connect github --no-input`](./docs/transcripts/connect-github-no-input.txt)
317
- - [`connect shop --no-input`](./docs/transcripts/connect-shop-no-input.txt)
318
- - [`connect steam --no-input`](./docs/transcripts/connect-steam-no-input.txt)
319
-
320
- To seed the fixture home used by the first tapes:
321
-
322
- ```bash
323
- pnpm demo:vhs:fixtures
324
- ```
325
-
326
- To render the checked-in tapes once `vhs` or Docker is available:
327
-
328
- ```bash
329
- pnpm demo:vhs
330
- ```
331
-
332
- To capture deterministic human-mode transcripts for review:
333
-
334
- ```bash
335
- pnpm demo:transcripts
336
- ```
337
-
338
- To watch the branch release lane, trigger Homebrew sync, and verify the
339
- published installer automatically:
340
-
341
- ```bash
342
- pnpm release:watch
343
- ```
344
-
345
- ### Local development
346
-
347
- From this repo:
348
-
349
- ```bash
350
- pnpm install
351
- pnpm build
352
- node dist/cli/bin.js status
353
- ```
354
-
355
- The CLI installs its local browser runtime under `~/.dataconnect/`.
356
- That runtime is bundled from `vana-connect` itself, so `vana setup` does not require a separate `data-connect` checkout.
357
-
358
- To build a standalone launcher plus app payload locally:
359
-
360
- ```bash
361
- pnpm build
362
- pnpm build:sea
363
- ./artifacts/sea/vana-linux-x64/vana status --json
364
- ```
131
+ - [CLI review surface](./docs/CLI-REVIEW-SURFACE.md)
132
+ - [CLI transcripts](./docs/transcripts/README.md)
133
+ - [CLI demos](./docs/vhs/README.md)
365
134
 
366
135
  `pnpm build:sea` uses Node 25's `--build-sea` flow to create a small `vana` launcher and packages the real app payload next to it under `app/`.
367
136
  It produces a platform-specific release directory plus a release archive and matching checksum file under `artifacts/sea/`.
@@ -1 +1 @@
1
- {"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/cli/index.ts"],"names":[],"mappings":"AA+FA,wBAAsB,MAAM,CAAC,IAAI,WAAe,GAAG,OAAO,CAAC,MAAM,CAAC,CA8LjE"}
1
+ {"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/cli/index.ts"],"names":[],"mappings":"AAiHA,wBAAsB,MAAM,CAAC,IAAI,WAAe,GAAG,OAAO,CAAC,MAAM,CAAC,CA0UjE"}