eve 0.6.0-beta.10 → 0.6.0-beta.12

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (108) hide show
  1. package/CHANGELOG.md +28 -0
  2. package/README.md +1 -1
  3. package/dist/docs/evals-v2-plan.md +108 -108
  4. package/dist/docs/public/advanced/evals.md +51 -23
  5. package/dist/docs/public/getting-started.mdx +2 -2
  6. package/dist/docs/public/reference/cli.md +17 -17
  7. package/dist/docs/public/reference/typescript-api.md +2 -2
  8. package/dist/src/chunks/{use-eve-agent-DCZbkLG7.js → use-eve-agent-BD79SFqg.js} +82 -29
  9. package/dist/src/chunks/{use-eve-agent-DoheC4_o.js → use-eve-agent-DT2A6VJb.js} +82 -29
  10. package/dist/src/cli/commands/setup.d.ts +6 -3
  11. package/dist/src/cli/commands/setup.js +1 -1
  12. package/dist/src/cli/run.d.ts +1 -1
  13. package/dist/src/cli/run.js +1 -1
  14. package/dist/src/client/file-parts.d.ts +18 -0
  15. package/dist/src/client/file-parts.js +1 -0
  16. package/dist/src/client/index.d.ts +3 -2
  17. package/dist/src/client/index.js +1 -1
  18. package/dist/src/client/message-response.js +1 -1
  19. package/dist/src/client/open-stream.d.ts +6 -0
  20. package/dist/src/client/open-stream.js +1 -1
  21. package/dist/src/client/session-utils.d.ts +5 -0
  22. package/dist/src/client/session-utils.js +1 -1
  23. package/dist/src/client/session.js +1 -1
  24. package/dist/src/client/types.d.ts +5 -1
  25. package/dist/src/evals/checks/checks.d.ts +1 -1
  26. package/dist/src/evals/checks/index.d.ts +1 -1
  27. package/dist/src/evals/checks/match.d.ts +1 -1
  28. package/dist/src/evals/cli/eval.d.ts +2 -2
  29. package/dist/src/evals/cli/eval.js +1 -1
  30. package/dist/src/evals/{define-eval-suite.d.ts → define-eval.d.ts} +6 -6
  31. package/dist/src/evals/define-eval.js +1 -0
  32. package/dist/src/evals/index.d.ts +3 -2
  33. package/dist/src/evals/index.js +1 -1
  34. package/dist/src/evals/runner/artifacts.d.ts +6 -6
  35. package/dist/src/evals/runner/artifacts.js +1 -1
  36. package/dist/src/evals/runner/discover.d.ts +10 -10
  37. package/dist/src/evals/runner/discover.js +1 -1
  38. package/dist/src/evals/runner/execute-case.d.ts +4 -7
  39. package/dist/src/evals/runner/execute-case.js +1 -1
  40. package/dist/src/evals/runner/{execute-suite.d.ts → execute-eval.d.ts} +6 -6
  41. package/dist/src/evals/runner/execute-eval.js +1 -0
  42. package/dist/src/evals/runner/reporters/braintrust.d.ts +4 -4
  43. package/dist/src/evals/runner/reporters/braintrust.js +2 -2
  44. package/dist/src/evals/runner/reporters/console.d.ts +3 -3
  45. package/dist/src/evals/runner/reporters/console.js +1 -1
  46. package/dist/src/evals/runner/reporters/types.d.ts +6 -6
  47. package/dist/src/evals/scorers/autoevals.d.ts +7 -7
  48. package/dist/src/evals/scorers/autoevals.js +1 -1
  49. package/dist/src/evals/scorers/model-marker.d.ts +3 -3
  50. package/dist/src/evals/session.d.ts +46 -0
  51. package/dist/src/evals/session.js +1 -0
  52. package/dist/src/evals/types.d.ts +154 -57
  53. package/dist/src/execution/tool-auth.js +1 -1
  54. package/dist/src/internal/application/package.js +1 -1
  55. package/dist/src/protocol/message.d.ts +8 -0
  56. package/dist/src/protocol/message.js +2 -2
  57. package/dist/src/runtime/connections/mcp-client.js +1 -1
  58. package/dist/src/runtime/connections/scoped-authorization.d.ts +9 -5
  59. package/dist/src/runtime/connections/scoped-authorization.js +1 -1
  60. package/dist/src/runtime/connections/types.d.ts +24 -0
  61. package/dist/src/setup/ask.d.ts +7 -0
  62. package/dist/src/setup/ask.js +1 -1
  63. package/dist/src/setup/boxes/add-channels.d.ts +11 -2
  64. package/dist/src/setup/boxes/add-channels.js +1 -1
  65. package/dist/src/setup/boxes/add-connections.d.ts +8 -58
  66. package/dist/src/setup/boxes/add-connections.js +1 -1
  67. package/dist/src/setup/boxes/deploy-project.js +1 -1
  68. package/dist/src/setup/boxes/one-shot-next-steps.d.ts +14 -0
  69. package/dist/src/setup/boxes/one-shot-next-steps.js +2 -0
  70. package/dist/src/setup/boxes/resolve-provisioning.js +1 -1
  71. package/dist/src/setup/boxes/select-connections.d.ts +32 -0
  72. package/dist/src/setup/boxes/select-connections.js +1 -0
  73. package/dist/src/setup/boxes/select-model.d.ts +4 -4
  74. package/dist/src/setup/boxes/select-model.js +1 -1
  75. package/dist/src/setup/boxes/select-setup-mode.d.ts +32 -0
  76. package/dist/src/setup/boxes/select-setup-mode.js +1 -0
  77. package/dist/src/setup/cli/index.d.ts +1 -0
  78. package/dist/src/setup/cli/index.js +1 -1
  79. package/dist/src/setup/cli/prompt-ui.d.ts +39 -15
  80. package/dist/src/setup/cli/prompt-ui.js +1 -1
  81. package/dist/src/setup/cli/select-component.d.ts +16 -1
  82. package/dist/src/setup/cli/select-component.js +1 -1
  83. package/dist/src/setup/cli/select-state.d.ts +13 -1
  84. package/dist/src/setup/cli/select-state.js +1 -1
  85. package/dist/src/setup/cli/whimsy.d.ts +16 -0
  86. package/dist/src/setup/cli/whimsy.js +1 -0
  87. package/dist/src/setup/connection-connector.js +1 -1
  88. package/dist/src/setup/index.d.ts +2 -2
  89. package/dist/src/setup/onboarding.d.ts +5 -3
  90. package/dist/src/setup/onboarding.js +1 -1
  91. package/dist/src/setup/primitives/run-vercel.d.ts +7 -0
  92. package/dist/src/setup/primitives/run-vercel.js +1 -1
  93. package/dist/src/setup/prompter.d.ts +20 -3
  94. package/dist/src/setup/prompter.js +1 -1
  95. package/dist/src/setup/scaffold/create/project.js +1 -1
  96. package/dist/src/setup/scaffold/update/channels.js +2 -2
  97. package/dist/src/setup/scaffold/update/connections.js +1 -1
  98. package/dist/src/setup/slackbot.js +1 -1
  99. package/dist/src/setup/state.d.ts +35 -1
  100. package/dist/src/setup/state.js +1 -1
  101. package/dist/src/setup/vercel-project.js +1 -1
  102. package/dist/src/svelte/index.js +1 -1
  103. package/dist/src/svelte/use-eve-agent.js +1 -1
  104. package/dist/src/vue/index.js +1 -1
  105. package/dist/src/vue/use-eve-agent.js +1 -1
  106. package/package.json +1 -1
  107. package/dist/src/evals/define-eval-suite.js +0 -1
  108. package/dist/src/evals/runner/execute-suite.js +0 -1
package/CHANGELOG.md CHANGED
@@ -1,5 +1,33 @@
1
1
  # eve
2
2
 
3
+ ## 0.6.0-beta.12
4
+
5
+ ### Minor Changes
6
+
7
+ - 4c1dd92: The connections picker moved into the onboarding interview: it now asks right after channel selection, before any files are written. The selected connections are still scaffolded and provisioned after the project link, exactly as before.
8
+ - 432deaa: The setup model picker now opens on a curated shortlist (Claude Sonnet 4.6 as the default, Claude Opus 4.8, GPT-5.5, and Gemini 3.5) and surfaces the rest of the AI Gateway catalog through scrolling or search. The search filter now accepts spaces. Vercel Connect steps in Slack channel setup run under hard deadlines, so an abandoned browser OAuth can no longer stall `connect create slack` forever.
9
+ - 4c1dd92: Onboarding deploys to Vercel only when the Slack channel was added — its connector needs a public production URL. A web-only onboarding run links the project but skips the deploy; Web Chat runs locally through `eve dev`. Adding channels to an existing project (`eve setup` in-project, `eve channels add`) still deploys for any channel.
10
+ - 4c1dd92: The onboarding flow now asks how much to set up after the agent name: "Complete setup" (the existing full flow, recommended) or "One-shot", which scaffolds the base template with the default model and skips provisioning, channels, deploy, and chat, ending with a next-steps note. `eve setup` in a directory that is not an Eve project now asks for the agent name and where the agent should live instead of force-scaffolding in place over the existing repo.
11
+ - 432deaa: A failed Slackbot provision no longer aborts onboarding or `eve setup`. The run warns, skips Slack, and keeps scaffolding and deploying, and you can add Slack later with `eve channels add slack`. The `eve channels add slack` command itself still fails hard, since Slack is its whole purpose.
12
+ - 432deaa: Setup multi-select prompts now render checkboxes and end with a bold Submit row. Enter toggles the highlighted option, and only enter on Submit confirms, so a stray enter can no longer skip the checklist. Single-select prompts mark the highlighted row with a `›` arrow instead of a check.
13
+
14
+ ### Patch Changes
15
+
16
+ - 432deaa: Refreshed onboarding copy: the deploy question now asks where to deploy (Vercel vs. elsewhere), the team and project pickers use shorter titles, and the intro banners spell the product as 𝐞𝐯𝐞.
17
+
18
+ ## 0.6.0-beta.11
19
+
20
+ ### Minor Changes
21
+
22
+ - 9bb6371: Adds the evals interaction API: scripted cases, `task.run`, `EveEvalSession` helpers for HITL responses and file attachments, multi-session event capture, and client-level HITL request results with retry handling for stream registration races.
23
+ - 22dda94: Rename the eval authoring helper from `defineEvalSuite` to `defineEval` and update the public eval types, reporter hooks, CLI wording, and JSON result shape to use eval terminology consistently.
24
+
25
+ ### Patch Changes
26
+
27
+ - a0ca3bb: Scaffolded projects now pin `@vercel/connect@0.2.2`. The previously pinned 0.1.1 predates the `@vercel/connect/eve` entrypoint, so generated channels and connections failed to build on deploy with `Package subpath './eve' is not defined by "exports"`.
28
+ - a0ca3bb: Fix interactive post-setup deploys failing with "The `projectSettings` object is required for new projects". The setup deploy now passes `--yes` to `vercel deploy --prod` in interactive runs too, so the Vercel API auto-detects framework settings for projects that eve provisioned through the projects API.
29
+ - 380693d: Token eviction on a rejected bearer now cascades to the authorization strategy's own cache, not just Eve's per-step cache. `AuthorizationDefinition` gains an optional `evict(opts)` hook, and the shared `evictScopedToken` path (used by both authored tools and MCP connections) invokes it after dropping the per-step entry. This lets `@vercel/connect`-backed connections purge their in-process token cache so a revoked-but-unexpired grant is genuinely re-fetched instead of re-read from a lower cache layer.
30
+
3
31
  ## 0.6.0-beta.10
4
32
 
5
33
  ### Minor Changes
package/README.md CHANGED
@@ -52,7 +52,7 @@ Every authored directory has a typed helper. Import each from the matching subpa
52
52
  | `eveChannel(...)`, `slackChannel(...)`, `vercelOidc(...)` | `eve/channels/eve`, `/slack`, `/auth` | reused from `channels/<name>.ts` |
53
53
  | `defineSandbox(...)` | `eve/sandbox` | `sandbox.ts` (or `sandbox/sandbox.ts`) |
54
54
  | `defineSchedule(...)` | `eve/schedules` | `schedules/<name>.ts` (or `schedules/<name>.md`) |
55
- | `defineEvalSuite(...)` | `eve/evals` | `evals/<name>.eval.ts` |
55
+ | `defineEval(...)` | `eve/evals` | `evals/<name>.eval.ts` |
56
56
 
57
57
  Runtime accessors live on the subpath that owns the concern:
58
58