@cursor/july 0.1.109 → 0.1.112

package/dist/docs/troubleshooting.md

@@ -1,111 +1,141 @@
 # Fix common agent problems
 
-Start with four checks, in order:
+Start with three checks:
 
-1. Project discovery: `agent-sdk validate --dir .`
-2. Whether the serve process is running
-3. What the playground or HTTP API shows
-4. The session event stream (trace)
+1. Run `agent-sdk validate --dir .`.
+2. Confirm the expected agent and connections in
+   `agent-sdk info --dir . --json`.
+3. Reproduce once, then inspect the serve log or session trace.
 
-Match your symptom below. Keep the commands as `agent-sdk`. If it is
-not on `PATH`, use `npx @cursor/july`.
+Match the visible symptom below. If `agent-sdk` is not on `PATH`, use
+`npx @cursor/july`.
 
-## What if serve or the playground looks wrong?
+## Serve or the playground will not work
 
 | What you see | What to do |
 | --- | --- |
-| `serve` won't start | Run `agent-sdk validate --dir .` and fix the reported errors. |
-| Playground is blank or says there are no agents | The UI needs a running `serve` process. Building the playground assets alone is not enough. |
-| The playground UI looks stale | `serve --dev` prints a playground URL. Open that URL. Agent-file edits still need a restart (press Enter on the TTY). |
-| Sessions exist but the playground list is empty | The list shows sessions for the authenticated caller. In `--dev` on loopback the list is wider. Otherwise open `/<slug>/playground?sessionId=ses_…`. |
-| Port 3000 is already in use | For the default serve port, the CLI tries the next free port and prints a notice. Pass `--port` to pick one, or `--port 0` for any free port. Stop leftover playground or webhook-forwarder processes if you need the original port. |
+| `serve` exits before listening | Fix the errors from `agent-sdk validate --dir .`, then start it again. |
+| Playground is blank or says there are no agents | Start `agent-sdk serve`; built playground assets have no agent data without the server. |
+| Agent-file edits do not appear | Open the URL printed by `serve --dev`, then press Enter in its TTY to reload after file changes. |
+| Sessions exist but the list is empty | The list is scoped to the authenticated principal. Use the same identity that created the session; a `?sessionId=` deep link does not bypass authorization. |
+| The preferred port is busy | Use the next port printed by the CLI, pass `--port <number>`, or pass `--port 0` for any free port. |
 
-## What if a model turn goes wrong?
+## A model turn fails
 
 | What you see | What to do |
 | --- | --- |
-| Built-in file reads and greps fail; the turn retries for a long time | Run under Node 22.13+ (or `tsx`), never Bun. Look for `NGHTTP2_FRAME_SIZE_ERROR` in logs. |
-| The turn fails immediately with an API-key error | Sign in with `agent-sdk login`, or set `CURSOR_API_KEY` or `CURSOR_SERVICE_ACCOUNT_KEY`. Discovery, `info`, `call`, and serve bring-up work without a key; model turns need one. |
-| Replies quote rules or `AGENTS.md` from outside your agent project | The session workspace inherited parent-folder config. Nested git checkouts default `local.cwd` to a per-project cache directory under `~/.cache`. Point `defineAgent({ local: { cwd } })` at a checkout only when the agent should inherit that tree, or set `--state-root` to a clean directory (for example under `/tmp`). |
-| Yellow box shows Datadog/Linear tools, but the model lists `GetDynamicTools` / IDE `cursor` tools and never calls them | Attached MCP sits behind harness meta-tools, or the harness cwd is still inside another checkout. Set `advertiseTools: true` for named tools on local turns. Check `GET /v1/info` `local.cwd` and `connections[].advertiseTools`. |
-| Server tools, skills, or workspace seed files never appear | Server tools and sandbox seeds apply on the local runtime (cloud server tools need `--public-url` / `--cloud-tools-url`). Skills reach cloud through the Agent Store when hosting or a personal `CURSOR_API_KEY` is available; otherwise only skills already in the cloud repo. `validate` warns when this combination is present. |
-| `validate` and `run` succeed, but typecheck fails in CI | The CLI runs TypeScript with type-stripping only. Keep tool `execute` return types as object literals or `type` aliases, not `interface` types. |
-| Login works, but turns are rejected when using custom API hosts | Point login and model traffic at the same host (`CURSOR_API_BASE_URL` and `CURSOR_BACKEND_URL`). A key from one host is rejected by the other. |
+| File reads and greps fail repeatedly with `NGHTTP2_FRAME_SIZE_ERROR` | Run the agent under Node 22.13 or newer, never Bun. |
+| The turn immediately reports a missing API key | Set `CURSOR_API_KEY`, `CURSOR_API_KEY_FILE`, or `CURSOR_SERVICE_ACCOUNT_KEY`, or run `agent-sdk login`. |
+| Login succeeds but the model host rejects the key | Point login and model traffic at the same API host; check `CURSOR_API_BASE_URL` and `CURSOR_BACKEND_URL`. |
+| Cloud turns cannot reach local tools or skills | Give the cloud runtime a reachable `--public-url` and protected tool bridge, or move the required capability into the cloud checkout. See [agent runtime](/docs/reference/agent-config.md#choose-a-runtime). |
 
-## What if the HTTP API returns an error?
+## A turn behaves unexpectedly
 
 | What you see | What to do |
 | --- | --- |
-| `409` on a follow-up message | Refresh the `continuationToken` or confirm the session is a chat session. Task sessions do not accept follow-ups. |
-| `409 session_busy` on `call --session` | The tool is a write (or declares no effect) and a model turn is running. Wait for the turn to finish, omit `--session` for a one-off call, or declare `effect: "read"` on a tool that only reads so it runs alongside turns. |
-| `403` on stream or follow-up | Use the same auth identity that created the session. Off localhost, pass `--bearer-token` and send it on every request. |
-| Works on localhost; blocked through a tunnel or LAN | Default auth allows only direct loopback callers. Share the host with `--bearer-token <secret>` (or authored `bearerAuth`). Use `--allow-anonymous` only on a trusted private network. |
-| A channel route fails to compile with a schema type error | `GET` routes need a Zod `querySchema`. `POST` / `PUT` / `PATCH` need a Zod `bodySchema`. Use `z.object({})` or `z.unknown()` for open shapes. |
+| Replies quote an ancestor `AGENTS.md` or unrelated repository rules | Inspect `local.cwd` in `/v1/info`. Set `defineAgent({ local: { cwd } })` or the session workspace explicitly instead of inheriting the parent checkout. |
+| The model lists IDE meta-tools but never calls named MCP tools | Set `advertiseTools: true` on the local model-visible connection and confirm it under `connections` in `/v1/info`. |
+| Server tools, skills, or seed files are absent | Check the selected local/cloud runtime and discovered project in `/v1/info`; follow the capability warning from `validate`. |
+| `validate` and `run` pass but CI type-checking fails | Run the project type check. Tool results must be JSON-shaped; prefer object literals or `type` aliases over `interface` return types. |
 
-## What if GitHub webhooks misbehave?
+## HTTP returns 401, 403, or 409
 
 | What you see | What to do |
 | --- | --- |
-| `github forward` returns 401 on every delivery, but the hook was created | Clear `GITHUB_TOKEN` and `GH_TOKEN` for that command. The forwarder uses your `gh` CLI login: `GITHUB_TOKEN= GH_TOKEN= agent-sdk github forward …` |
-| `Hook already exists` when starting a forwarder | GitHub allows one forwarder per repo. Run a single `github forward --dir <parent>` and stop stale forwarders. |
-| Deliveries rejected outside `--dev` | Set `GITHUB_WEBHOOK_SECRET` on the server and on the signer. Without a secret, the channel stays loopback-only. |
-| You lack repo admin and can't forward | Use `agent-sdk github replay <pr-url>`. It needs pull access only and posts signed test payloads. |
+| `401` outside localhost | Send the configured bearer token, alias token, or channel credential. Default custom routes admit direct loopback only. |
+| `403` on a stream or follow-up | Use the same authenticated principal that created the session. |
+| A localhost route fails through a tunnel or LAN | Protect the shared host with `--bearer-token` or authored channel auth. Use `--allow-anonymous` only behind a proxy that authenticates every caller. |
+| `409` on a follow-up | Refresh the rotating `continuationToken` and confirm the target is a chat session; task sessions do not accept follow-ups. |
+| `409 session_busy` from `call --session` | Wait for the turn, omit `--session`, or mark a read-only tool with `effect: "read"` so it can run concurrently. |
+| A custom route fails schema type-checking | Add the required Zod `querySchema` for `GET`, or `bodySchema` for `POST`, `PUT`, and `PATCH`. See [Channels](/docs/reference/channels.md). |
 
-## What if Slack stays quiet?
+## A hosted deployment fails or looks stale
 
 | What you see | What to do |
 | --- | --- |
-| Logs show `channel idle … missing credentials` | Expected when tokens are missing. Run `agent-sdk slack create --dir <agent>` to provision the app and write the tokens, or `agent-sdk slack init --manual --dir <agent>` and paste the manifests at api.slack.com. Then set `<PREFIX>_SLACK_BOT_TOKEN` and `<PREFIX>_SLACK_APP_TOKEN` per agent and run `agent-sdk slack doctor --prefix <PREFIX>`. |
-| `slack create` reports the app needs admin approval | Open Slack's **Request approval** page (the CLI prints the link; the same URL is **Send a reminder** after you submit). Managed install does not file the request. Keep the CLI running, then click **Retry** in the dashboard after an admin approves. |
-| The bot ignores ordinary channel posts | Default engagement is mentions and DMs only. Enable `engagement.channelPosts` with an allowlist, and subscribe the app to `message.channels` / `message.groups`. |
-| Approve / Deny buttons do nothing | Channels that post approval cards need `toolApprovals: true`. Recreate the app with `slack create` if interactivity is off. |
+| Local changes do not appear after deploy | `deploy` reads a pushed Git ref, not the working tree. Commit and push the intended ref, then deploy it again. |
+| The deployment never becomes running | Run `agent-sdk deployment <slug>` and `agent-sdk logs --prod --slug <slug>`, then act on the reported build or startup error. |
+| A secret or egress change has no effect | Confirm the name with `secrets list`, verify the `hosting` block exists on the pushed ref, and follow the CLI or dashboard prompt to redeploy. |
+| Cursor events stopped after redeploy | Redeploy replaces CLI-supplied event repositories. Pass every `--cursor-events-repo` value again. |
+| External HTTP rejects the alias token | Update the caller with the current token. If the token is lost or exposed, run `agent-sdk rotate-token <slug>` and replace it everywhere. |
 
-## What if host MCP OAuth fails?
+See [Deployment](/docs/deployment.md) for source, credential, and
+redeployment boundaries.
+
+## GitHub deliveries fail
+
+| What you see | What to do |
+| --- | --- |
+| `github forward` returns 401 on every delivery after creating the hook | Clear `GITHUB_TOKEN` and `GH_TOKEN` for that command so the forwarder uses the `gh` CLI login: `GITHUB_TOKEN= GH_TOKEN= agent-sdk github forward ...`. |
+| `Hook already exists` | Run one forwarder for the repository and stop the stale process. |
+| Direct webhook deliveries are rejected outside `--dev` | Configure the same `GITHUB_WEBHOOK_SECRET` on the signer and server. Cursor event pull needs no public webhook or webhook secret. |
+| You cannot create a forwarder | Use `agent-sdk github replay <pr-url>`; it needs pull access instead of repository administration. |
+
+The [GitHub guide](/docs/guides/github.md) covers event pull, replay, and
+direct webhooks.
+
+## Slack does not respond
 
 | What you see | What to do |
 | --- | --- |
-| `must be defineConnection({ url, oauth: true })` | The connection file needs `oauth: true`, or you passed the wrong connection name to `agent-sdk mcp oauth`. |
-| Local auth works; hosted calls unauthorized | Finish Connect on the hosted engine, or run `agent-sdk mcp oauth <name> --store`. Confirm names with `agent-sdk secrets list <slug>`, then redeploy. |
-| Model asks for `mcp_auth` or IDE MCP for a connector it already has | Attached MCP is behind meta-tools. Set `advertiseTools: true` for named tools on local turns, or call it from a host tool via `ctx.host.mcp`. |
+| Logs say `channel idle ... missing credentials` | Run `agent-sdk slack create --dir <agent>`, then check the generated prefix with `agent-sdk slack doctor`. Use `slack init --manual` only for an app you own. |
+| `slack create` is waiting for workspace approval | Open the approval link printed by the CLI, keep the command running, and retry after an admin approves. |
+| The bot ignores ordinary channel posts | Configure `engagement.channelPosts`, create the app with `--channel-posts`, and invite it to every allowed channel. |
+| Approval buttons do nothing | Set `toolApprovals: true`, then recreate the app if its interactivity is not enabled. |
 
-See [Host MCP OAuth](/docs/guides/mcp-oauth.md) and
-[`skills/mcp-auth/SKILL.md`](/docs/skills/mcp-auth.md).
+See the [Slack guide](/docs/guides/slack.md) for app setup and engagement
+choices.
 
-## What if a secret showed up in a terminal transcript?
+## MCP authorization fails
 
 | What you see | What to do |
 | --- | --- |
-| `secrets set … NAME=VALUE` in an agent-captured terminal or shell history | Rotate the secret at the provider. Set it again with names only: `agent-sdk secrets set <slug> NAME` (hidden prompt) or pipe/redirect the value. `NAME=VALUE` requires `--from-argv` and still leaks into argv. |
-| Alias token printed during first deploy or `rotate-token` | Treat it as exposed if the transcript left your machine. Run `agent-sdk rotate-token <slug>`, store the new token outside agent transcripts, and update callers. |
-| Someone verified a secret with `echo` / `printenv` | Rotate it. Confirm presence with `agent-sdk secrets list <slug>` (names only), then redeploy and test the feature. |
+| `must be defineConnection({ url, oauth: true })` | Add `oauth: true` to the named URL connection or correct the connection filename passed to `mcp oauth`. |
+| Local auth works but hosted calls return unauthorized | Complete Connect for the running process, or run `mcp oauth <name> --store` and redeploy for future replacements. |
+| The model invents `mcp_auth` instead of calling the server | Set `advertiseTools: true` for named local tools, or expose a host-side wrapper through `ctx.host.mcp`. |
 
-## What if schedules, reminders, or approvals stall?
+See [Host MCP OAuth](/docs/guides/mcp-oauth.md) for the credential lifecycle.
+
+## Schedules, reminders, or approvals stall
+
+| What you see | What to do |
+| --- | --- |
+| A schedule or reminder never fires under `--dev` | Trigger it through the matching `/v1/dev/schedules/<id>` or `/v1/dev/reminders/<id>` route; development mode does not auto-fire. |
+| A pending approval disappears after restart | Parked approvals do not survive restart. Run the turn again. |
+| A reminder is disarmed with `handler_lost_on_restart` | Recreate handler-form reminders after restart, or use a prompt-form reminder. |
+| The same schedule fires on several self-hosted processes | Enable schedules on one serving process per project and pass `--no-schedules` to the others. |
+
+## A credential was exposed
 
 | What you see | What to do |
 | --- | --- |
-| A schedule or reminder never fires under `--dev` | Dev mode does not auto-fire. Trigger with `POST /<slug>/v1/dev/schedules/<id>` or `POST /<slug>/v1/dev/reminders/<id>` (list reminders at `GET /v1/dev/reminders`). |
-| A pending tool approval disappeared after restart | Parked approvals do not survive host restart. They resolve as interrupted. Run the turn again. |
-| A reminder is disarmed after restart (`handler_lost_on_restart`) | Handler-form reminders live in memory. Re-arm them from the code that created them, or use prompt-form reminders. |
+| A secret value appears in a command, transcript, or shell history | Rotate it at the provider, set it again through hidden input or stdin, and test the feature. |
+| An alias token appears outside its secure destination | Run `agent-sdk rotate-token <slug>`, store the new value outside transcripts, and update every caller. |
+| Someone printed a secret to verify it | Rotate it. Confirm only the name with `agent-sdk secrets list <slug>`, then redeploy and exercise the feature. |
+
+## Read the session trace
 
-## How do I read a session trace?
+Start with `actions.requested` and `action.result`. Count calls by tool
+name, pair every request with its result, and separate host preparation
+from tools chosen by the model.
 
-Look at `actions.requested` / `action.result` pairs for the tool
-trajectory. Count calls by tool name before blaming latency. Separate
-host-side work (channel `callTool`, preparation) from tools the model
-chose.
+`turn.failed` with `turn interrupted` usually means a follow-up or stop
+ended the turn deliberately. Other failures should have an error event
+near the tool or model boundary that produced them.
 
-`turn.failed` with `"turn interrupted"` means a follow-up or stop ended
-the turn on purpose.
+Use the trace path printed by `agent-sdk run`:
 
-If the model reads outside the session workspace, the prepared files
-don't match what the instructions expect. Fix the layout. See
-[Hillclimbing](/docs/hillclimbing.md).
+```bash
+agent-sdk trajectory --events <trace-path>
+```
 
-`agent-sdk trajectory --events <file>` summarizes any saved NDJSON
-stream. The playground **Open trace** control does the same visually.
+The playground's **Open trace** control renders the same trajectory.
+When the agent runs but makes poor decisions, move from diagnosis to a
+measured [hillclimb](/docs/hillclimbing.md).
 
-## What's next
+## Related
 
-- [Concepts](/docs/concepts.md): the model behind these symptoms
-- [Hillclimbing](/docs/hillclimbing.md): when the agent runs but underperforms
-- [Deployment](/docs/deployment.md): auth and state on shared hosts
+- [Deployment](/docs/deployment.md): hosted and self-hosted boundaries
+- [Sessions](/docs/reference/sessions.md): session ownership and event
+  vocabulary
+- [CLI reference](/docs/reference/cli.md): command flags and exit behavior

package/dist/evals/assertions.js

@@ -73,7 +73,7 @@ export class EvalAssertionRecorder {
     recordAsync(input, settle) {
         const handle = this.record(input);
         const slot = this.slots[this.slots.length - 1];
-        this.pending.push(settle.then((patch) => {
+        this.pending.push(settle.then(patch => {
             Object.assign(slot, patch);
             if (patch.passed !== undefined) {
                 slot.rawPassed = patch.passed;
@@ -102,7 +102,7 @@ export class EvalAssertionRecorder {
         });
     }
     results() {
-        return this.slots.map((slot) => ({
+        return this.slots.map(slot => ({
             name: slot.name,
             passed: slot.passed,
             detail: slot.detail,
@@ -164,11 +164,11 @@ function handleFor(slot) {
  * successful turn), which keeps pre-severity eval files working unchanged.
  */
 export function computeVerdict(results) {
-    const failedGate = results.some((r) => { var _a; return ((_a = r.severity) !== null && _a !== void 0 ? _a : "gate") === "gate" && !r.passed; });
+    const failedGate = results.some(r => { var _a; return ((_a = r.severity) !== null && _a !== void 0 ? _a : "gate") === "gate" && !r.passed; });
     if (failedGate) {
         return "failed";
     }
-    const missedSoftBar = results.some((r) => { var _a; return ((_a = r.severity) !== null && _a !== void 0 ? _a : "gate") === "soft" &&
+    const missedSoftBar = results.some(r => { var _a; return ((_a = r.severity) !== null && _a !== void 0 ? _a : "gate") === "soft" &&
         r.threshold !== undefined &&
         !r.passed; });
     return missedSoftBar ? "scored" : "passed";
@@ -186,7 +186,7 @@ export function createAssertions(options) {
     const facts = () => deriveRunFacts(events());
     const name = (text) => scope === undefined ? text : `${scope}.${text}`;
     const record = (input) => recorder.record(Object.assign(Object.assign({}, input), { name: name(input.name), scope }));
-    const matchingToolCalls = (toolName, matcher) => facts().toolCalls.filter((call) => {
+    const matchingToolCalls = (toolName, matcher) => facts().toolCalls.filter(call => {
         if (call.toolName !== toolName) {
             return false;
         }
@@ -204,7 +204,7 @@ export function createAssertions(options) {
         }
         return true;
     });
-    const matchingEvents = (type, matcher) => events().filter((event) => event.type === type && matchValue(event.data, matcher === null || matcher === void 0 ? void 0 : matcher.data));
+    const matchingEvents = (type, matcher) => events().filter(event => event.type === type && matchValue(event.data, matcher === null || matcher === void 0 ? void 0 : matcher.data));
     return {
         succeeded() {
             var _a;
@@ -227,7 +227,7 @@ export function createAssertions(options) {
                 name: "parked",
                 passed: run.parked && run.turnsFailed === 0,
                 detail: run.parked
-                    ? pending.map((r) => r.toolName).join(", ")
+                    ? pending.map(r => r.toolName).join(", ")
                     : "no unanswered approval request",
             });
         },
@@ -246,7 +246,7 @@ export function createAssertions(options) {
             const matched = matchingToolCalls(toolName, matcher);
             const passed = matchCount(matched.length, matcher === null || matcher === void 0 ? void 0 : matcher.count);
             const observed = facts()
-                .toolCalls.map((c) => c.toolName)
+                .toolCalls.map(c => c.toolName)
                 .join(", ");
             return record({
                 name: `calledTool(${toolName}${describeMatcherObject(matcher)})`,
@@ -266,7 +266,7 @@ export function createAssertions(options) {
         },
         loadedSkill(skill) {
             const needle = `skills/${skill}/SKILL.md`;
-            const matched = facts().toolCalls.filter((call) => { var _a; return JSON.stringify((_a = call.input) !== null && _a !== void 0 ? _a : "").includes(needle); });
+            const matched = facts().toolCalls.filter(call => { var _a; return JSON.stringify((_a = call.input) !== null && _a !== void 0 ? _a : "").includes(needle); });
             return record({
                 name: `loadedSkill(${skill})`,
                 passed: matched.length > 0,
@@ -274,7 +274,7 @@ export function createAssertions(options) {
             });
         },
         toolOrder(names) {
-            const called = facts().toolCalls.map((c) => c.toolName);
+            const called = facts().toolCalls.map(c => c.toolName);
             let cursor = 0;
             for (const expected of names) {
                 const found = called.indexOf(expected, cursor);
@@ -299,7 +299,7 @@ export function createAssertions(options) {
                 passed: called.length === 0,
                 detail: called.length === 0
                     ? undefined
-                    : `called [${called.map((c) => c.toolName).join(", ")}]`,
+                    : `called [${called.map(c => c.toolName).join(", ")}]`,
             });
         },
         maxToolCalls(max) {
@@ -317,11 +317,11 @@ export function createAssertions(options) {
                 passed: failed.length === 0,
                 detail: failed.length === 0
                     ? undefined
-                    : failed.map((c) => c.toolName).join(", "),
+                    : failed.map(c => c.toolName).join(", "),
             });
         },
         calledSubagent(subagentName, matcher) {
-            const matched = facts().subagents.filter((sub) => {
+            const matched = facts().subagents.filter(sub => {
                 if (sub.name !== subagentName) {
                     return false;
                 }
@@ -343,20 +343,20 @@ export function createAssertions(options) {
                 detail: passed
                     ? undefined
                     : `matched ${matched.length}; delegated [${facts()
-                        .subagents.map((s) => { var _a; return (_a = s.name) !== null && _a !== void 0 ? _a : s.callId; })
+                        .subagents.map(s => { var _a; return (_a = s.name) !== null && _a !== void 0 ? _a : s.callId; })
                         .join(", ")}]`,
             });
         },
         taggedArtifact(kind, predicate) {
-            const tagged = events().flatMap((event) => event.type === "artifact.tagged" ? [event.data] : []);
-            const matched = tagged.filter((record) => (kind === undefined || record.kind === kind) &&
+            const tagged = events().flatMap(event => event.type === "artifact.tagged" ? [event.data] : []);
+            const matched = tagged.filter(record => (kind === undefined || record.kind === kind) &&
                 (predicate === undefined || predicate(record) === true));
             return record({
                 name: `taggedArtifact(${kind !== null && kind !== void 0 ? kind : ""})`,
                 passed: matched.length > 0,
                 detail: matched.length > 0
                     ? undefined
-                    : `tagged kinds: [${tagged.map((r) => r.kind).join(", ")}]`,
+                    : `tagged kinds: [${tagged.map(r => r.kind).join(", ")}]`,
             });
         },
         event(type, matcher) {
@@ -378,7 +378,7 @@ export function createAssertions(options) {
         },
         eventOrder(matchers) {
             const stream = events();
-            const label = `eventOrder([${matchers.map((m) => m.type).join(", ")}])`;
+            const label = `eventOrder([${matchers.map(m => m.type).join(", ")}])`;
             let cursor = 0;
             for (const matcher of matchers) {
                 const required = typeof matcher.count === "number" ? matcher.count : 1;
@@ -453,7 +453,7 @@ export function createAssertions(options) {
             return first;
         },
         requireInputRequest(filter) {
-            const pending = facts().pendingInputRequests.filter((request) => matchValue(request.toolName, filter === null || filter === void 0 ? void 0 : filter.toolName) &&
+            const pending = facts().pendingInputRequests.filter(request => matchValue(request.toolName, filter === null || filter === void 0 ? void 0 : filter.toolName) &&
                 matchValue(request.args, filter === null || filter === void 0 ? void 0 : filter.args));
             const assertionName = "requireInputRequest";
             const passed = pending.length === 1;

package/dist/evals/expect.js

@@ -81,7 +81,7 @@ function coerceToString(value) {
 function formatIssue(issue) {
     var _a;
     const path = ((_a = issue.path) !== null && _a !== void 0 ? _a : [])
-        .map((segment) => typeof segment === "object" && segment !== null && "key" in segment
+        .map(segment => typeof segment === "object" && segment !== null && "key" in segment
         ? String(segment.key)
         : String(segment))
         .join(".");

package/dist/evals/judge.js

@@ -88,7 +88,7 @@ export function parseJudgeReply(reply, allowed) {
     throw new Error(`judge reply had no choice from [${allowed.join(", ")}]: ${JSON.stringify(text.slice(0, 160))}`);
 }
 function normalizeChoice(token, allowed) {
-    return allowed.find((choice) => choice.toLowerCase() === token.toLowerCase());
+    return allowed.find(choice => choice.toLowerCase() === token.toLowerCase());
 }
 function graderFromChoices(args) {
     const allowed = Object.keys(args.scores);

package/dist/evals/reporters.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"reporters.d.ts","sourceRoot":"","sources":["../../src/evals/reporters.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;GAqBG;AAIH,OAAO,KAAK,EACV,YAAY,EAIZ,cAAc,EACf,MAAM,cAAc,CAAC;AAEtB,YAAY,EACV,YAAY,EACZ,oBAAoB,EACpB,kBAAkB,EAClB,aAAa,EACb,cAAc,GACf,MAAM,cAAc,CAAC;AAEtB,MAAM,WAAW,oBAAoB;IACnC,2EAA2E;IAC3E,QAAQ,EAAE,MAAM,CAAC;IACjB,wDAAwD;IACxD,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB;AAED;;;;;;;GAOG;AACH,wBAAgB,KAAK,CAAC,OAAO,EAAE,oBAAoB,GAAG,YAAY,CAYjE;AAED,wEAAwE;AACxE,wBAAgB,cAAc,CAC5B,OAAO,EAAE,cAAc,EACvB,SAAS,EAAE,MAAM,GAChB,MAAM,CAiDR;AA8CD,MAAM,WAAW,wBAAwB;IACvC,kEAAkE;IAClE,GAAG,EAAE,MAAM,CAAC;CACb;AAED;;;;;;;;;;;;GAYG;AACH,wBAAgB,SAAS,CAAC,OAAO,EAAE,wBAAwB,GAAG,YAAY,CA8CzE;AAED;;;;;;GAMG;AACH,wBAAgB,cAAc,CAAC,EAAE,EAAE,MAAM,GAAG,MAAM,CAMjD;AAED,2EAA2E;AAC3E,wBAAgB,gBAAgB,CAC9B,SAAS,EAAE,SAAS,YAAY,EAAE,EAClC,OAAO,CAAC,EAAE,CAAC,KAAK,EAAE,OAAO,KAAK,IAAI,GACjC,YAAY,CAmBd"}
+{"version":3,"file":"reporters.d.ts","sourceRoot":"","sources":["../../src/evals/reporters.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;GAqBG;AAIH,OAAO,KAAK,EACV,YAAY,EAIZ,cAAc,EACf,MAAM,cAAc,CAAC;AAEtB,YAAY,EACV,YAAY,EACZ,oBAAoB,EACpB,kBAAkB,EAClB,aAAa,EACb,cAAc,GACf,MAAM,cAAc,CAAC;AAEtB,MAAM,WAAW,oBAAoB;IACnC,2EAA2E;IAC3E,QAAQ,EAAE,MAAM,CAAC;IACjB,wDAAwD;IACxD,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB;AAED;;;;;;;GAOG;AACH,wBAAgB,KAAK,CAAC,OAAO,EAAE,oBAAoB,GAAG,YAAY,CAYjE;AAED,wEAAwE;AACxE,wBAAgB,cAAc,CAC5B,OAAO,EAAE,cAAc,EACvB,SAAS,EAAE,MAAM,GAChB,MAAM,CAiDR;AA8CD,MAAM,WAAW,wBAAwB;IACvC,kEAAkE;IAClE,GAAG,EAAE,MAAM,CAAC;CACb;AAED;;;;;;;;;;;;GAYG;AACH,wBAAgB,SAAS,CAAC,OAAO,EAAE,wBAAwB,GAAG,YAAY,CA8CzE;AAED;;;;;;GAMG;AACH,wBAAgB,cAAc,CAAC,EAAE,EAAE,MAAM,GAAG,MAAM,CAMjD;AAED,2EAA2E;AAC3E,wBAAgB,gBAAgB,CAC9B,SAAS,EAAE,SAAS,YAAY,EAAE,EAClC,OAAO,CAAC,EAAE,CAAC,KAAK,EAAE,OAAO,KAAK,IAAI,GACjC,YAAY,CAkBd"}

package/dist/evals/reporters.js

@@ -80,9 +80,9 @@ export function renderJUnitXml(summary, suiteName) {
         }
         else if (verdict === "failed" ||
             (verdict === "scored" && summary.strict)) {
-            const failures = result.assertions.filter((a) => !a.passed);
+            const failures = result.assertions.filter(a => !a.passed);
             const message = (_d = (_c = result.error) !== null && _c !== void 0 ? _c : failures
-                .map((a) => `${a.name}${a.detail === undefined ? "" : ` (${a.detail})`}`)
+                .map(a => `${a.name}${a.detail === undefined ? "" : ` (${a.detail})`}`)
                 .join("; ")) !== null && _d !== void 0 ? _d : verdict;
             lines.push(`      <failure message="${escapeXml(message === "" ? verdict : message)}" type="${escapeXml(verdict)}"/>`);
         }
@@ -181,7 +181,7 @@ export function Artifacts(options) {
             return __awaiter(this, void 0, void 0, function* () {
                 yield mkdir(root, { recursive: true });
                 const { results } = summary, totals = __rest(summary, ["results"]);
-                yield writeFile(join(root, "summary.json"), `${JSON.stringify(Object.assign(Object.assign({}, totals), { caseCount: results.length, target, discovered: discovered.map((e) => e.id) }), null, 2)}\n`, "utf8");
+                yield writeFile(join(root, "summary.json"), `${JSON.stringify(Object.assign(Object.assign({}, totals), { caseCount: results.length, target, discovered: discovered.map(e => e.id) }), null, 2)}\n`, "utf8");
             });
         },
     };
@@ -196,8 +196,8 @@ export function Artifacts(options) {
 export function sanitizeCaseId(id) {
     return id
         .split("/")
-        .map((segment) => segment.replace(/[^A-Za-z0-9._-]/g, "_"))
-        .filter((segment) => segment !== "" && segment !== "." && segment !== "..")
+        .map(segment => segment.replace(/[^A-Za-z0-9._-]/g, "_"))
+        .filter(segment => segment !== "" && segment !== "." && segment !== "..")
         .join("/");
 }
 /** Fan one lifecycle call out to several reporters, isolating failures. */
@@ -214,8 +214,8 @@ export function combineReporters(reporters, onError) {
         }
     });
     return {
-        onRunStart: (evals, target) => forEach((r) => { var _a; return (_a = r.onRunStart) === null || _a === void 0 ? void 0 : _a.call(r, evals, target); }),
-        onEvalComplete: (result) => forEach((r) => { var _a; return (_a = r.onEvalComplete) === null || _a === void 0 ? void 0 : _a.call(r, result); }),
-        onRunComplete: (summary) => forEach((r) => { var _a; return (_a = r.onRunComplete) === null || _a === void 0 ? void 0 : _a.call(r, summary); }),
+        onRunStart: (evals, target) => forEach(r => { var _a; return (_a = r.onRunStart) === null || _a === void 0 ? void 0 : _a.call(r, evals, target); }),
+        onEvalComplete: result => forEach(r => { var _a; return (_a = r.onEvalComplete) === null || _a === void 0 ? void 0 : _a.call(r, result); }),
+        onRunComplete: summary => forEach(r => { var _a; return (_a = r.onRunComplete) === null || _a === void 0 ? void 0 : _a.call(r, summary); }),
     };
 }

package/dist/evals/run-facts.js

@@ -193,7 +193,7 @@ export function deriveRunFacts(events) {
                 break;
         }
     }
-    const pendingInputRequests = inputRequests.filter((r) => !r.resolved);
+    const pendingInputRequests = inputRequests.filter(r => !r.resolved);
     // `turn.*` events all carry a turnId; session-scoped events do not, so the
     // turn count is the number of distinct turn ids seen.
     const turns = turnIds.size;
@@ -209,6 +209,6 @@ export function deriveRunFacts(events) {
         ok: failedTurnIds.size === 0 && !sessionFailed && turns > 0,
         assistantMessages,
         assistantText: assistantMessages.join("\n"),
-        failedToolCalls: toolCalls.filter((c) => c.status === "failed"),
+        failedToolCalls: toolCalls.filter(c => c.status === "failed"),
     };
 }

package/dist/evals.d.ts

@@ -73,7 +73,7 @@ export { computeVerdict, verdictFailsRun } from "./evals/assertions.js";
 export type { EvalSchemaLike, Expectation } from "./evals/expect.js";
 export { equals, includes, matches, normalizedSimilarity, satisfies, similarity, } from "./evals/expect.js";
 export type { EvalJudge, EvalJudgeCallOptions, EvalJudgeConfig, EvalJudgeGraderName, } from "./evals/judge.js";
-export { EVAL_JUDGE_INJECTION_GUARD, fenceUntrusted, } from "./evals/judge.js";
+export { EVAL_JUDGE_INJECTION_GUARD, fenceUntrusted } from "./evals/judge.js";
 export type { EvalCountMatcher, EvalEventMatcher, EvalEventOrderMatcher, EvalMatcher, EvalSubagentMatcher, EvalToolCallMatcher, EvalToolCallStatus, } from "./evals/matchers.js";
 export type { EvalReporter, EvalReporterEvalInfo, EvalReporterTarget, EvalRunResult, EvalRunSummary, } from "./evals/results.js";
 export type { EvalInputRequestFact, EvalRunFacts, EvalSubagentFact, EvalToolCallFact, } from "./evals/run-facts.js";

package/dist/evals.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"evals.d.ts","sourceRoot":"","sources":["../src/evals.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAgEG;AAEH,OAAO,KAAK,EACV,mBAAmB,EACnB,cAAc,EACd,WAAW,EACZ,MAAM,uBAAuB,CAAC;AAC/B,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,mBAAmB,CAAC;AACrD,OAAO,KAAK,EAAE,SAAS,EAAE,eAAe,EAAE,MAAM,kBAAkB,CAAC;AACnE,OAAO,KAAK,EAAE,YAAY,EAAE,MAAM,oBAAoB,CAAC;AAGvD,OAAO,KAAK,EAAE,iBAAiB,EAAE,YAAY,EAAE,MAAM,YAAY,CAAC;AAKlE,YAAY,EACV,mBAAmB,EACnB,mBAAmB,EACnB,qBAAqB,EACrB,cAAc,EACd,sBAAsB,EACtB,WAAW,GACZ,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,cAAc,EAAE,eAAe,EAAE,MAAM,uBAAuB,CAAC;AACxE,YAAY,EAAE,cAAc,EAAE,WAAW,EAAE,MAAM,mBAAmB,CAAC;AACrE,OAAO,EACL,MAAM,EACN,QAAQ,EACR,OAAO,EACP,oBAAoB,EACpB,SAAS,EACT,UAAU,GACX,MAAM,mBAAmB,CAAC;AAC3B,YAAY,EACV,SAAS,EACT,oBAAoB,EACpB,eAAe,EACf,mBAAmB,GACpB,MAAM,kBAAkB,CAAC;AAG1B,OAAO,EACL,0BAA0B,EAC1B,cAAc,GACf,MAAM,kBAAkB,CAAC;AAC1B,YAAY,EACV,gBAAgB,EAChB,gBAAgB,EAChB,qBAAqB,EACrB,WAAW,EACX,mBAAmB,EACnB,mBAAmB,EACnB,kBAAkB,GACnB,MAAM,qBAAqB,CAAC;AAC7B,YAAY,EACV,YAAY,EACZ,oBAAoB,EACpB,kBAAkB,EAClB,aAAa,EACb,cAAc,GACf,MAAM,oBAAoB,CAAC;AAC5B,YAAY,EACV,oBAAoB,EACpB,YAAY,EACZ,gBAAgB,EAChB,gBAAgB,GACjB,MAAM,sBAAsB,CAAC;AAC9B,OAAO,EAAE,cAAc,EAAE,MAAM,sBAAsB,CAAC;AAEtD;;;;;;;;;;GAUG;AACH,MAAM,WAAW,cAAe,SAAQ,cAAc;IACpD,OAAO,EAAE,MAAM,CAAC;IAChB,SAAS,EAAE,MAAM,CAAC;IAClB,MAAM,EAAE,YAAY,EAAE,CAAC;IACvB,uDAAuD;IACvD,SAAS,EAAE,MAAM,EAAE,CAAC;IACpB,EAAE,EAAE,OAAO,CAAC;IACZ,0CAA0C;IAC1C,KAAK,EAAE,MAAM,CAAC;IACd,+EAA+E;IAC/E,QAAQ,IAAI,cAAc,CAAC;CAC5B;AAED,MAAM,WAAW,eAAe;IAC9B,oFAAoF;IACpF,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,qEAAqE;IACrE,cAAc,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,MAAM,CAAC,CAAC;IACxC;;;;OAIG;IACH,KAAK,CAAC,EAAE,iBAAiB,CAAC;CAC3B;AAED;;;;;;;GAOG;AACH,MAAM,WAAW,eAAgB,SAAQ,cAAc;IACrD,+DAA+D;IAC/D,IAAI,CAAC,OAAO,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,eAAe,GAAG,OAAO,CAAC,cAAc,CAAC,CAAC;IAC1E,0DAA0D;IAC1D,QAAQ,CAAC,KAAK,EAAE,MAAM,GAAG,IAAI,CAAC;IAC9B,QAAQ,CAAC,SAAS,EAAE,MAAM,GAAG,SAAS,CAAC;IACvC,+CAA+C;IAC/C,QAAQ,CAAC,MAAM,EAAE,YAAY,EAAE,CAAC;IAChC,0CAA0C;IAC1C,QAAQ,CAAC,KAAK,EAAE,SAAS,cAAc,EAAE,CAAC;IAC1C;;;;OAIG;IACH,QAAQ,CAAC,SAAS,EAAE,MAAM,CAAC;IAC3B,yDAAyD;IACzD,QAAQ,CAAC,UAAU,EAAE,MAAM,CAAC;IAC5B,6CAA6C;IAC7C,QAAQ,CAAC,MAAM,EAAE,WAAW,CAAC;IAC7B;;;;OAIG;IACH,QAAQ,CAAC,KAAK,EAAE,SAAS,CAAC;IAC1B;;;;OAIG;IACH,OAAO,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,EAAE,SAAS,EAAE,WAAW,GAAG,OAAO,CAAC,CAAC,CAAC,CAAC;IACzD;;;OAGG;IACH,IAAI,CAAC,MAAM,EAAE,MAAM,GAAG,KAAK,CAAC;IAC5B,8DAA8D;IAC9D,GAAG,CAAC,OAAO,EAAE,MAAM,GAAG,IAAI,CAAC;IAC3B;;;;OAIG;IACH,MAAM,CAAC,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,GAAG,MAAM,GAAG,IAAI,CAAC;CACpD;AAED,0EAA0E;AAC1E,eAAO,MAAM,mBAAmB,MAAM,CAAC;AAEvC,0EAA0E;AAC1E,MAAM,WAAW,aAAa;IAC5B;;;;OAIG;IACH,EAAE,EAAE,MAAM,CAAC;IACX,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;;;OAKG;IACH,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,iEAAiE;IACjE,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,oEAAoE;IACpE,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,6EAA6E;IAC7E,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,IAAI,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;CAC7C;AAED;;;GAGG;AACH,MAAM,WAAW,UAAU;IACzB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;OAGG;IACH,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,8EAA8E;IAC9E,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,+DAA+D;IAC/D,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,mEAAmE;IACnE,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,sEAAsE;IACtE,IAAI,CAAC,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;IAC7C,wEAAwE;IACxE,KAAK,CAAC,EAAE,aAAa,EAAE,CAAC;CACzB;AAED,sEAAsE;AACtE,MAAM,WAAW,kBAAkB;IACjC,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,8DAA8D;IAC9D,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,+DAA+D;IAC/D,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,IAAI,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;IAC5C,QAAQ,CAAC,YAAY,EAAE,MAAM,CAAC;CAC/B;AAED,MAAM,MAAM,cAAc,GAAG,UAAU,GAAG;IAAE,QAAQ,CAAC,YAAY,EAAE,MAAM,CAAA;CAAE,CAAC;AAE5E;;;;GAIG;AACH,wBAAgB,uBAAuB,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAK9D;AAED,wBAAgB,UAAU,CAAC,MAAM,EAAE,UAAU,GAAG,cAAc,CAoC7D;AAaD;;;;;;;GAOG;AACH,wBAAgB,oBAAoB,CAClC,MAAM,EAAE,MAAM,EACd,UAAU,EAAE,cAAc,GACzB,KAAK,CAAC;IAAE,EAAE,EAAE,MAAM,CAAC;IAAC,UAAU,EAAE,kBAAkB,CAAA;CAAE,CAAC,CAwCvD;AAqDD;;;;;GAKG;AACH,wBAAgB,mBAAmB,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,EAAE,MAAM,GAAG,OAAO,CAE3E;AAED;;;;;GAKG;AACH,eAAO,MAAM,gBAAgB,YAAY,CAAC;AAE1C,sDAAsD;AACtD,wBAAgB,iBAAiB,CAC/B,IAAI,EAAE,SAAS,MAAM,EAAE,GAAG,SAAS,GAClC,OAAO,CAET;AAED;;;;GAIG;AACH,wBAAgB,2BAA2B,CACzC,CAAC,SAAS;IAAE,EAAE,EAAE,MAAM,CAAC;IAAC,MAAM,EAAE,MAAM,CAAA;CAAE,EAExC,GAAG,EAAE,SAAS,CAAC,EAAE,EACjB,QAAQ,EAAE,SAAS,CAAC,EAAE,EACtB,SAAS,EAAE,CAAC,IAAI,EAAE,CAAC,KAAK,OAAO,GAC9B,CAAC,EAAE,CAgBL;AAED;;;;;GAKG;AACH,eAAO,MAAM,0BAA0B,MAAM,CAAC;AAE9C,gGAAgG;AAChG,eAAO,MAAM,gCAAgC,KAAK,CAAC;AAEnD,iEAAiE;AACjE,eAAO,MAAM,wBAAwB,MAAM,CAAC;AAE5C,MAAM,MAAM,iBAAiB,GAAG,SAAS,GAAG,SAAS,GAAG,MAAM,CAAC;AAC/D,MAAM,MAAM,eAAe,GAAG,SAAS,GAAG,WAAW,GAAG,QAAQ,GAAG,WAAW,CAAC;AAE/E,+DAA+D;AAC/D,MAAM,WAAW,gBAAgB;IAC/B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,MAAM,EAAE,iBAAiB,CAAC;IAC1B,EAAE,CAAC,EAAE,OAAO,CAAC;IACb,0EAA0E;IAC1E,OAAO,CAAC,EAAE,WAAW,CAAC;IACtB,sCAAsC;IACtC,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,mBAAmB,EAAE,CAAC;IACnC,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,6DAA6D;IAC7D,OAAO,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,MAAM,GAAG,MAAM,CAAC,CAAC;IAC1C,gEAAgE;IAChE,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,MAAM,CAAC,EAAE,MAAM,EAAE,CAAC;IAClB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,KAAK,CAAC,EAAE,MAAM,EAAE,CAAC;IACjB,SAAS,CAAC,EAAE,KAAK,CAAC;QAChB,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,CAAC,EAAE,OAAO,CAAC;QACf,MAAM,CAAC,EAAE,OAAO,CAAC;QACjB,OAAO,EAAE,OAAO,CAAC;KAClB,CAAC,CAAC;CACJ;AAED,gFAAgF;AAChF,MAAM,WAAW,eAAe;IAC9B,KAAK,EAAE,MAAM,CAAC;IACd,MAAM,EAAE,eAAe,CAAC;IACxB,SAAS,EAAE,MAAM,CAAC;IAClB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,OAAO,EAAE;QACP,MAAM,EAAE,MAAM,CAAC;QACf,MAAM,EAAE,MAAM,CAAC;QACf;;;WAGG;QACH,MAAM,CAAC,EAAE,MAAM,CAAC;QAChB,qEAAqE;QACrE,OAAO,CAAC,EAAE,MAAM,CAAC;QACjB,KAAK,EAAE,MAAM,CAAC;QACd,IAAI,EAAE,MAAM,CAAC;KACd,CAAC;IACF,KAAK,EAAE,gBAAgB,EAAE,CAAC;IAC1B,MAAM,EAAE;QACN,cAAc,CAAC,EAAE,MAAM,CAAC;QACxB,SAAS,CAAC,EAAE,MAAM,CAAC;QACnB,iBAAiB,CAAC,EAAE,MAAM,CAAC;QAC3B,WAAW,CAAC,EAAE,OAAO,CAAC;KACvB,CAAC;CACH;AAED,8EAA8E;AAC9E,MAAM,WAAW,gBAAgB;IAC/B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;CACjB;AAED,4DAA4D;AAC5D,MAAM,WAAW,kBAAkB;IACjC,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,iBAAiB,EAAE,MAAM,CAAC;IAC1B,8DAA8D;IAC9D,WAAW,EAAE,OAAO,CAAC;CACtB;AAED,wFAAwF;AACxF,MAAM,WAAW,qBAAqB;IACpC,SAAS,CAAC,EAAE,MAAM,EAAE,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,wEAAwE;IACxE,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB;AAED;;;;GAIG;AACH,MAAM,WAAW,YAAY;IAC3B,IAAI,IAAI,OAAO,CAAC;QACd,KAAK,EAAE,gBAAgB,EAAE,CAAC;QAC1B,MAAM,EAAE,kBAAkB,CAAC;KAC5B,CAAC,CAAC;IACH,GAAG,CAAC,KAAK,EAAE,MAAM,GAAG,OAAO,CAAC,eAAe,GAAG,SAAS,CAAC,CAAC;IACzD,kBAAkB,IAAI,OAAO,CAAC;QAC5B,IAAI,EAAE,eAAe,EAAE,CAAC;QACxB,WAAW,CAAC,EAAE,MAAM,CAAC;KACtB,CAAC,CAAC;IACH,KAAK,CAAC,KAAK,CAAC,EAAE,qBAAqB,GAAG,OAAO,CAAC,eAAe,CAAC,CAAC;IAC/D,mDAAmD;IACnD,MAAM,CAAC,KAAK,EAAE,MAAM,GAAG,OAAO,CAAC,eAAe,CAAC,CAAC;CACjD;AAED,MAAM,WAAW,cAAc;IAC7B,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;;OAIG;IACH,cAAc,EAAE,MAAM,CAAC;IACvB;;;OAGG;IACH,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB;;;;OAIG;IACH,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B;;;;;;;;OAQG;IACH,iBAAiB,CAAC,EAAE,MAAM,CAAC;CAC5B;AAED;;;;;;GAMG;AACH,wBAAgB,gBAAgB,CAAC,MAAM,EAAE,cAAc,GAAG,cAAc,CAUvE;AAED;;GAEG;AACH,wBAAgB,2BAA2B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAMlE;AAED,yDAAyD;AACzD,wBAAgB,8BAA8B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAKrE;AAED;;;GAGG;AACH,wBAAgB,4BAA4B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CASnE"}
+{"version":3,"file":"evals.d.ts","sourceRoot":"","sources":["../src/evals.ts"],"names":[],"mappings":"AAAA;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;GAgEG;AAEH,OAAO,KAAK,EACV,mBAAmB,EACnB,cAAc,EACd,WAAW,EACZ,MAAM,uBAAuB,CAAC;AAC/B,OAAO,KAAK,EAAE,WAAW,EAAE,MAAM,mBAAmB,CAAC;AACrD,OAAO,KAAK,EAAE,SAAS,EAAE,eAAe,EAAE,MAAM,kBAAkB,CAAC;AACnE,OAAO,KAAK,EAAE,YAAY,EAAE,MAAM,oBAAoB,CAAC;AAGvD,OAAO,KAAK,EAAE,iBAAiB,EAAE,YAAY,EAAE,MAAM,YAAY,CAAC;AAKlE,YAAY,EACV,mBAAmB,EACnB,mBAAmB,EACnB,qBAAqB,EACrB,cAAc,EACd,sBAAsB,EACtB,WAAW,GACZ,MAAM,uBAAuB,CAAC;AAC/B,OAAO,EAAE,cAAc,EAAE,eAAe,EAAE,MAAM,uBAAuB,CAAC;AACxE,YAAY,EAAE,cAAc,EAAE,WAAW,EAAE,MAAM,mBAAmB,CAAC;AACrE,OAAO,EACL,MAAM,EACN,QAAQ,EACR,OAAO,EACP,oBAAoB,EACpB,SAAS,EACT,UAAU,GACX,MAAM,mBAAmB,CAAC;AAC3B,YAAY,EACV,SAAS,EACT,oBAAoB,EACpB,eAAe,EACf,mBAAmB,GACpB,MAAM,kBAAkB,CAAC;AAG1B,OAAO,EAAE,0BAA0B,EAAE,cAAc,EAAE,MAAM,kBAAkB,CAAC;AAC9E,YAAY,EACV,gBAAgB,EAChB,gBAAgB,EAChB,qBAAqB,EACrB,WAAW,EACX,mBAAmB,EACnB,mBAAmB,EACnB,kBAAkB,GACnB,MAAM,qBAAqB,CAAC;AAC7B,YAAY,EACV,YAAY,EACZ,oBAAoB,EACpB,kBAAkB,EAClB,aAAa,EACb,cAAc,GACf,MAAM,oBAAoB,CAAC;AAC5B,YAAY,EACV,oBAAoB,EACpB,YAAY,EACZ,gBAAgB,EAChB,gBAAgB,GACjB,MAAM,sBAAsB,CAAC;AAC9B,OAAO,EAAE,cAAc,EAAE,MAAM,sBAAsB,CAAC;AAEtD;;;;;;;;;;GAUG;AACH,MAAM,WAAW,cAAe,SAAQ,cAAc;IACpD,OAAO,EAAE,MAAM,CAAC;IAChB,SAAS,EAAE,MAAM,CAAC;IAClB,MAAM,EAAE,YAAY,EAAE,CAAC;IACvB,uDAAuD;IACvD,SAAS,EAAE,MAAM,EAAE,CAAC;IACpB,EAAE,EAAE,OAAO,CAAC;IACZ,0CAA0C;IAC1C,KAAK,EAAE,MAAM,CAAC;IACd,+EAA+E;IAC/E,QAAQ,IAAI,cAAc,CAAC;CAC5B;AAED,MAAM,WAAW,eAAe;IAC9B,oFAAoF;IACpF,YAAY,CAAC,EAAE,MAAM,CAAC;IACtB,qEAAqE;IACrE,cAAc,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,MAAM,CAAC,CAAC;IACxC;;;;OAIG;IACH,KAAK,CAAC,EAAE,iBAAiB,CAAC;CAC3B;AAED;;;;;;;GAOG;AACH,MAAM,WAAW,eAAgB,SAAQ,cAAc;IACrD,+DAA+D;IAC/D,IAAI,CAAC,OAAO,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,eAAe,GAAG,OAAO,CAAC,cAAc,CAAC,CAAC;IAC1E,0DAA0D;IAC1D,QAAQ,CAAC,KAAK,EAAE,MAAM,GAAG,IAAI,CAAC;IAC9B,QAAQ,CAAC,SAAS,EAAE,MAAM,GAAG,SAAS,CAAC;IACvC,+CAA+C;IAC/C,QAAQ,CAAC,MAAM,EAAE,YAAY,EAAE,CAAC;IAChC,0CAA0C;IAC1C,QAAQ,CAAC,KAAK,EAAE,SAAS,cAAc,EAAE,CAAC;IAC1C;;;;OAIG;IACH,QAAQ,CAAC,SAAS,EAAE,MAAM,CAAC;IAC3B,yDAAyD;IACzD,QAAQ,CAAC,UAAU,EAAE,MAAM,CAAC;IAC5B,6CAA6C;IAC7C,QAAQ,CAAC,MAAM,EAAE,WAAW,CAAC;IAC7B;;;;OAIG;IACH,QAAQ,CAAC,KAAK,EAAE,SAAS,CAAC;IAC1B;;;;OAIG;IACH,OAAO,CAAC,CAAC,EAAE,KAAK,EAAE,CAAC,EAAE,SAAS,EAAE,WAAW,GAAG,OAAO,CAAC,CAAC,CAAC,CAAC;IACzD;;;OAGG;IACH,IAAI,CAAC,MAAM,EAAE,MAAM,GAAG,KAAK,CAAC;IAC5B,8DAA8D;IAC9D,GAAG,CAAC,OAAO,EAAE,MAAM,GAAG,IAAI,CAAC;IAC3B;;;;OAIG;IACH,MAAM,CAAC,IAAI,EAAE,MAAM,EAAE,KAAK,EAAE,MAAM,GAAG,MAAM,GAAG,IAAI,CAAC;CACpD;AAED,0EAA0E;AAC1E,eAAO,MAAM,mBAAmB,MAAM,CAAC;AAEvC,0EAA0E;AAC1E,MAAM,WAAW,aAAa;IAC5B;;;;OAIG;IACH,EAAE,EAAE,MAAM,CAAC;IACX,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;;;OAKG;IACH,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,iEAAiE;IACjE,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,oEAAoE;IACpE,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,6EAA6E;IAC7E,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,IAAI,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;CAC7C;AAED;;;GAGG;AACH,MAAM,WAAW,UAAU;IACzB,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;OAGG;IACH,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,8EAA8E;IAC9E,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,+DAA+D;IAC/D,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,mEAAmE;IACnE,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,sEAAsE;IACtE,IAAI,CAAC,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;IAC7C,wEAAwE;IACxE,KAAK,CAAC,EAAE,aAAa,EAAE,CAAC;CACzB;AAED,sEAAsE;AACtE,MAAM,WAAW,kBAAkB;IACjC,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,8DAA8D;IAC9D,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,+DAA+D;IAC/D,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B,IAAI,EAAE,CAAC,CAAC,EAAE,eAAe,KAAK,OAAO,CAAC,IAAI,CAAC,CAAC;IAC5C,QAAQ,CAAC,YAAY,EAAE,MAAM,CAAC;CAC/B;AAED,MAAM,MAAM,cAAc,GAAG,UAAU,GAAG;IAAE,QAAQ,CAAC,YAAY,EAAE,MAAM,CAAA;CAAE,CAAC;AAE5E;;;;GAIG;AACH,wBAAgB,uBAAuB,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAK9D;AAED,wBAAgB,UAAU,CAAC,MAAM,EAAE,UAAU,GAAG,cAAc,CAoC7D;AAaD;;;;;;;GAOG;AACH,wBAAgB,oBAAoB,CAClC,MAAM,EAAE,MAAM,EACd,UAAU,EAAE,cAAc,GACzB,KAAK,CAAC;IAAE,EAAE,EAAE,MAAM,CAAC;IAAC,UAAU,EAAE,kBAAkB,CAAA;CAAE,CAAC,CAwCvD;AAqDD;;;;;GAKG;AACH,wBAAgB,mBAAmB,CAAC,MAAM,EAAE,MAAM,EAAE,MAAM,EAAE,MAAM,GAAG,OAAO,CAE3E;AAED;;;;;GAKG;AACH,eAAO,MAAM,gBAAgB,YAAY,CAAC;AAE1C,sDAAsD;AACtD,wBAAgB,iBAAiB,CAC/B,IAAI,EAAE,SAAS,MAAM,EAAE,GAAG,SAAS,GAClC,OAAO,CAET;AAED;;;;GAIG;AACH,wBAAgB,2BAA2B,CACzC,CAAC,SAAS;IAAE,EAAE,EAAE,MAAM,CAAC;IAAC,MAAM,EAAE,MAAM,CAAA;CAAE,EAExC,GAAG,EAAE,SAAS,CAAC,EAAE,EACjB,QAAQ,EAAE,SAAS,CAAC,EAAE,EACtB,SAAS,EAAE,CAAC,IAAI,EAAE,CAAC,KAAK,OAAO,GAC9B,CAAC,EAAE,CAgBL;AAED;;;;;GAKG;AACH,eAAO,MAAM,0BAA0B,MAAM,CAAC;AAE9C,gGAAgG;AAChG,eAAO,MAAM,gCAAgC,KAAK,CAAC;AAEnD,iEAAiE;AACjE,eAAO,MAAM,wBAAwB,MAAM,CAAC;AAE5C,MAAM,MAAM,iBAAiB,GAAG,SAAS,GAAG,SAAS,GAAG,MAAM,CAAC;AAC/D,MAAM,MAAM,eAAe,GAAG,SAAS,GAAG,WAAW,GAAG,QAAQ,GAAG,WAAW,CAAC;AAE/E,+DAA+D;AAC/D,MAAM,WAAW,gBAAgB;IAC/B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,MAAM,EAAE,iBAAiB,CAAC;IAC1B,EAAE,CAAC,EAAE,OAAO,CAAC;IACb,0EAA0E;IAC1E,OAAO,CAAC,EAAE,WAAW,CAAC;IACtB,sCAAsC;IACtC,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,UAAU,CAAC,EAAE,mBAAmB,EAAE,CAAC;IACnC,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,6DAA6D;IAC7D,OAAO,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,MAAM,GAAG,MAAM,CAAC,CAAC;IAC1C,gEAAgE;IAChE,QAAQ,CAAC,EAAE,MAAM,CAAC,MAAM,EAAE,OAAO,CAAC,CAAC;IACnC,MAAM,CAAC,EAAE,MAAM,EAAE,CAAC;IAClB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,KAAK,CAAC,EAAE,MAAM,EAAE,CAAC;IACjB,SAAS,CAAC,EAAE,KAAK,CAAC;QAChB,QAAQ,EAAE,MAAM,CAAC;QACjB,IAAI,CAAC,EAAE,OAAO,CAAC;QACf,MAAM,CAAC,EAAE,OAAO,CAAC;QACjB,OAAO,EAAE,OAAO,CAAC;KAClB,CAAC,CAAC;CACJ;AAED,gFAAgF;AAChF,MAAM,WAAW,eAAe;IAC9B,KAAK,EAAE,MAAM,CAAC;IACd,MAAM,EAAE,eAAe,CAAC;IACxB,SAAS,EAAE,MAAM,CAAC;IAClB,UAAU,CAAC,EAAE,MAAM,CAAC;IACpB,KAAK,CAAC,EAAE,MAAM,CAAC;IACf,OAAO,EAAE;QACP,MAAM,EAAE,MAAM,CAAC;QACf,MAAM,EAAE,MAAM,CAAC;QACf;;;WAGG;QACH,MAAM,CAAC,EAAE,MAAM,CAAC;QAChB,qEAAqE;QACrE,OAAO,CAAC,EAAE,MAAM,CAAC;QACjB,KAAK,EAAE,MAAM,CAAC;QACd,IAAI,EAAE,MAAM,CAAC;KACd,CAAC;IACF,KAAK,EAAE,gBAAgB,EAAE,CAAC;IAC1B,MAAM,EAAE;QACN,cAAc,CAAC,EAAE,MAAM,CAAC;QACxB,SAAS,CAAC,EAAE,MAAM,CAAC;QACnB,iBAAiB,CAAC,EAAE,MAAM,CAAC;QAC3B,WAAW,CAAC,EAAE,OAAO,CAAC;KACvB,CAAC;CACH;AAED,8EAA8E;AAC9E,MAAM,WAAW,gBAAgB;IAC/B,EAAE,EAAE,MAAM,CAAC;IACX,MAAM,EAAE,MAAM,CAAC;IACf,WAAW,CAAC,EAAE,MAAM,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;CACjB;AAED,4DAA4D;AAC5D,MAAM,WAAW,kBAAkB;IACjC,cAAc,CAAC,EAAE,MAAM,CAAC;IACxB,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB,iBAAiB,EAAE,MAAM,CAAC;IAC1B,8DAA8D;IAC9D,WAAW,EAAE,OAAO,CAAC;CACtB;AAED,wFAAwF;AACxF,MAAM,WAAW,qBAAqB;IACpC,SAAS,CAAC,EAAE,MAAM,EAAE,CAAC;IACrB,IAAI,CAAC,EAAE,MAAM,EAAE,CAAC;IAChB,wEAAwE;IACxE,SAAS,CAAC,EAAE,MAAM,CAAC;CACpB;AAED;;;;GAIG;AACH,MAAM,WAAW,YAAY;IAC3B,IAAI,IAAI,OAAO,CAAC;QACd,KAAK,EAAE,gBAAgB,EAAE,CAAC;QAC1B,MAAM,EAAE,kBAAkB,CAAC;KAC5B,CAAC,CAAC;IACH,GAAG,CAAC,KAAK,EAAE,MAAM,GAAG,OAAO,CAAC,eAAe,GAAG,SAAS,CAAC,CAAC;IACzD,kBAAkB,IAAI,OAAO,CAAC;QAC5B,IAAI,EAAE,eAAe,EAAE,CAAC;QACxB,WAAW,CAAC,EAAE,MAAM,CAAC;KACtB,CAAC,CAAC;IACH,KAAK,CAAC,KAAK,CAAC,EAAE,qBAAqB,GAAG,OAAO,CAAC,eAAe,CAAC,CAAC;IAC/D,mDAAmD;IACnD,MAAM,CAAC,KAAK,EAAE,MAAM,GAAG,OAAO,CAAC,eAAe,CAAC,CAAC;CACjD;AAED,MAAM,WAAW,cAAc;IAC7B,SAAS,CAAC,EAAE,MAAM,CAAC;IACnB;;;;OAIG;IACH,cAAc,EAAE,MAAM,CAAC;IACvB;;;OAGG;IACH,KAAK,CAAC,EAAE,eAAe,CAAC;IACxB;;;;OAIG;IACH,SAAS,CAAC,EAAE,YAAY,EAAE,CAAC;IAC3B;;;;;;;;OAQG;IACH,iBAAiB,CAAC,EAAE,MAAM,CAAC;CAC5B;AAED;;;;;;GAMG;AACH,wBAAgB,gBAAgB,CAAC,MAAM,EAAE,cAAc,GAAG,cAAc,CAUvE;AAED;;GAEG;AACH,wBAAgB,2BAA2B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAMlE;AAED,yDAAyD;AACzD,wBAAgB,8BAA8B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CAKrE;AAED;;;GAGG;AACH,wBAAgB,4BAA4B,CAAC,KAAK,EAAE,OAAO,GAAG,MAAM,CASnE"}

package/dist/evals.js

@@ -69,7 +69,7 @@ export { computeVerdict, verdictFailsRun } from "./evals/assertions.js";
 export { equals, includes, matches, normalizedSimilarity, satisfies, similarity, } from "./evals/expect.js";
 // A custom judge built on `t.judge.model` embeds the same attacker-controlled
 // agent output the built-in graders do, so it needs the same two protections.
-export { EVAL_JUDGE_INJECTION_GUARD, fenceUntrusted, } from "./evals/judge.js";
+export { EVAL_JUDGE_INJECTION_GUARD, fenceUntrusted } from "./evals/judge.js";
 export { deriveRunFacts } from "./evals/run-facts.js";
 /** Hard ceiling for {@link EvalConfig.iterations} / case `iterations`. */
 export const EVAL_MAX_ITERATIONS = 100;
@@ -136,7 +136,7 @@ function validateDatapointId(id) {
 export function expandEvalDefinition(fileId, definition) {
     var _a;
     if (definition.cases !== undefined) {
-        return definition.cases.flatMap((datapoint) => {
+        return definition.cases.flatMap(datapoint => {
             var _a, _b, _c, _d, _e, _f;
             const description = (_a = datapoint.description) !== null && _a !== void 0 ? _a : definition.description;
             const timeoutMs = (_b = datapoint.timeoutMs) !== null && _b !== void 0 ? _b : definition.timeoutMs;
@@ -224,17 +224,17 @@ export function isEvalSummaryCase(tags) {
  * Preserves discovery order from `all`.
  */
 export function expandSummarySuiteSelection(all, selected, isSummary) {
-    const fileIdsNeedingSuite = new Set(selected.filter((item) => isSummary(item)).map((item) => item.fileId));
+    const fileIdsNeedingSuite = new Set(selected.filter(item => isSummary(item)).map(item => item.fileId));
     if (fileIdsNeedingSuite.size === 0) {
         return [...selected];
     }
-    const selectedIds = new Set(selected.map((item) => item.id));
-    const extras = all.filter((item) => fileIdsNeedingSuite.has(item.fileId) && !selectedIds.has(item.id));
+    const selectedIds = new Set(selected.map(item => item.id));
+    const extras = all.filter(item => fileIdsNeedingSuite.has(item.fileId) && !selectedIds.has(item.id));
     if (extras.length === 0) {
         return [...selected];
     }
-    const want = new Set([...selectedIds, ...extras.map((item) => item.id)]);
-    return all.filter((item) => want.has(item.id));
+    const want = new Set([...selectedIds, ...extras.map(item => item.id)]);
+    return all.filter(item => want.has(item.id));
 }
 /**
  * Hard ceiling for concurrent eval cases.

package/dist/extensions/cursor-cloud-agents/extension.js

@@ -57,7 +57,7 @@ const config = z
     apiKey: z.string().optional(),
 })
     .default({})
-    .transform((options) => { var _a; return (Object.assign(Object.assign({}, options), { needsApproval: (_a = options.needsApproval) !== null && _a !== void 0 ? _a : options.cloud.repos === undefined })); });
+    .transform(options => { var _a; return (Object.assign(Object.assign({}, options), { needsApproval: (_a = options.needsApproval) !== null && _a !== void 0 ? _a : options.cloud.repos === undefined })); });
 const cursorCloudAgents = defineExtension({
     root: import.meta.dirname,
     description: "Launch, steer, and monitor Cursor cloud agents.",

package/dist/extensions/cursor-cloud-agents/lib/backend.js

@@ -177,10 +177,10 @@ export class CloudAgentsBackend {
     conversation(agentId) {
         return __awaiter(this, void 0, void 0, function* () {
             const { conversation } = conversationResponseSchema.parse(yield this.rpcClient.serviceRpc(SERVICE, "GetBackgroundComposerConversation", { bcId: agentId }, RPC_TIMEOUT_MS));
-            return (conversation !== null && conversation !== void 0 ? conversation : []).map((message) => {
+            return (conversation !== null && conversation !== void 0 ? conversation : []).map(message => {
                 var _a;
                 var _b;
-                const toolCalls = ((_b = message.toolResults) !== null && _b !== void 0 ? _b : []).map((result) => { var _a; var _b, _c; return ({
+                const toolCalls = ((_b = message.toolResults) !== null && _b !== void 0 ? _b : []).map(result => { var _a; var _b, _c; return ({
                     name: (_b = result.toolName) !== null && _b !== void 0 ? _b : "",
                     args: parseArgs((_c = result.args) !== null && _c !== void 0 ? _c : result.rawArgs),
                     content: result.content,
@@ -278,7 +278,7 @@ function apiErrorMessage(text) {
         const parsed = JSON.parse(text);
         const code = (_c = (_a = parsed.error) === null || _a === void 0 ? void 0 : _a.code) !== null && _c !== void 0 ? _c : parsed.code;
         const message = (_d = (_b = parsed.error) === null || _b === void 0 ? void 0 : _b.message) !== null && _d !== void 0 ? _d : parsed.message;
-        return ([code, message].filter((part) => part !== undefined).join(": ") || text);
+        return ([code, message].filter(part => part !== undefined).join(": ") || text);
     }
     catch (_e) {
         return text;