@post-print/agent-test 0.3.5 → 0.3.6

package/README.md

@@ -21,6 +21,7 @@ const result = await runAgentTest({
   cwd: process.cwd(),
   scenario: {
     name: "uses the project instructions",
+    description: "Checks that the agent reads AGENTS.md.",
     prompt: "Review the current change.",
     rubric: { mustReadPath: ["AGENTS.md"] },
   },
@@ -31,141 +32,17 @@ The default host is Cursor. Set `scenario.host`, `defaults.host`, or the top-lev
 
 ## JSON suites and CLI
 
-JSON is an authoring adapter, not a stored answer. This repository keeps host-agent suites under `agent-suites/<suite>/scenarios.json`. Consumer repositories can use the same layout.
+JSON is an authoring adapter, not a stored answer. This repository keeps host-agent suites under `agent-suites/<suite>/scenarios.json`.
 
 ```bash
-npx agent-test --suites-dir agent-suites
-npx agent-test --suites-dir agent-suites --host cursor
-npx agent-test --suites-dir agent-suites --suite smoke
-npx agent-test --suites-dir agent-suites --suite tools
-npx agent-test --suites-dir agent-suites --suite mcp
-npx agent-test --suites-dir agent-suites --suite judge
-npx agent-test --suites-dir agent-suites --suite depth
 npx agent-test --check --suites-dir agent-suites
+npx agent-test --suites-dir agent-suites --host cursor --suite smoke
 ```
 
-In-repo suites list `hosts: ["cursor", "claude", "openai"]`. `npx agent-test --suites-dir agent-suites` and `bun run test` run every suite on each host. That is the consumer confidence gate. Pass `--host cursor` to pin one adapter.
-
-`smoke` is the short host proof. `tools` checks Read and Write. `mcp` checks echo invoke and a lookup read. `judge` starts a second host call that scores the reply. One judge scenario runs two workspace arms and scores both transcripts together. `depth` checks workspace roots, seed patches, injected context, mustRun, and skill invoke. `bun run test:smoke` stays on Cursor.
-
-`scenario.host` pins that scenario to one host. A matrix run skips it on the other hosts.
-
-## Custom hosts
-
-A consumer repo can register its own adapter.
-
-```js
-// agent-test.config.mjs
-import { defineConfig } from "@post-print/agent-test";
-
-export default defineConfig({
-  adapters: [
-    {
-      host: "gemini",
-      missingAuth() {
-        return process.env.GEMINI_API_KEY ? undefined : "GEMINI_API_KEY not set";
-      },
-      classifierHost: "cursor",
-      async run(options) {
-        return {
-          host: "gemini",
-          status: "completed",
-          durationMs: 0,
-          trace: {
-            messages: [{ role: "assistant", content: options.prompt }],
-            toolCalls: [],
-            shellCommands: [],
-            artifacts: {},
-          },
-        };
-      },
-    },
-  ],
-});
-```
-
-Then `--host gemini` and a suite `hosts` list can include `gemini`. You can also pass `--adapter ./hosts/gemini.mjs`. The module can export `{ adapters: [...] }` or call `registerHostAdapter` as a side effect.
-
-Do not reuse `cursor`, `claude`, `openai`, `replay`, or `all` as the slug.
-
-Direct runs need host auth. Cursor uses `CURSOR_API_KEY`, or `CURSOR_AUTH_MODE=subscription` after `Cursor.auth.login()`. The Cursor app login does not count. Claude uses `CLAUDE_AUTH_MODE` plus `ANTHROPIC_API_KEY` or a Claude Code login. OpenAI uses `OPENAI_API_KEY` or `CODEX_API_KEY`, or `OPENAI_AUTH_MODE=subscription` after `codex login`. The judge uses the same host family. It runs when a rubric has judge questions or `mustInvokeSkill`. A `compare` scenario runs two arms. `compare.faster` and `compare.cheaper` pick a metric winner. `rubric.judge` is optional and scores both transcripts. `--no-judge` turns the judge off. The CLI does not load `.env`.
-
-`--allow-user-input` starts a second classifier as the user. That user agent answers AskQuestion-style tools. The test agent then continues with the original task plus the transcript.
-
-## Check, rubrics, and compare
-
-`--check` inspects the suite, seeds, package, and host. It does not launch an agent. A live run runs the same check first, then starts the host.
-
-```bash
-npx agent-test --check --suites-dir agent-suites
-```
-
-A compare scenario sets `compare.a` and `compare.b`. Each arm can override workspace, prompt, host, skills, or extra rubric checks. Arm rubric arrays append onto the scenario rubric. Do not put `judge` on an arm. `compare.faster` and `compare.cheaper` name the arm that must win on time or tokens. Add `rubric.judge` when you want a pairwise judge. Omit it for a metric-only compare. `--no-judge` skips the judge.
-
-```json
-{
-  "name": "cheaper prompt",
-  "prompt": "Read README.txt. Reply with one sentence.",
-  "compare": {
-    "a": { "label": "verbose", "prompt": "Read README.txt. Write a long summary." },
-    "b": { "label": "short" },
-    "cheaper": "b"
-  },
-  "rubric": { "mustReadPath": ["README.txt"] }
-}
-```
-
-Use two workspaces when one arm has a skill and the other does not. Put `mustInvokeSkill` on the skill arm only.
-
-```json
-{
-  "name": "skill vs no skill",
-  "prompt": "Read every markdown file. Write a detailed shipping plan.",
-  "compare": {
-    "a": {
-      "label": "no skill",
-      "workspace": "workspaces/skill-off",
-      "rubric": { "mustNotInvokeSkill": ["brief-ship"] }
-    },
-    "b": {
-      "label": "with skill",
-      "workspace": "workspaces/skill-on",
-      "skills": [".agents/skills/brief-ship/SKILL.md"],
-      "rubric": { "mustInvokeSkill": ["brief-ship"] }
-    },
-    "cheaper": "b"
-  },
-  "rubric": {
-    "mustReadPath": ["note.md"],
-    "judge": ["Did the skill arm stay closer to the note?"]
-  }
-}
-```
+First run: [docs/getting-started.md](../../docs/getting-started.md). Flags: [docs/cli.md](../../docs/cli.md). Suite fields, rubric, compare, and MCP: [docs/suites.md](../../docs/suites.md). Auth and adapters: [docs/hosts.md](../../docs/hosts.md). Sealed workspace and debug: [docs/isolation.md](../../docs/isolation.md).
 
 `--doctor`, `--validate-only`, `--validate-paths`, and `--validate-seeds` are aliases for `--check`.
 
-`scenarios.json` can omit inline rubric keys when a sibling `rubrics.json` / `scenarios.rubric.json` or `--rubrics-dir` supplies them.
-
-## Isolation and diagnostics
-
-In-repo suites set `workspace` on every scenario. The runner copies that folder into a temp repo. Omit `workspace`, or set `"."`, to copy HEAD plus caller context instead. The folder gets its own `.git`. The runner fails the scenario when tool paths leave that folder. A leftover caller-tree check still restores leaked caller edits.
-
-Host-global user skills stay out of the run by default. Those trees live under `~/.cursor/skills`, `~/.claude/skills`, `~/.codex/skills`, and `~/.agents/skills`. A custom `workspace` is a fixture. Keep `allowUserSkills` false for that case. Set `allowUserSkills` to true on the scenario or suite defaults when the test needs the machine skill set. The `skills` field only overlays repo-relative folders into the sealed workspace.
-
-`contextSources` and `skills` are relative to the workspace root when `workspace` is a subfolder. A bare `contextSources` name is a file in that root. `seedPatch` stays a caller-repo path. Its hunks are relative to that workspace.
-
-`--debug` retains an evidence bundle under `$TMPDIR/agent-spec/sessions/<id>/` by default. Use `--debug-dir` to override the parent directory.
-
-Host SDK INFO lines stay hidden. Set `AGENT_TEST_HOST_LOGS=1` or `--debug` to print them.
-
-A TTY run prints `agent started`, then updates an `agent` clock every 0.1s. Tool names and a short reply preview print as the host streams them. The clock line stays one row so the terminal can overwrite it. The HTML report line is a localhost link. A click opens the browser. The preview exits after 30 minutes idle. Set `AGENT_TEST_NO_REPORT_PREVIEW=1` to skip the preview.
-
-`Ctrl+C` cancels active host work and deletes the temp folder. `--no-worktree` requires `AGENT_TEST_ALLOW_IN_PLACE=1` because agent edits will persist in the caller checkout.
-
-## MCP servers
-
-Scenarios can attach inline stdio or HTTP/SSE MCP servers through suite defaults or scenario overrides. Ambient project/user MCP configuration is not loaded. When `workspace` is a subfolder, stdio MCP cwd is the caller repo. Script args stay caller-relative.
-
 ## In-repo package checks
 
 Default CI does not launch a paid agent:

package/dist/compare-scenario.d.ts

@@ -6,6 +6,9 @@ export declare function isCompareScenario(scenario: Pick<AgentScenario, "compare
 };
 export declare function parseCompareArmId(value: unknown): CompareArmId | undefined;
 export declare function compareArmLabel(arm: CompareArm | undefined, side: CompareArmId): string;
+/** Trim a description. Empty text becomes undefined. */
+export declare function plainDescription(value?: string): string | undefined;
+export declare function compareArmDescription(arm: CompareArm | undefined): string | undefined;
 export declare function compareArmTokens(arm: CompareArmResult): number | undefined;
 /** Apply one compare arm onto the shared scenario. Drops `compare` so the arm is a normal run. */
 export declare function applyCompareArm(scenario: AgentScenario, side: CompareArmId): AgentScenario;
@@ -18,6 +21,11 @@ export declare function compareStoryFields(scenario: AgentScenario): {
     bRubric?: ScenarioRubric;
 };
 export declare function prefixCompareFailures(label: string, failures: AssertionFailure[]): AssertionFailure[];
+/**
+ * Plain-language winners after both arms finish.
+ * Lower duration, token count, and tool count win.
+ */
+export declare function describeCompareOutcome(compare: ScenarioCompareResult): string[];
 export declare function applySidecarCompareDurations(compare: ScenarioCompareResult, sidecar?: {
     compare?: {
         a?: {

package/dist/compare-scenario.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"compare-scenario.d.ts","sourceRoot":"","sources":["../src/compare-scenario.ts"],"names":[],"mappings":"AACA,OAAO,KAAK,EACX,aAAa,EACb,gBAAgB,EAChB,UAAU,EACV,YAAY,EACZ,gBAAgB,EAChB,eAAe,EACf,qBAAqB,EACrB,cAAc,EACd,MAAM,YAAY,CAAC;AAcpB,gFAAgF;AAChF,wBAAgB,cAAc,CAAC,IAAI,EAAE,cAAc,EAAE,OAAO,CAAC,EAAE,cAAc,GAAG,cAAc,CAmB7F;AAED,wBAAgB,iBAAiB,CAChC,QAAQ,EAAE,IAAI,CAAC,aAAa,EAAE,SAAS,CAAC,GACtC,QAAQ,IAAI,aAAa,GAAG;IAAE,OAAO,EAAE,eAAe,CAAA;CAAE,CAE1D;AAED,wBAAgB,iBAAiB,CAAC,KAAK,EAAE,OAAO,GAAG,YAAY,GAAG,SAAS,CAE1E;AAED,wBAAgB,eAAe,CAAC,GAAG,EAAE,UAAU,GAAG,SAAS,EAAE,IAAI,EAAE,YAAY,GAAG,MAAM,CAMvF;AAMD,wBAAgB,gBAAgB,CAAC,GAAG,EAAE,gBAAgB,GAAG,MAAM,GAAG,SAAS,CAG1E;AAED,kGAAkG;AAClG,wBAAgB,eAAe,CAAC,QAAQ,EAAE,aAAa,EAAE,IAAI,EAAE,YAAY,GAAG,aAAa,CAoB1F;AAED,wBAAgB,kBAAkB,CAAC,QAAQ,EAAE,aAAa,GAAG;IAC5D,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,YAAY,CAAC;IACtB,OAAO,CAAC,EAAE,YAAY,CAAC;IACvB,OAAO,CAAC,EAAE,cAAc,CAAC;IACzB,OAAO,CAAC,EAAE,cAAc,CAAC;CACzB,CASA;AAED,wBAAgB,qBAAqB,CACpC,KAAK,EAAE,MAAM,EACb,QAAQ,EAAE,gBAAgB,EAAE,GAC1B,gBAAgB,EAAE,CAKpB;AAED,wBAAgB,4BAA4B,CAC3C,OAAO,EAAE,qBAAqB,EAC9B,OAAO,CAAC,EAAE;IAAE,OAAO,CAAC,EAAE;QAAE,CAAC,CAAC,EAAE;YAAE,UAAU,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC;QAAC,CAAC,CAAC,EAAE;YAAE,UAAU,CAAC,EAAE,MAAM,CAAA;SAAE,CAAA;KAAE,CAAA;CAAE,GAClF,qBAAqB,CAQvB;AAED,kEAAkE;AAClE,wBAAgB,oBAAoB,CACnC,IAAI,EAAE,IAAI,CAAC,eAAe,EAAE,QAAQ,GAAG,SAAS,CAAC,EACjD,MAAM,EAAE,qBAAqB,GAC3B,gBAAgB,EAAE,CA+CpB"}
+{"version":3,"file":"compare-scenario.d.ts","sourceRoot":"","sources":["../src/compare-scenario.ts"],"names":[],"mappings":"AACA,OAAO,KAAK,EACX,aAAa,EACb,gBAAgB,EAChB,UAAU,EACV,YAAY,EACZ,gBAAgB,EAChB,eAAe,EACf,qBAAqB,EACrB,cAAc,EACd,MAAM,YAAY,CAAC;AAcpB,gFAAgF;AAChF,wBAAgB,cAAc,CAAC,IAAI,EAAE,cAAc,EAAE,OAAO,CAAC,EAAE,cAAc,GAAG,cAAc,CAmB7F;AAED,wBAAgB,iBAAiB,CAChC,QAAQ,EAAE,IAAI,CAAC,aAAa,EAAE,SAAS,CAAC,GACtC,QAAQ,IAAI,aAAa,GAAG;IAAE,OAAO,EAAE,eAAe,CAAA;CAAE,CAE1D;AAED,wBAAgB,iBAAiB,CAAC,KAAK,EAAE,OAAO,GAAG,YAAY,GAAG,SAAS,CAE1E;AAED,wBAAgB,eAAe,CAAC,GAAG,EAAE,UAAU,GAAG,SAAS,EAAE,IAAI,EAAE,YAAY,GAAG,MAAM,CAMvF;AAED,wDAAwD;AACxD,wBAAgB,gBAAgB,CAAC,KAAK,CAAC,EAAE,MAAM,GAAG,MAAM,GAAG,SAAS,CAGnE;AAED,wBAAgB,qBAAqB,CAAC,GAAG,EAAE,UAAU,GAAG,SAAS,GAAG,MAAM,GAAG,SAAS,CAErF;AAMD,wBAAgB,gBAAgB,CAAC,GAAG,EAAE,gBAAgB,GAAG,MAAM,GAAG,SAAS,CAG1E;AAED,kGAAkG;AAClG,wBAAgB,eAAe,CAAC,QAAQ,EAAE,aAAa,EAAE,IAAI,EAAE,YAAY,GAAG,aAAa,CAoB1F;AAED,wBAAgB,kBAAkB,CAAC,QAAQ,EAAE,aAAa,GAAG;IAC5D,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,EAAE,MAAM,CAAC;IACf,MAAM,CAAC,EAAE,YAAY,CAAC;IACtB,OAAO,CAAC,EAAE,YAAY,CAAC;IACvB,OAAO,CAAC,EAAE,cAAc,CAAC;IACzB,OAAO,CAAC,EAAE,cAAc,CAAC;CACzB,CASA;AAED,wBAAgB,qBAAqB,CACpC,KAAK,EAAE,MAAM,EACb,QAAQ,EAAE,gBAAgB,EAAE,GAC1B,gBAAgB,EAAE,CAKpB;AAaD;;;GAGG;AACH,wBAAgB,sBAAsB,CAAC,OAAO,EAAE,qBAAqB,GAAG,MAAM,EAAE,CAgD/E;AAED,wBAAgB,4BAA4B,CAC3C,OAAO,EAAE,qBAAqB,EAC9B,OAAO,CAAC,EAAE;IAAE,OAAO,CAAC,EAAE;QAAE,CAAC,CAAC,EAAE;YAAE,UAAU,CAAC,EAAE,MAAM,CAAA;SAAE,CAAC;QAAC,CAAC,CAAC,EAAE;YAAE,UAAU,CAAC,EAAE,MAAM,CAAA;SAAE,CAAA;KAAE,CAAA;CAAE,GAClF,qBAAqB,CAQvB;AAED,kEAAkE;AAClE,wBAAgB,oBAAoB,CACnC,IAAI,EAAE,IAAI,CAAC,eAAe,EAAE,QAAQ,GAAG,SAAS,CAAC,EACjD,MAAM,EAAE,qBAAqB,GAC3B,gBAAgB,EAAE,CA+CpB"}

package/dist/compare-scenario.js

@@ -44,6 +44,14 @@ export function compareArmLabel(arm, side) {
     }
     return side === "a" ? "A" : "B";
 }
+/** Trim a description. Empty text becomes undefined. */
+export function plainDescription(value) {
+    const text = value?.trim();
+    return text ? text : undefined;
+}
+export function compareArmDescription(arm) {
+    return plainDescription(arm?.description);
+}
 function otherArm(side) {
     return side === "a" ? "b" : "a";
 }
@@ -89,6 +97,64 @@ export function prefixCompareFailures(label, failures) {
         message: `${label}: ${failure.message}`,
     }));
 }
+function formatCompareDuration(ms) {
+    if (ms < 1000) {
+        return `${Math.round(ms)}ms`;
+    }
+    return `${(ms / 1000).toFixed(1)}s`;
+}
+function armToolCount(arm) {
+    return arm.trace ? arm.trace.toolCalls.length : undefined;
+}
+/**
+ * Plain-language winners after both arms finish.
+ * Lower duration, token count, and tool count win.
+ */
+export function describeCompareOutcome(compare) {
+    const lines = [];
+    const aLabel = compare.a.label;
+    const bLabel = compare.b.label;
+    const aMs = compare.a.durationMs;
+    const bMs = compare.b.durationMs;
+    if (typeof aMs === "number" && typeof bMs === "number") {
+        if (aMs === bMs) {
+            lines.push(`both arms took ${formatCompareDuration(aMs)}`);
+        }
+        else if (aMs < bMs) {
+            lines.push(`${aLabel} is faster than ${bLabel} (${formatCompareDuration(aMs)} vs ${formatCompareDuration(bMs)})`);
+        }
+        else {
+            lines.push(`${bLabel} is faster than ${aLabel} (${formatCompareDuration(bMs)} vs ${formatCompareDuration(aMs)})`);
+        }
+    }
+    const aTokens = compareArmTokens(compare.a);
+    const bTokens = compareArmTokens(compare.b);
+    if (typeof aTokens === "number" && typeof bTokens === "number") {
+        if (aTokens === bTokens) {
+            lines.push(`both arms use ${aTokens} tokens`);
+        }
+        else if (aTokens < bTokens) {
+            lines.push(`${aLabel} uses fewer tokens than ${bLabel} (${aTokens} vs ${bTokens})`);
+        }
+        else {
+            lines.push(`${bLabel} uses fewer tokens than ${aLabel} (${bTokens} vs ${aTokens})`);
+        }
+    }
+    const aTools = armToolCount(compare.a);
+    const bTools = armToolCount(compare.b);
+    if (typeof aTools === "number" && typeof bTools === "number") {
+        if (aTools === bTools) {
+            lines.push(aTools === 1 ? "both arms make 1 tool call" : `both arms make ${aTools} tool calls`);
+        }
+        else if (aTools < bTools) {
+            lines.push(`${aLabel} makes fewer tool calls than ${bLabel} (${aTools} vs ${bTools})`);
+        }
+        else {
+            lines.push(`${bLabel} makes fewer tool calls than ${aLabel} (${bTools} vs ${aTools})`);
+        }
+    }
+    return lines;
+}
 export function applySidecarCompareDurations(compare, sidecar) {
     if (!sidecar?.compare) {
         return compare;

package/dist/compare-scenario.js.map

@@ -1 +1 @@
-{"version":3,"file":"compare-scenario.js","sourceRoot":"","sources":["../src/compare-scenario.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,gBAAgB,EAAE,MAAM,eAAe,CAAC;AAYjD,MAAM,iBAAiB,GAAG;IACzB,MAAM;IACN,SAAS;IACT,SAAS;IACT,cAAc;IACd,iBAAiB;IACjB,cAAc;IACd,iBAAiB;IACjB,iBAAiB;IACjB,oBAAoB;CACX,CAAC;AAEX,gFAAgF;AAChF,MAAM,UAAU,cAAc,CAAC,IAAoB,EAAE,OAAwB;IAC5E,IAAI,CAAC,OAAO,EAAE,CAAC;QACd,OAAO,IAAI,CAAC;IACb,CAAC;IACD,MAAM,MAAM,GAAmB;QAC9B,GAAG,IAAI;QACP,IAAI,EAAE,OAAO,CAAC,IAAI,IAAI,IAAI,CAAC,IAAI;QAC/B,cAAc,EAAE,OAAO,CAAC,cAAc,IAAI,IAAI,CAAC,cAAc;QAC7D,YAAY,EAAE,OAAO,CAAC,YAAY,IAAI,IAAI,CAAC,YAAY;QACvD,WAAW,EAAE,OAAO,CAAC,WAAW,IAAI,IAAI,CAAC,WAAW;QACpD,KAAK,EAAE,IAAI,CAAC,KAAK;KACjB,CAAC;IACF,KAAK,MAAM,GAAG,IAAI,iBAAiB,EAAE,CAAC;QACrC,MAAM,KAAK,GAAG,OAAO,CAAC,GAAG,CAAC,CAAC;QAC3B,IAAI,KAAK,KAAK,SAAS,EAAE,CAAC;YACzB,MAAM,CAAC,GAAG,CAAC,GAAG,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,EAAE,CAAC,EAAE,GAAG,KAAK,CAAC,CAAC;QAChD,CAAC;IACF,CAAC;IACD,OAAO,MAAM,CAAC;AACf,CAAC;AAED,MAAM,UAAU,iBAAiB,CAChC,QAAwC;IAExC,OAAO,QAAQ,CAAC,OAAO,KAAK,SAAS,CAAC;AACvC,CAAC;AAED,MAAM,UAAU,iBAAiB,CAAC,KAAc;IAC/C,OAAO,KAAK,KAAK,GAAG,IAAI,KAAK,KAAK,GAAG,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,SAAS,CAAC;AAC3D,CAAC;AAED,MAAM,UAAU,eAAe,CAAC,GAA2B,EAAE,IAAkB;IAC9E,MAAM,KAAK,GAAG,GAAG,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;IACjC,IAAI,KAAK,EAAE,CAAC;QACX,OAAO,KAAK,CAAC;IACd,CAAC;IACD,OAAO,IAAI,KAAK,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC;AACjC,CAAC;AAED,SAAS,QAAQ,CAAC,IAAkB;IACnC,OAAO,IAAI,KAAK,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC;AACjC,CAAC;AAED,MAAM,UAAU,gBAAgB,CAAC,GAAqB;IACrD,MAAM,KAAK,GAAG,GAAG,CAAC,KAAK,EAAE,KAAK,EAAE,WAAW,CAAC;IAC5C,OAAO,OAAO,KAAK,KAAK,QAAQ,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,SAAS,CAAC;AACtD,CAAC;AAED,kGAAkG;AAClG,MAAM,UAAU,eAAe,CAAC,QAAuB,EAAE,IAAkB;IAC1E,MAAM,EAAE,OAAO,EAAE,GAAG,IAAI,EAAE,GAAG,QAAQ,CAAC;IACtC,MAAM,GAAG,GAAG,OAAO,EAAE,CAAC,IAAI,CAAC,CAAC;IAC5B,IAAI,CAAC,GAAG,EAAE,CAAC;QACV,OAAO,IAAI,CAAC;IACb,CAAC;IACD,OAAO;QACN,GAAG,IAAI;QACP,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,IAAI,CAAC,MAAM;QACjC,IAAI,EAAE,GAAG,CAAC,IAAI,IAAI,IAAI,CAAC,IAAI;QAC3B,OAAO,EAAE,GAAG,CAAC,OAAO,IAAI,IAAI,CAAC,OAAO;QACpC,SAAS,EAAE,GAAG,CAAC,SAAS,IAAI,IAAI,CAAC,SAAS;QAC1C,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,IAAI,CAAC,MAAM;QACjC,cAAc,EAAE,GAAG,CAAC,cAAc,IAAI,IAAI,CAAC,cAAc;QACzD,UAAU,EAAE,GAAG,CAAC,UAAU,IAAI,IAAI,CAAC,UAAU;QAC7C,eAAe,EAAE,GAAG,CAAC,eAAe,IAAI,IAAI,CAAC,eAAe;QAC5D,SAAS,EAAE,GAAG,CAAC,SAAS,IAAI,IAAI,CAAC,SAAS;QAC1C,aAAa,EAAE,GAAG,CAAC,aAAa,IAAI,IAAI,CAAC,aAAa;QACtD,MAAM,EAAE,cAAc,CAAC,IAAI,CAAC,MAAM,EAAE,GAAG,CAAC,MAAM,CAAC;KAC/C,CAAC;AACH,CAAC;AAED,MAAM,UAAU,kBAAkB,CAAC,QAAuB;IAQzD,OAAO;QACN,MAAM,EAAE,eAAe,CAAC,QAAQ,CAAC,OAAO,EAAE,CAAC,EAAE,GAAG,CAAC;QACjD,MAAM,EAAE,eAAe,CAAC,QAAQ,CAAC,OAAO,EAAE,CAAC,EAAE,GAAG,CAAC;QACjD,MAAM,EAAE,QAAQ,CAAC,OAAO,EAAE,MAAM;QAChC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,OAAO;QAClC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,CAAC,CAAC,MAAM;QACnC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,CAAC,CAAC,MAAM;KACnC,CAAC;AACH,CAAC;AAED,MAAM,UAAU,qBAAqB,CACpC,KAAa,EACb,QAA4B;IAE5B,OAAO,QAAQ,CAAC,GAAG,CAAC,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC;QACjC,GAAG,OAAO;QACV,OAAO,EAAE,GAAG,KAAK,KAAK,OAAO,CAAC,OAAO,EAAE;KACvC,CAAC,CAAC,CAAC;AACL,CAAC;AAED,MAAM,UAAU,4BAA4B,CAC3C,OAA8B,EAC9B,OAAoF;IAEpF,IAAI,CAAC,OAAO,EAAE,OAAO,EAAE,CAAC;QACvB,OAAO,OAAO,CAAC;IAChB,CAAC;IACD,OAAO;QACN,CAAC,EAAE,EAAE,GAAG,OAAO,CAAC,CAAC,EAAE,UAAU,EAAE,OAAO,CAAC,OAAO,CAAC,CAAC,EAAE,UAAU,IAAI,OAAO,CAAC,CAAC,CAAC,UAAU,EAAE;QACtF,CAAC,EAAE,EAAE,GAAG,OAAO,CAAC,CAAC,EAAE,UAAU,EAAE,OAAO,CAAC,OAAO,CAAC,CAAC,EAAE,UAAU,IAAI,OAAO,CAAC,CAAC,CAAC,UAAU,EAAE;KACtF,CAAC;AACH,CAAC;AAED,kEAAkE;AAClE,MAAM,UAAU,oBAAoB,CACnC,IAAiD,EACjD,MAA6B;IAE7B,MAAM,QAAQ,GAAuB,EAAE,CAAC;IACxC,IAAI,IAAI,CAAC,MAAM,EAAE,CAAC;QACjB,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC;QACnC,MAAM,KAAK,GAAG,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC,CAAC;QAC5C,IAAI,MAAM,CAAC,UAAU,KAAK,SAAS,IAAI,KAAK,CAAC,UAAU,KAAK,SAAS,EAAE,CAAC;YACvE,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,QAAQ,EACR,GAAG,MAAM,CAAC,KAAK,wBAAwB,KAAK,CAAC,KAAK,uCAAuC,EACzF,aAAa,CACb,CACD,CAAC;QACH,CAAC;aAAM,IAAI,CAAC,CAAC,MAAM,CAAC,UAAU,GAAG,KAAK,CAAC,UAAU,CAAC,EAAE,CAAC;YACpD,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,QAAQ,EACR,GAAG,MAAM,CAAC,KAAK,wBAAwB,KAAK,CAAC,KAAK,KAAK,MAAM,CAAC,UAAU,SAAS,KAAK,CAAC,UAAU,KAAK,EACtG,aAAa,CACb,CACD,CAAC;QACH,CAAC;IACF,CAAC;IACD,IAAI,IAAI,CAAC,OAAO,EAAE,CAAC;QAClB,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;QACpC,MAAM,KAAK,GAAG,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,CAAC;QAC7C,MAAM,YAAY,GAAG,gBAAgB,CAAC,MAAM,CAAC,CAAC;QAC9C,MAAM,WAAW,GAAG,gBAAgB,CAAC,KAAK,CAAC,CAAC;QAC5C,IAAI,YAAY,KAAK,SAAS,IAAI,WAAW,KAAK,SAAS,EAAE,CAAC;YAC7D,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,SAAS,EACT,GAAG,MAAM,CAAC,KAAK,+BAA+B,KAAK,CAAC,KAAK,qCAAqC,EAC9F,aAAa,CACb,CACD,CAAC;QACH,CAAC;aAAM,IAAI,CAAC,CAAC,YAAY,GAAG,WAAW,CAAC,EAAE,CAAC;YAC1C,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,SAAS,EACT,GAAG,MAAM,CAAC,KAAK,+BAA+B,KAAK,CAAC,KAAK,KAAK,YAAY,OAAO,WAAW,GAAG,EAC/F,aAAa,CACb,CACD,CAAC;QACH,CAAC;IACF,CAAC;IACD,OAAO,QAAQ,CAAC;AACjB,CAAC"}
+{"version":3,"file":"compare-scenario.js","sourceRoot":"","sources":["../src/compare-scenario.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,gBAAgB,EAAE,MAAM,eAAe,CAAC;AAYjD,MAAM,iBAAiB,GAAG;IACzB,MAAM;IACN,SAAS;IACT,SAAS;IACT,cAAc;IACd,iBAAiB;IACjB,cAAc;IACd,iBAAiB;IACjB,iBAAiB;IACjB,oBAAoB;CACX,CAAC;AAEX,gFAAgF;AAChF,MAAM,UAAU,cAAc,CAAC,IAAoB,EAAE,OAAwB;IAC5E,IAAI,CAAC,OAAO,EAAE,CAAC;QACd,OAAO,IAAI,CAAC;IACb,CAAC;IACD,MAAM,MAAM,GAAmB;QAC9B,GAAG,IAAI;QACP,IAAI,EAAE,OAAO,CAAC,IAAI,IAAI,IAAI,CAAC,IAAI;QAC/B,cAAc,EAAE,OAAO,CAAC,cAAc,IAAI,IAAI,CAAC,cAAc;QAC7D,YAAY,EAAE,OAAO,CAAC,YAAY,IAAI,IAAI,CAAC,YAAY;QACvD,WAAW,EAAE,OAAO,CAAC,WAAW,IAAI,IAAI,CAAC,WAAW;QACpD,KAAK,EAAE,IAAI,CAAC,KAAK;KACjB,CAAC;IACF,KAAK,MAAM,GAAG,IAAI,iBAAiB,EAAE,CAAC;QACrC,MAAM,KAAK,GAAG,OAAO,CAAC,GAAG,CAAC,CAAC;QAC3B,IAAI,KAAK,KAAK,SAAS,EAAE,CAAC;YACzB,MAAM,CAAC,GAAG,CAAC,GAAG,CAAC,GAAG,CAAC,IAAI,CAAC,GAAG,CAAC,IAAI,EAAE,CAAC,EAAE,GAAG,KAAK,CAAC,CAAC;QAChD,CAAC;IACF,CAAC;IACD,OAAO,MAAM,CAAC;AACf,CAAC;AAED,MAAM,UAAU,iBAAiB,CAChC,QAAwC;IAExC,OAAO,QAAQ,CAAC,OAAO,KAAK,SAAS,CAAC;AACvC,CAAC;AAED,MAAM,UAAU,iBAAiB,CAAC,KAAc;IAC/C,OAAO,KAAK,KAAK,GAAG,IAAI,KAAK,KAAK,GAAG,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,SAAS,CAAC;AAC3D,CAAC;AAED,MAAM,UAAU,eAAe,CAAC,GAA2B,EAAE,IAAkB;IAC9E,MAAM,KAAK,GAAG,GAAG,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC;IACjC,IAAI,KAAK,EAAE,CAAC;QACX,OAAO,KAAK,CAAC;IACd,CAAC;IACD,OAAO,IAAI,KAAK,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC;AACjC,CAAC;AAED,wDAAwD;AACxD,MAAM,UAAU,gBAAgB,CAAC,KAAc;IAC9C,MAAM,IAAI,GAAG,KAAK,EAAE,IAAI,EAAE,CAAC;IAC3B,OAAO,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,SAAS,CAAC;AAChC,CAAC;AAED,MAAM,UAAU,qBAAqB,CAAC,GAA2B;IAChE,OAAO,gBAAgB,CAAC,GAAG,EAAE,WAAW,CAAC,CAAC;AAC3C,CAAC;AAED,SAAS,QAAQ,CAAC,IAAkB;IACnC,OAAO,IAAI,KAAK,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC;AACjC,CAAC;AAED,MAAM,UAAU,gBAAgB,CAAC,GAAqB;IACrD,MAAM,KAAK,GAAG,GAAG,CAAC,KAAK,EAAE,KAAK,EAAE,WAAW,CAAC;IAC5C,OAAO,OAAO,KAAK,KAAK,QAAQ,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,SAAS,CAAC;AACtD,CAAC;AAED,kGAAkG;AAClG,MAAM,UAAU,eAAe,CAAC,QAAuB,EAAE,IAAkB;IAC1E,MAAM,EAAE,OAAO,EAAE,GAAG,IAAI,EAAE,GAAG,QAAQ,CAAC;IACtC,MAAM,GAAG,GAAG,OAAO,EAAE,CAAC,IAAI,CAAC,CAAC;IAC5B,IAAI,CAAC,GAAG,EAAE,CAAC;QACV,OAAO,IAAI,CAAC;IACb,CAAC;IACD,OAAO;QACN,GAAG,IAAI;QACP,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,IAAI,CAAC,MAAM;QACjC,IAAI,EAAE,GAAG,CAAC,IAAI,IAAI,IAAI,CAAC,IAAI;QAC3B,OAAO,EAAE,GAAG,CAAC,OAAO,IAAI,IAAI,CAAC,OAAO;QACpC,SAAS,EAAE,GAAG,CAAC,SAAS,IAAI,IAAI,CAAC,SAAS;QAC1C,MAAM,EAAE,GAAG,CAAC,MAAM,IAAI,IAAI,CAAC,MAAM;QACjC,cAAc,EAAE,GAAG,CAAC,cAAc,IAAI,IAAI,CAAC,cAAc;QACzD,UAAU,EAAE,GAAG,CAAC,UAAU,IAAI,IAAI,CAAC,UAAU;QAC7C,eAAe,EAAE,GAAG,CAAC,eAAe,IAAI,IAAI,CAAC,eAAe;QAC5D,SAAS,EAAE,GAAG,CAAC,SAAS,IAAI,IAAI,CAAC,SAAS;QAC1C,aAAa,EAAE,GAAG,CAAC,aAAa,IAAI,IAAI,CAAC,aAAa;QACtD,MAAM,EAAE,cAAc,CAAC,IAAI,CAAC,MAAM,EAAE,GAAG,CAAC,MAAM,CAAC;KAC/C,CAAC;AACH,CAAC;AAED,MAAM,UAAU,kBAAkB,CAAC,QAAuB;IAQzD,OAAO;QACN,MAAM,EAAE,eAAe,CAAC,QAAQ,CAAC,OAAO,EAAE,CAAC,EAAE,GAAG,CAAC;QACjD,MAAM,EAAE,eAAe,CAAC,QAAQ,CAAC,OAAO,EAAE,CAAC,EAAE,GAAG,CAAC;QACjD,MAAM,EAAE,QAAQ,CAAC,OAAO,EAAE,MAAM;QAChC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,OAAO;QAClC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,CAAC,CAAC,MAAM;QACnC,OAAO,EAAE,QAAQ,CAAC,OAAO,EAAE,CAAC,CAAC,MAAM;KACnC,CAAC;AACH,CAAC;AAED,MAAM,UAAU,qBAAqB,CACpC,KAAa,EACb,QAA4B;IAE5B,OAAO,QAAQ,CAAC,GAAG,CAAC,CAAC,OAAO,EAAE,EAAE,CAAC,CAAC;QACjC,GAAG,OAAO;QACV,OAAO,EAAE,GAAG,KAAK,KAAK,OAAO,CAAC,OAAO,EAAE;KACvC,CAAC,CAAC,CAAC;AACL,CAAC;AAED,SAAS,qBAAqB,CAAC,EAAU;IACxC,IAAI,EAAE,GAAG,IAAI,EAAE,CAAC;QACf,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,EAAE,CAAC,IAAI,CAAC;IAC9B,CAAC;IACD,OAAO,GAAG,CAAC,EAAE,GAAG,IAAI,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,GAAG,CAAC;AACrC,CAAC;AAED,SAAS,YAAY,CAAC,GAAqB;IAC1C,OAAO,GAAG,CAAC,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,SAAS,CAAC,MAAM,CAAC,CAAC,CAAC,SAAS,CAAC;AAC3D,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,sBAAsB,CAAC,OAA8B;IACpE,MAAM,KAAK,GAAa,EAAE,CAAC;IAC3B,MAAM,MAAM,GAAG,OAAO,CAAC,CAAC,CAAC,KAAK,CAAC;IAC/B,MAAM,MAAM,GAAG,OAAO,CAAC,CAAC,CAAC,KAAK,CAAC;IAE/B,MAAM,GAAG,GAAG,OAAO,CAAC,CAAC,CAAC,UAAU,CAAC;IACjC,MAAM,GAAG,GAAG,OAAO,CAAC,CAAC,CAAC,UAAU,CAAC;IACjC,IAAI,OAAO,GAAG,KAAK,QAAQ,IAAI,OAAO,GAAG,KAAK,QAAQ,EAAE,CAAC;QACxD,IAAI,GAAG,KAAK,GAAG,EAAE,CAAC;YACjB,KAAK,CAAC,IAAI,CAAC,kBAAkB,qBAAqB,CAAC,GAAG,CAAC,EAAE,CAAC,CAAC;QAC5D,CAAC;aAAM,IAAI,GAAG,GAAG,GAAG,EAAE,CAAC;YACtB,KAAK,CAAC,IAAI,CACT,GAAG,MAAM,mBAAmB,MAAM,KAAK,qBAAqB,CAAC,GAAG,CAAC,OAAO,qBAAqB,CAAC,GAAG,CAAC,GAAG,CACrG,CAAC;QACH,CAAC;aAAM,CAAC;YACP,KAAK,CAAC,IAAI,CACT,GAAG,MAAM,mBAAmB,MAAM,KAAK,qBAAqB,CAAC,GAAG,CAAC,OAAO,qBAAqB,CAAC,GAAG,CAAC,GAAG,CACrG,CAAC;QACH,CAAC;IACF,CAAC;IAED,MAAM,OAAO,GAAG,gBAAgB,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;IAC5C,MAAM,OAAO,GAAG,gBAAgB,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;IAC5C,IAAI,OAAO,OAAO,KAAK,QAAQ,IAAI,OAAO,OAAO,KAAK,QAAQ,EAAE,CAAC;QAChE,IAAI,OAAO,KAAK,OAAO,EAAE,CAAC;YACzB,KAAK,CAAC,IAAI,CAAC,iBAAiB,OAAO,SAAS,CAAC,CAAC;QAC/C,CAAC;aAAM,IAAI,OAAO,GAAG,OAAO,EAAE,CAAC;YAC9B,KAAK,CAAC,IAAI,CAAC,GAAG,MAAM,2BAA2B,MAAM,KAAK,OAAO,OAAO,OAAO,GAAG,CAAC,CAAC;QACrF,CAAC;aAAM,CAAC;YACP,KAAK,CAAC,IAAI,CAAC,GAAG,MAAM,2BAA2B,MAAM,KAAK,OAAO,OAAO,OAAO,GAAG,CAAC,CAAC;QACrF,CAAC;IACF,CAAC;IAED,MAAM,MAAM,GAAG,YAAY,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;IACvC,MAAM,MAAM,GAAG,YAAY,CAAC,OAAO,CAAC,CAAC,CAAC,CAAC;IACvC,IAAI,OAAO,MAAM,KAAK,QAAQ,IAAI,OAAO,MAAM,KAAK,QAAQ,EAAE,CAAC;QAC9D,IAAI,MAAM,KAAK,MAAM,EAAE,CAAC;YACvB,KAAK,CAAC,IAAI,CACT,MAAM,KAAK,CAAC,CAAC,CAAC,CAAC,4BAA4B,CAAC,CAAC,CAAC,kBAAkB,MAAM,aAAa,CACnF,CAAC;QACH,CAAC;aAAM,IAAI,MAAM,GAAG,MAAM,EAAE,CAAC;YAC5B,KAAK,CAAC,IAAI,CAAC,GAAG,MAAM,gCAAgC,MAAM,KAAK,MAAM,OAAO,MAAM,GAAG,CAAC,CAAC;QACxF,CAAC;aAAM,CAAC;YACP,KAAK,CAAC,IAAI,CAAC,GAAG,MAAM,gCAAgC,MAAM,KAAK,MAAM,OAAO,MAAM,GAAG,CAAC,CAAC;QACxF,CAAC;IACF,CAAC;IAED,OAAO,KAAK,CAAC;AACd,CAAC;AAED,MAAM,UAAU,4BAA4B,CAC3C,OAA8B,EAC9B,OAAoF;IAEpF,IAAI,CAAC,OAAO,EAAE,OAAO,EAAE,CAAC;QACvB,OAAO,OAAO,CAAC;IAChB,CAAC;IACD,OAAO;QACN,CAAC,EAAE,EAAE,GAAG,OAAO,CAAC,CAAC,EAAE,UAAU,EAAE,OAAO,CAAC,OAAO,CAAC,CAAC,EAAE,UAAU,IAAI,OAAO,CAAC,CAAC,CAAC,UAAU,EAAE;QACtF,CAAC,EAAE,EAAE,GAAG,OAAO,CAAC,CAAC,EAAE,UAAU,EAAE,OAAO,CAAC,OAAO,CAAC,CAAC,EAAE,UAAU,IAAI,OAAO,CAAC,CAAC,CAAC,UAAU,EAAE;KACtF,CAAC;AACH,CAAC;AAED,kEAAkE;AAClE,MAAM,UAAU,oBAAoB,CACnC,IAAiD,EACjD,MAA6B;IAE7B,MAAM,QAAQ,GAAuB,EAAE,CAAC;IACxC,IAAI,IAAI,CAAC,MAAM,EAAE,CAAC;QACjB,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC;QACnC,MAAM,KAAK,GAAG,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,MAAM,CAAC,CAAC,CAAC;QAC5C,IAAI,MAAM,CAAC,UAAU,KAAK,SAAS,IAAI,KAAK,CAAC,UAAU,KAAK,SAAS,EAAE,CAAC;YACvE,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,QAAQ,EACR,GAAG,MAAM,CAAC,KAAK,wBAAwB,KAAK,CAAC,KAAK,uCAAuC,EACzF,aAAa,CACb,CACD,CAAC;QACH,CAAC;aAAM,IAAI,CAAC,CAAC,MAAM,CAAC,UAAU,GAAG,KAAK,CAAC,UAAU,CAAC,EAAE,CAAC;YACpD,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,QAAQ,EACR,GAAG,MAAM,CAAC,KAAK,wBAAwB,KAAK,CAAC,KAAK,KAAK,MAAM,CAAC,UAAU,SAAS,KAAK,CAAC,UAAU,KAAK,EACtG,aAAa,CACb,CACD,CAAC;QACH,CAAC;IACF,CAAC;IACD,IAAI,IAAI,CAAC,OAAO,EAAE,CAAC;QAClB,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC;QACpC,MAAM,KAAK,GAAG,MAAM,CAAC,QAAQ,CAAC,IAAI,CAAC,OAAO,CAAC,CAAC,CAAC;QAC7C,MAAM,YAAY,GAAG,gBAAgB,CAAC,MAAM,CAAC,CAAC;QAC9C,MAAM,WAAW,GAAG,gBAAgB,CAAC,KAAK,CAAC,CAAC;QAC5C,IAAI,YAAY,KAAK,SAAS,IAAI,WAAW,KAAK,SAAS,EAAE,CAAC;YAC7D,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,SAAS,EACT,GAAG,MAAM,CAAC,KAAK,+BAA+B,KAAK,CAAC,KAAK,qCAAqC,EAC9F,aAAa,CACb,CACD,CAAC;QACH,CAAC;aAAM,IAAI,CAAC,CAAC,YAAY,GAAG,WAAW,CAAC,EAAE,CAAC;YAC1C,QAAQ,CAAC,IAAI,CACZ,gBAAgB,CACf,SAAS,EACT,GAAG,MAAM,CAAC,KAAK,+BAA+B,KAAK,CAAC,KAAK,KAAK,YAAY,OAAO,WAAW,GAAG,EAC/F,aAAa,CACb,CACD,CAAC;QACH,CAAC;IACF,CAAC;IACD,OAAO,QAAQ,CAAC;AACjB,CAAC"}

package/dist/html-report.d.ts.map

@@ -1 +1 @@
-{"version":3,"file":"html-report.d.ts","sourceRoot":"","sources":["../src/html-report.ts"],"names":[],"mappings":"AAYA,OAAO,KAAK,EAAoC,cAAc,EAAc,MAAM,YAAY,CAAC;AAE/F,MAAM,WAAW,cAAc;IAC9B,WAAW,CAAC,EAAE,IAAI,CAAC;IACnB,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,SAAS,CAAC,EAAE,MAAM,CAAC;CACnB;AAq5BD,oEAAoE;AACpE,wBAAgB,gBAAgB,CAAC,OAAO,EAAE,cAAc,EAAE,EAAE,IAAI,GAAE,cAAmB,GAAG,MAAM,CAkD7F;AAED;;;GAGG;AACH,wBAAsB,eAAe,CACpC,OAAO,EAAE,cAAc,EAAE,EACzB,IAAI,GAAE,cAAmB,EACzB,OAAO,CAAC,EAAE,MAAM,GACd,OAAO,CAAC,MAAM,CAAC,CAQjB"}
+{"version":3,"file":"html-report.d.ts","sourceRoot":"","sources":["../src/html-report.ts"],"names":[],"mappings":"AAaA,OAAO,KAAK,EAAoC,cAAc,EAAc,MAAM,YAAY,CAAC;AAE/F,MAAM,WAAW,cAAc;IAC9B,WAAW,CAAC,EAAE,IAAI,CAAC;IACnB,IAAI,CAAC,EAAE,MAAM,CAAC;IACd,SAAS,CAAC,EAAE,MAAM,CAAC;CACnB;AA6gCD,oEAAoE;AACpE,wBAAgB,gBAAgB,CAAC,OAAO,EAAE,cAAc,EAAE,EAAE,IAAI,GAAE,cAAmB,GAAG,MAAM,CAkD7F;AAED;;;GAGG;AACH,wBAAsB,eAAe,CACpC,OAAO,EAAE,cAAc,EAAE,EACzB,IAAI,GAAE,cAAmB,EACzB,OAAO,CAAC,EAAE,MAAM,GACd,OAAO,CAAC,MAAM,CAAC,CAQjB"}

package/dist/html-report.js

@@ -1,6 +1,7 @@
 import { mkdir, mkdtemp, writeFile } from "node:fs/promises";
 import { tmpdir } from "node:os";
 import { dirname, join } from "node:path";
+import { describeCompareOutcome } from "./compare-scenario.js";
 import { summarizeReports } from "./suite-summary.js";
 function escapeHtml(value) {
     return value
@@ -446,11 +447,20 @@ function tokenDelta(a, b, key) {
     }
     return bValue - aValue;
 }
+function winnerCellClass(delta, side) {
+    if (delta === undefined || delta === 0) {
+        return "";
+    }
+    if (side === "a") {
+        return delta > 0 ? "is-better" : "is-worse";
+    }
+    return delta < 0 ? "is-better" : "is-worse";
+}
 function renderCompareMetricRow(label, aText, bText, delta, deltaText) {
     return `<tr>
   <th scope="row">${escapeHtml(label)}</th>
-  <td>${escapeHtml(aText)}</td>
-  <td>${escapeHtml(bText)}</td>
+  <td class="${winnerCellClass(delta, "a")}">${escapeHtml(aText)}</td>
+  <td class="${winnerCellClass(delta, "b")}">${escapeHtml(bText)}</td>
   <td class="${deltaClass(delta)}">${escapeHtml(deltaText)}</td>
 </tr>`;
 }
@@ -466,12 +476,17 @@ function renderCompareMetrics(result) {
     const bTools = armToolCount(compare.b);
     const toolDelta = aTools !== undefined && bTools !== undefined ? bTools - aTools : undefined;
     const totalDelta = tokenDelta(compare.a, compare.b, "total");
+    const callouts = describeCompareOutcome(compare);
+    const calloutList = callouts.length > 0
+        ? `<ul class="compare-callouts">${callouts.map((line) => `<li>${escapeHtml(line)}</li>`).join("")}</ul>`
+        : "";
     return `
 <section class="compare">
   <header class="compare-header">
     <h3>Comparison</h3>
     <p class="muted">${escapeHtml(compare.a.label)} vs ${escapeHtml(compare.b.label)}. Δ is B minus A. A lower time and a lower token count is better.</p>
   </header>
+  ${calloutList}
   <div class="compare-table-wrap">
     <table class="compare-table">
       <thead>
@@ -493,6 +508,57 @@ function renderCompareMetrics(result) {
   </div>
 </section>`;
 }
+function renderArmMetrics(arm) {
+    const parts = [];
+    const ms = armDurationMs(arm);
+    if (ms !== undefined) {
+        parts.push(formatDuration(ms));
+    }
+    const tokens = formatArmTokens(arm, "total");
+    if (tokens !== "n/a") {
+        parts.push(`${tokens} tokens`);
+    }
+    const tools = armToolCount(arm);
+    if (tools !== undefined) {
+        parts.push(tools === 1 ? "1 tool" : `${formatInteger(tools)} tools`);
+    }
+    if (parts.length === 0) {
+        return "";
+    }
+    return `<p class="compare-arm-metrics">${escapeHtml(parts.join(" · "))}</p>`;
+}
+function renderArmColumn(arm, side) {
+    const description = arm.description
+        ? `<p class="compare-arm-description">${escapeHtml(arm.description)}</p>`
+        : "";
+    return `
+<article class="compare-arm compare-arm-${side}">
+  <header class="compare-arm-header">
+    <p class="compare-arm-kicker">${side === "a" ? "Arm A" : "Arm B"}</p>
+    <h3>${escapeHtml(arm.label)}</h3>
+    ${description}
+    ${renderArmMetrics(arm)}
+  </header>
+  ${renderChat(arm.trace, arm.prompt)}
+</article>`;
+}
+function renderCompareConversations(result) {
+    const compare = result.compare;
+    if (!compare) {
+        return `<section class="conversation">
+    <h3>Conversation</h3>
+    ${renderChat(result.trace, result.prompt)}
+  </section>`;
+    }
+    return `
+<div class="compare-layout">
+  <div class="compare-arms">
+    ${renderArmColumn(compare.a, "a")}
+    ${renderArmColumn(compare.b, "b")}
+  </div>
+  ${renderCompareMetrics(result)}
+</div>`;
+}
 function renderStoryList(title, lines) {
     if (!lines || lines.length === 0) {
         return "";
@@ -511,12 +577,12 @@ function renderStory(result) {
   </div>`;
 }
 function renderScenario(result) {
-    const open = result.passed || result.skipped ? "" : " open";
+    const open = result.skipped ? "" : !result.passed || result.compare ? " open" : "";
     const failures = result.story ? "" : renderFailures(result);
     const judgeVerdicts = renderJudgeVerdicts(result);
     const tokens = formatTokensBadge(result);
-    const usageDetail = renderUsageDetail(usageOf(result));
-    const traceMeta = renderTraceMeta(result);
+    const usageDetail = result.compare ? "" : renderUsageDetail(usageOf(result));
+    const traceMeta = result.compare ? "" : renderTraceMeta(result);
     const story = renderStory(result);
     const diagnostics = story || failures || judgeVerdicts
         ? `<div class="diagnostics">
@@ -528,31 +594,25 @@ function renderScenario(result) {
     const metaRow = usageDetail || traceMeta
         ? `<div class="diagnostics meta-row">${usageDetail}${traceMeta}</div>`
         : "";
+    const compareClass = result.compare ? " compare-scenario" : "";
+    const description = result.description
+        ? `<span class="scenario-lede">${escapeHtml(result.description)}</span>`
+        : "";
     return `
-<details class="scenario ${statusClass(result)}"${open}>
+<details class="scenario ${statusClass(result)}${compareClass}"${open}>
   <summary>
     <span class="badge ${statusClass(result)}">${statusLabel(result)}</span>
-    <span class="scenario-name">${escapeHtml(result.scenario)}</span>
+    <span class="scenario-heading">
+      <span class="scenario-name">${escapeHtml(result.scenario)}</span>
+      ${description}
+    </span>
     ${tokens ? `<span class="tokens">${escapeHtml(tokens)}</span>` : ""}
     <span class="duration">${escapeHtml(formatDuration(result.durationMs))}</span>
   </summary>
   <div class="scenario-body">
   ${diagnostics}
   ${metaRow}
-  ${renderCompareMetrics(result)}
-  ${result.compare
-        ? `<section class="conversation">
-    <h3>Conversation · ${escapeHtml(result.compare.a.label)}</h3>
-    ${renderChat(result.compare.a.trace, result.compare.a.prompt)}
-  </section>
-  <section class="conversation">
-    <h3>Conversation · ${escapeHtml(result.compare.b.label)}</h3>
-    ${renderChat(result.compare.b.trace, result.compare.b.prompt)}
-  </section>`
-        : `<section class="conversation">
-    <h3>Conversation</h3>
-    ${renderChat(result.trace, result.prompt)}
-  </section>`}
+  ${renderCompareConversations(result)}
   </div>
 </details>`;
 }
@@ -589,6 +649,8 @@ function sharedReportCss() {
     --system-bubble: oklch(0.26 0.04 300);
     --tool: oklch(0.82 0.12 80);
     --tool-bubble: oklch(0.26 0.04 80);
+    --arm-a: oklch(0.72 0.12 250);
+    --arm-b: oklch(0.78 0.14 75);
   }
   @layer reset {
     * { box-sizing: border-box; }
@@ -605,6 +667,7 @@ function sharedReportCss() {
       word-spacing: 0.16em;
     }
     main { max-width: 68rem; margin-inline: auto; padding: 1.5rem 1.25rem 3rem; }
+    main:has(.compare-layout) { max-width: 96rem; }
     h1 { font-size: 1.7rem; font-weight: 650; letter-spacing: -0.02em; }
     h2 { font-size: 1.05rem; font-weight: 650; }
     h3 { font-size: 0.8rem; color: var(--muted); font-weight: 650; }
@@ -693,7 +756,9 @@ function sharedReportCss() {
   }
   details.scenario[open] summary { border-bottom: 1px solid var(--border); background: #17202d; }
   details.scenario summary::-webkit-details-marker { display: none; }
+  .scenario-heading { display: grid; gap: 0.1rem; min-width: 12rem; flex: 1 1 16rem; }
   .scenario-name { font-weight: 600; font-size: 0.9rem; }
+  .scenario-lede { color: var(--muted); font-size: 0.78rem; font-weight: 400; }
   .duration { color: var(--muted); margin-left: auto; font-variant-numeric: tabular-nums; }
   .badge {
     display: inline-block;
@@ -784,8 +849,47 @@ function sharedReportCss() {
   .shell-commands li { font-size: 0.8rem; background: #0b1017; border: 1px solid var(--border); border-radius: 6px; padding: 0.3rem 0.5rem; }
   code { font-family: ui-monospace, SFMono-Regular, Menlo, monospace; font-size: 0.85em; }
 
+  .compare-layout {
+    container-type: inline-size;
+    display: grid;
+    gap: 0.9rem;
+  }
+  .compare-arms {
+    display: grid;
+    grid-template-columns: minmax(0, 1fr) minmax(0, 1fr);
+    gap: 0.85rem;
+    align-items: stretch;
+  }
+  .compare-arm {
+    min-width: 0;
+    display: grid;
+    align-content: start;
+    gap: 0.65rem;
+    background: var(--panel-2);
+    border: 1px solid var(--border);
+    border-radius: 10px;
+    padding: 0.75rem 0.8rem 0.85rem;
+    border-block-start-width: 3px;
+  }
+  .compare-arm-a { border-block-start-color: var(--arm-a); }
+  .compare-arm-b { border-block-start-color: var(--arm-b); }
+  .compare-arm-header { display: grid; gap: 0.15rem; padding-bottom: 0.55rem; border-bottom: 1px solid var(--border); }
+  .compare-arm-kicker {
+    color: var(--muted);
+    font-size: 0.66rem;
+    font-weight: 700;
+    letter-spacing: 0.06em;
+    text-transform: uppercase;
+  }
+  .compare-arm-a .compare-arm-kicker { color: var(--arm-a); }
+  .compare-arm-b .compare-arm-kicker { color: var(--arm-b); }
+  .compare-arm-header h3 { color: var(--text); font-size: 0.95rem; }
+  .compare-arm-description { color: var(--muted); font-size: 0.8rem; }
+  .compare-arm-metrics { color: var(--muted); font-size: 0.78rem; font-variant-numeric: tabular-nums; }
+  .compare-arm .bubble, .compare-arm .tool-card { max-width: 100%; }
+
   .compare {
-    margin-top: 1.1rem;
+    margin-top: 0;
     background: var(--panel);
     border: 1px solid var(--border);
     border-radius: 10px;
@@ -793,6 +897,13 @@ function sharedReportCss() {
   }
   .compare-header { margin-bottom: 0.65rem; }
   .compare-header h3 { margin-bottom: 0.2rem; }
+  .compare-callouts {
+    margin: 0 0 0.75rem;
+    padding-left: 1.1rem;
+    display: grid;
+    gap: 0.25rem;
+    font-size: 0.85rem;
+  }
   .compare-table-wrap { overflow-x: auto; }
   .compare-table {
     width: 100%;
@@ -810,12 +921,19 @@ function sharedReportCss() {
   .delta-up { color: var(--fail); }
   .delta-down { color: var(--pass); }
   .delta-flat { color: var(--muted); }
+  .is-better { color: var(--pass); font-weight: 650; }
+  .is-worse { color: var(--muted); }
+
+  @container (max-width: 44rem) {
+    .compare-arms { grid-template-columns: minmax(0, 1fr); }
+  }
 
   @media (max-width: 720px) {
     main { padding: 0.75rem; }
     .suite-header { align-items: flex-start; flex-direction: column; gap: 0.2rem; }
     .diagnostics { grid-template-columns: 1fr; }
     .bubble, .tool-card { max-width: 92%; }
+    .compare-arms { grid-template-columns: minmax(0, 1fr); }
   }
   }
 `;
@@ -858,7 +976,7 @@ export function renderHtmlReport(reports, meta = {}) {
     <h2 id="guide-heading">How to read this report</h2>
     <ol>
       <li>The verdict is pass or fail. Tokens are cost, not the score.</li>
-      <li>Open a scenario for the criteria and the result. A compare scenario shows a time and token table, then two conversations.</li>
+      <li>Open a scenario for the criteria and the result. A compare scenario shows the two arms side by side, then a comparison of time, tokens, and tools.</li>
       <li>Typical is the middle scenario cost. Largest is the heaviest scenario.</li>
       <li>In is prompt and context. Out is generated text.</li>
     </ol>