@darkrishabh/bench-ai 1.0.0

package/README.md

@@ -0,0 +1,333 @@
+<div align="center">
+
+<img src="https://raw.githubusercontent.com/darkrishabh/bench-ai/master/docs/cover.png" alt="Bench AI cover" width="100%" />
+
+<br />
+<br />
+
+<h1>Bench AI</h1>
+
+<p>One prompt, many models — compare quality, speed, and cost.</p>
+
+<br />
+
+[![npm](https://img.shields.io/npm/v/@darkrishabh%2Fbench-ai?style=flat-square&color=black&label=%40darkrishabh%2Fbench-ai)](https://www.npmjs.com/package/@darkrishabh/bench-ai)
+[![License: MIT](https://img.shields.io/badge/license-MIT-black?style=flat-square)](./LICENSE)
+[![Node.js](https://img.shields.io/badge/node-%3E%3D18-black?style=flat-square&logo=node.js&logoColor=white)](https://nodejs.org)
+[![Live demo](https://img.shields.io/badge/demo-live-black?style=flat-square)](https://bench-ai-web.vercel.app/)
+[![GitHub](https://img.shields.io/badge/github-darkrishabh%2Fbench--ai-black?style=flat-square&logo=github)](https://github.com/darkrishabh/bench-ai)
+
+<br />
+
+[**Live demo →**](https://bench-ai-web.vercel.app/) &nbsp;·&nbsp; [Quick start](#quick-start) &nbsp;·&nbsp; [Web UI](#web-ui) &nbsp;·&nbsp; [CLI](#cli-usage) &nbsp;·&nbsp; [Providers](#providers) &nbsp;·&nbsp; [Eval suites](#eval-suites-yaml) &nbsp;·&nbsp; [Architecture](#architecture)
+
+</div>
+
+---
+
+**Bench AI** runs **one prompt against many LLMs** and lines up answers, latency, tokens, and cost in a single npm package: a **CLI** (binary **`bench-ai`**), a **Next.js web UI** (`bench-ai web`), and a **programmatic API** (`import { … } from "@darkrishabh/bench-ai"`).
+
+```bash
+npx @darkrishabh/bench-ai "Explain the CAP theorem in one paragraph" --models claude,ollama
+```
+
+Works on **macOS**, **Linux**, and **Windows** with **Node.js 18+**.
+
+---
+
+## Table of contents
+
+- [Why Bench AI?](#why-bench-ai)
+- [Features](#features)
+- [Quick start](#quick-start)
+- [Providers](#providers)
+- [Configuration](#configuration)
+- [Eval suites (YAML)](#eval-suites-yaml)
+- [Web UI](#web-ui)
+- [CLI usage](#cli-usage)
+- [Architecture](#architecture)
+- [Contributing](#contributing)
+- [License](#license)
+
+---
+
+## Why Bench AI?
+
+Picking the right model shouldn't mean mentally mapping *which output came from where*. Bench AI keeps every model's answer and metrics in one place so you can decide with data.
+
+> **Tip:** Use the **CLI** in CI and scripts (`--output json`). Use **`bench-ai web`** or the **hosted app** when you want a polished compare view, YAML test suites, and judge-backed rubrics — without restarting the server when you change models.
+
+---
+
+## Features
+
+| | |
+|---|---|
+| **Side-by-side compare** | Same prompt, every enabled model — outputs, errors, and metrics in one grid. |
+| **YAML eval suites** | Prompt templates × variable matrices × assertions (`contains`, `latency`, `cost`, `llm-rubric`). |
+| **Live suite logs** | Streamed run log in the web UI so you see each LLM and judge call as it happens. |
+| **OpenAI model list** | With an API key, the UI loads chat models from OpenAI's `/v1/models` (plus presets & "Other"). |
+| **Secrets & judge** | Web settings for secret variables, Anthropic/Ollama judge, and YAML import/export. |
+| **One package** | `npx @darkrishabh/bench-ai`, `npm i -g @darkrishabh/bench-ai`, `bench-ai web`, and `import … from "@darkrishabh/bench-ai"`. |
+
+---
+
+## Quick start
+
+### CLI — zero install
+
+```bash
+ANTHROPIC_API_KEY=sk-... npx @darkrishabh/bench-ai "What is LoRA?"
+
+npx @darkrishabh/bench-ai "Review this function" --file ./utils.py --models claude,ollama
+
+# Average latency over 5 runs
+npx @darkrishabh/bench-ai "Summarize this" --runs 5 --output json
+```
+
+The npm package is **scoped** as **`@darkrishabh/bench-ai`** because unscoped **`bench-ai`** is taken by another project and unscoped **`bench-ai`** is blocked as too similar. After **`npm i -g @darkrishabh/bench-ai`**, the CLI is **`bench-ai`** / **`bench-ai web`**.
+
+### Web UI — hosted
+
+Open [**https://bench-ai-web.vercel.app/**](https://bench-ai-web.vercel.app/). Add API keys under **Settings** in the browser; test suites live at `/suite`.
+
+### Web UI — local dev
+
+```bash
+git clone https://github.com/darkrishabh/bench-ai
+cd bench-ai
+npm install
+npm run dev
+```
+
+Then open [http://localhost:3000](http://localhost:3000) (or `3001` if 3000 is busy).
+
+From a global or local install you can also run:
+
+```bash
+bench-ai web
+```
+
+> **Note:** Suite streaming and eval need a Node deployment (not `output: 'export'`). The suite API sets a long `maxDuration` for hosts like Vercel; very heavy runs may still need a higher limit or a long-lived server.
+
+### Deploying on Vercel
+
+1. **Root Directory** → `.` (repository root), or leave empty if the Vercel project is linked to this repo only.
+2. **Build Command** → leave empty (uses root `vercel.json`: `npm run build`) or set explicitly to `npm run build`.
+3. **Install** → default `npm install` at the repo root.
+
+`next.config.ts` sets `outputFileTracingRoot` to the project root for correct serverless file tracing.
+
+---
+
+## Providers
+
+### Cloud APIs
+
+| Provider | Env var | Notes |
+|---|---|---|
+| **Claude** | `ANTHROPIC_API_KEY` | Haiku, Sonnet, Opus |
+| **OpenAI** | `OPENAI_API_KEY` | Full list in UI when key is set |
+| **Groq** | `GROQ_API_KEY` | Very fast inference |
+| **OpenRouter** | `OPENROUTER_API_KEY` | Many models, one key |
+| **Together** | `TOGETHER_API_KEY` | Open-weight models |
+| **NVIDIA NIM** | `NVIDIA_NIM_API_KEY` | NIM endpoints |
+| **Perplexity** | `PERPLEXITY_API_KEY` | Search-grounded |
+| **Minimax** | `MINIMAX_API_KEY` + `MINIMAX_GROUP_ID` | API + group ID |
+| **Custom** | — | Any OpenAI-compatible base URL |
+
+### Local & CLI
+
+| Provider | Requirements |
+|---|---|
+| **Ollama** | [ollama.ai](https://ollama.ai) — local tags discovered via `/api/models` |
+| **Claude CLI** | `@anthropic-ai/claude-code` on `PATH` |
+| **Codex CLI** | `@openai/codex` on `PATH` |
+| **LM Studio** | OpenAI-compatible server (e.g. `localhost:1234`) via **Custom** |
+
+---
+
+## Configuration
+
+Copy `.env.example` to `.env.local` for the web app, or export vars in your shell for the CLI.
+
+```bash
+ANTHROPIC_API_KEY=sk-ant-...
+OLLAMA_BASE_URL=http://localhost:11434   # optional
+
+OPENAI_API_KEY=sk-...
+GROQ_API_KEY=gsk_...
+OPENROUTER_API_KEY=sk-or-...
+TOGETHER_API_KEY=...
+NVIDIA_NIM_API_KEY=nvapi-...
+PERPLEXITY_API_KEY=pplx-...
+
+MINIMAX_API_KEY=...
+MINIMAX_GROUP_ID=...
+```
+
+---
+
+## Eval suites (YAML)
+
+Define prompt templates, test rows (`vars`), and assertions: `contains`, `not-contains`, `latency`, `cost`, and `llm-rubric` (needs a judge — Claude when a key is available, or `--judge ollama` / `none`).
+
+Full example: [`examples/bench-ai.yaml`](examples/bench-ai.yaml)
+
+```bash
+npx @darkrishabh/bench-ai run --config examples/bench-ai.yaml --models claude,ollama,minimax
+npx @darkrishabh/bench-ai run --config examples/bench-ai.yaml --output json --fail-on-error
+npx @darkrishabh/bench-ai run --config examples/bench-ai.yaml --judge none
+```
+
+With a global install (`npm i -g @darkrishabh/bench-ai`), use **`bench-ai run --config …`** instead of **`npx @darkrishabh/bench-ai`**.
+
+The web app runs the same engine at `POST /api/suite` with SSE live logs when `stream: true`.
+
+---
+
+## Web UI
+
+<div align="center">
+<img src="https://raw.githubusercontent.com/darkrishabh/bench-ai/master/docs/screenshot.png" alt="Bench AI web UI screenshot" width="100%" />
+</div>
+
+<br />
+
+| Capability | Description |
+|---|---|
+| **Run workspace** | Prompt card, colored model chips, **+ add model**, **Run**, then **Responses / Compare & evaluate / History** |
+| **Responses** | **Grid** (wrapping cards, 4+ models), **Side-by-side** (horizontal scroll), or **Diff** (line-level LCS between two outputs) |
+| **Model cards** | Provider label, model ID, highlight pills (fastest / slowest / cheapest / best rated), 3-column metrics, markdown body, star rating + **Copy** |
+| **Quick comparison** | Sticky footer mini-bars for latency, output tokens, and cost; **Full compare** jumps to the evaluate tab |
+| **History** | Last runs stored in `localStorage`; click an entry to reload prompt + results |
+| **Test suites** | `/suite` — YAML editor, run target banner, judge summary, live log, matrix results, recent runs (last 15, browser `localStorage`) |
+| **Settings** | Models, secrets, judge, YAML import/export — stored in `localStorage` |
+| **API routes** | `/api/diff`, `/api/suite`, `/api/models` (Ollama GET, OpenAI POST) |
+
+---
+
+## CLI usage
+
+The binary name is **`bench-ai`**. Use **`npx @darkrishabh/bench-ai …`** for one-off runs, or **`npm i -g @darkrishabh/bench-ai`** and then **`bench-ai …`**.
+
+Top-level: **`bench-ai --help`** — commands are **`diff`** (default), **`run`**, and **`web`**.
+
+### `diff` — one prompt across providers
+
+You can omit **`diff`**; it is the default command.
+
+```
+Usage: bench-ai diff [options] [prompt]
+
+Arguments:
+  prompt                     Prompt to send to all providers
+
+Options:
+  --file <path>              Append file contents to the prompt
+  --models <list>            Comma-separated providers (default: "claude,ollama")
+  --runs <n>                 Runs for latency averaging (default: 1)
+  --output <format>          pretty | json (default: "pretty")
+  -h, --help                 Show help for this command
+```
+
+Program options: **`-V` / `--version`**, **`-h` / `--help`** (when no subcommand).
+
+```bash
+bench-ai "Implement binary search in Python" --models claude,ollama
+bench-ai diff "Hello" --models groq,claude --runs 10 --output json | jq '.results[].latencyMs'
+bench-ai "Find bugs" --file ./server.ts
+bench-ai "Explain recursion" --models claude-cli,codex
+```
+
+### `run` — YAML eval suite
+
+```
+Usage: bench-ai run [options]
+
+Options:
+  --config <path>            Path to suite YAML (required)
+  --models <list>            Comma-separated providers (default: "claude,ollama")
+  --output <format>            pretty | json (default: "pretty")
+  --verbose                    Per-case assertion details and full prompts
+  --fail-on-error            Exit 1 if any provider result fails
+  --judge <name>             llm-rubric judge: auto | claude | ollama | none (default: "auto")
+  -h, --help                 Show help
+```
+
+Use **`npx @darkrishabh/bench-ai run …`** when the CLI is not installed globally.
+
+### `web` — local Next.js UI
+
+```
+Usage: bench-ai web [options]
+
+Options:
+  -p, --port <port>          Port to listen on (default: "3000")
+  -h, --help                 Show help
+```
+
+Starts the Next.js dev server from the **`@darkrishabh/bench-ai`** package directory (works with **`npx @darkrishabh/bench-ai`** and global installs).
+
+---
+
+## Architecture
+
+This repository is **one npm package at the root** (`@darkrishabh/bench-ai`): no workspaces or `packages/` split. Use **`npm install`** / **`npm run dev`** / **`npm run build`** from the clone root.
+
+```mermaid
+flowchart LR
+  subgraph clients [Clients]
+    CLI[CLI / Ink]
+    WEB[Next.js UI]
+  end
+
+  subgraph pkg [npm @darkrishabh/bench-ai]
+    ENG["Engine\nrunDiff · runSuite · providers"]
+    API[API routes]
+  end
+
+  CLI --> ENG
+  WEB --> API
+  API --> ENG
+  ENG --> P1[Claude / Ollama / OpenAI-compat …]
+```
+
+| Area | Role |
+|---|---|
+| **This repo** (npm **`@darkrishabh/bench-ai`**) | Engine (`src/engine`), CLI (`src/cli`, binary **`bench-ai`**), Next.js app (`src/app`, `src/components`, …) |
+| **`bench-ai web`** | Runs `next dev` with cwd at the installed package root |
+
+**Adding a provider** is on the order of tens of lines: implement `Provider` in the engine and wire it in the web API (and CLI config if needed). `OpenAICompatibleProvider` covers most REST APIs; subprocess adapters cover local CLIs.
+
+---
+
+## Contributing
+
+```bash
+git clone https://github.com/darkrishabh/bench-ai.git
+cd bench-ai
+npm install
+npm run dev          # engine watch + Next dev
+npm run build
+npm run type-check
+```
+
+If your local `origin` still uses the old repository name:
+
+```bash
+git remote set-url origin https://github.com/darkrishabh/bench-ai.git
+```
+
+Ideas that move the needle: new providers (Gemini, Bedrock, Azure OpenAI), richer diff UX, terminal markdown, tighter CI eval stories.
+
+---
+
+## License
+
+MIT — see [LICENSE](./LICENSE).
+
+<div align="center">
+<br />
+<sub>Built by <a href="https://github.com/darkrishabh">@darkrishabh</a></sub>
+</div>

package/dist/cli/app.d.ts

@@ -0,0 +1,11 @@
+import type { ProviderName, ProviderConfig } from "../engine/index.js";
+interface AppProps {
+    prompt: string;
+    providers: ProviderName[];
+    config: ProviderConfig;
+    runs: number;
+    outputFormat: "pretty" | "json";
+}
+export declare function App({ prompt, providers, config, runs, outputFormat }: AppProps): import("react/jsx-runtime").JSX.Element | null;
+export {};
+//# sourceMappingURL=app.d.ts.map

package/dist/cli/app.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"app.d.ts","sourceRoot":"","sources":["../../src/cli/app.tsx"],"names":[],"mappings":"AAGA,OAAO,KAAK,EAAc,YAAY,EAAE,cAAc,EAAE,MAAM,oBAAoB,CAAC;AAInF,UAAU,QAAQ;IAChB,MAAM,EAAE,MAAM,CAAC;IACf,SAAS,EAAE,YAAY,EAAE,CAAC;IAC1B,MAAM,EAAE,cAAc,CAAC;IACvB,IAAI,EAAE,MAAM,CAAC;IACb,YAAY,EAAE,QAAQ,GAAG,MAAM,CAAC;CACjC;AAED,wBAAgB,GAAG,CAAC,EAAE,MAAM,EAAE,SAAS,EAAE,MAAM,EAAE,IAAI,EAAE,YAAY,EAAE,EAAE,QAAQ,kDA2D9E"}

package/dist/cli/app.js

@@ -0,0 +1,48 @@
+import { jsx as _jsx, jsxs as _jsxs } from "react/jsx-runtime";
+import { useState, useEffect } from "react";
+import { Box, Text, useApp } from "ink";
+import { runDiff, runDiffMany } from "../engine/index.js";
+import { DiffView } from "./components/DiffView.js";
+import { Spinner } from "./components/Spinner.js";
+export function App({ prompt, providers, config, runs, outputFormat }) {
+    const { exit } = useApp();
+    const [loading, setLoading] = useState(true);
+    const [diffs, setDiffs] = useState([]);
+    const [error, setError] = useState(null);
+    useEffect(() => {
+        const run = async () => {
+            try {
+                if (runs > 1) {
+                    const results = await runDiffMany({ prompt, providers, config, runs });
+                    setDiffs(results);
+                }
+                else {
+                    const result = await runDiff({ prompt, providers, config });
+                    setDiffs([result]);
+                }
+            }
+            catch (err) {
+                setError(err instanceof Error ? err.message : String(err));
+            }
+            finally {
+                setLoading(false);
+                setTimeout(() => exit(), 50);
+            }
+        };
+        run();
+    }, []);
+    if (outputFormat === "json") {
+        if (!loading) {
+            process.stdout.write(JSON.stringify(diffs, null, 2) + "\n");
+        }
+        return null;
+    }
+    if (loading) {
+        return (_jsx(Box, { children: _jsx(Spinner, { label: `Querying ${providers.join(", ")}...` }) }));
+    }
+    if (error) {
+        return _jsxs(Text, { color: "red", children: ["Error: ", error] });
+    }
+    return (_jsx(Box, { flexDirection: "column", children: diffs.map((diff, i) => (_jsxs(Box, { flexDirection: "column", children: [diffs.length > 1 && (_jsxs(Text, { bold: true, color: "yellow", children: ["\u2014 Run ", i + 1, " of ", diffs.length, " \u2014"] })), _jsx(DiffView, { diff: diff })] }, i))) }));
+}
+//# sourceMappingURL=app.js.map

package/dist/cli/app.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"app.js","sourceRoot":"","sources":["../../src/cli/app.tsx"],"names":[],"mappings":";AAAA,OAAc,EAAE,QAAQ,EAAE,SAAS,EAAE,MAAM,OAAO,CAAC;AACnD,OAAO,EAAE,GAAG,EAAE,IAAI,EAAE,MAAM,EAAE,MAAM,KAAK,CAAC;AACxC,OAAO,EAAE,OAAO,EAAE,WAAW,EAAE,MAAM,oBAAoB,CAAC;AAE1D,OAAO,EAAE,QAAQ,EAAE,MAAM,0BAA0B,CAAC;AACpD,OAAO,EAAE,OAAO,EAAE,MAAM,yBAAyB,CAAC;AAUlD,MAAM,UAAU,GAAG,CAAC,EAAE,MAAM,EAAE,SAAS,EAAE,MAAM,EAAE,IAAI,EAAE,YAAY,EAAY;IAC7E,MAAM,EAAE,IAAI,EAAE,GAAG,MAAM,EAAE,CAAC;IAC1B,MAAM,CAAC,OAAO,EAAE,UAAU,CAAC,GAAG,QAAQ,CAAC,IAAI,CAAC,CAAC;IAC7C,MAAM,CAAC,KAAK,EAAE,QAAQ,CAAC,GAAG,QAAQ,CAAe,EAAE,CAAC,CAAC;IACrD,MAAM,CAAC,KAAK,EAAE,QAAQ,CAAC,GAAG,QAAQ,CAAgB,IAAI,CAAC,CAAC;IAExD,SAAS,CAAC,GAAG,EAAE;QACb,MAAM,GAAG,GAAG,KAAK,IAAI,EAAE;YACrB,IAAI,CAAC;gBACH,IAAI,IAAI,GAAG,CAAC,EAAE,CAAC;oBACb,MAAM,OAAO,GAAG,MAAM,WAAW,CAAC,EAAE,MAAM,EAAE,SAAS,EAAE,MAAM,EAAE,IAAI,EAAE,CAAC,CAAC;oBACvE,QAAQ,CAAC,OAAO,CAAC,CAAC;gBACpB,CAAC;qBAAM,CAAC;oBACN,MAAM,MAAM,GAAG,MAAM,OAAO,CAAC,EAAE,MAAM,EAAE,SAAS,EAAE,MAAM,EAAE,CAAC,CAAC;oBAC5D,QAAQ,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC;gBACrB,CAAC;YACH,CAAC;YAAC,OAAO,GAAG,EAAE,CAAC;gBACb,QAAQ,CAAC,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC;YAC7D,CAAC;oBAAS,CAAC;gBACT,UAAU,CAAC,KAAK,CAAC,CAAC;gBAClB,UAAU,CAAC,GAAG,EAAE,CAAC,IAAI,EAAE,EAAE,EAAE,CAAC,CAAC;YAC/B,CAAC;QACH,CAAC,CAAC;QACF,GAAG,EAAE,CAAC;IACR,CAAC,EAAE,EAAE,CAAC,CAAC;IAEP,IAAI,YAAY,KAAK,MAAM,EAAE,CAAC;QAC5B,IAAI,CAAC,OAAO,EAAE,CAAC;YACb,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,IAAI,CAAC,SAAS,CAAC,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC,GAAG,IAAI,CAAC,CAAC;QAC9D,CAAC;QACD,OAAO,IAAI,CAAC;IACd,CAAC;IAED,IAAI,OAAO,EAAE,CAAC;QACZ,OAAO,CACL,KAAC,GAAG,cACF,KAAC,OAAO,IAAC,KAAK,EAAE,YAAY,SAAS,CAAC,IAAI,CAAC,IAAI,CAAC,KAAK,GAAI,GACrD,CACP,CAAC;IACJ,CAAC;IAED,IAAI,KAAK,EAAE,CAAC;QACV,OAAO,MAAC,IAAI,IAAC,KAAK,EAAC,KAAK,wBAAS,KAAK,IAAQ,CAAC;IACjD,CAAC;IAED,OAAO,CACL,KAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,YACxB,KAAK,CAAC,GAAG,CAAC,CAAC,IAAI,EAAE,CAAC,EAAE,EAAE,CAAC,CACtB,MAAC,GAAG,IAAS,aAAa,EAAC,QAAQ,aAChC,KAAK,CAAC,MAAM,GAAG,CAAC,IAAI,CACnB,MAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,QAAQ,4BAChB,CAAC,GAAG,CAAC,UAAM,KAAK,CAAC,MAAM,eACzB,CACR,EACD,KAAC,QAAQ,IAAC,IAAI,EAAE,IAAI,GAAI,KANhB,CAAC,CAOL,CACP,CAAC,GACE,CACP,CAAC;AACJ,CAAC"}

package/dist/cli/components/DiffView.d.ts

@@ -0,0 +1,5 @@
+import type { DiffResult } from "../../engine/index.js";
+export declare function DiffView({ diff }: {
+    diff: DiffResult;
+}): import("react/jsx-runtime").JSX.Element;
+//# sourceMappingURL=DiffView.d.ts.map

package/dist/cli/components/DiffView.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"DiffView.d.ts","sourceRoot":"","sources":["../../../src/cli/components/DiffView.tsx"],"names":[],"mappings":"AAEA,OAAO,KAAK,EAAE,UAAU,EAAkB,MAAM,uBAAuB,CAAC;AAoCxE,wBAAgB,QAAQ,CAAC,EAAE,IAAI,EAAE,EAAE;IAAE,IAAI,EAAE,UAAU,CAAA;CAAE,2CAetD"}

package/dist/cli/components/DiffView.js

@@ -0,0 +1,14 @@
+import { jsxs as _jsxs, jsx as _jsx } from "react/jsx-runtime";
+import { Box, Text } from "ink";
+import { formatCost } from "../../engine/index.js";
+function ProviderCard({ result }) {
+    const color = result.error ? "red" : "green";
+    const latency = `${result.latencyMs}ms`;
+    const tokens = `${result.inputTokens}→${result.outputTokens} tok`;
+    const cost = formatCost(result.costUsd);
+    return (_jsxs(Box, { flexDirection: "column", borderStyle: "round", borderColor: color, paddingX: 1, marginBottom: 1, children: [_jsxs(Box, { justifyContent: "space-between", children: [_jsxs(Text, { bold: true, color: color, children: [result.provider.toUpperCase(), " (", result.model, ")"] }), _jsxs(Text, { dimColor: true, children: [latency, "  ", tokens, "  ", cost] })] }), _jsx(Box, { marginTop: 1, children: result.error ? (_jsxs(Text, { color: "red", children: ["Error: ", result.error] })) : (_jsx(Text, { wrap: "wrap", children: result.output })) })] }));
+}
+export function DiffView({ diff }) {
+    return (_jsxs(Box, { flexDirection: "column", children: [_jsxs(Box, { marginBottom: 1, children: [_jsx(Text, { bold: true, children: "Prompt: " }), _jsx(Text, { color: "cyan", wrap: "wrap", children: diff.prompt })] }), diff.results.map((r) => (_jsx(ProviderCard, { result: r }, r.provider))), _jsxs(Text, { dimColor: true, children: ["Ran at ", diff.ranAt] })] }));
+}
+//# sourceMappingURL=DiffView.js.map

package/dist/cli/components/DiffView.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"DiffView.js","sourceRoot":"","sources":["../../../src/cli/components/DiffView.tsx"],"names":[],"mappings":";AACA,OAAO,EAAE,GAAG,EAAE,IAAI,EAAE,MAAM,KAAK,CAAC;AAEhC,OAAO,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AAEnD,SAAS,YAAY,CAAC,EAAE,MAAM,EAA8B;IAC1D,MAAM,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,OAAO,CAAC;IAC7C,MAAM,OAAO,GAAG,GAAG,MAAM,CAAC,SAAS,IAAI,CAAC;IACxC,MAAM,MAAM,GAAG,GAAG,MAAM,CAAC,WAAW,IAAI,MAAM,CAAC,YAAY,MAAM,CAAC;IAClE,MAAM,IAAI,GAAG,UAAU,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC;IAExC,OAAO,CACL,MAAC,GAAG,IACF,aAAa,EAAC,QAAQ,EACtB,WAAW,EAAC,OAAO,EACnB,WAAW,EAAE,KAAK,EAClB,QAAQ,EAAE,CAAC,EACX,YAAY,EAAE,CAAC,aAEf,MAAC,GAAG,IAAC,cAAc,EAAC,eAAe,aACjC,MAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAE,KAAK,aACpB,MAAM,CAAC,QAAQ,CAAC,WAAW,EAAE,QAAI,MAAM,CAAC,KAAK,SACzC,EACP,MAAC,IAAI,IAAC,QAAQ,mBACX,OAAO,QAAI,MAAM,QAAI,IAAI,IACrB,IACH,EACN,KAAC,GAAG,IAAC,SAAS,EAAE,CAAC,YACd,MAAM,CAAC,KAAK,CAAC,CAAC,CAAC,CACd,MAAC,IAAI,IAAC,KAAK,EAAC,KAAK,wBAAS,MAAM,CAAC,KAAK,IAAQ,CAC/C,CAAC,CAAC,CAAC,CACF,KAAC,IAAI,IAAC,IAAI,EAAC,MAAM,YAAE,MAAM,CAAC,MAAM,GAAQ,CACzC,GACG,IACF,CACP,CAAC;AACJ,CAAC;AAED,MAAM,UAAU,QAAQ,CAAC,EAAE,IAAI,EAAwB;IACrD,OAAO,CACL,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,aACzB,MAAC,GAAG,IAAC,YAAY,EAAE,CAAC,aAClB,KAAC,IAAI,IAAC,IAAI,+BAAgB,EAC1B,KAAC,IAAI,IAAC,KAAK,EAAC,MAAM,EAAC,IAAI,EAAC,MAAM,YAC3B,IAAI,CAAC,MAAM,GACP,IACH,EACL,IAAI,CAAC,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CACvB,KAAC,YAAY,IAAkB,MAAM,EAAE,CAAC,IAArB,CAAC,CAAC,QAAQ,CAAe,CAC7C,CAAC,EACF,MAAC,IAAI,IAAC,QAAQ,8BAAS,IAAI,CAAC,KAAK,IAAQ,IACrC,CACP,CAAC;AACJ,CAAC"}

package/dist/cli/components/EvalView.d.ts

@@ -0,0 +1,6 @@
+import type { SuiteResult } from "../../engine/index.js";
+export declare function EvalView({ result, verbose }: {
+    result: SuiteResult;
+    verbose?: boolean;
+}): import("react/jsx-runtime").JSX.Element;
+//# sourceMappingURL=EvalView.d.ts.map

package/dist/cli/components/EvalView.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"EvalView.d.ts","sourceRoot":"","sources":["../../../src/cli/components/EvalView.tsx"],"names":[],"mappings":"AAEA,OAAO,KAAK,EAAE,WAAW,EAAuD,MAAM,uBAAuB,CAAC;AAmO9G,wBAAgB,QAAQ,CAAC,EAAE,MAAM,EAAE,OAAe,EAAE,EAAE;IAAE,MAAM,EAAE,WAAW,CAAC;IAAC,OAAO,CAAC,EAAE,OAAO,CAAA;CAAE,2CA8B/F"}

package/dist/cli/components/EvalView.js

@@ -0,0 +1,82 @@
+import { jsx as _jsx, jsxs as _jsxs } from "react/jsx-runtime";
+import { Box, Text } from "ink";
+import { formatCost } from "../../engine/index.js";
+// ─── Helpers ──────────────────────────────────────────────────────────────────
+function pct(n) {
+    return `${Math.round(n * 100)}%`;
+}
+function bar(score, width = 12) {
+    const filled = Math.round(score * width);
+    return "█".repeat(filled) + "░".repeat(width - filled);
+}
+function scoreColor(score) {
+    if (score >= 0.8)
+        return "green";
+    if (score >= 0.5)
+        return "yellow";
+    return "red";
+}
+// ─── Summary table ────────────────────────────────────────────────────────────
+function SummaryTable({ summary }) {
+    const colW = { provider: 20, model: 24, score: 18, pass: 10, latency: 12, cost: 10 };
+    return (_jsxs(Box, { flexDirection: "column", marginBottom: 1, children: [_jsx(Text, { bold: true, color: "cyan", children: " Summary" }), _jsxs(Box, { children: [_jsx(Text, { bold: true, dimColor: true, children: "Provider".padEnd(colW.provider) }), _jsx(Text, { bold: true, dimColor: true, children: "Model".padEnd(colW.model) }), _jsx(Text, { bold: true, dimColor: true, children: "Score".padEnd(colW.score) }), _jsx(Text, { bold: true, dimColor: true, children: "Pass/Total".padEnd(colW.pass) }), _jsx(Text, { bold: true, dimColor: true, children: "Avg Latency".padEnd(colW.latency) }), _jsx(Text, { bold: true, dimColor: true, children: "Total Cost" })] }), _jsx(Text, { dimColor: true, children: "─".repeat(colW.provider + colW.model + colW.score + colW.pass + colW.latency + colW.cost) }), summary.map((s) => (_jsxs(Box, { children: [_jsx(Text, { children: s.provider.padEnd(colW.provider) }), _jsx(Text, { dimColor: true, children: s.model.slice(0, colW.model - 2).padEnd(colW.model) }), _jsx(Text, { color: scoreColor(s.score), children: `${bar(s.score)} ${pct(s.score)}`.padEnd(colW.score) }), _jsx(Text, { children: `${s.passed}/${s.total}`.padEnd(colW.pass) }), _jsx(Text, { dimColor: true, children: `${s.avgLatencyMs}ms`.padEnd(colW.latency) }), _jsx(Text, { dimColor: true, children: s.totalCostUsd === 0 ? "$0.00" : formatCost(s.totalCostUsd) })] }, `${s.provider}/${s.model}`)))] }));
+}
+// ─── Case × provider matrix (default view) ────────────────────────────────────
+const COL_CASE = 42;
+const COL_CELL = 11;
+function userAssertions(pr) {
+    return pr.assertions.filter((a) => a.type !== "provider-error");
+}
+function MatrixCell({ pr }) {
+    const w = COL_CELL;
+    if (!pr) {
+        return (_jsx(Box, { width: w, flexShrink: 0, children: _jsx(Text, { dimColor: true, children: "—".padStart(w - 1) }) }));
+    }
+    if (pr.error) {
+        return (_jsx(Box, { width: w, flexShrink: 0, children: _jsx(Text, { color: "red", bold: true, children: "ERR".padEnd(w - 1) }) }));
+    }
+    const ua = userAssertions(pr);
+    const suffix = ua.length > 0 ? ` ${ua.filter((a) => a.pass).length}/${ua.length}` : "";
+    const label = `${pr.pass ? "✓" : "✗"}${suffix}`.slice(0, w - 1).padEnd(w - 1);
+    return (_jsx(Box, { width: w, flexShrink: 0, children: _jsx(Text, { color: pr.pass ? "green" : "red", children: label }) }));
+}
+function CaseMatrix({ cases, providerOrder, }) {
+    return (_jsxs(Box, { flexDirection: "column", marginBottom: 1, children: [_jsx(Text, { bold: true, color: "cyan", children: " Test matrix" }), _jsx(Text, { dimColor: true, children: " Rows = test cases \u00B7 Columns = providers (\u2713/\u2717, assertion pass/total)" }), _jsxs(Box, { marginTop: 1, children: [_jsx(Box, { width: 4, flexShrink: 0, children: _jsx(Text, { bold: true, dimColor: true, children: "#".padEnd(3) }) }), _jsx(Box, { width: COL_CASE, flexShrink: 0, children: _jsx(Text, { bold: true, dimColor: true, children: "Case".padEnd(COL_CASE - 1) }) }), providerOrder.map((key) => {
+                        const short = key.includes("/") ? key.split("/")[0] : key;
+                        const head = short.slice(0, COL_CELL - 2).padEnd(COL_CELL - 1);
+                        return (_jsx(Box, { width: COL_CELL, flexShrink: 0, children: _jsx(Text, { bold: true, dimColor: true, children: head }) }, key));
+                    })] }), _jsx(Text, { dimColor: true, children: "─".repeat(4 + COL_CASE + providerOrder.length * COL_CELL) }), cases.map((c, i) => {
+                const prompt = c.prompt.length > COL_CASE - 2
+                    ? c.prompt.slice(0, COL_CASE - 4) + "… "
+                    : c.prompt.padEnd(COL_CASE - 1);
+                return (_jsxs(Box, { children: [_jsx(Box, { width: 4, flexShrink: 0, children: _jsx(Text, { dimColor: true, children: `${i + 1}`.padEnd(3) }) }), _jsx(Box, { width: COL_CASE, flexShrink: 0, children: _jsx(Text, { children: prompt }) }), providerOrder.map((key) => {
+                            const pr = c.providerResults.find((r) => `${r.provider}/${r.model}` === key);
+                            return _jsx(MatrixCell, { pr: pr }, key);
+                        })] }, i));
+            })] }));
+}
+// ─── Per-case rows ────────────────────────────────────────────────────────────
+function CaseRow({ c, idx, providerOrder }) {
+    const prompt = c.prompt.length > 60 ? c.prompt.slice(0, 57) + "…" : c.prompt;
+    const varStr = Object.entries(c.vars).map(([k, v]) => `${k}=${v}`).join(", ");
+    return (_jsxs(Box, { flexDirection: "column", marginBottom: 1, children: [_jsxs(Box, { children: [_jsxs(Text, { bold: true, color: "cyan", children: ["#", idx + 1, " "] }), _jsx(Text, { wrap: "truncate-end", children: prompt }), varStr && _jsxs(Text, { dimColor: true, children: [" (", varStr, ")"] })] }), providerOrder.map((key) => {
+                const pr = c.providerResults.find((r) => `${r.provider}/${r.model}` === key);
+                if (!pr)
+                    return null;
+                const icon = pr.error ? "✗" : pr.pass ? "✓" : "✗";
+                const color = pr.error ? "red" : pr.pass ? "green" : "red";
+                const label = `${pr.provider}/${pr.model}`;
+                return (_jsxs(Box, { marginLeft: 2, flexDirection: "column", children: [_jsxs(Box, { gap: 1, children: [_jsx(Text, { color: color, children: icon }), _jsx(Text, { dimColor: true, children: label.slice(0, 36).padEnd(36) }), !pr.error && (_jsxs(Text, { dimColor: true, children: [pr.latencyMs, "ms"] }))] }), pr.assertions
+                            .filter((a) => !(pr.error && a.type === "provider-error"))
+                            .map((a, i) => a.type === "llm-rubric" ? (_jsxs(Box, { marginLeft: 4, flexDirection: "column", marginBottom: 1, children: [_jsxs(Box, { flexDirection: "row", gap: 1, children: [_jsxs(Text, { bold: true, color: "magenta", children: ["[", a.type, "]"] }), _jsx(Text, { bold: true, color: a.pass ? "green" : "red", children: a.pass ? "Pass" : "Fail" })] }), a.rubricCriterion ? (_jsxs(Box, { marginLeft: 2, flexDirection: "column", children: [_jsx(Text, { dimColor: true, children: "Rubric:" }), _jsx(Text, { wrap: "wrap", children: a.rubricCriterion })] })) : null, _jsxs(Box, { marginLeft: 2, flexDirection: "column", children: [_jsxs(Text, { dimColor: true, children: [a.pass ? "Why it passed" : "Why it failed", ":"] }), _jsx(Text, { wrap: "wrap", children: a.reason ?? "—" })] })] }, i)) : (_jsxs(Box, { marginLeft: 4, children: [_jsxs(Text, { color: a.pass ? "green" : "red", children: [a.pass ? "✓" : "✗", " "] }), _jsxs(Text, { dimColor: true, children: ["[", a.type, "]"] }), a.reason && _jsxs(Text, { dimColor: true, children: [" \u2014 ", a.reason] })] }, i))), pr.error && (_jsx(Box, { marginLeft: 4, children: _jsxs(Text, { color: "red", children: ["Error: ", pr.error] }) }))] }, key));
+            })] }));
+}
+// ─── Main component ───────────────────────────────────────────────────────────
+export function EvalView({ result, verbose = false }) {
+    const providerOrder = result.summary.map((s) => `${s.provider}/${s.model}`);
+    const allPassed = result.summary.every((s) => s.failed === 0);
+    return (_jsxs(Box, { flexDirection: "column", children: [_jsxs(Box, { marginBottom: 1, children: [_jsx(Text, { bold: true, color: allPassed ? "green" : "red", children: allPassed
+                            ? "✓ All test results passed"
+                            : `✗ ${result.summary.reduce((acc, s) => acc + s.failed, 0)} failed (provider × case)` }), _jsxs(Text, { dimColor: true, children: ["  (", result.cases.length, " test case", result.cases.length !== 1 ? "s" : "", ", ", result.summary.length, " provider", result.summary.length !== 1 ? "s" : "", ")"] })] }), _jsx(SummaryTable, { summary: result.summary }), _jsx(CaseMatrix, { cases: result.cases, providerOrder: providerOrder }), verbose && (_jsxs(Box, { flexDirection: "column", children: [_jsx(Text, { bold: true, color: "cyan", children: " Details" }), _jsx(Text, { dimColor: true, children: "─".repeat(80) }), result.cases.map((c, i) => (_jsx(CaseRow, { c: c, idx: i, providerOrder: providerOrder }, i)))] }))] }));
+}
+//# sourceMappingURL=EvalView.js.map

package/dist/cli/components/EvalView.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"EvalView.js","sourceRoot":"","sources":["../../../src/cli/components/EvalView.tsx"],"names":[],"mappings":";AACA,OAAO,EAAE,GAAG,EAAE,IAAI,EAAE,MAAM,KAAK,CAAC;AAEhC,OAAO,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AAEnD,iFAAiF;AAEjF,SAAS,GAAG,CAAC,CAAS;IACpB,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,CAAC,GAAG,GAAG,CAAC,GAAG,CAAC;AACnC,CAAC;AAED,SAAS,GAAG,CAAC,KAAa,EAAE,KAAK,GAAG,EAAE;IACpC,MAAM,MAAM,GAAG,IAAI,CAAC,KAAK,CAAC,KAAK,GAAG,KAAK,CAAC,CAAC;IACzC,OAAO,GAAG,CAAC,MAAM,CAAC,MAAM,CAAC,GAAG,GAAG,CAAC,MAAM,CAAC,KAAK,GAAG,MAAM,CAAC,CAAC;AACzD,CAAC;AAED,SAAS,UAAU,CAAC,KAAa;IAC/B,IAAI,KAAK,IAAI,GAAG;QAAE,OAAO,OAAO,CAAC;IACjC,IAAI,KAAK,IAAI,GAAG;QAAE,OAAO,QAAQ,CAAC;IAClC,OAAO,KAAK,CAAC;AACf,CAAC;AAED,iFAAiF;AAEjF,SAAS,YAAY,CAAC,EAAE,OAAO,EAAkC;IAC/D,MAAM,IAAI,GAAG,EAAE,QAAQ,EAAE,EAAE,EAAE,KAAK,EAAE,EAAE,EAAE,KAAK,EAAE,EAAE,EAAE,IAAI,EAAE,EAAE,EAAE,OAAO,EAAE,EAAE,EAAE,IAAI,EAAE,EAAE,EAAE,CAAC;IAErF,OAAO,CACL,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,EAAC,YAAY,EAAE,CAAC,aACzC,KAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,MAAM,yBAAgB,EACvC,MAAC,GAAG,eACF,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,UAAU,CAAC,MAAM,CAAC,IAAI,CAAC,QAAQ,CAAC,GAAQ,EAC7D,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,OAAO,CAAC,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,GAAQ,EACvD,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,OAAO,CAAC,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,GAAQ,EACvD,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,YAAY,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,GAAQ,EAC3D,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,aAAa,CAAC,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,GAAQ,EAC/D,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAAE,YAAY,GAAQ,IACrC,EACN,KAAC,IAAI,IAAC,QAAQ,kBAAE,GAAG,CAAC,MAAM,CAAC,IAAI,CAAC,QAAQ,GAAG,IAAI,CAAC,KAAK,GAAG,IAAI,CAAC,KAAK,GAAG,IAAI,CAAC,IAAI,GAAG,IAAI,CAAC,OAAO,GAAG,IAAI,CAAC,IAAI,CAAC,GAAQ,EACjH,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAClB,MAAC,GAAG,eACF,KAAC,IAAI,cAAE,CAAC,CAAC,QAAQ,CAAC,MAAM,CAAC,IAAI,CAAC,QAAQ,CAAC,GAAQ,EAC/C,KAAC,IAAI,IAAC,QAAQ,kBAAE,CAAC,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC,EAAE,IAAI,CAAC,KAAK,GAAG,CAAC,CAAC,CAAC,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,GAAQ,EAC3E,KAAC,IAAI,IAAC,KAAK,EAAE,UAAU,CAAC,CAAC,CAAC,KAAK,CAAC,YAC7B,GAAG,GAAG,CAAC,CAAC,CAAC,KAAK,CAAC,IAAI,GAAG,CAAC,CAAC,CAAC,KAAK,CAAC,EAAE,CAAC,MAAM,CAAC,IAAI,CAAC,KAAK,CAAC,GAChD,EACP,KAAC,IAAI,cAAE,GAAG,CAAC,CAAC,MAAM,IAAI,CAAC,CAAC,KAAK,EAAE,CAAC,MAAM,CAAC,IAAI,CAAC,IAAI,CAAC,GAAQ,EACzD,KAAC,IAAI,IAAC,QAAQ,kBAAE,GAAG,CAAC,CAAC,YAAY,IAAI,CAAC,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,GAAQ,EAClE,KAAC,IAAI,IAAC,QAAQ,kBAAE,CAAC,CAAC,YAAY,KAAK,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,YAAY,CAAC,GAAQ,KAR3E,GAAG,CAAC,CAAC,QAAQ,IAAI,CAAC,CAAC,KAAK,EAAE,CAS9B,CACP,CAAC,IACE,CACP,CAAC;AACJ,CAAC;AAED,iFAAiF;AAEjF,MAAM,QAAQ,GAAG,EAAE,CAAC;AACpB,MAAM,QAAQ,GAAG,EAAE,CAAC;AAEpB,SAAS,cAAc,CAAC,EAAsB;IAC5C,OAAO,EAAE,CAAC,UAAU,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,KAAK,gBAAgB,CAAC,CAAC;AAClE,CAAC;AAED,SAAS,UAAU,CAAC,EAAE,EAAE,EAA0C;IAChE,MAAM,CAAC,GAAG,QAAQ,CAAC;IACnB,IAAI,CAAC,EAAE,EAAE,CAAC;QACR,OAAO,CACL,KAAC,GAAG,IAAC,KAAK,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC,YAC1B,KAAC,IAAI,IAAC,QAAQ,kBAAE,GAAG,CAAC,QAAQ,CAAC,CAAC,GAAG,CAAC,CAAC,GAAQ,GACvC,CACP,CAAC;IACJ,CAAC;IACD,IAAI,EAAE,CAAC,KAAK,EAAE,CAAC;QACb,OAAO,CACL,KAAC,GAAG,IAAC,KAAK,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC,YAC1B,KAAC,IAAI,IAAC,KAAK,EAAC,KAAK,EAAC,IAAI,kBACnB,KAAK,CAAC,MAAM,CAAC,CAAC,GAAG,CAAC,CAAC,GACf,GACH,CACP,CAAC;IACJ,CAAC;IACD,MAAM,EAAE,GAAG,cAAc,CAAC,EAAE,CAAC,CAAC;IAC9B,MAAM,MAAM,GACV,EAAE,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,IAAI,EAAE,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,MAAM,IAAI,EAAE,CAAC,MAAM,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC;IAC1E,MAAM,KAAK,GAAG,GAAG,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,GAAG,MAAM,EAAE,CAAC,KAAK,CAAC,CAAC,EAAE,CAAC,GAAG,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC;IAC9E,OAAO,CACL,KAAC,GAAG,IAAC,KAAK,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC,YAC1B,KAAC,IAAI,IAAC,KAAK,EAAE,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,YAAG,KAAK,GAAQ,GAClD,CACP,CAAC;AACJ,CAAC;AAED,SAAS,UAAU,CAAC,EAClB,KAAK,EACL,aAAa,GAId;IACC,OAAO,CACL,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,EAAC,YAAY,EAAE,CAAC,aACzC,KAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,MAAM,6BAAoB,EAC3C,KAAC,IAAI,IAAC,QAAQ,0GAA4E,EAC1F,MAAC,GAAG,IAAC,SAAS,EAAE,CAAC,aACf,KAAC,GAAG,IAAC,KAAK,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC,YAC1B,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAChB,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,GACT,GACH,EACN,KAAC,GAAG,IAAC,KAAK,EAAE,QAAQ,EAAE,UAAU,EAAE,CAAC,YACjC,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAChB,MAAM,CAAC,MAAM,CAAC,QAAQ,GAAG,CAAC,CAAC,GACvB,GACH,EACL,aAAa,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE;wBACzB,MAAM,KAAK,GAAG,GAAG,CAAC,QAAQ,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,CAAE,CAAC,CAAC,CAAC,GAAG,CAAC;wBAC3D,MAAM,IAAI,GAAG,KAAK,CAAC,KAAK,CAAC,CAAC,EAAE,QAAQ,GAAG,CAAC,CAAC,CAAC,MAAM,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;wBAC/D,OAAO,CACL,KAAC,GAAG,IAAW,KAAK,EAAE,QAAQ,EAAE,UAAU,EAAE,CAAC,YAC3C,KAAC,IAAI,IAAC,IAAI,QAAC,QAAQ,kBAChB,IAAI,GACA,IAHC,GAAG,CAIP,CACP,CAAC;oBACJ,CAAC,CAAC,IACE,EACN,KAAC,IAAI,IAAC,QAAQ,kBACX,GAAG,CAAC,MAAM,CAAC,CAAC,GAAG,QAAQ,GAAG,aAAa,CAAC,MAAM,GAAG,QAAQ,CAAC,GACtD,EACN,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE;gBAClB,MAAM,MAAM,GACV,CAAC,CAAC,MAAM,CAAC,MAAM,GAAG,QAAQ,GAAG,CAAC;oBAC5B,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,QAAQ,GAAG,CAAC,CAAC,GAAG,IAAI;oBACxC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,MAAM,CAAC,QAAQ,GAAG,CAAC,CAAC,CAAC;gBACpC,OAAO,CACL,MAAC,GAAG,eACF,KAAC,GAAG,IAAC,KAAK,EAAE,CAAC,EAAE,UAAU,EAAE,CAAC,YAC1B,KAAC,IAAI,IAAC,QAAQ,kBAAE,GAAG,CAAC,GAAG,CAAC,EAAE,CAAC,MAAM,CAAC,CAAC,CAAC,GAAQ,GACxC,EACN,KAAC,GAAG,IAAC,KAAK,EAAE,QAAQ,EAAE,UAAU,EAAE,CAAC,YACjC,KAAC,IAAI,cAAE,MAAM,GAAQ,GACjB,EACL,aAAa,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE;4BACzB,MAAM,EAAE,GAAG,CAAC,CAAC,eAAe,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,GAAG,CAAC,CAAC,QAAQ,IAAI,CAAC,CAAC,KAAK,EAAE,KAAK,GAAG,CAAC,CAAC;4BAC7E,OAAO,KAAC,UAAU,IAAW,EAAE,EAAE,EAAE,IAAX,GAAG,CAAY,CAAC;wBAC1C,CAAC,CAAC,KAVM,CAAC,CAWL,CACP,CAAC;YACJ,CAAC,CAAC,IACE,CACP,CAAC;AACJ,CAAC;AAED,iFAAiF;AAEjF,SAAS,OAAO,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,aAAa,EAA+D;IACrG,MAAM,MAAM,GAAG,CAAC,CAAC,MAAM,CAAC,MAAM,GAAG,EAAE,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,EAAE,CAAC,GAAG,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,MAAM,CAAC;IAC7E,MAAM,MAAM,GAAG,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,EAAE,EAAE,CAAC,GAAG,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IAE9E,OAAO,CACL,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,EAAC,YAAY,EAAE,CAAC,aACzC,MAAC,GAAG,eACF,MAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,MAAM,kBAAG,GAAG,GAAG,CAAC,SAAS,EAC1C,KAAC,IAAI,IAAC,IAAI,EAAC,cAAc,YAAE,MAAM,GAAQ,EACxC,MAAM,IAAI,MAAC,IAAI,IAAC,QAAQ,yBAAI,MAAM,SAAS,IACxC,EACL,aAAa,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,EAAE;gBACzB,MAAM,EAAE,GAAG,CAAC,CAAC,eAAe,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,GAAG,CAAC,CAAC,QAAQ,IAAI,CAAC,CAAC,KAAK,EAAE,KAAK,GAAG,CAAC,CAAC;gBAC7E,IAAI,CAAC,EAAE;oBAAE,OAAO,IAAI,CAAC;gBACrB,MAAM,IAAI,GAAG,EAAE,CAAC,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,CAAC;gBAClD,MAAM,KAAK,GAAG,EAAE,CAAC,KAAK,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,CAAC,EAAE,CAAC,IAAI,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,CAAC;gBAC3D,MAAM,KAAK,GAAG,GAAG,EAAE,CAAC,QAAQ,IAAI,EAAE,CAAC,KAAK,EAAE,CAAC;gBAE3C,OAAO,CACL,MAAC,GAAG,IAAW,UAAU,EAAE,CAAC,EAAE,aAAa,EAAC,QAAQ,aAClD,MAAC,GAAG,IAAC,GAAG,EAAE,CAAC,aACT,KAAC,IAAI,IAAC,KAAK,EAAE,KAAK,YAAG,IAAI,GAAQ,EACjC,KAAC,IAAI,IAAC,QAAQ,kBAAE,KAAK,CAAC,KAAK,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,MAAM,CAAC,EAAE,CAAC,GAAQ,EACpD,CAAC,EAAE,CAAC,KAAK,IAAI,CACZ,MAAC,IAAI,IAAC,QAAQ,mBAAE,EAAE,CAAC,SAAS,UAAU,CACvC,IACG,EACL,EAAE,CAAC,UAAU;6BACX,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,EAAE,CAAC,KAAK,IAAI,CAAC,CAAC,IAAI,KAAK,gBAAgB,CAAC,CAAC;6BACzD,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CACZ,CAAC,CAAC,IAAI,KAAK,YAAY,CAAC,CAAC,CAAC,CACxB,MAAC,GAAG,IAAS,UAAU,EAAE,CAAC,EAAE,aAAa,EAAC,QAAQ,EAAC,YAAY,EAAE,CAAC,aAChE,MAAC,GAAG,IAAC,aAAa,EAAC,KAAK,EAAC,GAAG,EAAE,CAAC,aAC7B,MAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,SAAS,kBACtB,CAAC,CAAC,IAAI,SACH,EACP,KAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAE,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,YACvC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,MAAM,CAAC,CAAC,CAAC,MAAM,GACpB,IACH,EACL,CAAC,CAAC,eAAe,CAAC,CAAC,CAAC,CACnB,MAAC,GAAG,IAAC,UAAU,EAAE,CAAC,EAAE,aAAa,EAAC,QAAQ,aACxC,KAAC,IAAI,IAAC,QAAQ,8BAAe,EAC7B,KAAC,IAAI,IAAC,IAAI,EAAC,MAAM,YAAE,CAAC,CAAC,eAAe,GAAQ,IACxC,CACP,CAAC,CAAC,CAAC,IAAI,EACR,MAAC,GAAG,IAAC,UAAU,EAAE,CAAC,EAAE,aAAa,EAAC,QAAQ,aACxC,MAAC,IAAI,IAAC,QAAQ,mBAAE,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,eAAe,CAAC,CAAC,CAAC,eAAe,SAAS,EACnE,KAAC,IAAI,IAAC,IAAI,EAAC,MAAM,YAAE,CAAC,CAAC,MAAM,IAAI,GAAG,GAAQ,IACtC,KAlBE,CAAC,CAmBL,CACP,CAAC,CAAC,CAAC,CACF,MAAC,GAAG,IAAS,UAAU,EAAE,CAAC,aACxB,MAAC,IAAI,IAAC,KAAK,EAAE,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,aAAG,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,GAAG,SAAS,EACnE,MAAC,IAAI,IAAC,QAAQ,wBAAG,CAAC,CAAC,IAAI,SAAS,EAC/B,CAAC,CAAC,MAAM,IAAI,MAAC,IAAI,IAAC,QAAQ,+BAAK,CAAC,CAAC,MAAM,IAAQ,KAHxC,CAAC,CAIL,CACP,CACJ,EACA,EAAE,CAAC,KAAK,IAAI,CACX,KAAC,GAAG,IAAC,UAAU,EAAE,CAAC,YAChB,MAAC,IAAI,IAAC,KAAK,EAAC,KAAK,wBAAS,EAAE,CAAC,KAAK,IAAQ,GACtC,CACP,KA5CO,GAAG,CA6CP,CACP,CAAC;YACJ,CAAC,CAAC,IACE,CACP,CAAC;AACJ,CAAC;AAED,iFAAiF;AAEjF,MAAM,UAAU,QAAQ,CAAC,EAAE,MAAM,EAAE,OAAO,GAAG,KAAK,EAA8C;IAC9F,MAAM,aAAa,GAAG,MAAM,CAAC,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,GAAG,CAAC,CAAC,QAAQ,IAAI,CAAC,CAAC,KAAK,EAAE,CAAC,CAAC;IAC5E,MAAM,SAAS,GAAG,MAAM,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,MAAM,KAAK,CAAC,CAAC,CAAC;IAE9D,OAAO,CACL,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,aACzB,MAAC,GAAG,IAAC,YAAY,EAAE,CAAC,aAClB,KAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAE,SAAS,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,YAC1C,SAAS;4BACR,CAAC,CAAC,2BAA2B;4BAC7B,CAAC,CAAC,KAAK,MAAM,CAAC,OAAO,CAAC,MAAM,CAAC,CAAC,GAAG,EAAE,CAAC,EAAE,EAAE,CAAC,GAAG,GAAG,CAAC,CAAC,MAAM,EAAE,CAAC,CAAC,2BAA2B,GACnF,EACP,MAAC,IAAI,IAAC,QAAQ,0BAAK,MAAM,CAAC,KAAK,CAAC,MAAM,gBAAY,MAAM,CAAC,KAAK,CAAC,MAAM,KAAK,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,QAAI,MAAM,CAAC,OAAO,CAAC,MAAM,eAAW,MAAM,CAAC,OAAO,CAAC,MAAM,KAAK,CAAC,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,SAAS,IACrK,EAEN,KAAC,YAAY,IAAC,OAAO,EAAE,MAAM,CAAC,OAAO,GAAI,EAEzC,KAAC,UAAU,IAAC,KAAK,EAAE,MAAM,CAAC,KAAK,EAAE,aAAa,EAAE,aAAa,GAAI,EAEhE,OAAO,IAAI,CACV,MAAC,GAAG,IAAC,aAAa,EAAC,QAAQ,aACzB,KAAC,IAAI,IAAC,IAAI,QAAC,KAAK,EAAC,MAAM,yBAAgB,EACvC,KAAC,IAAI,IAAC,QAAQ,kBAAE,GAAG,CAAC,MAAM,CAAC,EAAE,CAAC,GAAQ,EACrC,MAAM,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAC1B,KAAC,OAAO,IAAS,CAAC,EAAE,CAAC,EAAE,GAAG,EAAE,CAAC,EAAE,aAAa,EAAE,aAAa,IAA7C,CAAC,CAAgD,CAChE,CAAC,IACE,CACP,IACG,CACP,CAAC;AACJ,CAAC"}

package/dist/cli/components/Spinner.d.ts

@@ -0,0 +1,4 @@
+export declare function Spinner({ label }: {
+    label: string;
+}): import("react/jsx-runtime").JSX.Element;
+//# sourceMappingURL=Spinner.d.ts.map

package/dist/cli/components/Spinner.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"Spinner.d.ts","sourceRoot":"","sources":["../../../src/cli/components/Spinner.tsx"],"names":[],"mappings":"AAKA,wBAAgB,OAAO,CAAC,EAAE,KAAK,EAAE,EAAE;IAAE,KAAK,EAAE,MAAM,CAAA;CAAE,2CAgBnD"}

package/dist/cli/components/Spinner.js

@@ -0,0 +1,15 @@
+import { jsxs as _jsxs } from "react/jsx-runtime";
+import { useState, useEffect } from "react";
+import { Text } from "ink";
+const FRAMES = ["⠋", "⠙", "⠹", "⠸", "⠼", "⠴", "⠦", "⠧", "⠇", "⠏"];
+export function Spinner({ label }) {
+    const [frame, setFrame] = useState(0);
+    useEffect(() => {
+        const id = setInterval(() => {
+            setFrame((f) => (f + 1) % FRAMES.length);
+        }, 80);
+        return () => clearInterval(id);
+    }, []);
+    return (_jsxs(Text, { children: [_jsxs(Text, { color: "cyan", children: [FRAMES[frame], " "] }), label] }));
+}
+//# sourceMappingURL=Spinner.js.map

package/dist/cli/components/Spinner.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"Spinner.js","sourceRoot":"","sources":["../../../src/cli/components/Spinner.tsx"],"names":[],"mappings":";AAAA,OAAc,EAAE,QAAQ,EAAE,SAAS,EAAE,MAAM,OAAO,CAAC;AACnD,OAAO,EAAE,IAAI,EAAE,MAAM,KAAK,CAAC;AAE3B,MAAM,MAAM,GAAG,CAAC,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,EAAE,GAAG,CAAC,CAAC;AAElE,MAAM,UAAU,OAAO,CAAC,EAAE,KAAK,EAAqB;IAClD,MAAM,CAAC,KAAK,EAAE,QAAQ,CAAC,GAAG,QAAQ,CAAC,CAAC,CAAC,CAAC;IAEtC,SAAS,CAAC,GAAG,EAAE;QACb,MAAM,EAAE,GAAG,WAAW,CAAC,GAAG,EAAE;YAC1B,QAAQ,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,GAAG,CAAC,CAAC,GAAG,MAAM,CAAC,MAAM,CAAC,CAAC;QAC3C,CAAC,EAAE,EAAE,CAAC,CAAC;QACP,OAAO,GAAG,EAAE,CAAC,aAAa,CAAC,EAAE,CAAC,CAAC;IACjC,CAAC,EAAE,EAAE,CAAC,CAAC;IAEP,OAAO,CACL,MAAC,IAAI,eACH,MAAC,IAAI,IAAC,KAAK,EAAC,MAAM,aAAE,MAAM,CAAC,KAAK,CAAC,SAAS,EACzC,KAAK,IACD,CACR,CAAC;AACJ,CAAC"}

package/dist/cli/index.d.ts

@@ -0,0 +1,3 @@
+#!/usr/bin/env node
+export {};
+//# sourceMappingURL=index.d.ts.map

package/dist/cli/index.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"index.d.ts","sourceRoot":"","sources":["../../src/cli/index.ts"],"names":[],"mappings":""}