@metaharness/weight-eft 0.1.0

package/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 RuvNet (https://ruv.io)
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,147 @@
+# @metaharness/weight-eft
+
+**Evolutionary fine-tuning** — the bridge from Darwin's gradient-FREE policy
+evolution (*freeze the model, evolve the harness*) to **gradient / weight**
+self-learning on the **open cheap tier**.
+
+## Thesis (honest, bounded)
+
+We attack the **cost-Pareto axis, not the frontier ceiling.**
+
+The metaharness cascade runs a cheap open model first (GLM / Qwen / DeepSeek)
+and **escalates to a frontier model** (Opus / GPT) only on the hard tail. Each
+escalation costs ~$0.50. `weight-eft` **distills the harness's archival
+success into the cheap tier via LoRA** so the cheap model resolves more issues
+on its own → **the cascade escalates less often** → **$/resolved drops.**
+
+A 7-14B local-GPU tune **will not crack the hard tail** — that's a frontier
+reasoning ceiling (clean-eval ~37.3%, ADR-177 §53). The win is **fewer
+escalations**, and the telemetry stays honest about that. The eval metric is
+**escalation-rate-reduction + cost/resolved**, *not* hard-tail cracking.
+
+## The data recipe (on/off-policy)
+
+| Set | Contents | Why |
+|-----|----------|-----|
+| **SFT** | **ALL** gold-resolved trajectories — cheap-OWN *and* frontier-escalation | SFT (max-likelihood) is off-policy-stable, so a frontier success on an issue the cheap model couldn't solve is **off-policy-safe DISTILLATION**. |
+| **DPO** | **ON-POLICY cheap-vs-cheap pairs ONLY** — `chosen` = a resolved sample, `rejected` = an empty/failed sample by the **same cheap model on the same instance** (BoN-derived) | A frontier-chosen-vs-cheap-rejected pair is **off-policy and unstable** (the reference policy never produced the chosen completion). That signal goes to SFT instead. |
+
+### Output formats (canonical / portable)
+
+Exported files use **standard** schemas (portable to TRL / axolotl / unsloth /
+ruvllm-MicroLoRA), never a custom format. A thin runner-adapter at the training
+boundary maps standard → whatever the runner ingests.
+
+- **SFT** — OpenAI chat JSONL:
+  `{"messages":[{role:system},{role:user},{role:assistant,tool_calls:[…]},{role:tool,…},…,{role:assistant}]}`.
+  **`tool_calls` are preserved** — the ReAct loop is **not** flattened to plain
+  text; the model learns real tool-use trajectories.
+- **DPO** — TRL/HF conversational preference:
+  `{"prompt":[system+issue], "chosen":[resolved trajectory], "rejected":[failed trajectory]}`.
+  ReAct diverges from the first action, so `prompt` is the shared system+issue
+  and chosen/rejected are full trajectories from there.
+
+## The guards
+
+1. **Contamination guard (the headline correctness property).** Strict
+   **train/eval instance-ID disjointness.** The exporter excludes any
+   trajectory whose `instance_id` is in the caller's `evalHoldout`, and
+   `assertTrainEvalDisjoint` **throws** on any overlap. *Training on eval
+   instances is fake lift — the exact contamination we debunk elsewhere.*
+2. **Reward-hacking filter** (Ornith-1.0 borrow). A **deterministic monitor**
+   drops any "success" that read a withheld gold/test path, modified the
+   verification harness, or escaped the sandbox. An archived reward-hack would
+   teach the model to reward-hack — this is the **training-data analog of the
+   conformance firewall**, separate from and *in addition to* the disjointness
+   guard.
+3. **Long-context filter.** SWE/ReAct trajectories can blow past a 7-14B
+   context window (~32k). Over-budget trajectories are **dropped (or truncated
+   with `--truncate`) and REPORTED** — never silently lost.
+
+Every drop is surfaced in the export report (`droppedRewardHacked`,
+`excludedByHoldout`, `droppedOverLength`, `truncatedOverLength`).
+
+## The `weightAdapter` genome gene (prune-the-overfitter safety net)
+
+A LoRA tune can overfit. Rather than trust it blindly, the adapter is a **gene**
+in the Darwin genome (`packages/darwin-mode/bench/swebench/evolve-config.mjs`):
+
+- `weightAdapter: null` = **BASE** (no adapter) — the default and the control.
+  A genome that never opts in is **byte-identical (by key) to a pre-gene
+  genome.**
+- `weightAdapter: 'sft'` = SFT-distilled adapter.
+- `weightAdapter: 'sft-dpo'` = SFT then on-policy DPO.
+
+Base competes against the tuned variants under the **same conformant fitness**,
+so **evolution prunes an adapter that doesn't actually lift held-out resolve.**
+The gene is inert until an adapter is trained (a GPU job) — it only *names* an
+adapter; it does not create one.
+
+## The training runner (GPU-gated)
+
+`weight-eft train` is **$0 by default** — it emits a training **plan** (config +
+the exact `ruvllm microlora …` command). A **real** run requires **BOTH** an
+explicit `--train` flag **AND** a detected GPU / endpoint; otherwise it dry-runs
+or refuses. Target is **7-14B** (Qwen2.5-Coder-7B / GLM-4-9B class) — *not* 32B
+(§59: 32B q4 spills a 16GB GPU). Stages: SFT first, then optional on-policy DPO
+from the SFT checkpoint.
+
+## CLI
+
+```bash
+# Status / recipe summary
+weight-eft status
+metaharness weight-eft status         # via the umbrella CLI
+
+# Export training sets ($0). evalHoldout enforces the contamination guard.
+weight-eft export --archive archive.json --eval-holdout holdout.json --out-dir ./out
+
+# Emit the training plan ($0 dry-run). Add --train on a GPU host to run.
+weight-eft train --base Qwen/Qwen2.5-Coder-7B-Instruct --params-b 7 \
+  --sft ./out/sft.jsonl --dpo ./out/dpo.jsonl --adapter glm5.2
+
+# Measure the cost-Pareto delta (base vs adapter cascade runs).
+weight-eft eval --base-outcomes base.json --adapter-outcomes adapter.json
+```
+
+### The exact (later, GPU) command to train + eval
+
+```bash
+# 1) Export ($0) — disjoint train/eval, reward-hack-filtered, long-context-filtered
+weight-eft export --archive darwin-archive.json --eval-holdout clean-eval-ids.json --out-dir ./eft
+
+# 2) Train (GPU host) — SFT then on-policy DPO. ruvllm/MicroLoRA executes plan.command.
+weight-eft train --base Qwen/Qwen2.5-Coder-7B-Instruct --params-b 7 \
+  --sft ./eft/sft.jsonl --dpo ./eft/dpo.jsonl --adapter glm5.2 --train
+# (refuses unless WEIGHT_EFT_BASE_URL / CUDA_VISIBLE_DEVICES is set)
+
+# 3) Run the conformant cascade twice (base vs glm5.2-sft-dpo adapter) on the
+#    HELD-OUT clean set via the existing darwin eval path, collect per-instance
+#    CascadeOutcome[] for each, then:
+weight-eft eval --base-outcomes base-outcomes.json --adapter-outcomes adapter-outcomes.json
+```
+
+## Input contract
+
+The exporter codes against `DarwinTrajectory[]` (see `src/types.ts`) —
+reconstructable from Firestore `darwin_runs` + the local prediction/trajectory
+artifacts (`predictions-*.jsonl` rows carry `instance_id` + `model_patch`; the
+agentic loop carries the `messages` array with `tool_calls`, see
+`darwin-mode/bench/swebench/solve-agentic.mjs`). A tiny mock fixture archive
+lives in `__tests__/fixtures/`.
+
+## Status (honest)
+
+- **Runnable, $0:** exporter (with all three guards), training-plan emission,
+  cost-Pareto eval folding, the `weightAdapter` gene (wired into darwin's
+  evolve-config genome + the umbrella `metaharness weight-eft` CLI).
+- **Scaffolded, GPU-gated:** the actual LoRA training (`spawn(plan.command)` on
+  a GPU host implementing the ruvllm/MicroLoRA seam). No training run, no GPU
+  job, no paid model call has been executed.
+
+See **ADR-198** for the full rationale, the SFT-distill / on-policy-DPO recipe,
+the disjointness invariant, and the self-scaffolding RL roadmap (Ornith-1.0).
+
+## License
+
+MIT

package/dist/cli.d.ts

@@ -0,0 +1,14 @@
+#!/usr/bin/env node
+export interface CliResult {
+    code: number;
+    lines: string[];
+}
+/** `weight-eft export --archive a.json --eval-holdout h.json --out-dir ./out` */
+export declare function exportCmd(args: string[]): Promise<CliResult>;
+/** `weight-eft train --base <id> --params-b N --sft sft.jsonl [--dpo dpo.jsonl] --adapter <prefix> [--train]` */
+export declare function trainCmd(args: string[]): Promise<CliResult>;
+/** `weight-eft eval --base-outcomes b.json --adapter-outcomes a.json` */
+export declare function evalCmd(args: string[]): Promise<CliResult>;
+export declare function statusCmd(): CliResult;
+export declare function dispatch(sub: string | undefined, args: string[]): Promise<CliResult>;
+//# sourceMappingURL=cli.d.ts.map

package/dist/cli.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"cli.d.ts","sourceRoot":"","sources":["../src/cli.ts"],"names":[],"mappings":";AA2BA,MAAM,WAAW,SAAS;IACxB,IAAI,EAAE,MAAM,CAAC;IACb,KAAK,EAAE,MAAM,EAAE,CAAC;CACjB;AAUD,iFAAiF;AACjF,wBAAsB,SAAS,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,OAAO,CAAC,SAAS,CAAC,CAwClE;AAED,iHAAiH;AACjH,wBAAsB,QAAQ,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,OAAO,CAAC,SAAS,CAAC,CAwCjE;AAED,yEAAyE;AACzE,wBAAsB,OAAO,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,OAAO,CAAC,SAAS,CAAC,CAoBhE;AAED,wBAAgB,SAAS,IAAI,SAAS,CA2BrC;AAED,wBAAsB,QAAQ,CAAC,GAAG,EAAE,MAAM,GAAG,SAAS,EAAE,IAAI,EAAE,MAAM,EAAE,GAAG,OAAO,CAAC,SAAS,CAAC,CAgB1F"}

package/dist/cli.js

@@ -0,0 +1,187 @@
+#!/usr/bin/env node
+// SPDX-License-Identifier: MIT
+//
+// weight-eft CLI — export | train | eval | status.
+//
+// Also the delegation target for `metaharness weight-eft <...>` (the umbrella
+// package forwards here). Everything is $0 by default: `export` reads an
+// archive JSON and writes SFT/DPO JSONL; `train` is a dry-run plan unless
+// --train AND a GPU/endpoint are present; `eval` folds outcome JSON into the
+// cost-Pareto delta; `status` prints the recipe + guard summary.
+import { mkdir, readFile, writeFile } from 'node:fs/promises';
+import { resolve } from 'node:path';
+import { exportTrainingData, sftToJsonl, dpoToJsonl } from './export.js';
+import { sftConfig, buildPlan, runTraining, twoStagePlan, defaultDetectGpu, } from './train.js';
+import { costParetoDelta } from './eval.js';
+function flag(args, name) {
+    const i = args.indexOf(name);
+    return i >= 0 ? args[i + 1] : undefined;
+}
+function has(args, name) {
+    return args.includes(name);
+}
+/** `weight-eft export --archive a.json --eval-holdout h.json --out-dir ./out` */
+export async function exportCmd(args) {
+    const archivePath = flag(args, '--archive');
+    const holdoutPath = flag(args, '--eval-holdout');
+    const outDir = flag(args, '--out-dir') ?? '.';
+    const maxTokens = flag(args, '--max-tokens');
+    const truncate = has(args, '--truncate');
+    if (!archivePath) {
+        return { code: 2, lines: ['Usage: weight-eft export --archive <archive.json> --eval-holdout <holdout.json> [--out-dir <dir>] [--max-tokens N] [--truncate]'] };
+    }
+    const archive = JSON.parse(await readFile(resolve(archivePath), 'utf8'));
+    const evalHoldout = holdoutPath
+        ? JSON.parse(await readFile(resolve(holdoutPath), 'utf8'))
+        : [];
+    const result = exportTrainingData(archive, {
+        evalHoldout,
+        maxTokens: maxTokens ? Number(maxTokens) : undefined,
+        truncateOverLength: truncate,
+    });
+    const outDirAbs = resolve(outDir);
+    await mkdir(outDirAbs, { recursive: true });
+    const sftPath = resolve(outDirAbs, 'sft.jsonl');
+    const dpoPath = resolve(outDirAbs, 'dpo.jsonl');
+    const reportPath = resolve(outDirAbs, 'export-report.json');
+    await writeFile(sftPath, sftToJsonl(result.sft));
+    await writeFile(dpoPath, dpoToJsonl(result.dpo));
+    await writeFile(reportPath, JSON.stringify(result.report, null, 2));
+    const r = result.report;
+    return {
+        code: 0,
+        lines: [
+            `weight-eft export (contamination guard ENFORCED):`,
+            `  trajectories in:   ${r.totalTrajectories}`,
+            `  excluded (holdout): ${r.excludedByHoldout}   (train/eval disjointness)`,
+            `  dropped over-len:  ${r.droppedOverLength}    truncated: ${r.truncatedOverLength}`,
+            `  reward-hack drops: ${r.droppedRewardHacked}    (gold-read / verification-tamper / sandbox-escape)`,
+            `  SFT rows:          ${r.sftRows} → ${sftPath}`,
+            `  DPO rows:          ${r.dpoRows} → ${dpoPath}   (on-policy cheap-vs-cheap only)`,
+            `  report:            ${reportPath}`,
+        ],
+    };
+}
+/** `weight-eft train --base <id> --params-b N --sft sft.jsonl [--dpo dpo.jsonl] --adapter <prefix> [--train]` */
+export async function trainCmd(args) {
+    const baseId = flag(args, '--base') ?? 'Qwen/Qwen2.5-Coder-7B-Instruct';
+    const paramsB = Number(flag(args, '--params-b') ?? '7');
+    const sftData = flag(args, '--sft');
+    const dpoData = flag(args, '--dpo');
+    const adapter = flag(args, '--adapter') ?? 'cheap-tier';
+    const doTrain = has(args, '--train');
+    const base = { id: baseId, paramsB };
+    const lines = [];
+    if (!sftData) {
+        return { code: 2, lines: ['Usage: weight-eft train --base <id> --params-b N --sft <sft.jsonl> [--dpo <dpo.jsonl>] --adapter <prefix> [--train]'] };
+    }
+    const gpu = defaultDetectGpu();
+    lines.push(`weight-eft train (${doTrain ? '--train requested' : 'DRY-RUN — emit plan only'}):`);
+    lines.push(`  GPU/endpoint: ${gpu.available ? 'available — ' : 'NOT available — '}${gpu.detail}`);
+    if (dpoData) {
+        const plans = twoStagePlan(base, sftData, dpoData, adapter);
+        for (const stage of [plans.sft, plans.dpo]) {
+            lines.push(`  PLAN ${stage.summary}`);
+            lines.push(`       ${stage.command}`);
+        }
+        if (doTrain) {
+            const sftRun = runTraining(plans.sft.config, { train: true });
+            lines.push(`  SFT: ${sftRun.status}${sftRun.reason ? ' — ' + sftRun.reason : ''}`);
+            const dpoRun = runTraining(plans.dpo.config, { train: true });
+            lines.push(`  DPO: ${dpoRun.status}${dpoRun.reason ? ' — ' + dpoRun.reason : ''}`);
+        }
+    }
+    else {
+        const plan = buildPlan(sftConfig(base, sftData, `${adapter}-sft`));
+        lines.push(`  PLAN ${plan.summary}`);
+        lines.push(`       ${plan.command}`);
+        if (doTrain) {
+            const run = runTraining(plan.config, { train: true });
+            lines.push(`  SFT: ${run.status}${run.reason ? ' — ' + run.reason : ''}`);
+        }
+    }
+    return { code: 0, lines };
+}
+/** `weight-eft eval --base-outcomes b.json --adapter-outcomes a.json` */
+export async function evalCmd(args) {
+    const basePath = flag(args, '--base-outcomes');
+    const adapterPath = flag(args, '--adapter-outcomes');
+    if (!basePath || !adapterPath) {
+        return { code: 2, lines: ['Usage: weight-eft eval --base-outcomes <base.json> --adapter-outcomes <adapter.json>'] };
+    }
+    const baseOutcomes = JSON.parse(await readFile(resolve(basePath), 'utf8'));
+    const adapterOutcomes = JSON.parse(await readFile(resolve(adapterPath), 'utf8'));
+    const d = costParetoDelta(baseOutcomes, adapterOutcomes);
+    return {
+        code: 0,
+        lines: [
+            `weight-eft eval (cost-Pareto, NOT hard-tail):`,
+            `  cheap-resolve lift:      ${(d.cheapResolveLift * 100).toFixed(1)}pp`,
+            `  escalation reduction:    ${(d.escalationRateReduction * 100).toFixed(1)}pp  (the cost-Pareto win)`,
+            `  cost/resolved reduction: $${d.costPerResolvedReduction.toFixed(4)}`,
+            `  resolve-rate delta:      ${(d.resolveRateDelta * 100).toFixed(1)}pp  (expected ≈0 — ceiling unmoved)`,
+            `  verdict: ${d.verdict}`,
+        ],
+    };
+}
+export function statusCmd() {
+    return {
+        code: 0,
+        lines: [
+            `@metaharness/weight-eft — evolutionary fine-tuning (ADR-198)`,
+            ``,
+            `THESIS: distill the archive into the open cheap tier (GLM/Qwen) via LoRA so`,
+            `the cost-cascade escalates to a frontier model LESS often. Cost-Pareto axis,`,
+            `NOT the frontier ceiling — a 7-14B tune will not crack the hard tail.`,
+            ``,
+            `DATA RECIPE:`,
+            `  SFT = ALL gold-resolved trajectories (cheap-own AND frontier-escalation;`,
+            `        frontier successes for off-policy-safe DISTILLATION).`,
+            `  DPO = ON-POLICY cheap-vs-cheap pairs ONLY (chosen=resolved, rejected=failed,`,
+            `        same model + same instance). No frontier-chosen pairs (off-policy).`,
+            ``,
+            `GUARDS:`,
+            `  - Contamination: strict train/eval instance-ID disjointness (throws on overlap).`,
+            `  - Long-context: drop/truncate over-budget trajectories, always reported.`,
+            `  - Tool-call fidelity: tool_calls preserved (never stringified).`,
+            ``,
+            `TRAIN: GPU-gated. Dry-run (plan) unless --train AND a GPU/endpoint is detected.`,
+            `       Target 7-14B (Qwen2.5-Coder-7B / GLM-4-9B), NOT 32B.`,
+            ``,
+            `Subcommands: export | train | eval | status`,
+        ],
+    };
+}
+export async function dispatch(sub, args) {
+    switch (sub) {
+        case 'export':
+            return exportCmd(args);
+        case 'train':
+            return trainCmd(args);
+        case 'eval':
+            return evalCmd(args);
+        case 'status':
+        case undefined:
+        case '--help':
+        case '-h':
+            return statusCmd();
+        default:
+            return { code: 2, lines: [`Unknown subcommand: ${sub}`, `Run 'weight-eft status' for usage.`] };
+    }
+}
+// Direct CLI entry (when invoked as the `weight-eft` bin).
+const isMain = import.meta.url === `file://${process.argv[1]}`;
+if (isMain) {
+    const [, , sub, ...rest] = process.argv;
+    dispatch(sub, rest)
+        .then((r) => {
+        for (const l of r.lines)
+            console.log(l);
+        process.exit(r.code);
+    })
+        .catch((err) => {
+        console.error(err instanceof Error ? err.message : String(err));
+        process.exit(1);
+    });
+}
+//# sourceMappingURL=cli.js.map

package/dist/cli.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"cli.js","sourceRoot":"","sources":["../src/cli.ts"],"names":[],"mappings":";AACA,+BAA+B;AAC/B,EAAE;AACF,mDAAmD;AACnD,EAAE;AACF,8EAA8E;AAC9E,yEAAyE;AACzE,0EAA0E;AAC1E,6EAA6E;AAC7E,iEAAiE;AAEjE,OAAO,EAAE,KAAK,EAAE,QAAQ,EAAE,SAAS,EAAE,MAAM,kBAAkB,CAAC;AAC9D,OAAO,EAAE,OAAO,EAAE,MAAM,WAAW,CAAC;AACpC,OAAO,EAAE,kBAAkB,EAAE,UAAU,EAAE,UAAU,EAAE,MAAM,aAAa,CAAC;AACzE,OAAO,EACL,SAAS,EAET,SAAS,EACT,WAAW,EACX,YAAY,EACZ,gBAAgB,GAEjB,MAAM,YAAY,CAAC;AACpB,OAAO,EAAE,eAAe,EAAE,MAAM,WAAW,CAAC;AAS5C,SAAS,IAAI,CAAC,IAAc,EAAE,IAAY;IACxC,MAAM,CAAC,GAAG,IAAI,CAAC,OAAO,CAAC,IAAI,CAAC,CAAC;IAC7B,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,SAAS,CAAC;AAC1C,CAAC;AACD,SAAS,GAAG,CAAC,IAAc,EAAE,IAAY;IACvC,OAAO,IAAI,CAAC,QAAQ,CAAC,IAAI,CAAC,CAAC;AAC7B,CAAC;AAED,iFAAiF;AACjF,MAAM,CAAC,KAAK,UAAU,SAAS,CAAC,IAAc;IAC5C,MAAM,WAAW,GAAG,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,CAAC;IAC5C,MAAM,WAAW,GAAG,IAAI,CAAC,IAAI,EAAE,gBAAgB,CAAC,CAAC;IACjD,MAAM,MAAM,GAAG,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,IAAI,GAAG,CAAC;IAC9C,MAAM,SAAS,GAAG,IAAI,CAAC,IAAI,EAAE,cAAc,CAAC,CAAC;IAC7C,MAAM,QAAQ,GAAG,GAAG,CAAC,IAAI,EAAE,YAAY,CAAC,CAAC;IACzC,IAAI,CAAC,WAAW,EAAE,CAAC;QACjB,OAAO,EAAE,IAAI,EAAE,CAAC,EAAE,KAAK,EAAE,CAAC,iIAAiI,CAAC,EAAE,CAAC;IACjK,CAAC;IACD,MAAM,OAAO,GAAG,IAAI,CAAC,KAAK,CAAC,MAAM,QAAQ,CAAC,OAAO,CAAC,WAAW,CAAC,EAAE,MAAM,CAAC,CAAuB,CAAC;IAC/F,MAAM,WAAW,GAAa,WAAW;QACvC,CAAC,CAAE,IAAI,CAAC,KAAK,CAAC,MAAM,QAAQ,CAAC,OAAO,CAAC,WAAW,CAAC,EAAE,MAAM,CAAC,CAAc;QACxE,CAAC,CAAC,EAAE,CAAC;IACP,MAAM,MAAM,GAAG,kBAAkB,CAAC,OAAO,EAAE;QACzC,WAAW;QACX,SAAS,EAAE,SAAS,CAAC,CAAC,CAAC,MAAM,CAAC,SAAS,CAAC,CAAC,CAAC,CAAC,SAAS;QACpD,kBAAkB,EAAE,QAAQ;KAC7B,CAAC,CAAC;IACH,MAAM,SAAS,GAAG,OAAO,CAAC,MAAM,CAAC,CAAC;IAClC,MAAM,KAAK,CAAC,SAAS,EAAE,EAAE,SAAS,EAAE,IAAI,EAAE,CAAC,CAAC;IAC5C,MAAM,OAAO,GAAG,OAAO,CAAC,SAAS,EAAE,WAAW,CAAC,CAAC;IAChD,MAAM,OAAO,GAAG,OAAO,CAAC,SAAS,EAAE,WAAW,CAAC,CAAC;IAChD,MAAM,UAAU,GAAG,OAAO,CAAC,SAAS,EAAE,oBAAoB,CAAC,CAAC;IAC5D,MAAM,SAAS,CAAC,OAAO,EAAE,UAAU,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC;IACjD,MAAM,SAAS,CAAC,OAAO,EAAE,UAAU,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC;IACjD,MAAM,SAAS,CAAC,UAAU,EAAE,IAAI,CAAC,SAAS,CAAC,MAAM,CAAC,MAAM,EAAE,IAAI,EAAE,CAAC,CAAC,CAAC,CAAC;IACpE,MAAM,CAAC,GAAG,MAAM,CAAC,MAAM,CAAC;IACxB,OAAO;QACL,IAAI,EAAE,CAAC;QACP,KAAK,EAAE;YACL,mDAAmD;YACnD,wBAAwB,CAAC,CAAC,iBAAiB,EAAE;YAC7C,yBAAyB,CAAC,CAAC,iBAAiB,8BAA8B;YAC1E,wBAAwB,CAAC,CAAC,iBAAiB,kBAAkB,CAAC,CAAC,mBAAmB,EAAE;YACpF,wBAAwB,CAAC,CAAC,mBAAmB,wDAAwD;YACrG,wBAAwB,CAAC,CAAC,OAAO,MAAM,OAAO,EAAE;YAChD,wBAAwB,CAAC,CAAC,OAAO,MAAM,OAAO,oCAAoC;YAClF,wBAAwB,UAAU,EAAE;SACrC;KACF,CAAC;AACJ,CAAC;AAED,iHAAiH;AACjH,MAAM,CAAC,KAAK,UAAU,QAAQ,CAAC,IAAc;IAC3C,MAAM,MAAM,GAAG,IAAI,CAAC,IAAI,EAAE,QAAQ,CAAC,IAAI,gCAAgC,CAAC;IACxE,MAAM,OAAO,GAAG,MAAM,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,IAAI,GAAG,CAAC,CAAC;IACxD,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;IACpC,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC;IACpC,MAAM,OAAO,GAAG,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,IAAI,YAAY,CAAC;IACxD,MAAM,OAAO,GAAG,GAAG,CAAC,IAAI,EAAE,SAAS,CAAC,CAAC;IACrC,MAAM,IAAI,GAAkB,EAAE,EAAE,EAAE,MAAM,EAAE,OAAO,EAAE,CAAC;IACpD,MAAM,KAAK,GAAa,EAAE,CAAC;IAE3B,IAAI,CAAC,OAAO,EAAE,CAAC;QACb,OAAO,EAAE,IAAI,EAAE,CAAC,EAAE,KAAK,EAAE,CAAC,qHAAqH,CAAC,EAAE,CAAC;IACrJ,CAAC;IAED,MAAM,GAAG,GAAG,gBAAgB,EAAE,CAAC;IAC/B,KAAK,CAAC,IAAI,CAAC,qBAAqB,OAAO,CAAC,CAAC,CAAC,mBAAmB,CAAC,CAAC,CAAC,0BAA0B,IAAI,CAAC,CAAC;IAChG,KAAK,CAAC,IAAI,CAAC,mBAAmB,GAAG,CAAC,SAAS,CAAC,CAAC,CAAC,cAAc,CAAC,CAAC,CAAC,kBAAkB,GAAG,GAAG,CAAC,MAAM,EAAE,CAAC,CAAC;IAElG,IAAI,OAAO,EAAE,CAAC;QACZ,MAAM,KAAK,GAAG,YAAY,CAAC,IAAI,EAAE,OAAO,EAAE,OAAO,EAAE,OAAO,CAAC,CAAC;QAC5D,KAAK,MAAM,KAAK,IAAI,CAAC,KAAK,CAAC,GAAG,EAAE,KAAK,CAAC,GAAG,CAAC,EAAE,CAAC;YAC3C,KAAK,CAAC,IAAI,CAAC,UAAU,KAAK,CAAC,OAAO,EAAE,CAAC,CAAC;YACtC,KAAK,CAAC,IAAI,CAAC,UAAU,KAAK,CAAC,OAAO,EAAE,CAAC,CAAC;QACxC,CAAC;QACD,IAAI,OAAO,EAAE,CAAC;YACZ,MAAM,MAAM,GAAG,WAAW,CAAC,KAAK,CAAC,GAAG,CAAC,MAAM,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC;YAC9D,KAAK,CAAC,IAAI,CAAC,UAAU,MAAM,CAAC,MAAM,GAAG,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC,KAAK,GAAG,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;YACnF,MAAM,MAAM,GAAG,WAAW,CAAC,KAAK,CAAC,GAAG,CAAC,MAAM,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC;YAC9D,KAAK,CAAC,IAAI,CAAC,UAAU,MAAM,CAAC,MAAM,GAAG,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC,KAAK,GAAG,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;QACrF,CAAC;IACH,CAAC;SAAM,CAAC;QACN,MAAM,IAAI,GAAG,SAAS,CAAC,SAAS,CAAC,IAAI,EAAE,OAAO,EAAE,GAAG,OAAO,MAAM,CAAC,CAAC,CAAC;QACnE,KAAK,CAAC,IAAI,CAAC,UAAU,IAAI,CAAC,OAAO,EAAE,CAAC,CAAC;QACrC,KAAK,CAAC,IAAI,CAAC,UAAU,IAAI,CAAC,OAAO,EAAE,CAAC,CAAC;QACrC,IAAI,OAAO,EAAE,CAAC;YACZ,MAAM,GAAG,GAAG,WAAW,CAAC,IAAI,CAAC,MAAM,EAAE,EAAE,KAAK,EAAE,IAAI,EAAE,CAAC,CAAC;YACtD,KAAK,CAAC,IAAI,CAAC,UAAU,GAAG,CAAC,MAAM,GAAG,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,KAAK,GAAG,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC;QAC5E,CAAC;IACH,CAAC;IACD,OAAO,EAAE,IAAI,EAAE,CAAC,EAAE,KAAK,EAAE,CAAC;AAC5B,CAAC;AAED,yEAAyE;AACzE,MAAM,CAAC,KAAK,UAAU,OAAO,CAAC,IAAc;IAC1C,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,EAAE,iBAAiB,CAAC,CAAC;IAC/C,MAAM,WAAW,GAAG,IAAI,CAAC,IAAI,EAAE,oBAAoB,CAAC,CAAC;IACrD,IAAI,CAAC,QAAQ,IAAI,CAAC,WAAW,EAAE,CAAC;QAC9B,OAAO,EAAE,IAAI,EAAE,CAAC,EAAE,KAAK,EAAE,CAAC,sFAAsF,CAAC,EAAE,CAAC;IACtH,CAAC;IACD,MAAM,YAAY,GAAG,IAAI,CAAC,KAAK,CAAC,MAAM,QAAQ,CAAC,OAAO,CAAC,QAAQ,CAAC,EAAE,MAAM,CAAC,CAAqB,CAAC;IAC/F,MAAM,eAAe,GAAG,IAAI,CAAC,KAAK,CAAC,MAAM,QAAQ,CAAC,OAAO,CAAC,WAAW,CAAC,EAAE,MAAM,CAAC,CAAqB,CAAC;IACrG,MAAM,CAAC,GAAG,eAAe,CAAC,YAAY,EAAE,eAAe,CAAC,CAAC;IACzD,OAAO;QACL,IAAI,EAAE,CAAC;QACP,KAAK,EAAE;YACL,+CAA+C;YAC/C,8BAA8B,CAAC,CAAC,CAAC,gBAAgB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,IAAI;YACvE,8BAA8B,CAAC,CAAC,CAAC,uBAAuB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,2BAA2B;YACrG,+BAA+B,CAAC,CAAC,wBAAwB,CAAC,OAAO,CAAC,CAAC,CAAC,EAAE;YACtE,8BAA8B,CAAC,CAAC,CAAC,gBAAgB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,qCAAqC;YACxG,cAAc,CAAC,CAAC,OAAO,EAAE;SAC1B;KACF,CAAC;AACJ,CAAC;AAED,MAAM,UAAU,SAAS;IACvB,OAAO;QACL,IAAI,EAAE,CAAC;QACP,KAAK,EAAE;YACL,8DAA8D;YAC9D,EAAE;YACF,6EAA6E;YAC7E,8EAA8E;YAC9E,uEAAuE;YACvE,EAAE;YACF,cAAc;YACd,4EAA4E;YAC5E,+DAA+D;YAC/D,gFAAgF;YAChF,6EAA6E;YAC7E,EAAE;YACF,SAAS;YACT,oFAAoF;YACpF,4EAA4E;YAC5E,mEAAmE;YACnE,EAAE;YACF,iFAAiF;YACjF,6DAA6D;YAC7D,EAAE;YACF,6CAA6C;SAC9C;KACF,CAAC;AACJ,CAAC;AAED,MAAM,CAAC,KAAK,UAAU,QAAQ,CAAC,GAAuB,EAAE,IAAc;IACpE,QAAQ,GAAG,EAAE,CAAC;QACZ,KAAK,QAAQ;YACX,OAAO,SAAS,CAAC,IAAI,CAAC,CAAC;QACzB,KAAK,OAAO;YACV,OAAO,QAAQ,CAAC,IAAI,CAAC,CAAC;QACxB,KAAK,MAAM;YACT,OAAO,OAAO,CAAC,IAAI,CAAC,CAAC;QACvB,KAAK,QAAQ,CAAC;QACd,KAAK,SAAS,CAAC;QACf,KAAK,QAAQ,CAAC;QACd,KAAK,IAAI;YACP,OAAO,SAAS,EAAE,CAAC;QACrB;YACE,OAAO,EAAE,IAAI,EAAE,CAAC,EAAE,KAAK,EAAE,CAAC,uBAAuB,GAAG,EAAE,EAAE,oCAAoC,CAAC,EAAE,CAAC;IACpG,CAAC;AACH,CAAC;AAED,2DAA2D;AAC3D,MAAM,MAAM,GAAG,MAAM,CAAC,IAAI,CAAC,GAAG,KAAK,UAAU,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC;AAC/D,IAAI,MAAM,EAAE,CAAC;IACX,MAAM,CAAC,EAAE,AAAD,EAAG,GAAG,EAAE,GAAG,IAAI,CAAC,GAAG,OAAO,CAAC,IAAI,CAAC;IACxC,QAAQ,CAAC,GAAG,EAAE,IAAI,CAAC;SAChB,IAAI,CAAC,CAAC,CAAC,EAAE,EAAE;QACV,KAAK,MAAM,CAAC,IAAI,CAAC,CAAC,KAAK;YAAE,OAAO,CAAC,GAAG,CAAC,CAAC,CAAC,CAAC;QACxC,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC;IACvB,CAAC,CAAC;SACD,KAAK,CAAC,CAAC,GAAY,EAAE,EAAE;QACtB,OAAO,CAAC,KAAK,CAAC,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,CAAC,CAAC;QAChE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;IAClB,CAAC,CAAC,CAAC;AACP,CAAC"}

package/dist/eval.d.ts

@@ -0,0 +1,50 @@
+/** Per-instance outcome from a conformant cascade eval run on the held-out set. */
+export interface CascadeOutcome {
+    instance_id: string;
+    /** Did the cheap tier resolve it WITHOUT escalating? */
+    cheapResolved: boolean;
+    /** Did the run escalate to the frontier tier? */
+    escalated: boolean;
+    /** Final resolved status (cheap OR post-escalation), from gold eval. */
+    resolved: boolean;
+    /** Measured $ for this instance (cheap + any escalation). */
+    costUsd: number;
+}
+/** The cost-Pareto summary for one eval run (base OR adapter). */
+export interface CascadeSummary {
+    n: number;
+    /** Fraction the CHEAP tier resolved alone. */
+    cheapResolveRate: number;
+    /** Fraction of runs that escalated to the frontier tier. */
+    escalationRate: number;
+    /** Final resolve rate (the headline, expected ~unchanged — ceiling unmoved). */
+    resolveRate: number;
+    /** Mean $ per RESOLVED instance (the cost-Pareto figure of merit). */
+    costPerResolved: number;
+    /** Total $ across the run. */
+    totalCostUsd: number;
+}
+/** The delta between an adapter run and the base run — the cost-Pareto win. */
+export interface CostParetoDelta {
+    base: CascadeSummary;
+    adapter: CascadeSummary;
+    /** adapter.cheapResolveRate − base.cheapResolveRate (want > 0). */
+    cheapResolveLift: number;
+    /** base.escalationRate − adapter.escalationRate (want > 0 — FEWER escalations). */
+    escalationRateReduction: number;
+    /** base.costPerResolved − adapter.costPerResolved (want > 0 — cheaper). */
+    costPerResolvedReduction: number;
+    /** adapter.resolveRate − base.resolveRate (expected ≈ 0 — ceiling unmoved). */
+    resolveRateDelta: number;
+    /** Honest verdict string for telemetry. */
+    verdict: string;
+}
+/** Fold per-instance cascade outcomes into the cost-Pareto summary. */
+export declare function summarizeCascade(outcomes: CascadeOutcome[]): CascadeSummary;
+/**
+ * Compute the cost-Pareto delta between an adapter run and the base run.
+ * Stays HONEST: the headline is escalation-rate-reduction + cost/resolved, and
+ * the verdict flags when the resolve ceiling is (as expected) unmoved.
+ */
+export declare function costParetoDelta(baseOutcomes: CascadeOutcome[], adapterOutcomes: CascadeOutcome[]): CostParetoDelta;
+//# sourceMappingURL=eval.d.ts.map

package/dist/eval.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"eval.d.ts","sourceRoot":"","sources":["../src/eval.ts"],"names":[],"mappings":"AAmBA,mFAAmF;AACnF,MAAM,WAAW,cAAc;IAC7B,WAAW,EAAE,MAAM,CAAC;IACpB,wDAAwD;IACxD,aAAa,EAAE,OAAO,CAAC;IACvB,iDAAiD;IACjD,SAAS,EAAE,OAAO,CAAC;IACnB,wEAAwE;IACxE,QAAQ,EAAE,OAAO,CAAC;IAClB,6DAA6D;IAC7D,OAAO,EAAE,MAAM,CAAC;CACjB;AAED,kEAAkE;AAClE,MAAM,WAAW,cAAc;IAC7B,CAAC,EAAE,MAAM,CAAC;IACV,8CAA8C;IAC9C,gBAAgB,EAAE,MAAM,CAAC;IACzB,4DAA4D;IAC5D,cAAc,EAAE,MAAM,CAAC;IACvB,gFAAgF;IAChF,WAAW,EAAE,MAAM,CAAC;IACpB,sEAAsE;IACtE,eAAe,EAAE,MAAM,CAAC;IACxB,8BAA8B;IAC9B,YAAY,EAAE,MAAM,CAAC;CACtB;AAED,+EAA+E;AAC/E,MAAM,WAAW,eAAe;IAC9B,IAAI,EAAE,cAAc,CAAC;IACrB,OAAO,EAAE,cAAc,CAAC;IACxB,mEAAmE;IACnE,gBAAgB,EAAE,MAAM,CAAC;IACzB,mFAAmF;IACnF,uBAAuB,EAAE,MAAM,CAAC;IAChC,2EAA2E;IAC3E,wBAAwB,EAAE,MAAM,CAAC;IACjC,+EAA+E;IAC/E,gBAAgB,EAAE,MAAM,CAAC;IACzB,2CAA2C;IAC3C,OAAO,EAAE,MAAM,CAAC;CACjB;AAED,uEAAuE;AACvE,wBAAgB,gBAAgB,CAAC,QAAQ,EAAE,cAAc,EAAE,GAAG,cAAc,CA8B3E;AAED;;;;GAIG;AACH,wBAAgB,eAAe,CAC7B,YAAY,EAAE,cAAc,EAAE,EAC9B,eAAe,EAAE,cAAc,EAAE,GAChC,eAAe,CAmCjB"}

package/dist/eval.js

@@ -0,0 +1,96 @@
+// SPDX-License-Identifier: MIT
+//
+// eval.ts — the eval-harness hook.
+//
+// Given a tuned adapter, measure the COST-PARETO win — NOT hard-tail cracking.
+// The metric that matters is:
+//   1. cheap-tier-ALONE resolve on the HELD-OUT clean set, and
+//   2. the cascade's ESCALATION-RATE delta (fewer $0.50 frontier escalations).
+//
+// A LoRA tune on 7-14B will NOT crack the hard tail (frontier reasoning
+// ceiling, clean-eval 37.3% + §53). The honest win is: the cheap tier resolves
+// more on its own → the cascade escalates less → $/resolved drops. This module
+// computes that delta from two eval runs (base vs adapter) and stays honest
+// about what it measures.
+//
+// The eval RUN itself (conformant swebench gold eval) is the existing darwin
+// path; this hook consumes its per-instance outcomes and folds them into the
+// cost-Pareto metric. No eval is executed here ($0).
+/** Fold per-instance cascade outcomes into the cost-Pareto summary. */
+export function summarizeCascade(outcomes) {
+    const n = outcomes.length;
+    if (n === 0) {
+        return {
+            n: 0,
+            cheapResolveRate: 0,
+            escalationRate: 0,
+            resolveRate: 0,
+            costPerResolved: 0,
+            totalCostUsd: 0,
+        };
+    }
+    let cheap = 0;
+    let escalated = 0;
+    let resolved = 0;
+    let totalCost = 0;
+    for (const o of outcomes) {
+        if (o.cheapResolved)
+            cheap++;
+        if (o.escalated)
+            escalated++;
+        if (o.resolved)
+            resolved++;
+        totalCost += o.costUsd;
+    }
+    return {
+        n,
+        cheapResolveRate: cheap / n,
+        escalationRate: escalated / n,
+        resolveRate: resolved / n,
+        costPerResolved: resolved > 0 ? totalCost / resolved : 0,
+        totalCostUsd: totalCost,
+    };
+}
+/**
+ * Compute the cost-Pareto delta between an adapter run and the base run.
+ * Stays HONEST: the headline is escalation-rate-reduction + cost/resolved, and
+ * the verdict flags when the resolve ceiling is (as expected) unmoved.
+ */
+export function costParetoDelta(baseOutcomes, adapterOutcomes) {
+    const base = summarizeCascade(baseOutcomes);
+    const adapter = summarizeCascade(adapterOutcomes);
+    const cheapResolveLift = adapter.cheapResolveRate - base.cheapResolveRate;
+    const escalationRateReduction = base.escalationRate - adapter.escalationRate;
+    const costPerResolvedReduction = base.costPerResolved - adapter.costPerResolved;
+    const resolveRateDelta = adapter.resolveRate - base.resolveRate;
+    const fewer = escalationRateReduction > 0;
+    const cheaper = costPerResolvedReduction > 0;
+    const ceilingMoved = Math.abs(resolveRateDelta) > 0.02;
+    let verdict;
+    if (fewer && cheaper) {
+        verdict =
+            `COST-PARETO WIN: ${(escalationRateReduction * 100).toFixed(1)}pp fewer escalations, ` +
+                `$${costPerResolvedReduction.toFixed(3)} cheaper per resolved` +
+                (ceilingMoved
+                    ? ` (note: resolve rate also moved ${(resolveRateDelta * 100).toFixed(1)}pp — investigate)`
+                    : ` (resolve ceiling unmoved, as expected — this tunes COST, not the frontier ceiling)`);
+    }
+    else if (fewer || cheaper) {
+        verdict = `PARTIAL: escalation−${(escalationRateReduction * 100).toFixed(1)}pp, cost−$${costPerResolvedReduction.toFixed(3)}/resolved`;
+    }
+    else {
+        verdict =
+            `NO COST WIN: adapter did not reduce escalations or cost — the prune-the-overfitter ` +
+                `gene should select BASE over this adapter.`;
+    }
+    return {
+        base,
+        adapter,
+        cheapResolveLift,
+        escalationRateReduction,
+        costPerResolvedReduction,
+        resolveRateDelta,
+        verdict,
+    };
+}
+//# sourceMappingURL=eval.js.map

package/dist/eval.js.map

@@ -0,0 +1 @@
+{"version":3,"file":"eval.js","sourceRoot":"","sources":["../src/eval.ts"],"names":[],"mappings":"AAAA,+BAA+B;AAC/B,EAAE;AACF,mCAAmC;AACnC,EAAE;AACF,+EAA+E;AAC/E,8BAA8B;AAC9B,+DAA+D;AAC/D,+EAA+E;AAC/E,EAAE;AACF,wEAAwE;AACxE,+EAA+E;AAC/E,+EAA+E;AAC/E,4EAA4E;AAC5E,0BAA0B;AAC1B,EAAE;AACF,6EAA6E;AAC7E,6EAA6E;AAC7E,qDAAqD;AA8CrD,uEAAuE;AACvE,MAAM,UAAU,gBAAgB,CAAC,QAA0B;IACzD,MAAM,CAAC,GAAG,QAAQ,CAAC,MAAM,CAAC;IAC1B,IAAI,CAAC,KAAK,CAAC,EAAE,CAAC;QACZ,OAAO;YACL,CAAC,EAAE,CAAC;YACJ,gBAAgB,EAAE,CAAC;YACnB,cAAc,EAAE,CAAC;YACjB,WAAW,EAAE,CAAC;YACd,eAAe,EAAE,CAAC;YAClB,YAAY,EAAE,CAAC;SAChB,CAAC;IACJ,CAAC;IACD,IAAI,KAAK,GAAG,CAAC,CAAC;IACd,IAAI,SAAS,GAAG,CAAC,CAAC;IAClB,IAAI,QAAQ,GAAG,CAAC,CAAC;IACjB,IAAI,SAAS,GAAG,CAAC,CAAC;IAClB,KAAK,MAAM,CAAC,IAAI,QAAQ,EAAE,CAAC;QACzB,IAAI,CAAC,CAAC,aAAa;YAAE,KAAK,EAAE,CAAC;QAC7B,IAAI,CAAC,CAAC,SAAS;YAAE,SAAS,EAAE,CAAC;QAC7B,IAAI,CAAC,CAAC,QAAQ;YAAE,QAAQ,EAAE,CAAC;QAC3B,SAAS,IAAI,CAAC,CAAC,OAAO,CAAC;IACzB,CAAC;IACD,OAAO;QACL,CAAC;QACD,gBAAgB,EAAE,KAAK,GAAG,CAAC;QAC3B,cAAc,EAAE,SAAS,GAAG,CAAC;QAC7B,WAAW,EAAE,QAAQ,GAAG,CAAC;QACzB,eAAe,EAAE,QAAQ,GAAG,CAAC,CAAC,CAAC,CAAC,SAAS,GAAG,QAAQ,CAAC,CAAC,CAAC,CAAC;QACxD,YAAY,EAAE,SAAS;KACxB,CAAC;AACJ,CAAC;AAED;;;;GAIG;AACH,MAAM,UAAU,eAAe,CAC7B,YAA8B,EAC9B,eAAiC;IAEjC,MAAM,IAAI,GAAG,gBAAgB,CAAC,YAAY,CAAC,CAAC;IAC5C,MAAM,OAAO,GAAG,gBAAgB,CAAC,eAAe,CAAC,CAAC;IAClD,MAAM,gBAAgB,GAAG,OAAO,CAAC,gBAAgB,GAAG,IAAI,CAAC,gBAAgB,CAAC;IAC1E,MAAM,uBAAuB,GAAG,IAAI,CAAC,cAAc,GAAG,OAAO,CAAC,cAAc,CAAC;IAC7E,MAAM,wBAAwB,GAAG,IAAI,CAAC,eAAe,GAAG,OAAO,CAAC,eAAe,CAAC;IAChF,MAAM,gBAAgB,GAAG,OAAO,CAAC,WAAW,GAAG,IAAI,CAAC,WAAW,CAAC;IAEhE,MAAM,KAAK,GAAG,uBAAuB,GAAG,CAAC,CAAC;IAC1C,MAAM,OAAO,GAAG,wBAAwB,GAAG,CAAC,CAAC;IAC7C,MAAM,YAAY,GAAG,IAAI,CAAC,GAAG,CAAC,gBAAgB,CAAC,GAAG,IAAI,CAAC;IACvD,IAAI,OAAe,CAAC;IACpB,IAAI,KAAK,IAAI,OAAO,EAAE,CAAC;QACrB,OAAO;YACL,oBAAoB,CAAC,uBAAuB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,wBAAwB;gBACtF,IAAI,wBAAwB,CAAC,OAAO,CAAC,CAAC,CAAC,uBAAuB;gBAC9D,CAAC,YAAY;oBACX,CAAC,CAAC,mCAAmC,CAAC,gBAAgB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,mBAAmB;oBAC3F,CAAC,CAAC,qFAAqF,CAAC,CAAC;IAC/F,CAAC;SAAM,IAAI,KAAK,IAAI,OAAO,EAAE,CAAC;QAC5B,OAAO,GAAG,uBAAuB,CAAC,uBAAuB,GAAG,GAAG,CAAC,CAAC,OAAO,CAAC,CAAC,CAAC,aAAa,wBAAwB,CAAC,OAAO,CAAC,CAAC,CAAC,WAAW,CAAC;IACzI,CAAC;SAAM,CAAC;QACN,OAAO;YACL,qFAAqF;gBACrF,4CAA4C,CAAC;IACjD,CAAC;IACD,OAAO;QACL,IAAI;QACJ,OAAO;QACP,gBAAgB;QAChB,uBAAuB;QACvB,wBAAwB;QACxB,gBAAgB;QAChB,OAAO;KACR,CAAC;AACJ,CAAC"}

package/dist/export.d.ts

@@ -0,0 +1,28 @@
+import type { ChatMessage, DarwinTrajectory, DpoRow, ExportOptions, ExportResult, SftRow } from './types.js';
+/**
+ * Rough token estimate for a message list. We deliberately do NOT pull in a
+ * tokenizer dependency (the package is dependency-free, like darwin-mode). The
+ * ~4-chars-per-token heuristic is conservative and stable; tool_calls
+ * arguments count too (they cost context). This is a budget gate, not a billing
+ * figure — over-estimating is the safe direction.
+ */
+export declare function estimateTokens(messages: ChatMessage[]): number;
+/**
+ * THE CONTAMINATION GUARD. Throws if any trajectory's instance_id appears in
+ * the eval holdout. Call it the first thing the exporter does — fail loud, not
+ * silently filter, when train/eval disjointness is violated.
+ */
+export declare function assertTrainEvalDisjoint(trajectories: DarwinTrajectory[], evalHoldout: Iterable<string>): void;
+/**
+ * Build the SFT and DPO sets from a Darwin trajectory archive.
+ *
+ * @param trajectories the input archive (already-excluded-of-holdout OR raw —
+ *   the exporter excludes holdout members itself, but ASSERTS disjointness on
+ *   what remains so a programming error can't slip eval data through).
+ */
+export declare function exportTrainingData(trajectories: DarwinTrajectory[], options: ExportOptions): ExportResult;
+/** Serialize SFT rows to JSONL (one row per line). */
+export declare function sftToJsonl(rows: SftRow[]): string;
+/** Serialize DPO rows to JSONL (one row per line). */
+export declare function dpoToJsonl(rows: DpoRow[]): string;
+//# sourceMappingURL=export.d.ts.map

package/dist/export.d.ts.map

@@ -0,0 +1 @@
+{"version":3,"file":"export.d.ts","sourceRoot":"","sources":["../src/export.ts"],"names":[],"mappings":"AA6BA,OAAO,KAAK,EACV,WAAW,EACX,gBAAgB,EAChB,MAAM,EACN,aAAa,EAEb,YAAY,EACZ,MAAM,EACP,MAAM,YAAY,CAAC;AAKpB;;;;;;GAMG;AACH,wBAAgB,cAAc,CAAC,QAAQ,EAAE,WAAW,EAAE,GAAG,MAAM,CAa9D;AAyCD;;;;GAIG;AACH,wBAAgB,uBAAuB,CACrC,YAAY,EAAE,gBAAgB,EAAE,EAChC,WAAW,EAAE,QAAQ,CAAC,MAAM,CAAC,GAC5B,IAAI,CAcN;AAED;;;;;;GAMG;AACH,wBAAgB,kBAAkB,CAChC,YAAY,EAAE,gBAAgB,EAAE,EAChC,OAAO,EAAE,aAAa,GACrB,YAAY,CAgId;AAED,sDAAsD;AACtD,wBAAgB,UAAU,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,MAAM,CAEjD;AAED,sDAAsD;AACtD,wBAAgB,UAAU,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,MAAM,CAEjD"}