npm - @percepta/kaizen - Versions diffs - 0.2.0 → 0.2.1 - Mend

@percepta/kaizen 0.2.0 → 0.2.1

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.

Files changed (29) hide show

package/README.md CHANGED Viewed

@@ -9,7 +9,7 @@ For a persistent local `kaizen` command:
 ```bash
 npm install -g @percepta/kaizen
 kaizen init
-kaizen create pipeline <pipeline-id>
+kaizen create pipeline <pipeline-id> # add --eval-language ts for TypeScript
 kaizen run --pipeline <pipeline-id> --variant baseline --hypothesis "starting baseline"
 kaizen studio
 ```
@@ -96,7 +96,7 @@ The web app (Next.js, pages router) provides:
 In real use, each target/customer repo owns its own `customers/`, `pipelines/`, `rubrics/`, `eval/`, and optional `views/` directories. Each pipeline is defined in `pipelines/*.md` with YAML frontmatter:
 ```yaml
-run_eval: eval/<pipeline>.py
+run_eval: eval/<pipeline>.ts # or .py
 eval_version: 1
 dataset_version: v1
 eval_style: ground-truth
@@ -104,6 +104,14 @@ primary_metric: score
 ```
 The eval script emits NDJSON events to `--out-fd`; the runner owns `.kaizen/runs/`.
+Kaizen runs Python evals with `python3`, JavaScript evals with `node`, and
+TypeScript evals with the package's bundled `tsx` loader. New pipeline scaffolds
+default to Python; pass `--eval-language ts` to create a TypeScript eval.
+For Langfuse-backed production evals, the same script should also link each
+dataset item to the fresh trace produced by that run in a Langfuse dataset run
+and write the primary metric as a trace score. Those writes are for durable
+trace inspection; the NDJSON `complete.score` remains Kaizen's required result
+contract.
 This repo keeps historical definitions under `examples/legacy-workspace/` only as sample data for local Studio development:

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/BUILD_ID CHANGED Viewed

	@@ -1 +1 @@
1	- ~~SjAC88d3utiBvgy5eS--0~~
1	+ NipfouxkPumeJ20wdsKlr

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/build-manifest.json CHANGED Viewed

@@ -43,8 +43,8 @@
   "devFiles": [],
   "polyfillFiles": [],
   "lowPriorityFiles": [
-    "static/SjAC88d3utiBvgy5eS--0/_ssgManifest.js",
-    "static/SjAC88d3utiBvgy5eS--0/_buildManifest.js"
+    "static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js",
+    "static/NipfouxkPumeJ20wdsKlr/_buildManifest.js"
   ],
   "rootMainFiles": []
 }

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/prerender-manifest.json CHANGED Viewed

@@ -3,9 +3,9 @@
   "routes": {},
   "dynamicRoutes": {},
   "preview": {
-    "previewModeId": "f76dea4948d5f48a22c602e0323d24dd",
-    "previewModeSigningKey": "021c33d490add5b43b266ecf3298258aa37c30e93ce68ecea21f593c3ef7eda2",
-    "previewModeEncryptionKey": "b135ff1f384fe413ec28a25ed22e74f565e2bffcd1d755877ef5d3cd23e10f5f"
+    "previewModeId": "14d2fc42d25999f83d901a6bb9c0bb4e",
+    "previewModeSigningKey": "c02fd44ac790fb468aa02132a5d362a652dc3ee4fd0ccf568119192c571c38da",
+    "previewModeEncryptionKey": "fcb067da738d6d323243f1a6965618a3d3b75c1dd15ae4e6ea6d6130a58d8a02"
   },
   "notFoundRoutes": []
 }

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/server/pages/404.html CHANGED Viewed

	@@ -1 +1 @@
1	- <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">404: This page could not be found</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/1d3222853e278f3b.js" defer=""></script><script src="/_next/static/chunks/turbopack-2020b4e8396ddd91.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_ssgManifest.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_buildManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div style="font-family:system-ui,"Segoe UI",Roboto,Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji";height:100vh;text-align:center;display:flex;flex-direction:column;align-items:center;justify-content:center"><div style="line-height:48px"><style>body{color:#000;background:#fff;margin:0}.next-error-h1{border-right:1px solid rgba(0,0,0,.3)}@media (prefers-color-scheme:dark){body{color:#fff;background:#000}.next-error-h1{border-right:1px solid rgba(255,255,255,.3)}}</style><h1 class="next-error-h1" style="display:inline-block;margin:0 20px 0 0;padding-right:23px;font-size:24px;font-weight:500;vertical-align:top">404</h1><div style="display:inline-block"><h2 style="font-size:14px;font-weight:400;line-height:28px">This page could not be found<!-- -->.</h2></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"statusCode":404}},"page":"/_error","query":{},"buildId":"~~SjAC88d3utiBvgy5eS--0~~","nextExport":true,"isFallback":false,"gip":true,"scriptLoader":[]}</script></body></html>
1	+ <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">404: This page could not be found</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/1d3222853e278f3b.js" defer=""></script><script src="/_next/static/chunks/turbopack-2020b4e8396ddd91.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_buildManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div style="font-family:system-ui,"Segoe UI",Roboto,Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji";height:100vh;text-align:center;display:flex;flex-direction:column;align-items:center;justify-content:center"><div style="line-height:48px"><style>body{color:#000;background:#fff;margin:0}.next-error-h1{border-right:1px solid rgba(0,0,0,.3)}@media (prefers-color-scheme:dark){body{color:#fff;background:#000}.next-error-h1{border-right:1px solid rgba(255,255,255,.3)}}</style><h1 class="next-error-h1" style="display:inline-block;margin:0 20px 0 0;padding-right:23px;font-size:24px;font-weight:500;vertical-align:top">404</h1><div style="display:inline-block"><h2 style="font-size:14px;font-weight:400;line-height:28px">This page could not be found<!-- -->.</h2></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"statusCode":404}},"page":"/_error","query":{},"buildId":"NipfouxkPumeJ20wdsKlr","nextExport":true,"isFallback":false,"gip":true,"scriptLoader":[]}</script></body></html>

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/server/pages/500.html CHANGED Viewed

	@@ -1 +1 @@
1	- <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">500: Internal Server Error</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/1d3222853e278f3b.js" defer=""></script><script src="/_next/static/chunks/turbopack-2020b4e8396ddd91.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_ssgManifest.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_buildManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div style="font-family:system-ui,"Segoe UI",Roboto,Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji";height:100vh;text-align:center;display:flex;flex-direction:column;align-items:center;justify-content:center"><div style="line-height:48px"><style>body{color:#000;background:#fff;margin:0}.next-error-h1{border-right:1px solid rgba(0,0,0,.3)}@media (prefers-color-scheme:dark){body{color:#fff;background:#000}.next-error-h1{border-right:1px solid rgba(255,255,255,.3)}}</style><h1 class="next-error-h1" style="display:inline-block;margin:0 20px 0 0;padding-right:23px;font-size:24px;font-weight:500;vertical-align:top">500</h1><div style="display:inline-block"><h2 style="font-size:14px;font-weight:400;line-height:28px">Internal Server Error<!-- -->.</h2></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"statusCode":500}},"page":"/_error","query":{},"buildId":"~~SjAC88d3utiBvgy5eS--0~~","nextExport":true,"isFallback":false,"gip":true,"scriptLoader":[]}</script></body></html>
1	+ <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">500: Internal Server Error</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/1d3222853e278f3b.js" defer=""></script><script src="/_next/static/chunks/turbopack-2020b4e8396ddd91.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_buildManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div style="font-family:system-ui,"Segoe UI",Roboto,Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji";height:100vh;text-align:center;display:flex;flex-direction:column;align-items:center;justify-content:center"><div style="line-height:48px"><style>body{color:#000;background:#fff;margin:0}.next-error-h1{border-right:1px solid rgba(0,0,0,.3)}@media (prefers-color-scheme:dark){body{color:#fff;background:#000}.next-error-h1{border-right:1px solid rgba(255,255,255,.3)}}</style><h1 class="next-error-h1" style="display:inline-block;margin:0 20px 0 0;padding-right:23px;font-size:24px;font-weight:500;vertical-align:top">500</h1><div style="display:inline-block"><h2 style="font-size:14px;font-weight:400;line-height:28px">Internal Server Error<!-- -->.</h2></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"statusCode":500}},"page":"/_error","query":{},"buildId":"NipfouxkPumeJ20wdsKlr","nextExport":true,"isFallback":false,"gip":true,"scriptLoader":[]}</script></body></html>

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/server/pages/[pipeline]/run/[runId].html CHANGED Viewed

	@@ -1 +1 @@
1	- <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/ea7338704ffb3b75.js" defer=""></script><script src="/_next/static/chunks/0407c34857ed1d44.js" defer=""></script><script src="/_next/static/chunks/turbopack-3ef30666a4876a93.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_buildManifest.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_ssgManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/[pipeline]/run/[runId]","query":{},"buildId":"~~SjAC88d3utiBvgy5eS--0~~","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>
1	+ <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/ea7338704ffb3b75.js" defer=""></script><script src="/_next/static/chunks/0407c34857ed1d44.js" defer=""></script><script src="/_next/static/chunks/turbopack-3ef30666a4876a93.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_buildManifest.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js" defer=""></script></head><body><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/[pipeline]/run/[runId]","query":{},"buildId":"NipfouxkPumeJ20wdsKlr","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/server/pages/[pipeline].html CHANGED Viewed

	@@ -1 +1 @@
1	- <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/ff7d20e97680d2ee.js" defer=""></script><script src="/_next/static/chunks/6f8a28bb54d1476e.js" defer=""></script><script src="/_next/static/chunks/d00ef473c6e5deb6.js" defer=""></script><script src="/_next/static/chunks/turbopack-4ab2e5754ea0dfc2.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_buildManifest.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_ssgManifest.js" defer=""></script></head><body><link rel="preload" as="image" href="/logo-cream.svg"/><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div class="Runs-module__drje5a__container"><div style="display:flex;flex-direction:column;align-items:center;justify-content:center;height:100%;gap:1.5rem;padding:4rem 2rem;position:relative"><div style="position:absolute;top:1rem;right:1rem"><div class="PipelineSelector-module__xQFfUa__wrapper"><button class="PipelineSelector-module__xQFfUa__trigger"><span class="PipelineSelector-module__xQFfUa__triggerPlaceholder">Select pipeline</span><svg width="10" height="10" viewBox="0 0 10 10" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round" class="PipelineSelector-module__xQFfUa__triggerChevron"><polyline points="2,3.5 5,6.5 8,3.5"></polyline></svg></button></div></div><img src="/logo-cream.svg" alt="Kaizen" class="Runs-module__drje5a__heroLogo"/><h1 style="font-size:1.5rem;font-weight:600;color:#fafafa;margin:0">Kaizen</h1><p style="font-size:0.9rem;color:var(--text-secondary);text-align:center;max-width:400px;line-height:1.6">Select a pipeline on the left to investigate traces, build evaluation datasets, record runs, and prepare improvements.</p><div style="display:flex;gap:2rem;margin-top:1rem;font-size:0.75rem;color:var(--text-tertiary)"><span>0<!-- --> pipeline<!-- -->s</span><span>0<!-- --> with eval datasets</span><span>0<!-- --> in progress</span></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/[pipeline]","query":{},"buildId":"~~SjAC88d3utiBvgy5eS--0~~","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>
1	+ <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/ff7d20e97680d2ee.js" defer=""></script><script src="/_next/static/chunks/6f8a28bb54d1476e.js" defer=""></script><script src="/_next/static/chunks/d00ef473c6e5deb6.js" defer=""></script><script src="/_next/static/chunks/turbopack-4ab2e5754ea0dfc2.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_buildManifest.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js" defer=""></script></head><body><link rel="preload" as="image" href="/logo-cream.svg"/><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div class="Runs-module__drje5a__container"><div style="display:flex;flex-direction:column;align-items:center;justify-content:center;height:100%;gap:1.5rem;padding:4rem 2rem;position:relative"><div style="position:absolute;top:1rem;right:1rem"><div class="PipelineSelector-module__xQFfUa__wrapper"><button class="PipelineSelector-module__xQFfUa__trigger"><span class="PipelineSelector-module__xQFfUa__triggerPlaceholder">Select pipeline</span><svg width="10" height="10" viewBox="0 0 10 10" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round" class="PipelineSelector-module__xQFfUa__triggerChevron"><polyline points="2,3.5 5,6.5 8,3.5"></polyline></svg></button></div></div><img src="/logo-cream.svg" alt="Kaizen" class="Runs-module__drje5a__heroLogo"/><h1 style="font-size:1.5rem;font-weight:600;color:#fafafa;margin:0">Kaizen</h1><p style="font-size:0.9rem;color:var(--text-secondary);text-align:center;max-width:400px;line-height:1.6">Select a pipeline on the left to investigate traces, build evaluation datasets, record runs, and prepare improvements.</p><div style="display:flex;gap:2rem;margin-top:1rem;font-size:0.75rem;color:var(--text-tertiary)"><span>0<!-- --> pipeline<!-- -->s</span><span>0<!-- --> with eval datasets</span><span>0<!-- --> in progress</span></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/[pipeline]","query":{},"buildId":"NipfouxkPumeJ20wdsKlr","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>

package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/server/pages/index.html CHANGED Viewed

	@@ -1 +1 @@
1	- <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/4a52053c5f0b5bd9.js" defer=""></script><script src="/_next/static/chunks/6f8a28bb54d1476e.js" defer=""></script><script src="/_next/static/chunks/d00ef473c6e5deb6.js" defer=""></script><script src="/_next/static/chunks/turbopack-55cc3a90e23138f9.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_ssgManifest.js" defer=""></script><script src="/_next/static/~~SjAC88d3utiBvgy5eS--0~~/_buildManifest.js" defer=""></script></head><body><link rel="preload" as="image" href="/logo-cream.svg"/><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div class="Runs-module__drje5a__container"><div style="display:flex;flex-direction:column;align-items:center;justify-content:center;height:100%;gap:1.5rem;padding:4rem 2rem;position:relative"><div style="position:absolute;top:1rem;right:1rem"><div class="PipelineSelector-module__xQFfUa__wrapper"><button class="PipelineSelector-module__xQFfUa__trigger"><span class="PipelineSelector-module__xQFfUa__triggerPlaceholder">Select pipeline</span><svg width="10" height="10" viewBox="0 0 10 10" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round" class="PipelineSelector-module__xQFfUa__triggerChevron"><polyline points="2,3.5 5,6.5 8,3.5"></polyline></svg></button></div></div><img src="/logo-cream.svg" alt="Kaizen" class="Runs-module__drje5a__heroLogo"/><h1 style="font-size:1.5rem;font-weight:600;color:#fafafa;margin:0">Kaizen</h1><p style="font-size:0.9rem;color:var(--text-secondary);text-align:center;max-width:400px;line-height:1.6">Select a pipeline on the left to investigate traces, build evaluation datasets, record runs, and prepare improvements.</p><div style="display:flex;gap:2rem;margin-top:1rem;font-size:0.75rem;color:var(--text-tertiary)"><span>0<!-- --> pipeline<!-- -->s</span><span>0<!-- --> with eval datasets</span><span>0<!-- --> in progress</span></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/","query":{},"buildId":"~~SjAC88d3utiBvgy5eS--0~~","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>
1	+ <!DOCTYPE html><html lang="en"><head><meta charSet="utf-8" data-next-head=""/><meta name="viewport" content="width=device-width" data-next-head=""/><title data-next-head="">Kaizen</title><link rel="icon" href="/favicon.svg" type="image/svg+xml"/><link rel="preload" href="/_next/static/chunks/957e4eafeea52721.css" as="style"/><link rel="preload" href="/_next/static/chunks/fc08cb52cbbd9486.css" as="style"/><link rel="stylesheet" href="/_next/static/chunks/957e4eafeea52721.css" data-n-g=""/><link rel="stylesheet" href="/_next/static/chunks/fc08cb52cbbd9486.css" data-n-p=""/><noscript data-n-css=""></noscript><script src="/_next/static/chunks/e7de444fec87369c.js" defer=""></script><script src="/_next/static/chunks/e39ca73a3364340b.js" defer=""></script><script src="/_next/static/chunks/31c9bc0d82922da1.js" defer=""></script><script src="/_next/static/chunks/turbopack-7c8bece1dcb2a025.js" defer=""></script><script src="/_next/static/chunks/4a52053c5f0b5bd9.js" defer=""></script><script src="/_next/static/chunks/6f8a28bb54d1476e.js" defer=""></script><script src="/_next/static/chunks/d00ef473c6e5deb6.js" defer=""></script><script src="/_next/static/chunks/turbopack-55cc3a90e23138f9.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_ssgManifest.js" defer=""></script><script src="/_next/static/NipfouxkPumeJ20wdsKlr/_buildManifest.js" defer=""></script></head><body><link rel="preload" as="image" href="/logo-cream.svg"/><div id="__next"><div style="display:flex;height:100vh;overflow:hidden"><div style="flex:1;overflow:hidden;display:flex;flex-direction:column"><div style="flex:1;overflow:auto"><div class="Runs-module__drje5a__container"><div style="display:flex;flex-direction:column;align-items:center;justify-content:center;height:100%;gap:1.5rem;padding:4rem 2rem;position:relative"><div style="position:absolute;top:1rem;right:1rem"><div class="PipelineSelector-module__xQFfUa__wrapper"><button class="PipelineSelector-module__xQFfUa__trigger"><span class="PipelineSelector-module__xQFfUa__triggerPlaceholder">Select pipeline</span><svg width="10" height="10" viewBox="0 0 10 10" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round" class="PipelineSelector-module__xQFfUa__triggerChevron"><polyline points="2,3.5 5,6.5 8,3.5"></polyline></svg></button></div></div><img src="/logo-cream.svg" alt="Kaizen" class="Runs-module__drje5a__heroLogo"/><h1 style="font-size:1.5rem;font-weight:600;color:#fafafa;margin:0">Kaizen</h1><p style="font-size:0.9rem;color:var(--text-secondary);text-align:center;max-width:400px;line-height:1.6">Select a pipeline on the left to investigate traces, build evaluation datasets, record runs, and prepare improvements.</p><div style="display:flex;gap:2rem;margin-top:1rem;font-size:0.75rem;color:var(--text-tertiary)"><span>0<!-- --> pipeline<!-- -->s</span><span>0<!-- --> with eval datasets</span><span>0<!-- --> in progress</span></div></div></div></div></div></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{}},"page":"/","query":{},"buildId":"NipfouxkPumeJ20wdsKlr","nextExport":true,"autoExport":true,"isFallback":false,"scriptLoader":[]}</script></body></html>

package/dist/commands/init-pipeline.js CHANGED Viewed

@@ -5,6 +5,7 @@ import { boolFlag, parseFlags, strFlag } from "../lib/parse-args.js";
 import { templatesDir, workspaceRoot } from "../lib/paths.js";
 import { prompt, promptChoice } from "../lib/prompt.js";
 const EVAL_STYLES = ["ground-truth", "llm-as-judge", "hybrid"];
+const EVAL_LANGUAGES = ["python", "typescript"];
 export async function runInitPipeline(argv) {
     const { positional, flags } = parseFlags(argv);
     const root = workspaceRoot();
@@ -24,6 +25,11 @@ export async function runInitPipeline(argv) {
         (await prompt("one-line description", `${name} pipeline`));
     const evalStyle = (strFlag(flags, "eval-style") ??
         (await promptChoice("eval style", [...EVAL_STYLES], "ground-truth")));
+    const evalLanguage = normalizeEvalLanguage(strFlag(flags, "eval-language") ?? strFlag(flags, "language") ?? "python");
+    if (!evalLanguage) {
+        process.stderr.write(`invalid eval language. use one of: ${EVAL_LANGUAGES.join(", ")}, py, ts.\n`);
+        return 1;
+    }
     const primaryMetric = strFlag(flags, "metric") ??
         (await prompt("primary metric name", evalStyle === "ground-truth" ? "accuracy" : "score"));
     const target = strFlag(flags, "target") ?? (await prompt("target score (0-1)", "0.90"));
@@ -33,10 +39,11 @@ export async function runInitPipeline(argv) {
         eval_style: evalStyle,
         primary_metric: primaryMetric,
         target,
+        eval_ext: evalLanguage === "typescript" ? "ts" : "py",
         iso_now: new Date().toISOString(),
     };
     const pipelinePath = join(root, "pipelines", `${name}.md`);
-    const evalPath = join(root, "eval", `${name}.py`);
+    const evalPath = join(root, "eval", `${name}.${vars.eval_ext}`);
     const rubricPath = join(root, "rubrics", `${name}.md`);
     if (!force) {
         for (const p of [pipelinePath, evalPath]) {
@@ -50,14 +57,14 @@ export async function runInitPipeline(argv) {
     ensureDir(join(root, "eval"));
     const tpl = templatesDir();
     writeFileSafely(pipelinePath, applyVars(readFileSync(join(tpl, "pipeline", "pipeline.md"), "utf-8"), vars), { overwrite: force });
-    writeFileSafely(evalPath, applyVars(readFileSync(join(tpl, "pipeline", "eval.py"), "utf-8"), vars), { overwrite: force });
+    writeFileSafely(evalPath, applyVars(readFileSync(join(tpl, "pipeline", evalLanguage === "typescript" ? "eval.ts" : "eval.py"), "utf-8"), vars), { overwrite: force });
     if (evalStyle !== "ground-truth") {
         ensureDir(join(root, "rubrics"));
         writeFileSafely(rubricPath, applyVars(readFileSync(join(tpl, "pipeline", "rubric.md"), "utf-8"), vars), { overwrite: force });
     }
     process.stdout.write(`scaffolded pipeline "${name}":\n`);
     process.stdout.write(`  pipelines/${name}.md\n`);
-    process.stdout.write(`  eval/${name}.py\n`);
+    process.stdout.write(`  eval/${name}.${vars.eval_ext}\n`);
     if (evalStyle !== "ground-truth")
         process.stdout.write(`  rubrics/${name}.md\n`);
     process.stdout.write([
@@ -70,4 +77,12 @@ export async function runInitPipeline(argv) {
     ].join("\n"));
     return 0;
 }
+function normalizeEvalLanguage(raw) {
+    const normalized = raw.toLowerCase();
+    if (normalized === "python" || normalized === "py")
+        return "python";
+    if (normalized === "typescript" || normalized === "ts")
+        return "typescript";
+    return null;
+}
 //# sourceMappingURL=init-pipeline.js.map

package/dist/commands/init-pipeline.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"file":"init-pipeline.js","sourceRoot":"","sources":["../../src/commands/init-pipeline.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,YAAY,EAAE,MAAM,SAAS,CAAC;AACnD,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AACjC,OAAO,EAAE,SAAS,EAAE,SAAS,EAAE,eAAe,EAAE,MAAM,oBAAoB,CAAC;AAC3E,OAAO,EAAE,QAAQ,EAAE,UAAU,EAAE,OAAO,EAAE,MAAM,sBAAsB,CAAC;AACrE,OAAO,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AAC9D,OAAO,EAAE,MAAM,EAAE,YAAY,EAAE,MAAM,kBAAkB,CAAC;AAExD,MAAM,WAAW,GAAG,CAAC,cAAc,EAAE,cAAc,EAAE,QAAQ,CAAU,CAAC;~~AAGxE~~,MAAM,CAAC,KAAK,UAAU,eAAe,CAAC,IAAc;IAClD,MAAM,EAAE,UAAU,EAAE,KAAK,EAAE,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC;IAC/C,MAAM,IAAI,GAAG,aAAa,EAAE,CAAC;IAC7B,MAAM,KAAK,GAAG,QAAQ,CAAC,KAAK,EAAE,OAAO,CAAC,CAAC;IAEvC,IAAI,CAAC,UAAU,CAAC,IAAI,CAAC,IAAI,EAAE,kBAAkB,CAAC,CAAC,EAAE,CAAC;QAChD,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,0BAA0B,IAAI,iCAAiC,CAChE,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,MAAM,IAAI,GACR,OAAO,CAAC,KAAK,EAAE,MAAM,CAAC;QACtB,UAAU,CAAC,CAAC,CAAC;QACb,CAAC,MAAM,MAAM,CAAC,4BAA4B,CAAC,CAAC,CAAC;IAC/C,IAAI,CAAC,IAAI,IAAI,CAAC,mBAAmB,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;QAC7C,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,2BAA2B,IAAI,0CAA0C,CAC1E,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,MAAM,WAAW,GACf,OAAO,CAAC,KAAK,EAAE,aAAa,CAAC;QAC7B,CAAC,MAAM,MAAM,CAAC,sBAAsB,EAAE,GAAG,IAAI,WAAW,CAAC,CAAC,CAAC;IAE7D,MAAM,SAAS,GAAG,CAAC,OAAO,CAAC,KAAK,EAAE,YAAY,CAAC;QAC7C,CAAC,MAAM,YAAY,CACjB,YAAY,EACZ,CAAC,GAAG,WAAW,CAAC,EAChB,cAAc,CACf,CAAC,CAAc,CAAC;IAEnB,MAAM,aAAa,GACjB,OAAO,CAAC,KAAK,EAAE,QAAQ,CAAC;QACxB,CAAC,MAAM,MAAM,CACX,qBAAqB,EACrB,SAAS,KAAK,cAAc,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,OAAO,CACpD,CAAC,CAAC;IAEL,MAAM,MAAM,GACV,OAAO,CAAC,KAAK,EAAE,QAAQ,CAAC,IAAI,CAAC,MAAM,MAAM,CAAC,oBAAoB,EAAE,MAAM,CAAC,CAAC,CAAC;IAE3E,MAAM,IAAI,GAA2B;QACnC,IAAI;QACJ,WAAW;QACX,UAAU,EAAE,SAAS;QACrB,cAAc,EAAE,aAAa;QAC7B,MAAM;QACN,OAAO,EAAE,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE;KAClC,CAAC;IAEF,MAAM,YAAY,GAAG,IAAI,CAAC,IAAI,EAAE,WAAW,EAAE,GAAG,IAAI,KAAK,CAAC,CAAC;IAC3D,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,IAAI,~~KAAK~~,CAAC,CAAC;~~IAClD~~,MAAM,UAAU,GAAG,IAAI,CAAC,IAAI,EAAE,SAAS,EAAE,GAAG,IAAI,KAAK,CAAC,CAAC;IAEvD,IAAI,CAAC,KAAK,EAAE,CAAC;QACX,KAAK,MAAM,CAAC,IAAI,CAAC,YAAY,EAAE,QAAQ,CAAC,EAAE,CAAC;YACzC,IAAI,UAAU,CAAC,CAAC,CAAC,EAAE,CAAC;gBAClB,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,yBAAyB,CAAC,8BAA8B,CACzD,CAAC;gBACF,OAAO,CAAC,CAAC;YACX,CAAC;QACH,CAAC;IACH,CAAC;IAED,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,CAAC,CAAC;IACnC,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,MAAM,CAAC,CAAC,CAAC;IAE9B,MAAM,GAAG,GAAG,YAAY,EAAE,CAAC;IAC3B,eAAe,CACb,YAAY,EACZ,SAAS,CACP,YAAY,CAAC,IAAI,CAAC,GAAG,EAAE,UAAU,EAAE,aAAa,CAAC,EAAE,OAAO,CAAC,EAC3D,IAAI,CACL,EACD,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IACF,eAAe,CACb,QAAQ,EACR,SAAS,~~CAAC~~,YAAY,~~CAAC~~,IAAI,~~CAAC~~,GAAG,~~EAAE~~,UAAU,~~EAAE~~,SAAS,CAAC,~~EAAE~~,OAAO,~~CAAC~~,~~EAAE~~,IAAI,~~CAAC~~,~~EACxE~~,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IAEF,IAAI,SAAS,KAAK,cAAc,EAAE,CAAC;QACjC,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,CAAC,CAAC;QACjC,eAAe,CACb,UAAU,EACV,SAAS,CACP,YAAY,CAAC,IAAI,CAAC,GAAG,EAAE,UAAU,EAAE,WAAW,CAAC,EAAE,OAAO,CAAC,EACzD,IAAI,CACL,EACD,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IACJ,CAAC;IAED,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,wBAAwB,IAAI,MAAM,CAAC,CAAC;IACzD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,eAAe,IAAI,OAAO,CAAC,CAAC;IACjD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,UAAU,IAAI,~~OAAO~~,CAAC,CAAC;~~IAC5C~~,IAAI,SAAS,KAAK,cAAc;QAC9B,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,aAAa,IAAI,OAAO,CAAC,CAAC;IACjD,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB;QACE,EAAE;QACF,6EAA6E;QAC7E,6DAA6D;QAC7D,EAAE;QACF,2BAA2B,IAAI,sDAAsD;QACrF,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,OAAO,CAAC,CAAC;AACX,CAAC"}
1	+ {"version":3,"file":"init-pipeline.js","sourceRoot":"","sources":["../../src/commands/init-pipeline.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,YAAY,EAAE,MAAM,SAAS,CAAC;AACnD,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AACjC,OAAO,EAAE,SAAS,EAAE,SAAS,EAAE,eAAe,EAAE,MAAM,oBAAoB,CAAC;AAC3E,OAAO,EAAE,QAAQ,EAAE,UAAU,EAAE,OAAO,EAAE,MAAM,sBAAsB,CAAC;AACrE,OAAO,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AAC9D,OAAO,EAAE,MAAM,EAAE,YAAY,EAAE,MAAM,kBAAkB,CAAC;AAExD,MAAM,WAAW,GAAG,CAAC,cAAc,EAAE,cAAc,EAAE,QAAQ,CAAU,CAAC;AAExE,MAAM,cAAc,GAAG,CAAC,QAAQ,EAAE,YAAY,CAAU,CAAC;AAGzD,MAAM,CAAC,KAAK,UAAU,eAAe,CAAC,IAAc;IAClD,MAAM,EAAE,UAAU,EAAE,KAAK,EAAE,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC;IAC/C,MAAM,IAAI,GAAG,aAAa,EAAE,CAAC;IAC7B,MAAM,KAAK,GAAG,QAAQ,CAAC,KAAK,EAAE,OAAO,CAAC,CAAC;IAEvC,IAAI,CAAC,UAAU,CAAC,IAAI,CAAC,IAAI,EAAE,kBAAkB,CAAC,CAAC,EAAE,CAAC;QAChD,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,0BAA0B,IAAI,iCAAiC,CAChE,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,MAAM,IAAI,GACR,OAAO,CAAC,KAAK,EAAE,MAAM,CAAC;QACtB,UAAU,CAAC,CAAC,CAAC;QACb,CAAC,MAAM,MAAM,CAAC,4BAA4B,CAAC,CAAC,CAAC;IAC/C,IAAI,CAAC,IAAI,IAAI,CAAC,mBAAmB,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAAC;QAC7C,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,2BAA2B,IAAI,0CAA0C,CAC1E,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,MAAM,WAAW,GACf,OAAO,CAAC,KAAK,EAAE,aAAa,CAAC;QAC7B,CAAC,MAAM,MAAM,CAAC,sBAAsB,EAAE,GAAG,IAAI,WAAW,CAAC,CAAC,CAAC;IAE7D,MAAM,SAAS,GAAG,CAAC,OAAO,CAAC,KAAK,EAAE,YAAY,CAAC;QAC7C,CAAC,MAAM,YAAY,CACjB,YAAY,EACZ,CAAC,GAAG,WAAW,CAAC,EAChB,cAAc,CACf,CAAC,CAAc,CAAC;IAEnB,MAAM,YAAY,GAAG,qBAAqB,CACxC,OAAO,CAAC,KAAK,EAAE,eAAe,CAAC,IAAI,OAAO,CAAC,KAAK,EAAE,UAAU,CAAC,IAAI,QAAQ,CAC1E,CAAC;IACF,IAAI,CAAC,YAAY,EAAE,CAAC;QAClB,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,sCAAsC,cAAc,CAAC,IAAI,CAAC,IAAI,CAAC,aAAa,CAC7E,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,MAAM,aAAa,GACjB,OAAO,CAAC,KAAK,EAAE,QAAQ,CAAC;QACxB,CAAC,MAAM,MAAM,CACX,qBAAqB,EACrB,SAAS,KAAK,cAAc,CAAC,CAAC,CAAC,UAAU,CAAC,CAAC,CAAC,OAAO,CACpD,CAAC,CAAC;IAEL,MAAM,MAAM,GACV,OAAO,CAAC,KAAK,EAAE,QAAQ,CAAC,IAAI,CAAC,MAAM,MAAM,CAAC,oBAAoB,EAAE,MAAM,CAAC,CAAC,CAAC;IAE3E,MAAM,IAAI,GAA2B;QACnC,IAAI;QACJ,WAAW;QACX,UAAU,EAAE,SAAS;QACrB,cAAc,EAAE,aAAa;QAC7B,MAAM;QACN,QAAQ,EAAE,YAAY,KAAK,YAAY,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,IAAI;QACrD,OAAO,EAAE,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE;KAClC,CAAC;IAEF,MAAM,YAAY,GAAG,IAAI,CAAC,IAAI,EAAE,WAAW,EAAE,GAAG,IAAI,KAAK,CAAC,CAAC;IAC3D,MAAM,QAAQ,GAAG,IAAI,CAAC,IAAI,EAAE,MAAM,EAAE,GAAG,IAAI,IAAI,IAAI,CAAC,QAAQ,EAAE,CAAC,CAAC;IAChE,MAAM,UAAU,GAAG,IAAI,CAAC,IAAI,EAAE,SAAS,EAAE,GAAG,IAAI,KAAK,CAAC,CAAC;IAEvD,IAAI,CAAC,KAAK,EAAE,CAAC;QACX,KAAK,MAAM,CAAC,IAAI,CAAC,YAAY,EAAE,QAAQ,CAAC,EAAE,CAAC;YACzC,IAAI,UAAU,CAAC,CAAC,CAAC,EAAE,CAAC;gBAClB,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,yBAAyB,CAAC,8BAA8B,CACzD,CAAC;gBACF,OAAO,CAAC,CAAC;YACX,CAAC;QACH,CAAC;IACH,CAAC;IAED,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,CAAC,CAAC;IACnC,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,MAAM,CAAC,CAAC,CAAC;IAE9B,MAAM,GAAG,GAAG,YAAY,EAAE,CAAC;IAC3B,eAAe,CACb,YAAY,EACZ,SAAS,CACP,YAAY,CAAC,IAAI,CAAC,GAAG,EAAE,UAAU,EAAE,aAAa,CAAC,EAAE,OAAO,CAAC,EAC3D,IAAI,CACL,EACD,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IACF,eAAe,CACb,QAAQ,EACR,SAAS,CACP,YAAY,CACV,IAAI,CACF,GAAG,EACH,UAAU,EACV,YAAY,KAAK,YAAY,CAAC,CAAC,CAAC,SAAS,CAAC,CAAC,CAAC,SAAS,CACtD,EACD,OAAO,CACR,EACD,IAAI,CACL,EACD,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IAEF,IAAI,SAAS,KAAK,cAAc,EAAE,CAAC;QACjC,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,CAAC,CAAC;QACjC,eAAe,CACb,UAAU,EACV,SAAS,CACP,YAAY,CAAC,IAAI,CAAC,GAAG,EAAE,UAAU,EAAE,WAAW,CAAC,EAAE,OAAO,CAAC,EACzD,IAAI,CACL,EACD,EAAE,SAAS,EAAE,KAAK,EAAE,CACrB,CAAC;IACJ,CAAC;IAED,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,wBAAwB,IAAI,MAAM,CAAC,CAAC;IACzD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,eAAe,IAAI,OAAO,CAAC,CAAC;IACjD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,UAAU,IAAI,IAAI,IAAI,CAAC,QAAQ,IAAI,CAAC,CAAC;IAC1D,IAAI,SAAS,KAAK,cAAc;QAC9B,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,aAAa,IAAI,OAAO,CAAC,CAAC;IACjD,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB;QACE,EAAE;QACF,6EAA6E;QAC7E,6DAA6D;QAC7D,EAAE;QACF,2BAA2B,IAAI,sDAAsD;QACrF,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,OAAO,CAAC,CAAC;AACX,CAAC;AAED,SAAS,qBAAqB,CAAC,GAAW;IACxC,MAAM,UAAU,GAAG,GAAG,CAAC,WAAW,EAAE,CAAC;IACrC,IAAI,UAAU,KAAK,QAAQ,IAAI,UAAU,KAAK,IAAI;QAAE,OAAO,QAAQ,CAAC;IACpE,IAAI,UAAU,KAAK,YAAY,IAAI,UAAU,KAAK,IAAI;QAAE,OAAO,YAAY,CAAC;IAC5E,OAAO,IAAI,CAAC;AACd,CAAC"}

package/dist/commands/init.js CHANGED Viewed

@@ -108,6 +108,7 @@ function appendClaudeSection(path, vars) {
         "",
         "- Pipeline definitions live in `pipelines/*.md`.",
         "- Each pipeline has an eval script under `eval/` that emits NDJSON events.",
+        "- Real Langfuse-backed eval scripts should also link each dataset item to the fresh run trace in a Langfuse dataset run and write the primary metric as a trace score.",
         "- Record runs via the supervisor: `kaizen run --pipeline <p> --variant <v>`.",
         "- Open the dashboard with `kaizen studio` (default port 6789).",
         "- Custom per-pipeline UIs go in `views/<pipeline>/index.tsx`.",

package/dist/commands/init.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"file":"init.js","sourceRoot":"","sources":["../../src/commands/init.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,SAAS,CAAC;AAClE,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AACjC,OAAO,EACL,eAAe,EACf,iBAAiB,EACjB,SAAS,EACT,eAAe,GAChB,MAAM,oBAAoB,CAAC;AAC5B,OAAO,EAAE,QAAQ,EAAE,UAAU,EAAE,OAAO,EAAE,MAAM,sBAAsB,CAAC;AACrE,OAAO,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AAC9D,OAAO,EAAE,MAAM,EAAE,MAAM,kBAAkB,CAAC;AAE1C,MAAM,CAAC,KAAK,UAAU,OAAO,CAAC,IAAc;IAC1C,MAAM,EAAE,KAAK,EAAE,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC;IACnC,MAAM,KAAK,GAAG,QAAQ,CAAC,KAAK,EAAE,OAAO,CAAC,CAAC;IACvC,MAAM,IAAI,GAAG,aAAa,EAAE,CAAC;IAC7B,MAAM,UAAU,GAAG,IAAI,CAAC,IAAI,EAAE,kBAAkB,CAAC,CAAC;IAElD,IAAI,UAAU,CAAC,UAAU,CAAC,IAAI,CAAC,KAAK,EAAE,CAAC;QACrC,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,sCAAsC,UAAU,IAAI;YAClD,iGAAiG,CACpG,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,2CAA2C,CAAC,CAAC;IAElE,MAAM,QAAQ,GACZ,OAAO,CAAC,KAAK,EAAE,UAAU,CAAC;QAC1B,CAAC,MAAM,MAAM,CACX,qCAAqC,EACrC,iBAAiB,CAAC,IAAI,CAAC,CACxB,CAAC,CAAC;IACL,MAAM,YAAY,GAChB,OAAO,CAAC,KAAK,EAAE,eAAe,CAAC;QAC/B,CAAC,MAAM,MAAM,CAAC,uBAAuB,EAAE,QAAQ,CAAC,CAAC,CAAC;IACpD,MAAM,YAAY,GAChB,OAAO,CAAC,KAAK,EAAE,eAAe,CAAC;QAC/B,CAAC,MAAM,MAAM,CAAC,mBAAmB,EAAE,8BAA8B,CAAC,CAAC,CAAC;IAEtE,MAAM,IAAI,GAA2B;QACnC,QAAQ;QACR,aAAa,EAAE,YAAY;QAC3B,aAAa,EAAE,YAAY;KAC5B,CAAC;IAEF,sBAAsB;IACtB,eAAe,CAAC,UAAU,EAAE,YAAY,CAAC,IAAI,CAAC,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,CAAC,CAAC;IAEtE,oBAAoB;IACpB,KAAK,MAAM,GAAG,IAAI,CAAC,WAAW,EAAE,SAAS,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,CAAC;QAC5D,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,GAAG,CAAC,CAAC,CAAC;QAC3B,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,GAAG,EAAE,UAAU,CAAC,EAAE,EAAE,CAAC,CAAC;IACnD,CAAC;IACD,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,CAAC,CAAC;IAEjC,4CAA4C;IAC5C,MAAM,aAAa,GAAG,iBAAiB,CACrC,IAAI,CAAC,YAAY,EAAE,EAAE,WAAW,EAAE,SAAS,CAAC,EAC5C,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,EACrB,IAAI,CACL,CAAC;IAEF,mFAAmF;IACnF,eAAe,CACb,IAAI,CAAC,IAAI,EAAE,SAAS,EAAE,YAAY,CAAC,EACnC;QACE,gGAAgG;QAChG,OAAO;QACP,OAAO;QACP,cAAc;QACd,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,kCAAkC;IAClC,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,UAAU,CAAC,CAAC;IACtD,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,eAAe,CAAC,CAAC;IAC3D,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,eAAe,CAAC,CAAC;IAE3D,8DAA8D;IAC9D,mBAAmB,CAAC,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,EAAE,IAAI,CAAC,CAAC;IAEnD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,iBAAiB,CAAC,CAAC;IACxC,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,KAAK,GAAG,CAAC,IAAI,EAAE,UAAU,CAAC,IAAI,CAAC,CAAC;IACrD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;IAChE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,wBAAwB,CAAC,CAAC;IAC/C,KAAK,MAAM,CAAC,IAAI,aAAa;QAAE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,aAAa,CAAC,IAAI,CAAC,CAAC;IAExE,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB;QACE,EAAE;QACF,OAAO;QACP,gEAAgE;QAChE,2DAA2D;QAC3D,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,OAAO,CAAC,CAAC;AACX,CAAC;AAED,SAAS,iBAAiB,CAAC,IAAY;IACrC,MAAM,IAAI,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,IAAI,EAAE,CAAC;IACzC,OAAO,IAAI,CAAC,OAAO,CAAC,cAAc,EAAE,EAAE,CAAC,CAAC,WAAW,EAAE,IAAI,UAAU,CAAC;AACtE,CAAC;AAED,SAAS,GAAG,CAAC,IAAY,EAAE,CAAS;IAClC,OAAO,CAAC,CAAC,UAAU,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;AAC3D,CAAC;AAED,SAAS,YAAY,CAAC,IAA4B;IAChD,6EAA6E;IAC7E,uEAAuE;IACvE,sBAAsB;IACtB,OAAO;;;;YAIG,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,QAAQ,CAAC;YAC7B,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,aAAa,CAAC;;;YAGlC,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,aAAa,CAAC;;;;;;;;;;;CAW7C,CAAC;AACF,CAAC;AAED,SAAS,mBAAmB,CAAC,IAAY,EAAE,IAA4B;IACrE,MAAM,GAAG,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,YAAY,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC;IAChE,IAAI,GAAG,CAAC,QAAQ,CAAC,WAAW,CAAC;QAAE,OAAO,CAAC,+BAA+B;IACtE,MAAM,OAAO,GAAG;QACd,WAAW;QACX,EAAE;QACF,yFAAyF;QACzF,EAAE;QACF,kDAAkD;QAClD,4EAA4E;QAC5E,8EAA8E;QAC9E,gEAAgE;QAChE,+DAA+D;QAC/D,uDAAuD;QACvD,kFAAkF;QAClF,EAAE;QACF,aAAa,IAAI,CAAC,aAAa,aAAa,IAAI,CAAC,QAAQ,KAAK;QAC9D,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IACb,MAAM,GAAG,GAAG,GAAG,CAAC,MAAM,KAAK,CAAC,IAAI,GAAG,CAAC,QAAQ,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC;IAC/D,aAAa,CAAC,IAAI,EAAE,GAAG,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,GAAG,OAAO,CAAC,CAAC;AACtE,CAAC"}
1	+ {"version":3,"file":"init.js","sourceRoot":"","sources":["../../src/commands/init.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,UAAU,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,SAAS,CAAC;AAClE,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AACjC,OAAO,EACL,eAAe,EACf,iBAAiB,EACjB,SAAS,EACT,eAAe,GAChB,MAAM,oBAAoB,CAAC;AAC5B,OAAO,EAAE,QAAQ,EAAE,UAAU,EAAE,OAAO,EAAE,MAAM,sBAAsB,CAAC;AACrE,OAAO,EAAE,YAAY,EAAE,aAAa,EAAE,MAAM,iBAAiB,CAAC;AAC9D,OAAO,EAAE,MAAM,EAAE,MAAM,kBAAkB,CAAC;AAE1C,MAAM,CAAC,KAAK,UAAU,OAAO,CAAC,IAAc;IAC1C,MAAM,EAAE,KAAK,EAAE,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC;IACnC,MAAM,KAAK,GAAG,QAAQ,CAAC,KAAK,EAAE,OAAO,CAAC,CAAC;IACvC,MAAM,IAAI,GAAG,aAAa,EAAE,CAAC;IAC7B,MAAM,UAAU,GAAG,IAAI,CAAC,IAAI,EAAE,kBAAkB,CAAC,CAAC;IAElD,IAAI,UAAU,CAAC,UAAU,CAAC,IAAI,CAAC,KAAK,EAAE,CAAC;QACrC,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB,sCAAsC,UAAU,IAAI;YAClD,iGAAiG,CACpG,CAAC;QACF,OAAO,CAAC,CAAC;IACX,CAAC;IAED,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,2CAA2C,CAAC,CAAC;IAElE,MAAM,QAAQ,GACZ,OAAO,CAAC,KAAK,EAAE,UAAU,CAAC;QAC1B,CAAC,MAAM,MAAM,CACX,qCAAqC,EACrC,iBAAiB,CAAC,IAAI,CAAC,CACxB,CAAC,CAAC;IACL,MAAM,YAAY,GAChB,OAAO,CAAC,KAAK,EAAE,eAAe,CAAC;QAC/B,CAAC,MAAM,MAAM,CAAC,uBAAuB,EAAE,QAAQ,CAAC,CAAC,CAAC;IACpD,MAAM,YAAY,GAChB,OAAO,CAAC,KAAK,EAAE,eAAe,CAAC;QAC/B,CAAC,MAAM,MAAM,CAAC,mBAAmB,EAAE,8BAA8B,CAAC,CAAC,CAAC;IAEtE,MAAM,IAAI,GAA2B;QACnC,QAAQ;QACR,aAAa,EAAE,YAAY;QAC3B,aAAa,EAAE,YAAY;KAC5B,CAAC;IAEF,sBAAsB;IACtB,eAAe,CAAC,UAAU,EAAE,YAAY,CAAC,IAAI,CAAC,EAAE,EAAE,SAAS,EAAE,KAAK,EAAE,CAAC,CAAC;IAEtE,oBAAoB;IACpB,KAAK,MAAM,GAAG,IAAI,CAAC,WAAW,EAAE,SAAS,EAAE,MAAM,EAAE,OAAO,CAAC,EAAE,CAAC;QAC5D,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,GAAG,CAAC,CAAC,CAAC;QAC3B,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,GAAG,EAAE,UAAU,CAAC,EAAE,EAAE,CAAC,CAAC;IACnD,CAAC;IACD,SAAS,CAAC,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,CAAC,CAAC;IAEjC,4CAA4C;IAC5C,MAAM,aAAa,GAAG,iBAAiB,CACrC,IAAI,CAAC,YAAY,EAAE,EAAE,WAAW,EAAE,SAAS,CAAC,EAC5C,IAAI,CAAC,IAAI,EAAE,SAAS,CAAC,EACrB,IAAI,CACL,CAAC;IAEF,mFAAmF;IACnF,eAAe,CACb,IAAI,CAAC,IAAI,EAAE,SAAS,EAAE,YAAY,CAAC,EACnC;QACE,gGAAgG;QAChG,OAAO;QACP,OAAO;QACP,cAAc;QACd,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,kCAAkC;IAClC,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,UAAU,CAAC,CAAC;IACtD,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,eAAe,CAAC,CAAC;IAC3D,eAAe,CAAC,IAAI,CAAC,IAAI,EAAE,YAAY,CAAC,EAAE,eAAe,CAAC,CAAC;IAE3D,8DAA8D;IAC9D,mBAAmB,CAAC,IAAI,CAAC,IAAI,EAAE,WAAW,CAAC,EAAE,IAAI,CAAC,CAAC;IAEnD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,iBAAiB,CAAC,CAAC;IACxC,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,KAAK,GAAG,CAAC,IAAI,EAAE,UAAU,CAAC,IAAI,CAAC,CAAC;IACrD,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,yCAAyC,CAAC,CAAC;IAChE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,wBAAwB,CAAC,CAAC;IAC/C,KAAK,MAAM,CAAC,IAAI,aAAa;QAAE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,aAAa,CAAC,IAAI,CAAC,CAAC;IAExE,OAAO,CAAC,MAAM,CAAC,KAAK,CAClB;QACE,EAAE;QACF,OAAO;QACP,gEAAgE;QAChE,2DAA2D;QAC3D,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CACb,CAAC;IAEF,OAAO,CAAC,CAAC;AACX,CAAC;AAED,SAAS,iBAAiB,CAAC,IAAY;IACrC,MAAM,IAAI,GAAG,IAAI,CAAC,KAAK,CAAC,GAAG,CAAC,CAAC,GAAG,EAAE,IAAI,EAAE,CAAC;IACzC,OAAO,IAAI,CAAC,OAAO,CAAC,cAAc,EAAE,EAAE,CAAC,CAAC,WAAW,EAAE,IAAI,UAAU,CAAC;AACtE,CAAC;AAED,SAAS,GAAG,CAAC,IAAY,EAAE,CAAS;IAClC,OAAO,CAAC,CAAC,UAAU,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,KAAK,CAAC,IAAI,CAAC,MAAM,GAAG,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;AAC3D,CAAC;AAED,SAAS,YAAY,CAAC,IAA4B;IAChD,6EAA6E;IAC7E,uEAAuE;IACvE,sBAAsB;IACtB,OAAO;;;;YAIG,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,QAAQ,CAAC;YAC7B,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,aAAa,CAAC;;;YAGlC,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC,aAAa,CAAC;;;;;;;;;;;CAW7C,CAAC;AACF,CAAC;AAED,SAAS,mBAAmB,CAAC,IAAY,EAAE,IAA4B;IACrE,MAAM,GAAG,GAAG,UAAU,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,YAAY,CAAC,IAAI,EAAE,OAAO,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC;IAChE,IAAI,GAAG,CAAC,QAAQ,CAAC,WAAW,CAAC;QAAE,OAAO,CAAC,+BAA+B;IACtE,MAAM,OAAO,GAAG;QACd,WAAW;QACX,EAAE;QACF,yFAAyF;QACzF,EAAE;QACF,kDAAkD;QAClD,4EAA4E;QAC5E,wKAAwK;QACxK,8EAA8E;QAC9E,gEAAgE;QAChE,+DAA+D;QAC/D,uDAAuD;QACvD,kFAAkF;QAClF,EAAE;QACF,aAAa,IAAI,CAAC,aAAa,aAAa,IAAI,CAAC,QAAQ,KAAK;QAC9D,EAAE;KACH,CAAC,IAAI,CAAC,IAAI,CAAC,CAAC;IACb,MAAM,GAAG,GAAG,GAAG,CAAC,MAAM,KAAK,CAAC,IAAI,GAAG,CAAC,QAAQ,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC;IAC/D,aAAa,CAAC,IAAI,EAAE,GAAG,GAAG,GAAG,GAAG,CAAC,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,GAAG,OAAO,CAAC,CAAC;AACtE,CAAC"}

package/dist/index.js CHANGED Viewed

@@ -9,6 +9,7 @@ const HELP = `kaizen — automated AI researcher
 human-facing:
   kaizen init                       scaffold a Kaizen workspace (run once per repo)
   kaizen create pipeline [name]     add a pipeline definition + starter eval
+                                    [--eval-language py|ts]
   kaizen studio [--port 6789] [--state-dir <dir>]
                                     open the local Kaizen dashboard against this workspace

package/dist/index.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,eAAe,EAAE,MAAM,6BAA6B,CAAC;AAC9D,OAAO,EAAE,OAAO,EAAE,MAAM,oBAAoB,CAAC;AAC7C,OAAO,EAAE,MAAM,EAAE,MAAM,mBAAmB,CAAC;AAC3C,OAAO,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AACnD,OAAO,EAAE,MAAM,EAAE,MAAM,mBAAmB,CAAC;AAC3C,OAAO,EAAE,SAAS,EAAE,MAAM,sBAAsB,CAAC;AAEjD,MAAM,IAAI,GAAG~~;;;;;;;;;;;;;;;;;;;;;;;;CAwBZ~~,CAAC;AAEF,KAAK,UAAU,IAAI,CAAC,IAAc;IAChC,MAAM,CAAC,GAAG,EAAE,GAAG,EAAE,GAAG,IAAI,CAAC,GAAG,IAAI,CAAC;IAEjC,IAAI,CAAC,GAAG,IAAI,GAAG,KAAK,QAAQ,IAAI,GAAG,KAAK,IAAI,IAAI,GAAG,KAAK,MAAM,EAAE,CAAC;QAC/D,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;QAC3B,OAAO,CAAC,CAAC;IACX,CAAC;IACD,IAAI,GAAG,KAAK,WAAW,IAAI,GAAG,KAAK,IAAI,EAAE,CAAC;QACxC,MAAM,GAAG,GAAG,MAAM,MAAM,CAAC,iBAAiB,EAAE,EAAE,IAAI,EAAE,EAAE,IAAI,EAAE,MAAM,EAAE,EAAE,CAAC,CAAC;QACxE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,GAAG,GAAG,CAAC,OAAO,CAAC,OAAO,IAAI,CAAC,CAAC;QACjD,OAAO,CAAC,CAAC;IACX,CAAC;IAED,QAAQ,GAAG,EAAE,CAAC;QACZ,KAAK,QAAQ;YACX,IAAI,CAAC,GAAG,EAAE,CAAC;gBACT,OAAO,eAAe,CAAC,EAAE,CAAC,CAAC;YAC7B,CAAC;YACD,IAAI,GAAG,KAAK,UAAU,EAAE,CAAC;gBACvB,OAAO,eAAe,CAAC,IAAI,CAAC,CAAC;YAC/B,CAAC;YACD,OAAO,eAAe,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACzD,KAAK,MAAM;YACT,IAAI,GAAG,KAAK,UAAU,EAAE,CAAC;gBACvB,OAAO,eAAe,CAAC,IAAI,CAAC,CAAC;YAC/B,CAAC;YACD,OAAO,OAAO,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACjD,KAAK,KAAK;YACR,OAAO,MAAM,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QAChD,KAAK,KAAK;YACR,OAAO,MAAM,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QAChD,KAAK,SAAS;YACZ,OAAO,UAAU,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACpD,KAAK,QAAQ;YACX,OAAO,SAAS,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACnD;YACE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,oBAAoB,GAAG,OAAO,IAAI,EAAE,CAAC,CAAC;YAC3D,OAAO,CAAC,CAAC;IACb,CAAC;AACH,CAAC;AAED,IAAI,CAAC,OAAO,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,CAC9B,CAAC,IAAI,EAAE,EAAE,CAAC,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,EAC5B,CAAC,GAAG,EAAE,EAAE;IACN,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,UAAU,GAAG,EAAE,OAAO,IAAI,GAAG,IAAI,CAAC,CAAC;IACxD,IAAI,OAAO,CAAC,GAAG,CAAC,YAAY;QAAE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,GAAG,GAAG,EAAE,KAAK,IAAI,CAAC,CAAC;IACtE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC,CACF,CAAC"}
1	+ {"version":3,"file":"index.js","sourceRoot":"","sources":["../src/index.ts"],"names":[],"mappings":"AAAA,OAAO,EAAE,eAAe,EAAE,MAAM,6BAA6B,CAAC;AAC9D,OAAO,EAAE,OAAO,EAAE,MAAM,oBAAoB,CAAC;AAC7C,OAAO,EAAE,MAAM,EAAE,MAAM,mBAAmB,CAAC;AAC3C,OAAO,EAAE,UAAU,EAAE,MAAM,uBAAuB,CAAC;AACnD,OAAO,EAAE,MAAM,EAAE,MAAM,mBAAmB,CAAC;AAC3C,OAAO,EAAE,SAAS,EAAE,MAAM,sBAAsB,CAAC;AAEjD,MAAM,IAAI,GAAG;;;;;;;;;;;;;;;;;;;;;;;;;CAyBZ,CAAC;AAEF,KAAK,UAAU,IAAI,CAAC,IAAc;IAChC,MAAM,CAAC,GAAG,EAAE,GAAG,EAAE,GAAG,IAAI,CAAC,GAAG,IAAI,CAAC;IAEjC,IAAI,CAAC,GAAG,IAAI,GAAG,KAAK,QAAQ,IAAI,GAAG,KAAK,IAAI,IAAI,GAAG,KAAK,MAAM,EAAE,CAAC;QAC/D,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,IAAI,CAAC,CAAC;QAC3B,OAAO,CAAC,CAAC;IACX,CAAC;IACD,IAAI,GAAG,KAAK,WAAW,IAAI,GAAG,KAAK,IAAI,EAAE,CAAC;QACxC,MAAM,GAAG,GAAG,MAAM,MAAM,CAAC,iBAAiB,EAAE,EAAE,IAAI,EAAE,EAAE,IAAI,EAAE,MAAM,EAAE,EAAE,CAAC,CAAC;QACxE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,GAAG,GAAG,CAAC,OAAO,CAAC,OAAO,IAAI,CAAC,CAAC;QACjD,OAAO,CAAC,CAAC;IACX,CAAC;IAED,QAAQ,GAAG,EAAE,CAAC;QACZ,KAAK,QAAQ;YACX,IAAI,CAAC,GAAG,EAAE,CAAC;gBACT,OAAO,eAAe,CAAC,EAAE,CAAC,CAAC;YAC7B,CAAC;YACD,IAAI,GAAG,KAAK,UAAU,EAAE,CAAC;gBACvB,OAAO,eAAe,CAAC,IAAI,CAAC,CAAC;YAC/B,CAAC;YACD,OAAO,eAAe,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACzD,KAAK,MAAM;YACT,IAAI,GAAG,KAAK,UAAU,EAAE,CAAC;gBACvB,OAAO,eAAe,CAAC,IAAI,CAAC,CAAC;YAC/B,CAAC;YACD,OAAO,OAAO,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACjD,KAAK,KAAK;YACR,OAAO,MAAM,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QAChD,KAAK,KAAK;YACR,OAAO,MAAM,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QAChD,KAAK,SAAS;YACZ,OAAO,UAAU,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACpD,KAAK,QAAQ;YACX,OAAO,SAAS,CAAC,CAAC,GAAG,EAAE,GAAG,IAAI,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC,CAAC;QACnD;YACE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,oBAAoB,GAAG,OAAO,IAAI,EAAE,CAAC,CAAC;YAC3D,OAAO,CAAC,CAAC;IACb,CAAC;AACH,CAAC;AAED,IAAI,CAAC,OAAO,CAAC,IAAI,CAAC,KAAK,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,CAC9B,CAAC,IAAI,EAAE,EAAE,CAAC,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,EAC5B,CAAC,GAAG,EAAE,EAAE;IACN,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,UAAU,GAAG,EAAE,OAAO,IAAI,GAAG,IAAI,CAAC,CAAC;IACxD,IAAI,OAAO,CAAC,GAAG,CAAC,YAAY;QAAE,OAAO,CAAC,MAAM,CAAC,KAAK,CAAC,GAAG,GAAG,EAAE,KAAK,IAAI,CAAC,CAAC;IACtE,OAAO,CAAC,IAAI,CAAC,CAAC,CAAC,CAAC;AAClB,CAAC,CACF,CAAC"}

package/dist/langfuse.d.ts CHANGED Viewed

@@ -25,6 +25,13 @@ export interface LangfuseScoreInput {
     comment?: string;
     metadata?: Record<string, unknown>;
 }
+export interface LangfuseDatasetRunItemInput {
+    datasetItemId: string;
+    traceId: string;
+    runName: string;
+    runDescription?: string;
+    metadata?: Record<string, unknown>;
+}
 export declare function langfuseConfigFromEnv(env?: NodeJS.ProcessEnv): LangfuseConfig;
 export declare class LangfuseApiClient {
     private readonly host;
@@ -35,6 +42,7 @@ export declare class LangfuseApiClient {
     }): Promise<LangfuseDatasetItem[]>;
     getTrace(traceId: string): Promise<LangfuseTrace>;
     createScore(input: LangfuseScoreInput): Promise<unknown>;
+    createDatasetRunItem(input: LangfuseDatasetRunItemInput): Promise<unknown>;
     private get;
     private post;
     private request;

package/dist/langfuse.js CHANGED Viewed

@@ -50,6 +50,15 @@ export class LangfuseApiClient {
             metadata: input.metadata,
         });
     }
+    async createDatasetRunItem(input) {
+        return this.post("/api/public/dataset-run-items", {
+            datasetItemId: input.datasetItemId,
+            traceId: input.traceId,
+            runName: input.runName,
+            runDescription: input.runDescription,
+            metadata: input.metadata,
+        });
+    }
     async get(path) {
         return this.request(path, { method: "GET" });
     }

package/dist/langfuse.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"file":"langfuse.js","sourceRoot":"","sources":["../src/langfuse.ts"],"names":[],"mappings":"~~AA+BA~~,MAAM,UAAU,qBAAqB,CACnC,MAAyB,OAAO,CAAC,GAAG;IAEpC,MAAM,IAAI,GAAG,GAAG,CAAC,aAAa,IAAI,GAAG,CAAC,iBAAiB,CAAC;IACxD,MAAM,SAAS,GAAG,GAAG,CAAC,mBAAmB,CAAC;IAC1C,MAAM,SAAS,GAAG,GAAG,CAAC,mBAAmB,CAAC;IAC1C,MAAM,OAAO,GAAG;QACd,CAAC,eAAe,EAAE,IAAI,CAAC;QACvB,CAAC,qBAAqB,EAAE,SAAS,CAAC;QAClC,CAAC,qBAAqB,EAAE,SAAS,CAAC;KACnC;SACE,MAAM,CAAC,CAAC,CAAC,EAAE,KAAK,CAAC,EAAE,EAAE,CAAC,CAAC,KAAK,CAAC;SAC7B,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,EAAE,EAAE,CAAC,IAAI,CAAC,CAAC;IAEzB,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;QACnB,MAAM,IAAI,KAAK,CACb,2CAA2C,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAChE,CAAC;IACJ,CAAC;IAED,OAAO;QACL,IAAI,EAAE,IAAK,CAAC,OAAO,CAAC,KAAK,EAAE,EAAE,CAAC;QAC9B,SAAS,EAAE,SAAU;QACrB,SAAS,EAAE,SAAU;KACtB,CAAC;AACJ,CAAC;AAED,MAAM,OAAO,iBAAiB;IACX,IAAI,CAAS;IACb,IAAI,CAAS;IAE9B,YAAY,MAAsB;QAChC,IAAI,CAAC,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,KAAK,EAAE,EAAE,CAAC,CAAC;QAC3C,IAAI,CAAC,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,GAAG,MAAM,CAAC,SAAS,IAAI,MAAM,CAAC,SAAS,EAAE,CAAC,CAAC,QAAQ,CACzE,QAAQ,CACT,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,gBAAgB,CACpB,WAAmB,EACnB,OAA2B,EAAE;QAE7B,MAAM,KAAK,GAAG,IAAI,CAAC,KAAK,IAAI,GAAG,CAAC;QAChC,MAAM,GAAG,GAA0B,EAAE,CAAC;QACtC,IAAI,IAAI,GAAG,CAAC,CAAC;QAEb,OAAO,IAAI,EAAE,CAAC;YACZ,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,GAAG,CACzB,yCAAyC,kBAAkB,CAAC,WAAW,CAAC,UAAU,KAAK,SAAS,IAAI,EAAE,CACvG,CAAC;YACF,MAAM,KAAK,GAAG,IAAI,CAAC,IAAI,IAAI,EAAE,CAAC;YAC9B,GAAG,CAAC,IAAI,CAAC,GAAG,KAAK,CAAC,CAAC;YACnB,IAAI,KAAK,CAAC,MAAM,GAAG,KAAK;gBAAE,OAAO,GAAG,CAAC;YACrC,IAAI,EAAE,CAAC;QACT,CAAC;IACH,CAAC;IAED,KAAK,CAAC,QAAQ,CAAC,OAAe;QAC5B,OAAO,IAAI,CAAC,GAAG,CACb,sBAAsB,kBAAkB,CAAC,OAAO,CAAC,EAAE,CACpD,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,WAAW,CAAC,KAAyB;QACzC,OAAO,IAAI,CAAC,IAAI,CAAC,oBAAoB,EAAE;YACrC,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,IAAI,EAAE,KAAK,CAAC,IAAI;YAChB,KAAK,EAAE,KAAK,CAAC,KAAK;YAClB,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,QAAQ,EAAE,KAAK,CAAC,QAAQ;SACzB,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,GAAG,CAAI,IAAY;QAC/B,OAAO,IAAI,CAAC,OAAO,CAAI,IAAI,EAAE,EAAE,MAAM,EAAE,KAAK,EAAE,CAAC,CAAC;IAClD,CAAC;IAEO,KAAK,CAAC,IAAI,CAAI,IAAY,EAAE,IAAa;QAC/C,OAAO,IAAI,CAAC,OAAO,CAAI,IAAI,EAAE;YAC3B,MAAM,EAAE,MAAM;YACd,OAAO,EAAE,EAAE,cAAc,EAAE,kBAAkB,EAAE;YAC/C,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC;SAC3B,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,OAAO,CAAI,IAAY,EAAE,IAAiB;QACtD,MAAM,GAAG,GAAG,MAAM,KAAK,CAAC,GAAG,IAAI,CAAC,IAAI,GAAG,IAAI,EAAE,EAAE;YAC7C,GAAG,IAAI;YACP,OAAO,EAAE;gBACP,aAAa,EAAE,SAAS,IAAI,CAAC,IAAI,EAAE;gBACnC,wDAAwD;gBACxD,GAAG,IAAI,CAAC,OAAO;aAChB;SACF,CAAC,CAAC;QACH,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC;YACZ,MAAM,IAAI,GAAG,MAAM,GAAG,CAAC,IAAI,EAAE,CAAC;YAC9B,MAAM,IAAI,KAAK,CAAC,YAAY,GAAG,CAAC,MAAM,KAAK,IAAI,CAAC,KAAK,CAAC,CAAC,EAAE,GAAG,CAAC,EAAE,CAAC,CAAC;QACnE,CAAC;QACD,OAAO,GAAG,CAAC,IAAI,EAAgB,CAAC;IAClC,CAAC;CACF;AAED,MAAM,UAAU,oBAAoB,CAClC,SAAyB,qBAAqB,EAAE;IAEhD,OAAO,IAAI,iBAAiB,CAAC,MAAM,CAAC,CAAC;AACvC,CAAC"}
1	+ {"version":3,"file":"langfuse.js","sourceRoot":"","sources":["../src/langfuse.ts"],"names":[],"mappings":"AAuCA,MAAM,UAAU,qBAAqB,CACnC,MAAyB,OAAO,CAAC,GAAG;IAEpC,MAAM,IAAI,GAAG,GAAG,CAAC,aAAa,IAAI,GAAG,CAAC,iBAAiB,CAAC;IACxD,MAAM,SAAS,GAAG,GAAG,CAAC,mBAAmB,CAAC;IAC1C,MAAM,SAAS,GAAG,GAAG,CAAC,mBAAmB,CAAC;IAC1C,MAAM,OAAO,GAAG;QACd,CAAC,eAAe,EAAE,IAAI,CAAC;QACvB,CAAC,qBAAqB,EAAE,SAAS,CAAC;QAClC,CAAC,qBAAqB,EAAE,SAAS,CAAC;KACnC;SACE,MAAM,CAAC,CAAC,CAAC,EAAE,KAAK,CAAC,EAAE,EAAE,CAAC,CAAC,KAAK,CAAC;SAC7B,GAAG,CAAC,CAAC,CAAC,IAAI,CAAC,EAAE,EAAE,CAAC,IAAI,CAAC,CAAC;IAEzB,IAAI,OAAO,CAAC,MAAM,EAAE,CAAC;QACnB,MAAM,IAAI,KAAK,CACb,2CAA2C,OAAO,CAAC,IAAI,CAAC,IAAI,CAAC,EAAE,CAChE,CAAC;IACJ,CAAC;IAED,OAAO;QACL,IAAI,EAAE,IAAK,CAAC,OAAO,CAAC,KAAK,EAAE,EAAE,CAAC;QAC9B,SAAS,EAAE,SAAU;QACrB,SAAS,EAAE,SAAU;KACtB,CAAC;AACJ,CAAC;AAED,MAAM,OAAO,iBAAiB;IACX,IAAI,CAAS;IACb,IAAI,CAAS;IAE9B,YAAY,MAAsB;QAChC,IAAI,CAAC,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,OAAO,CAAC,KAAK,EAAE,EAAE,CAAC,CAAC;QAC3C,IAAI,CAAC,IAAI,GAAG,MAAM,CAAC,IAAI,CAAC,GAAG,MAAM,CAAC,SAAS,IAAI,MAAM,CAAC,SAAS,EAAE,CAAC,CAAC,QAAQ,CACzE,QAAQ,CACT,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,gBAAgB,CACpB,WAAmB,EACnB,OAA2B,EAAE;QAE7B,MAAM,KAAK,GAAG,IAAI,CAAC,KAAK,IAAI,GAAG,CAAC;QAChC,MAAM,GAAG,GAA0B,EAAE,CAAC;QACtC,IAAI,IAAI,GAAG,CAAC,CAAC;QAEb,OAAO,IAAI,EAAE,CAAC;YACZ,MAAM,IAAI,GAAG,MAAM,IAAI,CAAC,GAAG,CACzB,yCAAyC,kBAAkB,CAAC,WAAW,CAAC,UAAU,KAAK,SAAS,IAAI,EAAE,CACvG,CAAC;YACF,MAAM,KAAK,GAAG,IAAI,CAAC,IAAI,IAAI,EAAE,CAAC;YAC9B,GAAG,CAAC,IAAI,CAAC,GAAG,KAAK,CAAC,CAAC;YACnB,IAAI,KAAK,CAAC,MAAM,GAAG,KAAK;gBAAE,OAAO,GAAG,CAAC;YACrC,IAAI,EAAE,CAAC;QACT,CAAC;IACH,CAAC;IAED,KAAK,CAAC,QAAQ,CAAC,OAAe;QAC5B,OAAO,IAAI,CAAC,GAAG,CACb,sBAAsB,kBAAkB,CAAC,OAAO,CAAC,EAAE,CACpD,CAAC;IACJ,CAAC;IAED,KAAK,CAAC,WAAW,CAAC,KAAyB;QACzC,OAAO,IAAI,CAAC,IAAI,CAAC,oBAAoB,EAAE;YACrC,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,IAAI,EAAE,KAAK,CAAC,IAAI;YAChB,KAAK,EAAE,KAAK,CAAC,KAAK;YAClB,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,QAAQ,EAAE,KAAK,CAAC,QAAQ;SACzB,CAAC,CAAC;IACL,CAAC;IAED,KAAK,CAAC,oBAAoB,CACxB,KAAkC;QAElC,OAAO,IAAI,CAAC,IAAI,CAAC,+BAA+B,EAAE;YAChD,aAAa,EAAE,KAAK,CAAC,aAAa;YAClC,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,OAAO,EAAE,KAAK,CAAC,OAAO;YACtB,cAAc,EAAE,KAAK,CAAC,cAAc;YACpC,QAAQ,EAAE,KAAK,CAAC,QAAQ;SACzB,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,GAAG,CAAI,IAAY;QAC/B,OAAO,IAAI,CAAC,OAAO,CAAI,IAAI,EAAE,EAAE,MAAM,EAAE,KAAK,EAAE,CAAC,CAAC;IAClD,CAAC;IAEO,KAAK,CAAC,IAAI,CAAI,IAAY,EAAE,IAAa;QAC/C,OAAO,IAAI,CAAC,OAAO,CAAI,IAAI,EAAE;YAC3B,MAAM,EAAE,MAAM;YACd,OAAO,EAAE,EAAE,cAAc,EAAE,kBAAkB,EAAE;YAC/C,IAAI,EAAE,IAAI,CAAC,SAAS,CAAC,IAAI,CAAC;SAC3B,CAAC,CAAC;IACL,CAAC;IAEO,KAAK,CAAC,OAAO,CAAI,IAAY,EAAE,IAAiB;QACtD,MAAM,GAAG,GAAG,MAAM,KAAK,CAAC,GAAG,IAAI,CAAC,IAAI,GAAG,IAAI,EAAE,EAAE;YAC7C,GAAG,IAAI;YACP,OAAO,EAAE;gBACP,aAAa,EAAE,SAAS,IAAI,CAAC,IAAI,EAAE;gBACnC,wDAAwD;gBACxD,GAAG,IAAI,CAAC,OAAO;aAChB;SACF,CAAC,CAAC;QACH,IAAI,CAAC,GAAG,CAAC,EAAE,EAAE,CAAC;YACZ,MAAM,IAAI,GAAG,MAAM,GAAG,CAAC,IAAI,EAAE,CAAC;YAC9B,MAAM,IAAI,KAAK,CAAC,YAAY,GAAG,CAAC,MAAM,KAAK,IAAI,CAAC,KAAK,CAAC,CAAC,EAAE,GAAG,CAAC,EAAE,CAAC,CAAC;QACnE,CAAC;QACD,OAAO,GAAG,CAAC,IAAI,EAAgB,CAAC;IAClC,CAAC;CACF;AAED,MAAM,UAAU,oBAAoB,CAClC,SAAyB,qBAAqB,EAAE;IAEhD,OAAO,IAAI,iBAAiB,CAAC,MAAM,CAAC,CAAC;AACvC,CAAC"}

package/dist/lib/runner.js CHANGED Viewed

@@ -1,5 +1,6 @@
 import { execSync, spawn } from "node:child_process";
 import { createWriteStream, existsSync, writeFileSync } from "node:fs";
+import { createRequire } from "node:module";
 import { arch, hostname, platform } from "node:os";
 import { extname, join } from "node:path";
 import { NdjsonReader, } from "./events.js";
@@ -8,6 +9,7 @@ import { loadPipeline, resolveEvalPath } from "./pipeline.js";
 import { decidePromotion } from "./promotion.js";
 import { appendNdjsonLine, clearLock, ensureDir, generateRunId, hypothesesPath, isPidAlive, pipelineRunsDir, readJsonIfExists, readLock, runDir, writeJsonAtomic, writeLock, } from "./run-dir.js";
 const FAILURE_K = 10;
+const require = createRequire(import.meta.url);
 export async function runExperiment(opts) {
     const stateDir = opts.stateDir ?? join(opts.workspace, ".kaizen");
     // 0. Reap stale runs across this pipeline (lock present, PID dead, no terminal event).
@@ -273,6 +275,12 @@ function detectInterpreter(evalPath) {
         return { cmd: "python3", preArgs: [] };
     if (ext === ".js" || ext === ".mjs" || ext === ".cjs")
         return { cmd: "node", preArgs: [] };
+    if (ext === ".ts" || ext === ".tsx" || ext === ".mts" || ext === ".cts") {
+        return {
+            cmd: process.execPath,
+            preArgs: ["--import", require.resolve("tsx")],
+        };
+    }
     // Default: assume executable with shebang.
     return { cmd: evalPath, preArgs: [] };
 }

package/dist/lib/runner.js.map CHANGED Viewed

	@@ -1 +1 @@
1	- {"version":3,"file":"runner.js","sourceRoot":"","sources":["../../src/lib/runner.ts"],"names":[],"mappings":"AAAA,OAAO,EAAqB,QAAQ,EAAE,KAAK,EAAE,MAAM,oBAAoB,CAAC;AACxE,OAAO,EAAE,iBAAiB,EAAE,UAAU,EAAE,aAAa,EAAE,MAAM,SAAS,CAAC;AACvE,OAAO,EAAE,IAAI,EAAE,QAAQ,EAAE,QAAQ,EAAE,MAAM,SAAS,CAAC;AACnD,OAAO,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAE1C,OAAO,EAKL,YAAY,GAEb,MAAM,aAAa,CAAC;AACrB,OAAO,EAGL,eAAe,EACf,QAAQ,GACT,MAAM,kBAAkB,CAAC;AAC1B,OAAO,EAAoB,YAAY,EAAE,eAAe,EAAE,MAAM,eAAe,CAAC;AAChF,OAAO,EAAE,eAAe,EAAE,MAAM,gBAAgB,CAAC;AACjD,OAAO,EACL,gBAAgB,EAChB,SAAS,EACT,SAAS,EACT,aAAa,EACb,cAAc,EACd,UAAU,EACV,eAAe,EACf,gBAAgB,EAChB,QAAQ,EACR,MAAM,EACN,eAAe,EACf,SAAS,GACV,MAAM,cAAc,CAAC;AAuBtB,MAAM,SAAS,GAAG,EAAE,CAAC;AAErB,MAAM,CAAC,KAAK,UAAU,aAAa,CAAC,IAAgB;IAClD,MAAM,QAAQ,GAAG,IAAI,CAAC,QAAQ,IAAI,IAAI,CAAC,IAAI,CAAC,SAAS,EAAE,SAAS,CAAC,CAAC;IAElE,uFAAuF;IACvF,aAAa,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC;IAEzC,+CAA+C;IAC/C,MAAM,QAAQ,GAAG,YAAY,CAAC,IAAI,CAAC,SAAS,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC;IAC/D,MAAM,OAAO,GAAG,eAAe,CAAC,IAAI,CAAC,SAAS,EAAE,QAAQ,CAAC,CAAC;IAC1D,IAAI,CAAC,UAAU,CAAC,OAAO,CAAC,EAAE,CAAC;QACzB,MAAM,IAAI,KAAK,CACb,4BAA4B,OAAO,2BAA2B,QAAQ,CAAC,WAAW,CAAC,QAAQ,iBAAiB,IAAI,CAAC,UAAU,MAAM,CAClI,CAAC;IACJ,CAAC;IACD,MAAM,MAAM,GAAG,iBAAiB,CAAC,OAAO,CAAC,CAAC;IAE1C,6DAA6D;IAC7D,MAAM,KAAK,GAAG,aAAa,EAAE,CAAC;IAC9B,MAAM,GAAG,GAAG,MAAM,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,EAAE,KAAK,CAAC,CAAC;IACrD,SAAS,CAAC,GAAG,CAAC,CAAC;IACf,MAAM,SAAS,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IAC3C,MAAM,QAAQ,GAAiB;QAC7B,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,SAAS,EAAE,IAAI,CAAC,MAAM;QACtB,UAAU,EAAE,IAAI,CAAC,UAAU;QAC3B,OAAO,EAAE,MAAM,CAAC,IAAI,CAAC,SAAS,CAAC;QAC/B,UAAU,EAAE,SAAS,CAAC,IAAI,CAAC,SAAS,CAAC;QACrC,aAAa,EAAE,WAAW,CAAC,IAAI,CAAC,SAAS,CAAC;QAC1C,cAAc,EAAE,YAAY,CAAC,IAAI,CAAC,SAAS,CAAC;QAC5C,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;QACrD,UAAU,EAAE,SAAS;QACrB,IAAI,EAAE,GAAG,QAAQ,EAAE,IAAI,IAAI,EAAE,KAAK,QAAQ,EAAE,GAAG;QAC/C,cAAc,EAAE,IAAI,CAAC,aAAa;QAClC,SAAS,EAAE,QAAQ;QACnB,UAAU,EAAE,IAAI,CAAC,UAAU;KAC5B,CAAC;IACF,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,eAAe,CAAC,EAAE,QAAQ,CAAC,CAAC;IACtD,SAAS,CAAC,GAAG,CAAC,CAAC;IAEf,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,cAAc,CAAC,CAAC;IAC7C,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,CAAC;IAC3C,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,CAAC;IAE3C,uCAAuC;IACvC,MAAM,KAAK,GAQP;QACF,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,MAAM,EAAE,SAAS;QACjB,KAAK,EAAE,IAAI;QACX,OAAO,EAAE,IAAI;QACb,MAAM,EAAE,CAAC;QACT,QAAQ,EAAE,IAAI;QACd,UAAU,EAAE,SAAS;QACrB,UAAU,EAAE,SAAS;QACrB,QAAQ,EAAE,IAAI;QACd,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;KACtD,CAAC;IACF,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;IAEhD,gDAAgD;IAChD,yEAAyE;IACzE,wEAAwE;IACxE,8DAA8D;IAC9D,MAAM,QAAQ,GAAG;QACf,GAAG,MAAM,CAAC,OAAO;QACjB,GAAG,CAAC,MAAM,CAAC,GAAG,KAAK,OAAO,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC;QAC5C,WAAW;QACX,IAAI,CAAC,OAAO;QACZ,WAAW;QACX,QAAQ,CAAC,WAAW,CAAC,eAAe;QACpC,UAAU;QACV,GAAG;KACJ,CAAC;IACF,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,CAAC,QAAQ,CAAC;IACzD,IAAI,YAAY,KAAK,IAAI,IAAI,YAAY,KAAK,SAAS,EAAE,CAAC;QACxD,QAAQ,CAAC,IAAI,CAAC,aAAa,EAAE,MAAM,CAAC,YAAY,CAAC,CAAC,CAAC;IACrD,CAAC;IAED,MAAM,SAAS,GAAG,iBAAiB,CAAC,UAAU,CAAC,CAAC;IAChD,MAAM,SAAS,GAAG,iBAAiB,CAAC,UAAU,CAAC,CAAC;IAChD,IAAI,UAAU,GAAG,EAAE,CAAC;IAEpB,MAAM,KAAK,GAAiB,KAAK,CAAC,MAAM,CAAC,GAAG,EAAE,QAAQ,EAAE;QACtD,GAAG,EAAE,IAAI,CAAC,SAAS;QACnB,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,MAAM,EAAE,MAAM,CAAC;QACzC,GAAG,EAAE,OAAO,CAAC,GAAG;KACjB,CAAC,CAAC;IAEH,qFAAqF;IACrF,KAAK,CAAC,MAAO,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAa,EAAE,EAAE,CAAC,SAAS,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC,CAAC;IACpE,KAAK,CAAC,MAAO,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAa,EAAE,EAAE;QACzC,SAAS,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC;QACvB,UAAU,GAAG,CAAC,UAAU,GAAG,KAAK,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,IAAI,CAAC,CAAC;IACnE,CAAC,CAAC,CAAC;IAEH,gGAAgG;IAChG,MAAM,SAAS,GAAG,KAAK,CAAC,KAAK,CAAC,CAAC,CAAa,CAAC;IAC7C,MAAM,UAAU,GAAgB,EAAE,CAAC;IACnC,IAAI,WAAW,GAAyB,IAAI,CAAC;IAC7C,IAAI,WAAW,GAAG,CAAC,CAAC;IACpB,IAAI,cAAc,GAAG,CAAC,CAAC;IAEvB,MAAM,MAAM,GAAG,IAAI,YAAY,CAC7B,CAAC,CAAC,EAAE,EAAE,CAAC,OAAO,CAAC,CAAC,CAAC,EACjB,CAAC,IAAI,EAAE,GAAG,EAAE,EAAE;QACZ,WAAW,EAAE,CAAC;QACd,SAAS,CAAC,KAAK,CACb,mCAAmC,IAAI,CAAC,KAAK,CAAC,CAAC,EAAE,GAAG,CAAC,IAAI,CAC1D,CAAC;QACF,SAAS,CAAC,KAAK,CACb,YAAY,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,IAAI,CACjE,CAAC;IACJ,CAAC,CACF,CAAC;IACF,SAAS,CAAC,WAAW,EAAE,CAAC,OAAO,CAAC,CAAC;IACjC,SAAS,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAK,EAAE,EAAE,CAAC,MAAM,CAAC,IAAI,CAAC,KAAwB,CAAC,CAAC,CAAC;IACvE,wEAAwE;IACxE,sEAAsE;IACtE,mEAAmE;IACnE,yEAAyE;IACzE,uDAAuD;IACvD,MAAM,cAAc,GAAG,IAAI,OAAO,CAAO,CAAC,OAAO,EAAE,EAAE;QACnD,SAAS,CAAC,EAAE,CAAC,KAAK,EAAE,GAAG,EAAE;YACvB,MAAM,CAAC,GAAG,EAAE,CAAC;YACb,OAAO,EAAE,CAAC;QACZ,CAAC,CAAC,CAAC;QACH,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE;YACzB,MAAM,CAAC,GAAG,EAAE,CAAC;YACb,OAAO,EAAE,CAAC;QACZ,CAAC,CAAC,CAAC;IACL,CAAC,CAAC,CAAC;IAEH,SAAS,OAAO,CAAC,CAAQ;QACvB,gBAAgB,CAAC,UAAU,EAAE,CAAC,CAAC,CAAC;QAChC,IAAI,CAAC,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;YACvB,MAAM,CAAC,GAAG,CAAC,CAAC;YACZ,IAAI,CAAC,CAAC,YAAY,KAAK,QAAQ,CAAC,WAAW,CAAC,YAAY,EAAE,CAAC;gBACzD,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,+BAA+B,CAAC,CAAC,YAAY,yCAAyC,QAAQ,CAAC,WAAW,CAAC,YAAY,IAAI,CAC5H,CAAC;YACJ,CAAC;YACD,IAAI,CAAC,CAAC,eAAe,KAAK,QAAQ,CAAC,WAAW,CAAC,eAAe,EAAE,CAAC;gBAC/D,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,kCAAkC,CAAC,CAAC,eAAe,4CAA4C,QAAQ,CAAC,WAAW,CAAC,eAAe,IAAI,CACxI,CAAC;YACJ,CAAC;YACD,KAAK,CAAC,OAAO,GAAG,CAAC,CAAC,CAAC,CAAC;YACpB,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;YAC7B,MAAM,EAAE,GAAG,CAAC,CAAC;YACb,UAAU,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;YACpB,KAAK,CAAC,MAAM,GAAG,CAAC,KAAK,CAAC,MAAM,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC;YACvC,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;YACjC,uEAAuE;YACvE,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;YACjC,WAAW,GAAG,CAAC,CAAC;YAChB,IAAI,KAAK,CAAC,OAAO,KAAK,IAAI,IAAI,WAAW,CAAC,CAAC,KAAK,KAAK,CAAC,OAAO,EAAE,CAAC;gBAC9D,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,uBAAuB,WAAW,CAAC,CAAC,2BAA2B,KAAK,CAAC,OAAO,IAAI,CACjF,CAAC;YACJ,CAAC;YACD,KAAK,CAAC,KAAK,GAAG,WAAW,CAAC,KAAK,CAAC;YAChC,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;QACD,gDAAgD;IAClD,CAAC;IAED,2EAA2E;IAC3E,wEAAwE;IACxE,oEAAoE;IACpE,MAAM,EAAE,IAAI,EAAE,MAAM,EAAE,GAAG,MAAM,WAAW,CAAC,KAAK,CAAC,CAAC;IAClD,MAAM,cAAc,CAAC;IAErB,cAAc;IACd,SAAS,CAAC,GAAG,EAAE,CAAC;IAChB,SAAS,CAAC,GAAG,EAAE,CAAC;IAChB,MAAM,OAAO,CAAC,GAAG,CAAC;QAChB,IAAI,OAAO,CAAO,CAAC,CAAC,EAAE,EAAE,CAAC,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE,CAAC,CAAC,EAAE,CAAC,CAAC;QAC1D,IAAI,OAAO,CAAO,CAAC,CAAC,EAAE,EAAE,CAAC,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE,CAAC,CAAC,EAAE,CAAC,CAAC;KAC3D,CAAC,CAAC;IAEH,4BAA4B;IAC5B,MAAM,OAAO,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IACzC,IACE,IAAI,KAAK,CAAC;QACV,WAAW,KAAK,IAAI;QACpB,WAAW,KAAK,CAAC;QACjB,cAAc,KAAK,CAAC,EACpB,CAAC;QACD,KAAK,CAAC,MAAM,GAAG,UAAU,CAAC;QAC1B,KAAK,CAAC,KAAK,GAAI,WAA6B,CAAC,KAAK,CAAC;QACnD,8DAA8D;IAChE,CAAC;SAAM,CAAC;QACN,MAAM,OAAO,GAAiB;YAC5B,IAAI,EAAE,SAAS;YACf,SAAS,EAAE,IAAI;YACf,MAAM,EAAE,MAAM,IAAI,IAAI;YACtB,WAAW,EAAE,UAAU,CAAC,KAAK,CAAC,CAAC,IAAI,CAAC;YACpC,MAAM,EACJ,IAAI,KAAK,CAAC,IAAI,IAAI,KAAK,IAAI;gBACzB,CAAC,CAAC,yBAAyB,IAAI,EAAE;gBACjC,CAAC,CAAC,MAAM;oBACN,CAAC,CAAC,6BAA6B,MAAM,EAAE;oBACvC,CAAC,CAAC,WAAW,GAAG,CAAC;wBACf,CAAC,CAAC,gBAAgB,WAAW,qBAAqB;wBAClD,CAAC,CAAC,cAAc,GAAG,CAAC;4BAClB,CAAC,CAAC,gBAAgB,cAAc,8BAA8B;4BAC9D,CAAC,CAAC,WAAW;gCACX,CAAC,CAAC,2CAA2C;gCAC7C,CAAC,CAAC,6CAA6C;YAC3D,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI;SACtB,CAAC;QACF,gBAAgB,CAAC,UAAU,EAAE,OAAO,CAAC,CAAC;QACtC,KAAK,CAAC,MAAM,GAAG,SAAS,CAAC;IAC3B,CAAC;IACD,KAAK,CAAC,QAAQ,GAAG,OAAO,CAAC;IACzB,KAAK,CAAC,UAAU,GAAG,OAAO,CAAC;IAE3B,qCAAqC;IACrC,IAAI,UAAU,CAAC,MAAM,EAAE,CAAC;QACtB,MAAM,MAAM,GAAG,CAAC,GAAG,UAAU,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC,KAAK,CAAC,CAAC;QACjE,MAAM,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,IAAI,CAAC,GAAG,CAAC,SAAS,EAAE,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC;QAClE,MAAM,IAAI,GACR,KAAK,CAAC,GAAG,CAAC,CAAC,EAAE,EAAE,EAAE,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC;YAChD,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;QAC7B,aAAa,CAAC,IAAI,CAAC,GAAG,EAAE,gBAAgB,CAAC,EAAE,IAAI,CAAC,CAAC;IACnD,CAAC;IAED,4CAA4C;IAC5C,IAAI,cAAc,GAA0B,IAAI,CAAC;IACjD,IAAI,KAAK,CAAC,MAAM,KAAK,UAAU,IAAI,CAAC,IAAI,CAAC,aAAa,EAAE,CAAC;QACvD,MAAM,OAAO,GAAG,QAAQ,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC,MAAM,CACxD,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,MAAM,KAAK,KAAK,CAC1B,CAAC;QACF,MAAM,WAAW,GAAG,eAAe,CACjC,OAAO,EACP,QAAQ,CAAC,WAAW,CAAC,YAAY,EACjC,QAAQ,CAAC,WAAW,CAAC,eAAe,CACrC,CAAC;QACF,MAAM,QAAQ,GAAG,WAAW;YAC1B,CAAC,CAAC;gBACE,MAAM,EAAE,WAAW,CAAC,MAAM;gBAC1B,OAAO,EAAE,WAAW,CAAC,OAAO;gBAC5B,KAAK,EAAE,WAAW,CAAC,KAAM;gBACzB,WAAW,EAAE,WAAW,CAAC,WAAW;aACrC;YACH,CAAC,CAAC,IAAI,CAAC;QACT,MAAM,QAAQ,GAAG,eAAe,CAC9B,YAAY,CAAC,UAAU,CAAC,EACxB,UAAU,EACV,QAAQ,EACR,EAAE,YAAY,EAAE,YAAY,CAAC,QAAQ,CAAC,EAAE,CACzC,CAAC;QACF,cAAc,GAAG,EAAE,IAAI,EAAE,WAAW,EAAE,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI,EAAE,GAAG,QAAQ,EAAE,CAAC;QAC3E,gBAAgB,CAAC,UAAU,EAAE,cAAc,CAAC,CAAC;QAC7C,KAAK,CAAC,QAAQ,GAAG,QAAQ,CAAC,QAAQ,CAAC;IACrC,CAAC;SAAM,IAAI,IAAI,CAAC,aAAa,EAAE,CAAC;QAC9B,KAAK,CAAC,QAAQ,GAAG,KAAK,CAAC;IACzB,CAAC;IACD,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;IAEhD,iEAAiE;IACjE,MAAM,QAAQ,GAAG;QACf,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,SAAS,EAAE,IAAI,CAAC,MAAM;QACtB,UAAU,EAAE,IAAI,CAAC,UAAU;QAC3B,MAAM,EAAE,KAAK,CAAC,MAAM;QACpB,KAAK,EAAE,KAAK,CAAC,KAAK;QAClB,QAAQ,EAAE,KAAK,CAAC,QAAQ;QACxB,UAAU,EAAE,SAAS;QACrB,QAAQ,EAAE,OAAO;QACjB,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;KACtD,CAAC;IACF,gBAAgB,CAAC,cAAc,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,EAAE,QAAQ,CAAC,CAAC;IAEtE,kBAAkB;IAClB,SAAS,CAAC,GAAG,CAAC,CAAC;IAEf,KAAK,WAAW,CAAC,CAAC,yCAAyC;IAE3D,OAAO;QACL,KAAK;QACL,MAAM,EAAE,KAAK,CAAC,MAA4C;QAC1D,KAAK,EAAE,KAAK,CAAC,KAAK;QAClB,QAAQ,EAAE,KAAK,CAAC,QAAQ,IAAI,IAAI;QAChC,QAAQ,EAAE,KAAK,CAAC,MAAM,KAAK,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;KAC9C,CAAC;AACJ,CAAC;AASD,SAAS,iBAAiB,CAAC,QAAgB;IACzC,MAAM,GAAG,GAAG,OAAO,CAAC,QAAQ,CAAC,CAAC,WAAW,EAAE,CAAC;IAC5C,IAAI,GAAG,KAAK,KAAK;QAAE,OAAO,EAAE,GAAG,EAAE,SAAS,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;IAC1D,IAAI,GAAG,KAAK,KAAK,IAAI,GAAG,KAAK,MAAM,IAAI,GAAG,KAAK,MAAM;QACnD,OAAO,EAAE,GAAG,EAAE,MAAM,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;IACtC,2CAA2C;IAC3C,OAAO,EAAE,GAAG,EAAE,QAAQ,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;AACxC,CAAC;AAED,SAAS,WAAW,CAClB,KAAmB;IAEnB,OAAO,IAAI,OAAO,CAAC,CAAC,OAAO,EAAE,EAAE;QAC7B,KAAK,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,IAAmB,EAAE,MAA6B,EAAE,EAAE,CACtE,OAAO,CAAC,EAAE,IAAI,EAAE,MAAM,EAAE,CAAC,CAC1B,CAAC;IACJ,CAAC,CAAC,CAAC;AACL,CAAC;AAED,SAAS,MAAM,CAAC,GAAW;IACzB,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,oBAAoB,EAAE;YAC7B,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,SAAS,CAAC,GAAW;IAC5B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,iCAAiC,EAAE;YAC1C,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,WAAW,CAAC,GAAW;IAC9B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,+BAA+B,EAAE;YACxC,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,YAAY,CAAC,GAAW;IAC/B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,gCAAgC,EAAE;YACzC,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,YAAY,CAAC,KAAkB;IACtC,MAAM,CAAC,GAAG,IAAI,GAAG,EAAkB,CAAC;IACpC,KAAK,MAAM,EAAE,IAAI,KAAK;QAAE,CAAC,CAAC,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,EAAE,CAAC,KAAK,CAAC,CAAC;IAC/C,OAAO,CAAC,CAAC;AACX,CAAC;AAED,SAAS,YAAY,CAAC,QAAqB;IACzC,MAAM,EAAE,GACN,QAAQ,CAAC,WAGV,CAAC,SAAS,CAAC;IACZ,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,EAAE,CAAC;QAAE,OAAO,EAAE,CAAC;IAClC,OAAO,EAAE,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,IAAI,CAAC,CAAC,IAAI,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC;AAChE,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,aAAa,CAAC,QAAgB,EAAE,UAAkB;IAChE,MAAM,GAAG,GAAG,eAAe,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAC;IAClD,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC;QAAE,OAAO;IAC7B,KAAK,MAAM,GAAG,IAAI,QAAQ,CAAC,QAAQ,EAAE,UAAU,CAAC,EAAE,CAAC;QACjD,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS;YAAE,SAAS;QACvC,MAAM,IAAI,GAAG,QAAQ,CAAC,IAAI,CAAC,GAAG,EAAE,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC;QAC7C,IAAI,CAAC,IAAI;YAAE,SAAS;QACpB,IAAI,UAAU,CAAC,IAAI,CAAC,GAAG,CAAC;YAAE,SAAS;QACnC,MAAM,WAAW,GAAiB;YAChC,IAAI,EAAE,SAAS;YACf,SAAS,EAAE,IAAI;YACf,MAAM,EAAE,IAAI;YACZ,MAAM,EAAE,cAAc,IAAI,CAAC,GAAG,gDAAgD;YAC9E,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI;SACtB,CAAC;QACF,gBAAgB,CAAC,GAAG,CAAC,WAAW,EAAE,WAAW,CAAC,CAAC;QAE/C,MAAM,KAAK,GAAG,gBAAgB,CAAY,GAAG,CAAC,UAAU,CAAC,CAAC;QAC1D,IAAI,KAAK,EAAE,CAAC;YACV,KAAK,CAAC,MAAM,GAAG,SAAS,CAAC;YACzB,KAAK,CAAC,QAAQ,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC1C,eAAe,CAAC,GAAG,CAAC,UAAU,EAAE,KAAK,CAAC,CAAC;QACzC,CAAC;QACD,SAAS,CAAC,IAAI,CAAC,GAAG,EAAE,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC;IACnC,CAAC;AACH,CAAC"}
1	+ {"version":3,"file":"runner.js","sourceRoot":"","sources":["../../src/lib/runner.ts"],"names":[],"mappings":"AAAA,OAAO,EAAqB,QAAQ,EAAE,KAAK,EAAE,MAAM,oBAAoB,CAAC;AACxE,OAAO,EAAE,iBAAiB,EAAE,UAAU,EAAE,aAAa,EAAE,MAAM,SAAS,CAAC;AACvE,OAAO,EAAE,aAAa,EAAE,MAAM,aAAa,CAAC;AAC5C,OAAO,EAAE,IAAI,EAAE,QAAQ,EAAE,QAAQ,EAAE,MAAM,SAAS,CAAC;AACnD,OAAO,EAAE,OAAO,EAAE,IAAI,EAAE,MAAM,WAAW,CAAC;AAE1C,OAAO,EAKL,YAAY,GAEb,MAAM,aAAa,CAAC;AACrB,OAAO,EAGL,eAAe,EACf,QAAQ,GACT,MAAM,kBAAkB,CAAC;AAC1B,OAAO,EAAoB,YAAY,EAAE,eAAe,EAAE,MAAM,eAAe,CAAC;AAChF,OAAO,EAAE,eAAe,EAAE,MAAM,gBAAgB,CAAC;AACjD,OAAO,EACL,gBAAgB,EAChB,SAAS,EACT,SAAS,EACT,aAAa,EACb,cAAc,EACd,UAAU,EACV,eAAe,EACf,gBAAgB,EAChB,QAAQ,EACR,MAAM,EACN,eAAe,EACf,SAAS,GACV,MAAM,cAAc,CAAC;AAuBtB,MAAM,SAAS,GAAG,EAAE,CAAC;AACrB,MAAM,OAAO,GAAG,aAAa,CAAC,MAAM,CAAC,IAAI,CAAC,GAAG,CAAC,CAAC;AAE/C,MAAM,CAAC,KAAK,UAAU,aAAa,CAAC,IAAgB;IAClD,MAAM,QAAQ,GAAG,IAAI,CAAC,QAAQ,IAAI,IAAI,CAAC,IAAI,CAAC,SAAS,EAAE,SAAS,CAAC,CAAC;IAElE,uFAAuF;IACvF,aAAa,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC;IAEzC,+CAA+C;IAC/C,MAAM,QAAQ,GAAG,YAAY,CAAC,IAAI,CAAC,SAAS,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC;IAC/D,MAAM,OAAO,GAAG,eAAe,CAAC,IAAI,CAAC,SAAS,EAAE,QAAQ,CAAC,CAAC;IAC1D,IAAI,CAAC,UAAU,CAAC,OAAO,CAAC,EAAE,CAAC;QACzB,MAAM,IAAI,KAAK,CACb,4BAA4B,OAAO,2BAA2B,QAAQ,CAAC,WAAW,CAAC,QAAQ,iBAAiB,IAAI,CAAC,UAAU,MAAM,CAClI,CAAC;IACJ,CAAC;IACD,MAAM,MAAM,GAAG,iBAAiB,CAAC,OAAO,CAAC,CAAC;IAE1C,6DAA6D;IAC7D,MAAM,KAAK,GAAG,aAAa,EAAE,CAAC;IAC9B,MAAM,GAAG,GAAG,MAAM,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,EAAE,KAAK,CAAC,CAAC;IACrD,SAAS,CAAC,GAAG,CAAC,CAAC;IACf,MAAM,SAAS,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IAC3C,MAAM,QAAQ,GAAiB;QAC7B,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,SAAS,EAAE,IAAI,CAAC,MAAM;QACtB,UAAU,EAAE,IAAI,CAAC,UAAU;QAC3B,OAAO,EAAE,MAAM,CAAC,IAAI,CAAC,SAAS,CAAC;QAC/B,UAAU,EAAE,SAAS,CAAC,IAAI,CAAC,SAAS,CAAC;QACrC,aAAa,EAAE,WAAW,CAAC,IAAI,CAAC,SAAS,CAAC;QAC1C,cAAc,EAAE,YAAY,CAAC,IAAI,CAAC,SAAS,CAAC;QAC5C,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;QACrD,UAAU,EAAE,SAAS;QACrB,IAAI,EAAE,GAAG,QAAQ,EAAE,IAAI,IAAI,EAAE,KAAK,QAAQ,EAAE,GAAG;QAC/C,cAAc,EAAE,IAAI,CAAC,aAAa;QAClC,SAAS,EAAE,QAAQ;QACnB,UAAU,EAAE,IAAI,CAAC,UAAU;KAC5B,CAAC;IACF,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,eAAe,CAAC,EAAE,QAAQ,CAAC,CAAC;IACtD,SAAS,CAAC,GAAG,CAAC,CAAC;IAEf,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,cAAc,CAAC,CAAC;IAC7C,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,CAAC;IAC3C,MAAM,UAAU,GAAG,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,CAAC;IAE3C,uCAAuC;IACvC,MAAM,KAAK,GAQP;QACF,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,MAAM,EAAE,SAAS;QACjB,KAAK,EAAE,IAAI;QACX,OAAO,EAAE,IAAI;QACb,MAAM,EAAE,CAAC;QACT,QAAQ,EAAE,IAAI;QACd,UAAU,EAAE,SAAS;QACrB,UAAU,EAAE,SAAS;QACrB,QAAQ,EAAE,IAAI;QACd,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;KACtD,CAAC;IACF,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;IAEhD,gDAAgD;IAChD,yEAAyE;IACzE,wEAAwE;IACxE,8DAA8D;IAC9D,MAAM,QAAQ,GAAG;QACf,GAAG,MAAM,CAAC,OAAO;QACjB,GAAG,CAAC,MAAM,CAAC,GAAG,KAAK,OAAO,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC,CAAC,CAAC,OAAO,CAAC,CAAC;QAC5C,WAAW;QACX,IAAI,CAAC,OAAO;QACZ,WAAW;QACX,QAAQ,CAAC,WAAW,CAAC,eAAe;QACpC,UAAU;QACV,GAAG;KACJ,CAAC;IACF,MAAM,YAAY,GAAG,IAAI,CAAC,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,IAAI,CAAC,QAAQ,CAAC;IACzD,IAAI,YAAY,KAAK,IAAI,IAAI,YAAY,KAAK,SAAS,EAAE,CAAC;QACxD,QAAQ,CAAC,IAAI,CAAC,aAAa,EAAE,MAAM,CAAC,YAAY,CAAC,CAAC,CAAC;IACrD,CAAC;IAED,MAAM,SAAS,GAAG,iBAAiB,CAAC,UAAU,CAAC,CAAC;IAChD,MAAM,SAAS,GAAG,iBAAiB,CAAC,UAAU,CAAC,CAAC;IAChD,IAAI,UAAU,GAAG,EAAE,CAAC;IAEpB,MAAM,KAAK,GAAiB,KAAK,CAAC,MAAM,CAAC,GAAG,EAAE,QAAQ,EAAE;QACtD,GAAG,EAAE,IAAI,CAAC,SAAS;QACnB,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,MAAM,EAAE,MAAM,CAAC;QACzC,GAAG,EAAE,OAAO,CAAC,GAAG;KACjB,CAAC,CAAC;IAEH,qFAAqF;IACrF,KAAK,CAAC,MAAO,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAa,EAAE,EAAE,CAAC,SAAS,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC,CAAC;IACpE,KAAK,CAAC,MAAO,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAa,EAAE,EAAE;QACzC,SAAS,CAAC,KAAK,CAAC,KAAK,CAAC,CAAC;QACvB,UAAU,GAAG,CAAC,UAAU,GAAG,KAAK,CAAC,QAAQ,CAAC,OAAO,CAAC,CAAC,CAAC,KAAK,CAAC,CAAC,IAAI,CAAC,CAAC;IACnE,CAAC,CAAC,CAAC;IAEH,gGAAgG;IAChG,MAAM,SAAS,GAAG,KAAK,CAAC,KAAK,CAAC,CAAC,CAAa,CAAC;IAC7C,MAAM,UAAU,GAAgB,EAAE,CAAC;IACnC,IAAI,WAAW,GAAyB,IAAI,CAAC;IAC7C,IAAI,WAAW,GAAG,CAAC,CAAC;IACpB,IAAI,cAAc,GAAG,CAAC,CAAC;IAEvB,MAAM,MAAM,GAAG,IAAI,YAAY,CAC7B,CAAC,CAAC,EAAE,EAAE,CAAC,OAAO,CAAC,CAAC,CAAC,EACjB,CAAC,IAAI,EAAE,GAAG,EAAE,EAAE;QACZ,WAAW,EAAE,CAAC;QACd,SAAS,CAAC,KAAK,CACb,mCAAmC,IAAI,CAAC,KAAK,CAAC,CAAC,EAAE,GAAG,CAAC,IAAI,CAC1D,CAAC;QACF,SAAS,CAAC,KAAK,CACb,YAAY,GAAG,YAAY,KAAK,CAAC,CAAC,CAAC,GAAG,CAAC,OAAO,CAAC,CAAC,CAAC,MAAM,CAAC,GAAG,CAAC,IAAI,CACjE,CAAC;IACJ,CAAC,CACF,CAAC;IACF,SAAS,CAAC,WAAW,EAAE,CAAC,OAAO,CAAC,CAAC;IACjC,SAAS,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,KAAK,EAAE,EAAE,CAAC,MAAM,CAAC,IAAI,CAAC,KAAwB,CAAC,CAAC,CAAC;IACvE,wEAAwE;IACxE,sEAAsE;IACtE,mEAAmE;IACnE,yEAAyE;IACzE,uDAAuD;IACvD,MAAM,cAAc,GAAG,IAAI,OAAO,CAAO,CAAC,OAAO,EAAE,EAAE;QACnD,SAAS,CAAC,EAAE,CAAC,KAAK,EAAE,GAAG,EAAE;YACvB,MAAM,CAAC,GAAG,EAAE,CAAC;YACb,OAAO,EAAE,CAAC;QACZ,CAAC,CAAC,CAAC;QACH,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE;YACzB,MAAM,CAAC,GAAG,EAAE,CAAC;YACb,OAAO,EAAE,CAAC;QACZ,CAAC,CAAC,CAAC;IACL,CAAC,CAAC,CAAC;IAEH,SAAS,OAAO,CAAC,CAAQ;QACvB,gBAAgB,CAAC,UAAU,EAAE,CAAC,CAAC,CAAC;QAChC,IAAI,CAAC,CAAC,IAAI,KAAK,OAAO,EAAE,CAAC;YACvB,MAAM,CAAC,GAAG,CAAC,CAAC;YACZ,IAAI,CAAC,CAAC,YAAY,KAAK,QAAQ,CAAC,WAAW,CAAC,YAAY,EAAE,CAAC;gBACzD,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,+BAA+B,CAAC,CAAC,YAAY,yCAAyC,QAAQ,CAAC,WAAW,CAAC,YAAY,IAAI,CAC5H,CAAC;YACJ,CAAC;YACD,IAAI,CAAC,CAAC,eAAe,KAAK,QAAQ,CAAC,WAAW,CAAC,eAAe,EAAE,CAAC;gBAC/D,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,kCAAkC,CAAC,CAAC,eAAe,4CAA4C,QAAQ,CAAC,WAAW,CAAC,eAAe,IAAI,CACxI,CAAC;YACJ,CAAC;YACD,KAAK,CAAC,OAAO,GAAG,CAAC,CAAC,CAAC,CAAC;YACpB,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,MAAM,EAAE,CAAC;YAC7B,MAAM,EAAE,GAAG,CAAC,CAAC;YACb,UAAU,CAAC,IAAI,CAAC,EAAE,CAAC,CAAC;YACpB,KAAK,CAAC,MAAM,GAAG,CAAC,KAAK,CAAC,MAAM,IAAI,CAAC,CAAC,GAAG,CAAC,CAAC;YACvC,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;YACjC,uEAAuE;YACvE,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;aAAM,IAAI,CAAC,CAAC,IAAI,KAAK,UAAU,EAAE,CAAC;YACjC,WAAW,GAAG,CAAC,CAAC;YAChB,IAAI,KAAK,CAAC,OAAO,KAAK,IAAI,IAAI,WAAW,CAAC,CAAC,KAAK,KAAK,CAAC,OAAO,EAAE,CAAC;gBAC9D,cAAc,EAAE,CAAC;gBACjB,SAAS,CAAC,KAAK,CACb,uBAAuB,WAAW,CAAC,CAAC,2BAA2B,KAAK,CAAC,OAAO,IAAI,CACjF,CAAC;YACJ,CAAC;YACD,KAAK,CAAC,KAAK,GAAG,WAAW,CAAC,KAAK,CAAC;YAChC,KAAK,CAAC,UAAU,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC5C,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;QAClD,CAAC;QACD,gDAAgD;IAClD,CAAC;IAED,2EAA2E;IAC3E,wEAAwE;IACxE,oEAAoE;IACpE,MAAM,EAAE,IAAI,EAAE,MAAM,EAAE,GAAG,MAAM,WAAW,CAAC,KAAK,CAAC,CAAC;IAClD,MAAM,cAAc,CAAC;IAErB,cAAc;IACd,SAAS,CAAC,GAAG,EAAE,CAAC;IAChB,SAAS,CAAC,GAAG,EAAE,CAAC;IAChB,MAAM,OAAO,CAAC,GAAG,CAAC;QAChB,IAAI,OAAO,CAAO,CAAC,CAAC,EAAE,EAAE,CAAC,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE,CAAC,CAAC,EAAE,CAAC,CAAC;QAC1D,IAAI,OAAO,CAAO,CAAC,CAAC,EAAE,EAAE,CAAC,SAAS,CAAC,EAAE,CAAC,OAAO,EAAE,GAAG,EAAE,CAAC,CAAC,EAAE,CAAC,CAAC;KAC3D,CAAC,CAAC;IAEH,4BAA4B;IAC5B,MAAM,OAAO,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;IACzC,IACE,IAAI,KAAK,CAAC;QACV,WAAW,KAAK,IAAI;QACpB,WAAW,KAAK,CAAC;QACjB,cAAc,KAAK,CAAC,EACpB,CAAC;QACD,KAAK,CAAC,MAAM,GAAG,UAAU,CAAC;QAC1B,KAAK,CAAC,KAAK,GAAI,WAA6B,CAAC,KAAK,CAAC;QACnD,8DAA8D;IAChE,CAAC;SAAM,CAAC;QACN,MAAM,OAAO,GAAiB;YAC5B,IAAI,EAAE,SAAS;YACf,SAAS,EAAE,IAAI;YACf,MAAM,EAAE,MAAM,IAAI,IAAI;YACtB,WAAW,EAAE,UAAU,CAAC,KAAK,CAAC,CAAC,IAAI,CAAC;YACpC,MAAM,EACJ,IAAI,KAAK,CAAC,IAAI,IAAI,KAAK,IAAI;gBACzB,CAAC,CAAC,yBAAyB,IAAI,EAAE;gBACjC,CAAC,CAAC,MAAM;oBACN,CAAC,CAAC,6BAA6B,MAAM,EAAE;oBACvC,CAAC,CAAC,WAAW,GAAG,CAAC;wBACf,CAAC,CAAC,gBAAgB,WAAW,qBAAqB;wBAClD,CAAC,CAAC,cAAc,GAAG,CAAC;4BAClB,CAAC,CAAC,gBAAgB,cAAc,8BAA8B;4BAC9D,CAAC,CAAC,WAAW;gCACX,CAAC,CAAC,2CAA2C;gCAC7C,CAAC,CAAC,6CAA6C;YAC3D,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI;SACtB,CAAC;QACF,gBAAgB,CAAC,UAAU,EAAE,OAAO,CAAC,CAAC;QACtC,KAAK,CAAC,MAAM,GAAG,SAAS,CAAC;IAC3B,CAAC;IACD,KAAK,CAAC,QAAQ,GAAG,OAAO,CAAC;IACzB,KAAK,CAAC,UAAU,GAAG,OAAO,CAAC;IAE3B,qCAAqC;IACrC,IAAI,UAAU,CAAC,MAAM,EAAE,CAAC;QACtB,MAAM,MAAM,GAAG,CAAC,GAAG,UAAU,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,GAAG,CAAC,CAAC,KAAK,CAAC,CAAC;QACjE,MAAM,KAAK,GAAG,MAAM,CAAC,KAAK,CAAC,CAAC,EAAE,IAAI,CAAC,GAAG,CAAC,SAAS,EAAE,MAAM,CAAC,MAAM,CAAC,CAAC,CAAC;QAClE,MAAM,IAAI,GACR,KAAK,CAAC,GAAG,CAAC,CAAC,EAAE,EAAE,EAAE,CAAC,IAAI,CAAC,SAAS,CAAC,EAAE,CAAC,CAAC,CAAC,IAAI,CAAC,IAAI,CAAC;YAChD,CAAC,KAAK,CAAC,MAAM,CAAC,CAAC,CAAC,IAAI,CAAC,CAAC,CAAC,EAAE,CAAC,CAAC;QAC7B,aAAa,CAAC,IAAI,CAAC,GAAG,EAAE,gBAAgB,CAAC,EAAE,IAAI,CAAC,CAAC;IACnD,CAAC;IAED,4CAA4C;IAC5C,IAAI,cAAc,GAA0B,IAAI,CAAC;IACjD,IAAI,KAAK,CAAC,MAAM,KAAK,UAAU,IAAI,CAAC,IAAI,CAAC,aAAa,EAAE,CAAC;QACvD,MAAM,OAAO,GAAG,QAAQ,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,CAAC,MAAM,CACxD,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,MAAM,KAAK,KAAK,CAC1B,CAAC;QACF,MAAM,WAAW,GAAG,eAAe,CACjC,OAAO,EACP,QAAQ,CAAC,WAAW,CAAC,YAAY,EACjC,QAAQ,CAAC,WAAW,CAAC,eAAe,CACrC,CAAC;QACF,MAAM,QAAQ,GAAG,WAAW;YAC1B,CAAC,CAAC;gBACE,MAAM,EAAE,WAAW,CAAC,MAAM;gBAC1B,OAAO,EAAE,WAAW,CAAC,OAAO;gBAC5B,KAAK,EAAE,WAAW,CAAC,KAAM;gBACzB,WAAW,EAAE,WAAW,CAAC,WAAW;aACrC;YACH,CAAC,CAAC,IAAI,CAAC;QACT,MAAM,QAAQ,GAAG,eAAe,CAC9B,YAAY,CAAC,UAAU,CAAC,EACxB,UAAU,EACV,QAAQ,EACR,EAAE,YAAY,EAAE,YAAY,CAAC,QAAQ,CAAC,EAAE,CACzC,CAAC;QACF,cAAc,GAAG,EAAE,IAAI,EAAE,WAAW,EAAE,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI,EAAE,GAAG,QAAQ,EAAE,CAAC;QAC3E,gBAAgB,CAAC,UAAU,EAAE,cAAc,CAAC,CAAC;QAC7C,KAAK,CAAC,QAAQ,GAAG,QAAQ,CAAC,QAAQ,CAAC;IACrC,CAAC;SAAM,IAAI,IAAI,CAAC,aAAa,EAAE,CAAC;QAC9B,KAAK,CAAC,QAAQ,GAAG,KAAK,CAAC;IACzB,CAAC;IACD,eAAe,CAAC,IAAI,CAAC,GAAG,EAAE,YAAY,CAAC,EAAE,KAAK,CAAC,CAAC;IAEhD,iEAAiE;IACjE,MAAM,QAAQ,GAAG;QACf,MAAM,EAAE,KAAK;QACb,QAAQ,EAAE,IAAI,CAAC,UAAU;QACzB,OAAO,EAAE,IAAI,CAAC,OAAO;QACrB,SAAS,EAAE,IAAI,CAAC,MAAM;QACtB,UAAU,EAAE,IAAI,CAAC,UAAU;QAC3B,MAAM,EAAE,KAAK,CAAC,MAAM;QACpB,KAAK,EAAE,KAAK,CAAC,KAAK;QAClB,QAAQ,EAAE,KAAK,CAAC,QAAQ;QACxB,UAAU,EAAE,SAAS;QACrB,QAAQ,EAAE,OAAO;QACjB,YAAY,EAAE,QAAQ,CAAC,WAAW,CAAC,YAAY;QAC/C,eAAe,EAAE,QAAQ,CAAC,WAAW,CAAC,eAAe;KACtD,CAAC;IACF,gBAAgB,CAAC,cAAc,CAAC,QAAQ,EAAE,IAAI,CAAC,UAAU,CAAC,EAAE,QAAQ,CAAC,CAAC;IAEtE,kBAAkB;IAClB,SAAS,CAAC,GAAG,CAAC,CAAC;IAEf,KAAK,WAAW,CAAC,CAAC,yCAAyC;IAE3D,OAAO;QACL,KAAK;QACL,MAAM,EAAE,KAAK,CAAC,MAA4C;QAC1D,KAAK,EAAE,KAAK,CAAC,KAAK;QAClB,QAAQ,EAAE,KAAK,CAAC,QAAQ,IAAI,IAAI;QAChC,QAAQ,EAAE,KAAK,CAAC,MAAM,KAAK,UAAU,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC,CAAC;KAC9C,CAAC;AACJ,CAAC;AASD,SAAS,iBAAiB,CAAC,QAAgB;IACzC,MAAM,GAAG,GAAG,OAAO,CAAC,QAAQ,CAAC,CAAC,WAAW,EAAE,CAAC;IAC5C,IAAI,GAAG,KAAK,KAAK;QAAE,OAAO,EAAE,GAAG,EAAE,SAAS,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;IAC1D,IAAI,GAAG,KAAK,KAAK,IAAI,GAAG,KAAK,MAAM,IAAI,GAAG,KAAK,MAAM;QACnD,OAAO,EAAE,GAAG,EAAE,MAAM,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;IACtC,IAAI,GAAG,KAAK,KAAK,IAAI,GAAG,KAAK,MAAM,IAAI,GAAG,KAAK,MAAM,IAAI,GAAG,KAAK,MAAM,EAAE,CAAC;QACxE,OAAO;YACL,GAAG,EAAE,OAAO,CAAC,QAAQ;YACrB,OAAO,EAAE,CAAC,UAAU,EAAE,OAAO,CAAC,OAAO,CAAC,KAAK,CAAC,CAAC;SAC9C,CAAC;IACJ,CAAC;IACD,2CAA2C;IAC3C,OAAO,EAAE,GAAG,EAAE,QAAQ,EAAE,OAAO,EAAE,EAAE,EAAE,CAAC;AACxC,CAAC;AAED,SAAS,WAAW,CAClB,KAAmB;IAEnB,OAAO,IAAI,OAAO,CAAC,CAAC,OAAO,EAAE,EAAE;QAC7B,KAAK,CAAC,EAAE,CAAC,MAAM,EAAE,CAAC,IAAmB,EAAE,MAA6B,EAAE,EAAE,CACtE,OAAO,CAAC,EAAE,IAAI,EAAE,MAAM,EAAE,CAAC,CAC1B,CAAC;IACJ,CAAC,CAAC,CAAC;AACL,CAAC;AAED,SAAS,MAAM,CAAC,GAAW;IACzB,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,oBAAoB,EAAE;YAC7B,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,SAAS,CAAC,GAAW;IAC5B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,iCAAiC,EAAE;YAC1C,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,WAAW,CAAC,GAAW;IAC9B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,+BAA+B,EAAE;YACxC,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,YAAY,CAAC,GAAW;IAC/B,IAAI,CAAC;QACH,OAAO,CACL,QAAQ,CAAC,gCAAgC,EAAE;YACzC,GAAG;YACH,KAAK,EAAE,CAAC,QAAQ,EAAE,MAAM,EAAE,QAAQ,CAAC;SACpC,CAAC;aACC,QAAQ,EAAE;aACV,IAAI,EAAE,IAAI,IAAI,CAClB,CAAC;IACJ,CAAC;IAAC,MAAM,CAAC;QACP,OAAO,IAAI,CAAC;IACd,CAAC;AACH,CAAC;AAED,SAAS,YAAY,CAAC,KAAkB;IACtC,MAAM,CAAC,GAAG,IAAI,GAAG,EAAkB,CAAC;IACpC,KAAK,MAAM,EAAE,IAAI,KAAK;QAAE,CAAC,CAAC,GAAG,CAAC,EAAE,CAAC,EAAE,EAAE,EAAE,CAAC,KAAK,CAAC,CAAC;IAC/C,OAAO,CAAC,CAAC;AACX,CAAC;AAED,SAAS,YAAY,CAAC,QAAqB;IACzC,MAAM,EAAE,GACN,QAAQ,CAAC,WAGV,CAAC,SAAS,CAAC;IACZ,IAAI,CAAC,KAAK,CAAC,OAAO,CAAC,EAAE,CAAC;QAAE,OAAO,EAAE,CAAC;IAClC,OAAO,EAAE,CAAC,GAAG,CAAC,CAAC,CAAC,EAAE,EAAE,CAAC,CAAC,CAAC,KAAK,IAAI,CAAC,CAAC,IAAI,IAAI,EAAE,CAAC,CAAC,MAAM,CAAC,OAAO,CAAC,CAAC;AAChE,CAAC;AAED;;;GAGG;AACH,MAAM,UAAU,aAAa,CAAC,QAAgB,EAAE,UAAkB;IAChE,MAAM,GAAG,GAAG,eAAe,CAAC,QAAQ,EAAE,UAAU,CAAC,CAAC;IAClD,IAAI,CAAC,UAAU,CAAC,GAAG,CAAC;QAAE,OAAO;IAC7B,KAAK,MAAM,GAAG,IAAI,QAAQ,CAAC,QAAQ,EAAE,UAAU,CAAC,EAAE,CAAC;QACjD,IAAI,GAAG,CAAC,MAAM,KAAK,SAAS;YAAE,SAAS;QACvC,MAAM,IAAI,GAAG,QAAQ,CAAC,IAAI,CAAC,GAAG,EAAE,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC;QAC7C,IAAI,CAAC,IAAI;YAAE,SAAS;QACpB,IAAI,UAAU,CAAC,IAAI,CAAC,GAAG,CAAC;YAAE,SAAS;QACnC,MAAM,WAAW,GAAiB;YAChC,IAAI,EAAE,SAAS;YACf,SAAS,EAAE,IAAI;YACf,MAAM,EAAE,IAAI;YACZ,MAAM,EAAE,cAAc,IAAI,CAAC,GAAG,gDAAgD;YAC9E,EAAE,EAAE,IAAI,CAAC,GAAG,EAAE,GAAG,IAAI;SACtB,CAAC;QACF,gBAAgB,CAAC,GAAG,CAAC,WAAW,EAAE,WAAW,CAAC,CAAC;QAE/C,MAAM,KAAK,GAAG,gBAAgB,CAAY,GAAG,CAAC,UAAU,CAAC,CAAC;QAC1D,IAAI,KAAK,EAAE,CAAC;YACV,KAAK,CAAC,MAAM,GAAG,SAAS,CAAC;YACzB,KAAK,CAAC,QAAQ,GAAG,IAAI,IAAI,EAAE,CAAC,WAAW,EAAE,CAAC;YAC1C,eAAe,CAAC,GAAG,CAAC,UAAU,EAAE,KAAK,CAAC,CAAC;QACzC,CAAC;QACD,SAAS,CAAC,IAAI,CAAC,GAAG,EAAE,GAAG,CAAC,MAAM,CAAC,CAAC,CAAC;IACnC,CAAC;AACH,CAAC"}

package/package.json CHANGED Viewed

@@ -1,6 +1,6 @@
 {
   "name": "@percepta/kaizen",
-  "version": "0.2.0",
+  "version": "0.2.1",
   "description": "Automated AI researcher that improves AI pipelines",
   "keywords": [
     "ai",
@@ -37,6 +37,7 @@
   },
   "dependencies": {
     "node-pty": "^1.1.0",
+    "tsx": "^4.21.0",
     "ws": "^8.20.0",
     "yaml": "^2.8.2"
   },
@@ -59,7 +60,6 @@
     "react-dom": "19.2.3",
     "react-markdown": "^10.1.0",
     "rimraf": "^5.0.5",
-    "tsx": "^4.21.0",
     "typescript": "^6.0.3",
     "vitest": "^4.0.17",
     "zod": "4.1.4",

package/templates/pipeline/eval.py CHANGED Viewed

@@ -14,6 +14,13 @@ The supervisor will record the run as `crashed` if no `complete` event is seen.
 This template runs against 3 dummy items so you can verify the event stream end-to-end
 before plugging in real data. Replace `iter_items` and `score_one` with your logic.
+For production evals backed by Langfuse, keep the NDJSON stream as the required
+Kaizen contract and also persist results back to Langfuse as a best-effort side
+effect: load the versioned dataset, run the pipeline to create a fresh trace for
+each item, link that trace to the dataset item in a dataset run, and write the
+primary metric as a score on the trace. Include that fresh trace id in the
+Kaizen item event so failure analysis can jump directly to Langfuse.
 """
 from __future__ import annotations
@@ -53,6 +60,8 @@ def score_one(item: dict[str, Any], variant: str) -> dict[str, Any]:
     Returns a dict with at minimum: {"score": float, "breakdown": dict, "trace_id": str | None}.
     """
     # TODO: call your actual pipeline here, then compare to ground truth.
+    # TODO: for Langfuse-backed evals, create/link a dataset-run item and
+    # write the primary metric as a Langfuse score on the fresh trace.
     # The dummy logic below produces a deterministic score so the supervisor sees real numbers.
     expected = item.get("expected", "")
     actual = item.get("input", "")  # placeholder

package/templates/pipeline/eval.ts ADDED Viewed

@@ -0,0 +1,168 @@
+/**
+ * Eval script for the {{name}} pipeline.
+ *
+ * The Kaizen supervisor invokes this script and consumes NDJSON events from
+ * its `--out-fd` (or stdout if no fd is given). Your only job is to emit a
+ * well-formed event stream:
+ *
+ *   {"type":"start","n":<int>,"eval_version":<int>,"dataset_version":"<str>"}
+ *   {"type":"item","id":"<str>","score":<float in [0,1]>,"breakdown":{},"trace_id":"<str|null>"}
+ *   ... one item event per dataset item ...
+ *   {"type":"complete","score":<float>,"breakdown":{},"worst_traces":[]}
+ *
+ * For Langfuse-backed production evals, keep the NDJSON stream as the required
+ * Kaizen contract and also persist results back to Langfuse as a best-effort
+ * side effect: load the versioned dataset, run the pipeline to create a fresh
+ * trace for each item, link that trace to the dataset item in a dataset run,
+ * and write the primary metric as a score on the trace. Include that fresh
+ * trace id in the Kaizen item event so failure analysis can jump to Langfuse.
+ */
+import { closeSync, writeSync } from "node:fs";
+const EVAL_VERSION = 1;
+const DATASET_VERSION = "v1";
+interface EvalArgs {
+  variant: string;
+  dataset: string;
+  maxItems: number | null;
+  outFd: number | null;
+}
+interface DemoItem {
+  id: string;
+  input: string;
+  expected: string;
+}
+interface ScoreResult {
+  score: number;
+  breakdown: Record<string, number>;
+  trace_id: string | null;
+}
+function emit(outFd: number | null, event: Record<string, unknown>): void {
+  const line = `${JSON.stringify(event)}\n`;
+  if (outFd === null) {
+    process.stdout.write(line);
+    return;
+  }
+  writeSync(outFd, line);
+}
+function parseArgs(argv: string[]): EvalArgs {
+  const args: EvalArgs = {
+    variant: "",
+    dataset: DATASET_VERSION,
+    maxItems: null,
+    outFd: null,
+  };
+  for (let i = 0; i < argv.length; i++) {
+    const arg = argv[i];
+    const next = argv[i + 1];
+    if (arg === "--variant" && next) {
+      args.variant = next;
+      i++;
+    } else if (arg === "--dataset" && next) {
+      args.dataset = next;
+      i++;
+    } else if (arg === "--max-items" && next) {
+      args.maxItems = Number.parseInt(next, 10);
+      i++;
+    } else if (arg === "--out-fd" && next) {
+      args.outFd = Number.parseInt(next, 10);
+      i++;
+    }
+  }
+  if (!args.variant) {
+    throw new Error("missing required --variant");
+  }
+  return args;
+}
+function iterItems(maxItems: number | null): DemoItem[] {
+  const items = [
+    { id: "demo-1", input: "hello", expected: "hi" },
+    { id: "demo-2", input: "world", expected: "world" },
+    { id: "demo-3", input: "foo", expected: "bar" },
+  ];
+  return maxItems === null ? items : items.slice(0, maxItems);
+}
+function scoreOne(item: DemoItem, _variant: string): ScoreResult {
+  // TODO: call your actual pipeline here, then compare to ground truth.
+  // TODO: for Langfuse-backed evals, create/link a dataset-run item and
+  // write the primary metric as a Langfuse score on the fresh trace.
+  const exact = item.input === item.expected ? 1 : 0;
+  return {
+    score: exact,
+    breakdown: { exact_match: exact },
+    trace_id: null,
+  };
+}
+function average(values: number[]): number {
+  return (
+    values.reduce((sum, value) => sum + value, 0) / Math.max(values.length, 1)
+  );
+}
+async function main(): Promise<void> {
+  const args = parseArgs(process.argv.slice(2));
+  const items = iterItems(args.maxItems);
+  emit(args.outFd, {
+    type: "start",
+    n: items.length,
+    eval_version: EVAL_VERSION,
+    dataset_version: args.dataset,
+    variant: args.variant,
+    ts: Date.now() / 1000,
+  });
+  const scored = items.map((item) => {
+    const result = scoreOne(item, args.variant);
+    const event = {
+      type: "item",
+      id: item.id,
+      score: result.score,
+      breakdown: result.breakdown,
+      trace_id: result.trace_id,
+      ts: Date.now() / 1000,
+    };
+    emit(args.outFd, event);
+    return event;
+  });
+  const breakdown = {
+    exact_match: average(scored.map((item) => item.breakdown.exact_match)),
+  };
+  const worst = [...scored]
+    .sort((a, b) => a.score - b.score)
+    .slice(0, 3)
+    .map((item) => ({
+      id: item.id,
+      score: item.score,
+      trace_id: item.trace_id,
+    }));
+  emit(args.outFd, {
+    type: "complete",
+    score: average(scored.map((item) => item.score)),
+    breakdown,
+    n: scored.length,
+    worst_traces: worst,
+    ts: Date.now() / 1000,
+  });
+  if (args.outFd !== null) closeSync(args.outFd);
+}
+main().catch((error: unknown) => {
+  process.stderr.write(
+    `${error instanceof Error ? error.message : String(error)}\n`,
+  );
+  process.exit(1);
+});

package/templates/pipeline/pipeline.md CHANGED Viewed

@@ -1,7 +1,7 @@
 ---
 name: {{name}}
 description: {{description}}
-run_eval: eval/{{name}}.py
+run_eval: eval/{{name}}.{{eval_ext}}
 eval_version: 1
 dataset_version: v1
 eval_style: {{eval_style}}
@@ -33,6 +33,15 @@ created_at: {{iso_now}}
 - set env vars
 - fetch fixtures -->
+## Eval persistence
+<!-- For Langfuse-backed production evals:
+- Load dataset items from the `dataset_version` named in frontmatter.
+- For each item, run the candidate pipeline and capture the fresh Langfuse trace id.
+- Link the dataset item to that trace in a Langfuse dataset run named for the Kaizen run.
+- Write the primary metric as a Langfuse score on the fresh trace, with secondary metrics in metadata.
+- Emit the same score through Kaizen's required NDJSON `item` / `complete` events. -->
 ## Architecture
 <!-- Mermaid diagram of the current best variant. Update when the leaderboard moves. -->

package/templates/workspace/.claude/agents/variant-builder.md CHANGED Viewed

@@ -38,6 +38,8 @@ kaizen run \
 The `kaizen run` runner is plain code, not an agent. It handles everything: writes manifest, tails NDJSON events into `events.jsonl`, atomically updates `state.json`, dumps worst items to `failures.jsonl`, decides promotion via paired-bootstrap statistical test, prints the score.
+The eval script may also write Langfuse dataset-run links and trace scores. Treat those writes as diagnostic persistence only. The authoritative run result for this loop is still the `complete.score` that `kaizen run` records from the NDJSON stream.
 You do **not** write `.kaizen/` files. You do **not** call any status CLI. The single `kaizen run` invocation is the whole interaction.
 ## After the run

package/templates/workspace/.claude/commands/kaizen.md CHANGED Viewed

@@ -30,6 +30,26 @@ Truth lives on disk under `.kaizen/runs/<pipeline>/<run_id>/`:
 The hypothesis log is `.kaizen/hypotheses/<pipeline>.jsonl` — every run leaves a line, success or failure.
 The promoted baseline is derived on demand: the latest run that beat the previous promoted baseline with statistical confidence under matching `eval_version` / `dataset_version`. The leaderboard still shows the best raw score. `kaizen log --pipeline <p>` shows the promoted baseline in the header alongside recent runs.
+## Eval script contract
+The pipeline's `run_eval` script is the single eval entrypoint. `kaizen run` invokes it as:
+```bash
+<run_eval> --variant <variant_id> --dataset <dataset_version> --out-fd 3 [--max-items <n>]
+```
+The required contract is the NDJSON stream on `--out-fd`: emit `start`, one `item` per dataset item, and one terminal `complete` with a numeric `score` in `[0,1]`. The `complete.score` is what Kaizen records, compares, and returns to you in the CLI summary.
+For real customer pipelines, the eval script should also persist results back to Langfuse as a best-effort side effect:
+- Load the versioned Langfuse dataset named by `--dataset`.
+- Run the candidate pipeline for each dataset item, producing a fresh Langfuse trace for that item.
+- Link each dataset item to that fresh trace in a Langfuse dataset run named for the Kaizen experiment or variant.
+- Write the primary metric as a Langfuse score on the fresh trace, with useful secondary metrics in score metadata or dataset-run metadata.
+- Include the fresh trace id in each Kaizen `item.trace_id` and in `complete.worst_traces`.
+Langfuse writes make traces, dataset runs, and scores durable for inspection. They must not replace the NDJSON stream; `.kaizen/runs/` remains Kaizen's local source of truth for experiment state and promotion.
 ## Loop
 1. **Read state** — `kaizen log --pipeline <p> -n 10` gives both the promoted baseline (header) and recent runs (body) in one call.

/package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/static/{SjAC88d3utiBvgy5eS--0 → NipfouxkPumeJ20wdsKlr}/_buildManifest.js RENAMED Viewed

File without changes

/package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/static/{SjAC88d3utiBvgy5eS--0 → NipfouxkPumeJ20wdsKlr}/_clientMiddlewareManifest.json RENAMED Viewed

File without changes

/package/dashboard/.next/standalone/packages/kaizen/dashboard/.next/static/{SjAC88d3utiBvgy5eS--0 → NipfouxkPumeJ20wdsKlr}/_ssgManifest.js RENAMED Viewed

File without changes