reeval 0.24.0 → 0.26.0
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +64 -0
- package/README.md +16 -16
- package/THIRD_PARTY_NOTICES.md +0 -2068
- package/assets/package.json +1 -1
- package/assets/pnpm-lock.yaml +65 -50
- package/dist/{adapter-dHdepWKb.js → adapter-BHMbIeH9.js} +7 -7
- package/dist/{adapter-dHdepWKb.js.map → adapter-BHMbIeH9.js.map} +1 -1
- package/dist/{agent-CZpiwA_r.js → agent-D67VCd6Q.js} +8 -8
- package/dist/{agent-CZpiwA_r.js.map → agent-D67VCd6Q.js.map} +1 -1
- package/dist/{agents-CEapsHV-.js → agents-Dnv1MmgY.js} +40 -59
- package/dist/agents-Dnv1MmgY.js.map +1 -0
- package/dist/{analysis-BnG_1x_O.js → analysis-8vvMnUJB.js} +4 -5
- package/dist/analysis-8vvMnUJB.js.map +1 -0
- package/dist/api-ZeGnedB3.js +141 -0
- package/dist/api-ZeGnedB3.js.map +1 -0
- package/dist/assemble-BlA7FWRn.js +1 -0
- package/dist/{assemble-Dw1bF13I.js → assemble-CuvlsOaE.js} +117 -66
- package/dist/assemble-CuvlsOaE.js.map +1 -0
- package/dist/{attach-DvYiMu6w.js → attach-6av4DmO3.js} +24 -6
- package/dist/attach-6av4DmO3.js.map +1 -0
- package/dist/{attempt-DxR1agFo.js → attempt-D5WH0yFa.js} +3 -3
- package/dist/{attempt-DxR1agFo.js.map → attempt-D5WH0yFa.js.map} +1 -1
- package/dist/{attempt-host-DgeJFSZw.js → attempt-host-Be_-uDKJ.js} +37 -14
- package/dist/attempt-host-Be_-uDKJ.js.map +1 -0
- package/dist/boat-BCNNEJni.js +298 -0
- package/dist/boat-BCNNEJni.js.map +1 -0
- package/dist/boat-CwBW2sbp.js +1 -0
- package/dist/{boat-CUNgSc75.js → boat-CygRcaM0.js} +115 -196
- package/dist/boat-CygRcaM0.js.map +1 -0
- package/dist/{boat-images-BuFigiEb.js → boat-images-asGLQXD5.js} +19 -23
- package/dist/boat-images-asGLQXD5.js.map +1 -0
- package/dist/{bundle-yEgI3RsI.js → bundle-B7P-Awnm.js} +105 -17
- package/dist/bundle-B7P-Awnm.js.map +1 -0
- package/dist/{capture-DdEKVrwk.js → capture-BwLa-4s-.js} +20 -19
- package/dist/{capture-DdEKVrwk.js.map → capture-BwLa-4s-.js.map} +1 -1
- package/dist/capture-CG-J-1-j.js +1 -0
- package/dist/cases-Bsp-G-ZL.js +1 -0
- package/dist/{cases-B7QkvMGE.js → cases-C6vnV-gn.js} +60 -42
- package/dist/cases-C6vnV-gn.js.map +1 -0
- package/dist/classify-BIJQ2Xqo.js +163 -0
- package/dist/classify-BIJQ2Xqo.js.map +1 -0
- package/dist/{cli-Z7aw8k25.js → cli-BoCPYLUQ.js} +305 -124
- package/dist/cli-BoCPYLUQ.js.map +1 -0
- package/dist/{cli-spec-3zvLC9YW.js → cli-spec-DgEWHOt3.js} +164 -50
- package/dist/cli-spec-DgEWHOt3.js.map +1 -0
- package/dist/cli.js +2 -2
- package/dist/client-Dj65gXG3.js +105 -0
- package/dist/client-Dj65gXG3.js.map +1 -0
- package/dist/{cloud-owVBaSRt.js → cloud-TuNUlZ0L.js} +3 -3
- package/dist/{cloud-owVBaSRt.js.map → cloud-TuNUlZ0L.js.map} +1 -1
- package/dist/{cloud-files-BjinrTTe.js → cloud-files-CBovrfZA.js} +8 -8
- package/dist/{cloud-files-BjinrTTe.js.map → cloud-files-CBovrfZA.js.map} +1 -1
- package/dist/{cloud-DuHcNQVV.js → cloud-igGIS4Bm.js} +43 -20
- package/dist/cloud-igGIS4Bm.js.map +1 -0
- package/dist/cloud-project-Ch7jjlwh.js +110 -0
- package/dist/cloud-project-Ch7jjlwh.js.map +1 -0
- package/dist/cloud-project-DdUVB4EE.js +1 -0
- package/dist/cloud-push-DvnqOgRd.js +817 -0
- package/dist/cloud-push-DvnqOgRd.js.map +1 -0
- package/dist/cloud-push-MXKreNyq.js +1 -0
- package/dist/{cloud-run-DqMkSGYB.js → cloud-run-CbGF8Lwt.js} +285 -48
- package/dist/cloud-run-CbGF8Lwt.js.map +1 -0
- package/dist/cloud-run-CghE2dG6.js +1 -0
- package/dist/{cloud-secrets-Bak83tik.js → cloud-secrets-BWoV4ddM.js} +43 -35
- package/dist/cloud-secrets-BWoV4ddM.js.map +1 -0
- package/dist/cloud-secrets-DlPRfS2l.js +1 -0
- package/dist/command-Bps8kBML.js +141 -0
- package/dist/command-Bps8kBML.js.map +1 -0
- package/dist/{command-CtmSJzPC.js → command-ByUmSm2D.js} +29 -23
- package/dist/command-ByUmSm2D.js.map +1 -0
- package/dist/{command-CeygdoVe.js → command-CQk7FCI1.js} +92 -26
- package/dist/command-CQk7FCI1.js.map +1 -0
- package/dist/{command-CoHN1ibe.js → command-CxuGky7A.js} +44 -20
- package/dist/command-CxuGky7A.js.map +1 -0
- package/dist/{command-efTGfUYb.js → command-pxfK2bkV.js} +26 -16
- package/dist/command-pxfK2bkV.js.map +1 -0
- package/dist/commands-Cl3Y_UXg.js +1 -0
- package/dist/{commands-DR-NolV2.js → commands-DGWNNyRD.js} +54 -38
- package/dist/commands-DGWNNyRD.js.map +1 -0
- package/dist/{config-Bn2OhCN_.js → config-mU7wFvQq.js} +46 -32
- package/dist/config-mU7wFvQq.js.map +1 -0
- package/dist/core-BXYzOEyQ.js +2058 -0
- package/dist/core-BXYzOEyQ.js.map +1 -0
- package/dist/{slug-IHh3f770.js → cost-DQ0ayy6h.js} +37 -2
- package/dist/cost-DQ0ayy6h.js.map +1 -0
- package/dist/{cursor-catalog-BYIDSsLn.js → cursor-catalog-EOFft6LJ.js} +4 -4
- package/dist/{cursor-catalog-BYIDSsLn.js.map → cursor-catalog-EOFft6LJ.js.map} +1 -1
- package/dist/{daytona-CWs9j9mt.js → daytona-DtCjv8rH.js} +22 -17
- package/dist/daytona-DtCjv8rH.js.map +1 -0
- package/dist/daytona-image-Xy5o53Ji.js +1 -0
- package/dist/{daytona-image-DmGlFAyq.js → daytona-image-w4uTRZ0z.js} +6 -6
- package/dist/{daytona-image-DmGlFAyq.js.map → daytona-image-w4uTRZ0z.js.map} +1 -1
- package/dist/db-BcplCdzu.js +1 -0
- package/dist/{db-D6yQib7M.js → db-yigMuHM2.js} +31 -119
- package/dist/db-yigMuHM2.js.map +1 -0
- package/dist/debug-CGg7KHKq.js +1 -0
- package/dist/{debug-CIXzB4wK.js → debug-T29p6HOX.js} +2 -10
- package/dist/debug-T29p6HOX.js.map +1 -0
- package/dist/{default-effort-Ck6ViSaI.js → default-effort-B1b8t81b.js} +1 -1
- package/dist/{default-effort-Bpz5ULfC.js → default-effort-BDYXBzu5.js} +3 -3
- package/dist/{default-effort-Bpz5ULfC.js.map → default-effort-BDYXBzu5.js.map} +1 -1
- package/dist/{dist-CZtW7eI5.js → dist-DCG7vZGQ.js} +3 -3
- package/dist/{dist-CZtW7eI5.js.map → dist-DCG7vZGQ.js.map} +1 -1
- package/dist/{docker-Dgw4aaRk.js → docker-DcnX2WpM.js} +4 -4
- package/dist/{docker-Dgw4aaRk.js.map → docker-DcnX2WpM.js.map} +1 -1
- package/dist/{docker-Bbi4kmFj.js → docker-XCyDUd7_.js} +1 -1
- package/dist/{doctor-BfS6jswW.js → doctor-DTKa8rrq.js} +27 -27
- package/dist/{doctor-BfS6jswW.js.map → doctor-DTKa8rrq.js.map} +1 -1
- package/dist/duration-Bz2H7pXb.js +34 -0
- package/dist/duration-Bz2H7pXb.js.map +1 -0
- package/dist/{environment-BY8lVFFK.js → environment-BCBg6c0p.js} +38 -12
- package/dist/environment-BCBg6c0p.js.map +1 -0
- package/dist/errors-BjzEWESY.js +93 -0
- package/dist/errors-BjzEWESY.js.map +1 -0
- package/dist/{errors-P8oHhNzy.js → errors-Cda7UzRA.js} +2 -2
- package/dist/{errors-P8oHhNzy.js.map → errors-Cda7UzRA.js.map} +1 -1
- package/dist/{eval-source-BB8In3xo.js → eval-source-CSPyKuV6.js} +6 -6
- package/dist/{eval-source-BB8In3xo.js.map → eval-source-CSPyKuV6.js.map} +1 -1
- package/dist/{evaluate-B9_nukrc.d.ts → evaluate-Nnh0iPuo.d.ts} +1 -1
- package/dist/{evaluate-B8I9AKgw.js → evaluate-wgW1lGQj.js} +280 -60
- package/dist/evaluate-wgW1lGQj.js.map +1 -0
- package/dist/{events-D97ZzAeq.js → events-DG_Cq5Pn.js} +154 -33
- package/dist/events-DG_Cq5Pn.js.map +1 -0
- package/dist/events-RaK1pDmT.js +1 -0
- package/dist/{fake-bootstrap-4DFtzib0.js → fake-bootstrap-uCyHhnMO.js} +2 -2
- package/dist/{fake-bootstrap-4DFtzib0.js.map → fake-bootstrap-uCyHhnMO.js.map} +1 -1
- package/dist/files-BnsRehge.js +1 -0
- package/dist/{files-B0DbptiO.js → files-Bv6ipFjc.js} +4 -4
- package/dist/{files-B0DbptiO.js.map → files-Bv6ipFjc.js.map} +1 -1
- package/dist/{files-GBTUBAek.js → files-CcnSILye.js} +3 -3
- package/dist/{files-GBTUBAek.js.map → files-CcnSILye.js.map} +1 -1
- package/dist/{files-BesexM88.js → files-CjPm3yyj.js} +173 -41
- package/dist/files-CjPm3yyj.js.map +1 -0
- package/dist/files-CkmCV5rH.js +1 -0
- package/dist/{files-DE13BqBC.js → files-ClUbQPj9.js} +2 -2
- package/dist/{files-DE13BqBC.js.map → files-ClUbQPj9.js.map} +1 -1
- package/dist/{files-B4K1k__s.js → files-CqfVnRXw.js} +5 -5
- package/dist/{files-B4K1k__s.js.map → files-CqfVnRXw.js.map} +1 -1
- package/dist/files-D4Hb9HZS.js +1 -0
- package/dist/files-DCcRkJN4.js +1 -0
- package/dist/{files-TwSVeWwM.js → files-GAocj_Z1.js} +27 -41
- package/dist/files-GAocj_Z1.js.map +1 -0
- package/dist/gateway.d.ts +1 -1
- package/dist/{git-DatgUcnf.js → git-CRPr6I2T.js} +3 -3
- package/dist/{git-DatgUcnf.js.map → git-CRPr6I2T.js.map} +1 -1
- package/dist/{harness-FcTyyPco.js → harness-Dcd3ffkY.js} +3 -2
- package/dist/harness-Dcd3ffkY.js.map +1 -0
- package/dist/{harness-EZNoeUBf.js → harness-DvqNGwl6.js} +2 -2
- package/dist/{harness-EZNoeUBf.js.map → harness-DvqNGwl6.js.map} +1 -1
- package/dist/{harness-install-HgR73tpF.js → harness-install-B0Y2GjnO.js} +4 -4
- package/dist/{harness-install-HgR73tpF.js.map → harness-install-B0Y2GjnO.js.map} +1 -1
- package/dist/harness.d.ts +1 -1
- package/dist/harness.js +1 -1
- package/dist/http-DtlSzw4A.js +96 -0
- package/dist/http-DtlSzw4A.js.map +1 -0
- package/dist/{ids-DqEvrBFZ.js → ids-CtxRn13a.js} +4 -3
- package/dist/ids-CtxRn13a.js.map +1 -0
- package/dist/{images-SRE4f3SM.js → images-JspTw1vt.js} +13 -13
- package/dist/{images-SRE4f3SM.js.map → images-JspTw1vt.js.map} +1 -1
- package/dist/index.d.ts +7 -2
- package/dist/index.js +4 -5
- package/dist/init-BHIWfE2L.js +1 -0
- package/dist/{init-D5F9MYPC.js → init-wmMbauok.js} +6 -6
- package/dist/{init-D5F9MYPC.js.map → init-wmMbauok.js.map} +1 -1
- package/dist/{ink-list-CLq6YVB8.js → ink-list-B5Gul5iZ.js} +7 -6
- package/dist/ink-list-B5Gul5iZ.js.map +1 -0
- package/dist/{inputs-B_FsOD2N.js → inputs-BWTtz1-v.js} +6 -6
- package/dist/{inputs-B_FsOD2N.js.map → inputs-BWTtz1-v.js.map} +1 -1
- package/dist/inputs-load-C8HEtAej.js +1 -0
- package/dist/{inputs-load-B4MFkp0Q.js → inputs-load-DQRC3dUA.js} +3 -3
- package/dist/{inputs-load-B4MFkp0Q.js.map → inputs-load-DQRC3dUA.js.map} +1 -1
- package/dist/internal/vm-api/boat.d.ts +46 -0
- package/dist/internal/vm-api/boat.js +1 -0
- package/dist/internal/vm-api/daytona.d.ts +26 -0
- package/dist/internal/vm-api/daytona.js +220 -0
- package/dist/internal/vm-api/daytona.js.map +1 -0
- package/dist/internal/vm-api.d.ts +86 -0
- package/dist/internal/vm-api.js +3 -0
- package/dist/internal/vm.d.ts +1 -1
- package/dist/internal/vm.js +1 -1
- package/dist/{invocations-BxQqe5GU.js → invocations-CSA9OKFn.js} +5 -5
- package/dist/{invocations-BxQqe5GU.js.map → invocations-CSA9OKFn.js.map} +1 -1
- package/dist/issue-ipG9Yy1h.js +1 -0
- package/dist/{issue-iErT9KkK.js → issue-lKqtL3iX.js} +4 -4
- package/dist/{issue-iErT9KkK.js.map → issue-lKqtL3iX.js.map} +1 -1
- package/dist/{jiti-CtahaHaY.js → jiti-aNfS_lSj.js} +2 -2
- package/dist/{jiti-CtahaHaY.js.map → jiti-aNfS_lSj.js.map} +1 -1
- package/dist/{judge-MOKPsr6R.js → judge-etHC4K02.js} +5 -5
- package/dist/{judge-MOKPsr6R.js.map → judge-etHC4K02.js.map} +1 -1
- package/dist/judge.d.ts +1 -1
- package/dist/judge.js +1 -1
- package/dist/{judgments-Dur4D2pj.js → judgments-CVCUWT-g.js} +7 -4
- package/dist/{judgments-Dur4D2pj.js.map → judgments-CVCUWT-g.js.map} +1 -1
- package/dist/{kinds-Dohijzi-.js → kinds-BQX5ZxpK.js} +37 -11
- package/dist/{kinds-Dohijzi-.js.map → kinds-BQX5ZxpK.js.map} +1 -1
- package/dist/labels-Dtyf5-pd.js +251 -0
- package/dist/labels-Dtyf5-pd.js.map +1 -0
- package/dist/{layout-BhhJAEgf.js → layout-Co4tPHWI.js} +3 -3
- package/dist/{layout-BhhJAEgf.js.map → layout-Co4tPHWI.js.map} +1 -1
- package/dist/link-Cqs2DhxR.js +127 -0
- package/dist/link-Cqs2DhxR.js.map +1 -0
- package/dist/{list-ClDb8qiX.js → list-CjcNH-5e.js} +10 -7
- package/dist/list-CjcNH-5e.js.map +1 -0
- package/dist/{live-QFILMmql.js → live-BRF0ogR6.js} +3 -5
- package/dist/live-BRF0ogR6.js.map +1 -0
- package/dist/live-DTpM9b4D.js +56 -0
- package/dist/live-DTpM9b4D.js.map +1 -0
- package/dist/{machine-service-xFhakTs5.js → machine-service-BetvBWHz.js} +146 -13
- package/dist/machine-service-BetvBWHz.js.map +1 -0
- package/dist/{machine-service-DpJScNtA.js → machine-service-XFymGCHj.js} +1 -1
- package/dist/{machines-Cm-rU7jp.js → machines-CkDTbMZ6.js} +25 -25
- package/dist/{machines-Cm-rU7jp.js.map → machines-CkDTbMZ6.js.map} +1 -1
- package/dist/markdown-COts-jxf.js +653 -0
- package/dist/markdown-COts-jxf.js.map +1 -0
- package/dist/{model-Rmv-L9Jb.js → model-BYHXnYLe.js} +1 -1
- package/dist/model-CrsA2Evf.js +1 -0
- package/dist/{model-CcvSrrq9.js → model-DNC53cPL.js} +4 -4
- package/dist/{model-CcvSrrq9.js.map → model-DNC53cPL.js.map} +1 -1
- package/dist/{model-D9WMMEWD.js → model-F4UH_YG6.js} +4 -4
- package/dist/{model-D9WMMEWD.js.map → model-F4UH_YG6.js.map} +1 -1
- package/dist/{model-mTaaEkeQ.js → model-xemZQ7DK.js} +251 -65
- package/dist/model-xemZQ7DK.js.map +1 -0
- package/dist/{node-Bl2CtSjB.js → node-gPT36n_n.js} +19 -8
- package/dist/{node-Bl2CtSjB.js.map → node-gPT36n_n.js.map} +1 -1
- package/dist/options-CAZfxE0h.js +1 -0
- package/dist/otlp-BxPnO99e.js +1 -0
- package/dist/otlp-DbNz-occ.js +25 -0
- package/dist/otlp-DbNz-occ.js.map +1 -0
- package/dist/outcome-1LBk2e3w.js +38 -0
- package/dist/outcome-1LBk2e3w.js.map +1 -0
- package/dist/{patch-DhJDHRFs.js → patch-Dxzv8msl.js} +3 -3
- package/dist/{patch-DhJDHRFs.js.map → patch-Dxzv8msl.js.map} +1 -1
- package/dist/{patch-C7yBztZj.js → patch-uwo6t4Zy.js} +26 -2
- package/dist/patch-uwo6t4Zy.js.map +1 -0
- package/dist/{pi-providers-HygmL1y-.js → pi-providers-BjcQv2A1.js} +23 -9
- package/dist/{pi-providers-HygmL1y-.js.map → pi-providers-BjcQv2A1.js.map} +1 -1
- package/dist/{plain-Ctn8oUdp.js → plain-DXUNwqpO.js} +2 -2
- package/dist/{plain-Ctn8oUdp.js.map → plain-DXUNwqpO.js.map} +1 -1
- package/dist/{plan-CC0bKbm9.js → plan-DSJX7Oyq.js} +9 -9
- package/dist/{plan-CC0bKbm9.js.map → plan-DSJX7Oyq.js.map} +1 -1
- package/dist/{plugins-PwEtW8GH.js → plugins-DVEOMsYw.js} +7 -7
- package/dist/{plugins-PwEtW8GH.js.map → plugins-DVEOMsYw.js.map} +1 -1
- package/dist/{preflight-BHUEfA4m.js → preflight-B3oLZttl.js} +4 -4
- package/dist/{preflight-BHUEfA4m.js.map → preflight-B3oLZttl.js.map} +1 -1
- package/dist/preflight-CLYRuQ3r.js +1 -0
- package/dist/{preflight-DEV_vrdB.js → preflight-DXMD6jou.js} +1 -1
- package/dist/{preflight-BzvLYQ70.js → preflight-dUe0QiPK.js} +9 -9
- package/dist/{preflight-BzvLYQ70.js.map → preflight-dUe0QiPK.js.map} +1 -1
- package/dist/{prepare-D7hPrh7Q.js → prepare-BTaX7vcC.js} +8 -8
- package/dist/{prepare-D7hPrh7Q.js.map → prepare-BTaX7vcC.js.map} +1 -1
- package/dist/{prepare-DS42k409.js → prepare-QdiYPOwR.js} +2 -2
- package/dist/prices-CfnkJOth.js +1 -0
- package/dist/{prices-DXJsP2Ha.js → prices-CoLymMRd.js} +3 -3
- package/dist/{prices-DXJsP2Ha.js.map → prices-CoLymMRd.js.map} +1 -1
- package/dist/{process-RPlEhpHz.js → process-C_nh1H7X.js} +9 -3
- package/dist/process-C_nh1H7X.js.map +1 -0
- package/dist/provenance-Cylt_YxT.d.ts +222 -0
- package/dist/{provenance-DgQJ-dq7.js → provenance-Di42xQIS.js} +5 -5
- package/dist/{provenance-DgQJ-dq7.js.map → provenance-Di42xQIS.js.map} +1 -1
- package/dist/provider-B24hZX95.js +1 -0
- package/dist/{provider-ieWOn4YS.js → provider-Cn7lmECy.js} +2 -2
- package/dist/{provider-ieWOn4YS.js.map → provider-Cn7lmECy.js.map} +1 -1
- package/dist/{provider-stop-CxzWW7Ft.js → provider-stop-DjBMfZW5.js} +2 -2
- package/dist/{provider-stop-CxzWW7Ft.js.map → provider-stop-DjBMfZW5.js.map} +1 -1
- package/dist/{providers-N4HDMeeo.js → providers-Bm5NLaRh.js} +1 -1
- package/dist/{providers-B5Vr0hKH.js → providers-CTTfYbm0.js} +28 -28
- package/dist/{providers-B5Vr0hKH.js.map → providers-CTTfYbm0.js.map} +1 -1
- package/dist/query-CTMdWXbx.js +1 -0
- package/dist/{query-CmTjYbqh.js → query-TzNtTvwf.js} +2 -2
- package/dist/{query-CmTjYbqh.js.map → query-TzNtTvwf.js.map} +1 -1
- package/dist/{questions-DnqkJga0.js → questions-BqisU7A0.js} +19 -13
- package/dist/questions-BqisU7A0.js.map +1 -0
- package/dist/{recipe-B0NeT_Sn.js → recipe-DzjXne35.js} +4 -4
- package/dist/{recipe-B0NeT_Sn.js.map → recipe-DzjXne35.js.map} +1 -1
- package/dist/{record-2liAelrB.js → record-Cj3yWR0E.js} +43 -12
- package/dist/record-Cj3yWR0E.js.map +1 -0
- package/dist/{redact-DMueYS-v.js → redact-CfTHYWLv.js} +30 -1
- package/dist/redact-CfTHYWLv.js.map +1 -0
- package/dist/{remarks-D5qOZzcX.js → remarks-BPKGorBW.js} +4 -2
- package/dist/remarks-BPKGorBW.js.map +1 -0
- package/dist/{remarks-D-9f1y1B.js → remarks-CYXYiB_O.js} +21 -11
- package/dist/{remarks-D-9f1y1B.js.map → remarks-CYXYiB_O.js.map} +1 -1
- package/dist/{remote-B7BIRUTK.js → remote-D4UEa7Rs.js} +10 -8
- package/dist/{remote-B7BIRUTK.js.map → remote-D4UEa7Rs.js.map} +1 -1
- package/dist/renderer/ascii.d.ts +6 -0
- package/dist/renderer/ascii.js +7 -0
- package/dist/renderer/ascii.js.map +1 -0
- package/dist/renderer/markdown.d.ts +31 -0
- package/dist/renderer/markdown.js +1 -0
- package/dist/report-BSi-R8hC.js +941 -0
- package/dist/report-BSi-R8hC.js.map +1 -0
- package/dist/report-inputs-5XwZBIRK.js +113 -0
- package/dist/report-inputs-5XwZBIRK.js.map +1 -0
- package/dist/{resolve-B60w6DcB.js → resolve-BEltmYhD.js} +6 -5
- package/dist/resolve-BEltmYhD.js.map +1 -0
- package/dist/resolve-C7A5Q2Jj.js +1 -0
- package/dist/{resolve-t9sOkGGS.js → resolve-nRzGt4Ff.js} +30 -13
- package/dist/resolve-nRzGt4Ff.js.map +1 -0
- package/dist/{results-Df910ONm.js → results-DXBaxfIM.js} +11 -7
- package/dist/{results-Df910ONm.js.map → results-DXBaxfIM.js.map} +1 -1
- package/dist/{resume-4Q9q8AcE.js → resume-DZPjjToJ.js} +46 -21
- package/dist/resume-DZPjjToJ.js.map +1 -0
- package/dist/{retry-C15f5yyy.js → retry-rLdXCinf.js} +5 -5
- package/dist/{retry-C15f5yyy.js.map → retry-rLdXCinf.js.map} +1 -1
- package/dist/{root-Cm93-6ix.js → root-Co0jhOT5.js} +2 -2
- package/dist/{root-Cm93-6ix.js.map → root-Co0jhOT5.js.map} +1 -1
- package/dist/run-D_o_8Fkv.js +128 -0
- package/dist/run-D_o_8Fkv.js.map +1 -0
- package/dist/{client-kUwtq-vt.js → runtime-DsRjnydE.js} +525 -105
- package/dist/runtime-DsRjnydE.js.map +1 -0
- package/dist/sandbox/boat.d.ts +1 -1
- package/dist/sandbox/boat.js +2 -2
- package/dist/sandbox/daytona.d.ts +1 -1
- package/dist/sandbox/daytona.js +1 -1
- package/dist/{sandbox-BffNervX.js → sandbox-B8gDRs5E.js} +3 -3
- package/dist/{sandbox-BffNervX.js.map → sandbox-B8gDRs5E.js.map} +1 -1
- package/dist/sandbox.d.ts +1 -1
- package/dist/sandbox.js +1 -1
- package/dist/{secrets-file-Dtd3h3kY.js → secrets-file-B8rUJV2L.js} +4 -4
- package/dist/{secrets-file-Dtd3h3kY.js.map → secrets-file-B8rUJV2L.js.map} +1 -1
- package/dist/server-eUWbjZoi.js +1 -0
- package/dist/server-mJzPXBMM.js +204 -0
- package/dist/server-mJzPXBMM.js.map +1 -0
- package/dist/{services-BG8xuU82.js → services-CHh83UDC.js} +4 -2
- package/dist/services-CHh83UDC.js.map +1 -0
- package/dist/{shared-DtZwIAfy.js → shared-bXaqVxk-.js} +5 -34
- package/dist/shared-bXaqVxk-.js.map +1 -0
- package/dist/skill-dirs-B7o83G5I.js +63 -0
- package/dist/skill-dirs-B7o83G5I.js.map +1 -0
- package/dist/source-C6JgdJdJ.js +1 -0
- package/dist/{source-zoRWRMql.js → source-DxgCge_u.js} +33 -18
- package/dist/source-DxgCge_u.js.map +1 -0
- package/dist/spans-B4MwgEyy.js +1 -0
- package/dist/spans-Dq3fo6HM.js +6 -0
- package/dist/spans-Dq3fo6HM.js.map +1 -0
- package/dist/spans-tf3biLpT.js +72 -0
- package/dist/spans-tf3biLpT.js.map +1 -0
- package/dist/src-B2psni1B.js +1 -0
- package/dist/{src-DiS13D_q.js → src-BI35cTig.js} +2 -2
- package/dist/src-BLePHsjw.js +2 -0
- package/dist/{src-Bj3WJs3t.js → src-CftydE9Q.js} +2 -2
- package/dist/{src-CDoAEO4u.js → src-ClMhIgi3.js} +2 -2
- package/dist/{src-CDoAEO4u.js.map → src-ClMhIgi3.js.map} +1 -1
- package/dist/{src-CUrcaZ91.js → src-CnOj4_n4.js} +1 -1
- package/dist/src-Cs3nmbrr.js +2 -0
- package/dist/{src-TMKittwH.js → src-D0GezGkJ.js} +2 -2
- package/dist/{src-OC89dAjO.js → src-D1Q6ElaF.js} +182 -36
- package/dist/src-D1Q6ElaF.js.map +1 -0
- package/dist/{src-CFBg2ecq.js → src-D_9qqp-Y.js} +2 -2
- package/dist/{src-DwcTn4JY.js → src-DhZuOcgq.js} +5 -5
- package/dist/{src-DwcTn4JY.js.map → src-DhZuOcgq.js.map} +1 -1
- package/dist/{src-CGBwMZgM.js → src-Dm2YIeXn.js} +8 -8
- package/dist/{src-CGBwMZgM.js.map → src-Dm2YIeXn.js.map} +1 -1
- package/dist/{src-CcbV6VpV.js → src-Dpzfe-vl.js} +3 -3
- package/dist/{src-c3ZQu7Uu.js → src-NYxoDS3b.js} +5 -5
- package/dist/{src-c3ZQu7Uu.js.map → src-NYxoDS3b.js.map} +1 -1
- package/dist/{src-C3OhA5pw.js → src-Y4AiZxLt.js} +5 -5
- package/dist/{src-C3OhA5pw.js.map → src-Y4AiZxLt.js.map} +1 -1
- package/dist/{src-BQWAxhKD.js → src-YpmRtJmP.js} +3 -3
- package/dist/{src-BQWAxhKD.js.map → src-YpmRtJmP.js.map} +1 -1
- package/dist/{src-Bb3k9Kn_.js → src-nIPDQ297.js} +66 -11
- package/dist/{src-Bb3k9Kn_.js.map → src-nIPDQ297.js.map} +1 -1
- package/dist/ssh-pool-B9bnSQIj.js +1 -0
- package/dist/{ssh-pool-DwboLN9O.js → ssh-pool-Gv8gAsgZ.js} +19 -16
- package/dist/ssh-pool-Gv8gAsgZ.js.map +1 -0
- package/dist/{start-BwMyDneA.js → start-YOYgbaNU.js} +45 -13
- package/dist/start-YOYgbaNU.js.map +1 -0
- package/dist/state-Bvsi2WgZ.js +1 -0
- package/dist/{state-CXTaT0t8.js → state-CJlYQtdl.js} +21 -38
- package/dist/state-CJlYQtdl.js.map +1 -0
- package/dist/store/local.d.ts +1 -1
- package/dist/store/s3.d.ts +1 -1
- package/dist/studio-share-4T6GYO7l.js +209 -0
- package/dist/studio-share-4T6GYO7l.js.map +1 -0
- package/dist/suite-fO-u8jlS.js +2 -0
- package/dist/{suite-C4XSg6Ls.js → suite-oH7uiCRq.js} +107 -106
- package/dist/suite-oH7uiCRq.js.map +1 -0
- package/dist/summary-CTMWfnOF.js +75 -0
- package/dist/summary-CTMWfnOF.js.map +1 -0
- package/dist/{sync-bnI6WWaL.js → sync-BNduS38K.js} +6 -6
- package/dist/{sync-bnI6WWaL.js.map → sync-BNduS38K.js.map} +1 -1
- package/dist/{tart-CSP5Q0qV.js → tart-B6Uz4S3I.js} +43 -13
- package/dist/tart-B6Uz4S3I.js.map +1 -0
- package/dist/{tart-DmVuVsmX.js → tart-DNrumWZu.js} +1 -1
- package/dist/{tart-CzViW3WZ.js → tart-Duqp33Zh.js} +2 -2
- package/dist/{tart-CzViW3WZ.js.map → tart-Duqp33Zh.js.map} +1 -1
- package/dist/{tart-bake-d9UvIfe3.js → tart-bake-B4QyNb7f.js} +1 -1
- package/dist/{tart-bake-BCKRfyKm.js → tart-bake-s99wBzxO.js} +9 -9
- package/dist/{tart-bake-BCKRfyKm.js.map → tart-bake-s99wBzxO.js.map} +1 -1
- package/dist/{tart-cli-CqSpUYGV.js → tart-cli-B0xVYBti.js} +6 -4
- package/dist/tart-cli-B0xVYBti.js.map +1 -0
- package/dist/{tart-cli-C4d5FXG1.js → tart-cli-DfteJCN9.js} +1 -1
- package/dist/{tart-hosts-Du7SZM4w.js → tart-hosts-B3Ze8aMp.js} +1 -1
- package/dist/{tart-hosts-G0EUDt07.js → tart-hosts-DfVUcZqA.js} +6 -6
- package/dist/{tart-hosts-G0EUDt07.js.map → tart-hosts-DfVUcZqA.js.map} +1 -1
- package/dist/{tart-images-De0-ib7R.js → tart-images-yzIyb0bQ.js} +8 -3
- package/dist/tart-images-yzIyb0bQ.js.map +1 -0
- package/dist/telemetry-bBhK3DSs.js +399 -0
- package/dist/telemetry-bBhK3DSs.js.map +1 -0
- package/dist/testing.d.ts +11 -2
- package/dist/testing.js +4 -4
- package/dist/{tool-class-B3ZFTSOw.js → tool-class-CB-m4PiF.js} +2 -2
- package/dist/{tool-class-B3ZFTSOw.js.map → tool-class-CB-m4PiF.js.map} +1 -1
- package/dist/{trace-CfppUzD9.js → trace-CJQLlAbB.js} +2 -2
- package/dist/{trace-CfppUzD9.js.map → trace-CJQLlAbB.js.map} +1 -1
- package/dist/{traits-Bj1PM5F7.js → traits-DPIffsN8.js} +2 -2
- package/dist/{traits-Bj1PM5F7.js.map → traits-DPIffsN8.js.map} +1 -1
- package/dist/{transcript-CW02A4s9.js → transcript-TWiaAuoL.js} +2 -2
- package/dist/{transcript-CW02A4s9.js.map → transcript-TWiaAuoL.js.map} +1 -1
- package/dist/{resources-DqdwihhT.js → turn-error-Dmv_Muj7.js} +15 -2
- package/dist/turn-error-Dmv_Muj7.js.map +1 -0
- package/dist/{types-D4WEnzhY.d.ts → types-BZaItiui.d.ts} +159 -13
- package/dist/types-Buut5yGe.js +29 -0
- package/dist/{types-CbcnJxCy.js.map → types-Buut5yGe.js.map} +1 -1
- package/dist/types-C48zuZbT.d.ts +156 -0
- package/dist/types-CYz4dqAd.d.ts +1366 -0
- package/dist/{ui-DfvPNmPP.js → ui-BIYUGm8D.js} +21 -17
- package/dist/ui-BIYUGm8D.js.map +1 -0
- package/dist/{vertex-BLxYasfw.js → vertex-DQQGhUn7.js} +2 -2
- package/dist/{vertex-BLxYasfw.js.map → vertex-DQQGhUn7.js.map} +1 -1
- package/dist/vertex-DtWe0Xf6.js +1 -0
- package/dist/view/index.d.ts +142 -809
- package/dist/view/index.js +17 -12
- package/dist/view/report/index.d.ts +217 -0
- package/dist/view/report/index.js +4 -0
- package/dist/views-DOYgIWRs.js +2 -0
- package/dist/{views-ChoSQxfF.js → views-DPsEJBBP.js} +6 -6
- package/dist/{views-ChoSQxfF.js.map → views-DPsEJBBP.js.map} +1 -1
- package/dist/{vm-container-DOtIi_rd.js → vm-container-rHUmgBRf.js} +13 -11
- package/dist/vm-container-rHUmgBRf.js.map +1 -0
- package/dist/{vm-images-CHutQVml.js → vm-images-BC2ZjZl5.js} +19 -21
- package/dist/vm-images-BC2ZjZl5.js.map +1 -0
- package/dist/wait-CixM6W0G.js +65 -0
- package/dist/wait-CixM6W0G.js.map +1 -0
- package/dist/{worker-entry-CKBfEt0h.js → worker-entry-CN1eVLzz.js} +7 -7
- package/dist/{worker-entry-CKBfEt0h.js.map → worker-entry-CN1eVLzz.js.map} +1 -1
- package/dist/{workspace-Cip2dVwU.js → workspace-BS-FUp5I.js} +9 -9
- package/dist/{workspace-Cip2dVwU.js.map → workspace-BS-FUp5I.js.map} +1 -1
- package/dist/workspace-D8HqjfsQ.js +1 -0
- package/package.json +38 -1
- package/skills/reeval/references/cli.md +1 -1
- package/skills/reeval/references/config.md +1 -1
- package/skills/reeval/references/environments.md +1 -1
- package/dist/agents-CEapsHV-.js.map +0 -1
- package/dist/analysis-BnG_1x_O.js.map +0 -1
- package/dist/app-files-Dsr3U1Q7.js +0 -10
- package/dist/app-files-Dsr3U1Q7.js.map +0 -1
- package/dist/assemble-DUtbByvj.js +0 -1
- package/dist/assemble-Dw1bF13I.js.map +0 -1
- package/dist/attach-DvYiMu6w.js.map +0 -1
- package/dist/attempt-host-DgeJFSZw.js.map +0 -1
- package/dist/boat-BBPOc_bs.js +0 -1
- package/dist/boat-CUNgSc75.js.map +0 -1
- package/dist/boat-images-BuFigiEb.js.map +0 -1
- package/dist/bundle-yEgI3RsI.js.map +0 -1
- package/dist/capture-DxxB3d7p.js +0 -1
- package/dist/cases-B7QkvMGE.js.map +0 -1
- package/dist/cases-CA7gxxdr.js +0 -1
- package/dist/cli-Z7aw8k25.js.map +0 -1
- package/dist/cli-spec-3zvLC9YW.js.map +0 -1
- package/dist/client-kUwtq-vt.js.map +0 -1
- package/dist/cloud-DuHcNQVV.js.map +0 -1
- package/dist/cloud-run-C08P_Uap.js +0 -1
- package/dist/cloud-run-DqMkSGYB.js.map +0 -1
- package/dist/cloud-secrets-Bak83tik.js.map +0 -1
- package/dist/command-Bs6Knfm4.js +0 -298
- package/dist/command-Bs6Knfm4.js.map +0 -1
- package/dist/command-CeygdoVe.js.map +0 -1
- package/dist/command-CoHN1ibe.js.map +0 -1
- package/dist/command-CtmSJzPC.js.map +0 -1
- package/dist/command-efTGfUYb.js.map +0 -1
- package/dist/commands-B_cAs8nG.js +0 -1
- package/dist/commands-DR-NolV2.js.map +0 -1
- package/dist/config-Bn2OhCN_.js.map +0 -1
- package/dist/context-Ba7PNMMe.js +0 -120
- package/dist/context-Ba7PNMMe.js.map +0 -1
- package/dist/daytona-CWs9j9mt.js.map +0 -1
- package/dist/daytona-image-BjVpi3KS.js +0 -1
- package/dist/db-Bjq6qr6c.js +0 -2
- package/dist/db-D6yQib7M.js.map +0 -1
- package/dist/debug-CF4p4Lp_.js +0 -1
- package/dist/debug-CIXzB4wK.js.map +0 -1
- package/dist/environment-BY8lVFFK.js.map +0 -1
- package/dist/evaluate-B8I9AKgw.js.map +0 -1
- package/dist/events-D97ZzAeq.js.map +0 -1
- package/dist/files-5HsFIpxw.js +0 -1
- package/dist/files-BNg3wgw_.js +0 -1
- package/dist/files-BesexM88.js.map +0 -1
- package/dist/files-DNgQwgA0.js +0 -1
- package/dist/files-DvDUSrWL.js +0 -1
- package/dist/files-TwSVeWwM.js.map +0 -1
- package/dist/gate-CgYdaprG.js +0 -49
- package/dist/gate-CgYdaprG.js.map +0 -1
- package/dist/harness-FcTyyPco.js.map +0 -1
- package/dist/ids-DqEvrBFZ.js.map +0 -1
- package/dist/init-CS5kEaVg.js +0 -1
- package/dist/ink-list-CLq6YVB8.js.map +0 -1
- package/dist/inputs-load-D4IsEjq3.js +0 -1
- package/dist/issue-DmSorsTF.js +0 -1
- package/dist/list-ClDb8qiX.js.map +0 -1
- package/dist/live-C7iGaDCA.js +0 -120
- package/dist/live-C7iGaDCA.js.map +0 -1
- package/dist/live-C7kN5v2P.js +0 -1
- package/dist/live-QFILMmql.js.map +0 -1
- package/dist/machine-service-xFhakTs5.js.map +0 -1
- package/dist/model-Colu5mEp.js +0 -1
- package/dist/model-mTaaEkeQ.js.map +0 -1
- package/dist/options-CmRy82gl.js +0 -1
- package/dist/pairs-BGb134Vu.js +0 -230
- package/dist/pairs-BGb134Vu.js.map +0 -1
- package/dist/patch-C7yBztZj.js.map +0 -1
- package/dist/paths-Dwmi7L4X.js +0 -75
- package/dist/paths-Dwmi7L4X.js.map +0 -1
- package/dist/preflight-xa8_eGOW.js +0 -1
- package/dist/prices-C_mbZa5a.js +0 -1
- package/dist/process-RPlEhpHz.js.map +0 -1
- package/dist/provider-DHT20Gl8.js +0 -1
- package/dist/query-BXV6pRyI.js +0 -1
- package/dist/questions-DnqkJga0.js.map +0 -1
- package/dist/record-2liAelrB.js.map +0 -1
- package/dist/redact-DMueYS-v.js.map +0 -1
- package/dist/remarks-D5qOZzcX.js.map +0 -1
- package/dist/resolve-B60w6DcB.js.map +0 -1
- package/dist/resolve-CCLiJX4i.js +0 -1
- package/dist/resolve-t9sOkGGS.js.map +0 -1
- package/dist/resources-DqdwihhT.js.map +0 -1
- package/dist/resume-4Q9q8AcE.js.map +0 -1
- package/dist/runtime-CIsljVBy.js +0 -457
- package/dist/runtime-CIsljVBy.js.map +0 -1
- package/dist/server-CeYUmuuu.js +0 -1
- package/dist/server-fSNuT3Z4.js +0 -284
- package/dist/server-fSNuT3Z4.js.map +0 -1
- package/dist/services-BG8xuU82.js.map +0 -1
- package/dist/shared-DtZwIAfy.js.map +0 -1
- package/dist/slug-IHh3f770.js.map +0 -1
- package/dist/source-n7nUVm9p.js +0 -1
- package/dist/source-zoRWRMql.js.map +0 -1
- package/dist/src-9V3C6A7C.js +0 -2
- package/dist/src-CB5cZhaN.js +0 -2
- package/dist/src-DB0vml0O.js +0 -1
- package/dist/src-OC89dAjO.js.map +0 -1
- package/dist/ssh-pool-ChpT-fDU.js +0 -1
- package/dist/ssh-pool-DwboLN9O.js.map +0 -1
- package/dist/start-BwMyDneA.js.map +0 -1
- package/dist/state-CXTaT0t8.js.map +0 -1
- package/dist/state-CltRWlCu.js +0 -1
- package/dist/suite-C4XSg6Ls.js.map +0 -1
- package/dist/suite-CIsyPqPA.js +0 -2
- package/dist/summary-DeeQJAR5.js +0 -169
- package/dist/summary-DeeQJAR5.js.map +0 -1
- package/dist/tart-CSP5Q0qV.js.map +0 -1
- package/dist/tart-cli-CqSpUYGV.js.map +0 -1
- package/dist/tart-images-De0-ib7R.js.map +0 -1
- package/dist/types-CbcnJxCy.js +0 -15
- package/dist/ui-DfvPNmPP.js.map +0 -1
- package/dist/vertex-DZDUpp0W.js +0 -1
- package/dist/views-DU0PM0UW.js +0 -2
- package/dist/vm-container-DOtIi_rd.js.map +0 -1
- package/dist/vm-images-CHutQVml.js.map +0 -1
- package/dist/workspace-BKcNJAPb.js +0 -1
package/CHANGELOG.md
CHANGED
|
@@ -1,5 +1,69 @@
|
|
|
1
1
|
# Changelog
|
|
2
2
|
|
|
3
|
+
## [0.26.0](https://github.com/reeval-ai/reeval/compare/v0.25.0...v0.26.0) (2026-11-13)
|
|
4
|
+
|
|
5
|
+
|
|
6
|
+
### ⚠ BREAKING CHANGES
|
|
7
|
+
|
|
8
|
+
* **cli:** require a linked project for a cloud run and check its secrets first ([#972](https://github.com/reeval-ai/reeval/issues/972))
|
|
9
|
+
|
|
10
|
+
### Features
|
|
11
|
+
|
|
12
|
+
* **api:** add a typed client for the cloud platform's API ([#975](https://github.com/reeval-ai/reeval/issues/975)) ([eb91fce](https://github.com/reeval-ai/reeval/commit/eb91fce1ed7d8532cfdfe54a040ae9465433cf4c))
|
|
13
|
+
* **cli:** require a linked project for a cloud run and check its secrets first ([#972](https://github.com/reeval-ai/reeval/issues/972)) ([b238ebb](https://github.com/reeval-ai/reeval/commit/b238ebbb427cb94ea1f70361a75dc850a068f3b6))
|
|
14
|
+
* **cloud:** cancel a cloud run with reeval cloud run cancel, and exit 4 when the platform stopped it ([#933](https://github.com/reeval-ai/reeval/issues/933)) ([747055a](https://github.com/reeval-ai/reeval/commit/747055ad9d1c927d60ae53c6afe6c046f046772d))
|
|
15
|
+
* **run:** resume a bundle's run with --bundle and --resume ([#932](https://github.com/reeval-ai/reeval/issues/932)) ([a6f44f2](https://github.com/reeval-ai/reeval/commit/a6f44f217155cdb6cfaaceda81901caa5592401a))
|
|
16
|
+
* **trace:** export spans, logs and host metrics over OTLP during the run ([#974](https://github.com/reeval-ai/reeval/issues/974)) ([c95599a](https://github.com/reeval-ai/reeval/commit/c95599a148bcc09a62d0a8b87b16f8c800b424de))
|
|
17
|
+
|
|
18
|
+
|
|
19
|
+
### Bug Fixes
|
|
20
|
+
|
|
21
|
+
* **fx:** move the relay port below the linux ephemeral range ([#969](https://github.com/reeval-ai/reeval/issues/969)) ([1f7ae3b](https://github.com/reeval-ai/reeval/commit/1f7ae3b2a0b6aa4519b7e42f31539a6275870710))
|
|
22
|
+
* **login:** print the cloud URL without a trailing slash and read sign-ins stored under it ([#971](https://github.com/reeval-ai/reeval/issues/971)) ([acfb468](https://github.com/reeval-ai/reeval/commit/acfb468b6411843f94488d969d5b14c22ebb35c3))
|
|
23
|
+
* **login:** warn about each sign-in login and logout couldn't revoke ([#973](https://github.com/reeval-ai/reeval/issues/973)) ([8515eee](https://github.com/reeval-ai/reeval/commit/8515eeeae4e71d3024a98c666cc3191d3fb369f6))
|
|
24
|
+
* **resume:** write retries and resume stubs atomically, and ignore this process's own pid ([#931](https://github.com/reeval-ai/reeval/issues/931)) ([5a1dfcf](https://github.com/reeval-ai/reeval/commit/5a1dfcf0b45bce772f28897e6f43de8bb8c3385a))
|
|
25
|
+
* **sandbox:** keep fixed loopback ports out of the ephemeral range ([#967](https://github.com/reeval-ai/reeval/issues/967)) ([0345795](https://github.com/reeval-ai/reeval/commit/0345795134e22f4177576afe9c1732b16e71ceed))
|
|
26
|
+
|
|
27
|
+
## [0.25.0](https://github.com/reeval-ai/reeval/compare/v0.24.0...v0.25.0) (2026-11-13)
|
|
28
|
+
|
|
29
|
+
|
|
30
|
+
### ⚠ BREAKING CHANGES
|
|
31
|
+
|
|
32
|
+
* **studio:** serve the run report in place of the run and attempt views ([#942](https://github.com/reeval-ai/reeval/issues/942))
|
|
33
|
+
* **studio:** reeval run --artifacts is removed; set history.artifacts, or pass reeval record --artifacts or reeval cloud push --artifacts.
|
|
34
|
+
* **studio:** serve a typed studio API on loopback to a paired studio page ([#934](https://github.com/reeval-ai/reeval/issues/934))
|
|
35
|
+
* **history:** add composable RunReport summary.md ([#935](https://github.com/reeval-ai/reeval/issues/935))
|
|
36
|
+
|
|
37
|
+
### Features
|
|
38
|
+
|
|
39
|
+
* **bundle:** declare vm-layout in the bundle manifest ([#962](https://github.com/reeval-ai/reeval/issues/962)) ([cf784d8](https://github.com/reeval-ai/reeval/commit/cf784d8f9c9298e1f01a428f63edc37caeb83094))
|
|
40
|
+
* **cli:** add reeval link to link a project to a cloud project ([#926](https://github.com/reeval-ai/reeval/issues/926)) ([e526316](https://github.com/reeval-ai/reeval/commit/e526316781261d491f7a7dbb7ba4af4670257223))
|
|
41
|
+
* **cloud:** push a recorded run to reeval cloud's studio ([#936](https://github.com/reeval-ai/reeval/issues/936)) ([f5d8350](https://github.com/reeval-ai/reeval/commit/f5d835064519c653fb5c0799e9acf3d831a6cf91))
|
|
42
|
+
* **cloud:** push saved analyses with a run ([#959](https://github.com/reeval-ai/reeval/issues/959)) ([ddf0607](https://github.com/reeval-ai/reeval/commit/ddf0607d3dba2254709a5e8f6dc51b43e5d706a1))
|
|
43
|
+
* **events:** emit a heartbeat with the attempts in progress ([#963](https://github.com/reeval-ai/reeval/issues/963)) ([1fe9f69](https://github.com/reeval-ai/reeval/commit/1fe9f69d51ddb971251b6ea98d1573749951a5fd))
|
|
44
|
+
* **history:** add composable RunReport summary.md ([#935](https://github.com/reeval-ai/reeval/issues/935)) ([c58b3ef](https://github.com/reeval-ai/reeval/commit/c58b3ef5310998979589d0ecfd137e4ed4014bf5))
|
|
45
|
+
* **history:** record a trace of what ran where in spans.jsonl ([#966](https://github.com/reeval-ai/reeval/issues/966)) ([46feb4d](https://github.com/reeval-ai/reeval/commit/46feb4d006fa728249e5096853e89e597af15118))
|
|
46
|
+
* **report:** add each attempt's transcript facts to the run report ([#958](https://github.com/reeval-ai/reeval/issues/958)) ([2666d47](https://github.com/reeval-ai/reeval/commit/2666d47d6b5bda5bd67aa22565a2ac86265df4b5))
|
|
47
|
+
* **sandbox:** add reeval/internal/vm-api, adapters over the Boat and Daytona SDKs ([#943](https://github.com/reeval-ai/reeval/issues/943)) ([f26ada3](https://github.com/reeval-ai/reeval/commit/f26ada3db868ec7c03c52890a7b0c38640d11125))
|
|
48
|
+
* **sandbox:** stop a cloud run's starts when the service says the run can't go on ([#941](https://github.com/reeval-ai/reeval/issues/941)) ([fd66b4e](https://github.com/reeval-ai/reeval/commit/fd66b4e337072b3aaeba15cee62141271bd6ad4b))
|
|
49
|
+
* **sandbox:** take cloud()'s layout from the service and give back reclaimed machines ([#940](https://github.com/reeval-ai/reeval/issues/940)) ([07b7bcb](https://github.com/reeval-ai/reeval/commit/07b7bcbf8cdaa710de4f12be51d3006e50946482))
|
|
50
|
+
* **sandbox:** wait on cloud() starts until the service ends the run ([#939](https://github.com/reeval-ai/reeval/issues/939)) ([085c3df](https://github.com/reeval-ai/reeval/commit/085c3dfcf7ebeac1bcc711d8a3d5107eb6e4d6e2))
|
|
51
|
+
* **studio:** serve a typed studio API on loopback to a paired studio page ([#934](https://github.com/reeval-ai/reeval/issues/934)) ([cee5ae8](https://github.com/reeval-ai/reeval/commit/cee5ae8e0b64891bc3bfbb8f1bf9d0d8f0492a2a))
|
|
52
|
+
* **studio:** serve the run report in place of the run and attempt views ([#942](https://github.com/reeval-ai/reeval/issues/942)) ([d105ba7](https://github.com/reeval-ai/reeval/commit/d105ba70e46eaf90f8c0aa03e5f2e6adc6f22f0d))
|
|
53
|
+
* **studio:** share a recorded run from the cli and write a push archive to a file ([#937](https://github.com/reeval-ai/reeval/issues/937)) ([365874e](https://github.com/reeval-ai/reeval/commit/365874ef4ea95b36873630aff83a811be1f7c9b2))
|
|
54
|
+
* **ui:** report when an attempt's sandbox is up ([#938](https://github.com/reeval-ai/reeval/issues/938)) ([1b778a9](https://github.com/reeval-ai/reeval/commit/1b778a9c674f9869f4c761c1bc4a1362db3f3804))
|
|
55
|
+
* **view:** derive a run's scope for like-with-like history and trends ([#945](https://github.com/reeval-ai/reeval/issues/945)) ([eaba735](https://github.com/reeval-ai/reeval/commit/eaba73506f806aef7b0123545a66177d30b05f09))
|
|
56
|
+
|
|
57
|
+
|
|
58
|
+
### Bug Fixes
|
|
59
|
+
|
|
60
|
+
* **compare:** treat a crashed attempt the engine passed as infra_error in questions ([#952](https://github.com/reeval-ai/reeval/issues/952)) ([24cef15](https://github.com/reeval-ai/reeval/commit/24cef150fe97a46b89aed7d379a0057f3622e8ab))
|
|
61
|
+
* **fx:** bump fx to 0.0.16, refuse mcp.sse and pass the sandbox env to stdio MCP servers ([#948](https://github.com/reeval-ai/reeval/issues/948)) ([e07599e](https://github.com/reeval-ai/reeval/commit/e07599ec7ac269ba1f0d94954eb3bbc99d3dcf2c))
|
|
62
|
+
* **login:** key the platform sign-in by its bare origin ([#965](https://github.com/reeval-ai/reeval/issues/965)) ([a3a33f6](https://github.com/reeval-ai/reeval/commit/a3a33f6d341768d5f232fd0fd16e8882cd9ce3e5))
|
|
63
|
+
* **sandbox:** fold a reading too close to the last into its sample, so avgCores never tops peakCores ([#957](https://github.com/reeval-ai/reeval/issues/957)) ([ed30676](https://github.com/reeval-ai/reeval/commit/ed30676aea426e49d684b04a6f4fcfd32d125205))
|
|
64
|
+
* **sandbox:** record no status for a brokered request the sandbox canceled ([#955](https://github.com/reeval-ai/reeval/issues/955)) ([d0fd4f7](https://github.com/reeval-ai/reeval/commit/d0fd4f7311fa6aed6d3e97df596315f9f20dd7c0))
|
|
65
|
+
* **sandbox:** remove the containers a killed reeval left running ([#964](https://github.com/reeval-ai/reeval/issues/964)) ([f2cb1e9](https://github.com/reeval-ai/reeval/commit/f2cb1e97118c4286a563beadbcc4ee95f350b58d))
|
|
66
|
+
|
|
3
67
|
## [0.24.0](https://github.com/reeval-ai/reeval/compare/v0.23.0...v0.24.0) (2026-11-10)
|
|
4
68
|
|
|
5
69
|
|
package/README.md
CHANGED
|
@@ -27,11 +27,11 @@ Evals are TypeScript files in `evals/`, next to the tool they test. Each run wri
|
|
|
27
27
|
|
|
28
28
|
Cursor ⋅ Claude Code ⋅ Codex ⋅ Antigravity ⋅ OpenCode ⋅ Goose ⋅ pi ⋅ Grok Build
|
|
29
29
|
|
|
30
|
-
- **Real agents**: each harness runs the agent itself, with its own tools, skills, and rules, as it works on a developer's machine ([Choose an agent](https://github.com/reeval-ai/reeval/blob/v0.
|
|
31
|
-
- **Keys stay on the host**: each attempt starts in a fresh sandbox that holds only a placeholder key. reeval's egress gateway swaps in the real key on requests to that provider and nowhere else ([Pass secrets](https://github.com/reeval-ai/reeval/blob/v0.
|
|
32
|
-
- **Compare a change**: one eval runs a baseline and its variants with the same prompt and checks, then prints whether each variant helped, made it worse, or did the same ([Measure lift against a baseline](https://github.com/reeval-ai/reeval/blob/v0.
|
|
33
|
-
- **Pinned environments**: an environment starts from a workspace, such as a git repository at a fixed ref, then adds files, setup steps, rules, skills, and MCP servers, so every attempt starts from the same state ([Define an environment](https://github.com/reeval-ai/reeval/blob/v0.
|
|
34
|
-
- **History in Git**: recorded runs sit beside the code. `reeval query` reads them with SQL, and `reeval studio` shows each attempt's transcript, diff, and checks ([Record runs in Git](https://github.com/reeval-ai/reeval/blob/v0.
|
|
30
|
+
- **Real agents**: each harness runs the agent itself, with its own tools, skills, and rules, as it works on a developer's machine ([Choose an agent](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/configuration/agents/index.mdx)).
|
|
31
|
+
- **Keys stay on the host**: each attempt starts in a fresh sandbox that holds only a placeholder key. reeval's egress gateway swaps in the real key on requests to that provider and nowhere else ([Pass secrets](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/configuration/environments/secrets.mdx)).
|
|
32
|
+
- **Compare a change**: one eval runs a baseline and its variants with the same prompt and checks, then prints whether each variant helped, made it worse, or did the same ([Measure lift against a baseline](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/results/compare/lift.mdx)).
|
|
33
|
+
- **Pinned environments**: an environment starts from a workspace, such as a git repository at a fixed ref, then adds files, setup steps, rules, skills, and MCP servers, so every attempt starts from the same state ([Define an environment](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/configuration/environments/index.mdx)).
|
|
34
|
+
- **History in Git**: recorded runs sit beside the code. `reeval query` reads them with SQL, and `reeval studio` shows each attempt's transcript, diff, and checks ([Record runs in Git](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/runs/recording.mdx)).
|
|
35
35
|
|
|
36
36
|
## Install
|
|
37
37
|
|
|
@@ -130,7 +130,7 @@ Without the skill, no attempt used `Output.object`; with it, all four did. `help
|
|
|
130
130
|
| <code>reeval compare --fail-on-regression</code> | Diff a run against its nearest recorded ancestor, and exit 1 when an eval regressed. |
|
|
131
131
|
| <code>reeval show --md</code> | One run's results as Markdown, for a job summary or a PR comment. |
|
|
132
132
|
| <code>reeval query</code> | Read-only SQL over every run, or built-in views such as `lift`, `effort`, and `failing_attempts`. |
|
|
133
|
-
| <code>reeval studio</code> | Runs, transcripts, diffs, and checks in the browser
|
|
133
|
+
| <code>reeval studio</code> | Runs, transcripts, diffs, and checks in the browser. |
|
|
134
134
|
|
|
135
135
|
Environments load extensions from where teams already keep them:
|
|
136
136
|
|
|
@@ -140,23 +140,23 @@ Environments load extensions from where teams already keep them:
|
|
|
140
140
|
|
|
141
141
|
## Examples
|
|
142
142
|
|
|
143
|
-
The recipes in [`docs/evaluations/recipes`](https://github.com/reeval-ai/reeval/blob/v0.
|
|
143
|
+
The recipes in [`docs/evaluations/recipes`](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes) are complete evals for common jobs:
|
|
144
144
|
|
|
145
|
-
- [Measure a skill](https://github.com/reeval-ai/reeval/blob/v0.
|
|
146
|
-
- [Compare harnesses](https://github.com/reeval-ai/reeval/blob/v0.
|
|
147
|
-
- [Measure MCP servers](https://github.com/reeval-ai/reeval/blob/v0.
|
|
148
|
-
- [Check a recommendation](https://github.com/reeval-ai/reeval/blob/v0.
|
|
149
|
-
- [Fail a pull request](https://github.com/reeval-ai/reeval/blob/v0.
|
|
145
|
+
- [Measure a skill](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes/measure-a-skill.mdx): with and without a skill, gated on a minimum lift.
|
|
146
|
+
- [Compare harnesses](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes/compare-harnesses.mdx): one suite on several agents at once, with pass rate and effort per agent.
|
|
147
|
+
- [Measure MCP servers](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes/measure-mcp-servers.mdx): check the agent calls the server's tools, and whether answers improve.
|
|
148
|
+
- [Check a recommendation](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes/test-recommendations.mdx): ask which library to use, and let a judge decide whether the agent picks the right one.
|
|
149
|
+
- [Fail a pull request](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/evaluations/recipes/gate-pull-requests.mdx): run on every pull request and fail the check on a regression.
|
|
150
150
|
|
|
151
|
-
The [`examples/`](https://github.com/reeval-ai/reeval/blob/v0.
|
|
151
|
+
The [`examples/`](https://github.com/reeval-ai/reeval/blob/v0.26.0/examples) directory has 80 runnable projects, one idea each, from [`with-checks`](https://github.com/reeval-ai/reeval/blob/v0.26.0/examples/with-checks) (deterministic checks) and [`with-skill-lift`](https://github.com/reeval-ai/reeval/blob/v0.26.0/examples/with-skill-lift) (does a skill help?) to sandboxes, egress, judges, captures and real-world tasks. Most run on a fake agent with no keys or Docker; [`examples/README.md`](https://github.com/reeval-ai/reeval/blob/v0.26.0/examples/README.md) lists them all.
|
|
152
152
|
|
|
153
153
|
## Documentation
|
|
154
154
|
|
|
155
|
-
The manual in [`docs/`](https://github.com/reeval-ai/reeval/blob/v0.
|
|
155
|
+
The manual in [`docs/`](https://github.com/reeval-ai/reeval/blob/v0.26.0/docs/overview.mdx) covers harnesses, sandboxes, environments, secrets and egress, checks and judges, profiles, history, and every CLI command and flag.
|
|
156
156
|
|
|
157
157
|
## For coding agents
|
|
158
158
|
|
|
159
|
-
To write or update evals, load [`skills/reeval/SKILL.md`](https://github.com/reeval-ai/reeval/blob/v0.
|
|
159
|
+
To write or update evals, load [`skills/reeval/SKILL.md`](https://github.com/reeval-ai/reeval/blob/v0.26.0/skills/reeval/SKILL.md). For every command, flag, and exit code, run `npx reeval --help`.
|
|
160
160
|
|
|
161
161
|
To preview a run without starting sandboxes or spending tokens, run `npx reeval run --dry-run --json`. It prints the planned evals, cells, and attempts as one JSON document and exits 0.
|
|
162
162
|
|
|
@@ -166,4 +166,4 @@ To read past runs without calling a model, run `npx reeval query failing_attempt
|
|
|
166
166
|
|
|
167
167
|
## License
|
|
168
168
|
|
|
169
|
-
[Apache-2.0](https://github.com/reeval-ai/reeval/blob/v0.
|
|
169
|
+
[Apache-2.0](https://github.com/reeval-ai/reeval/blob/v0.26.0/LICENSE). Copyright 2026 Invertase Limited. The npm package ships third-party licenses and attributions in `THIRD_PARTY_NOTICES.md`. Questions about licensing: [oss@invertase.io](mailto:oss@invertase.io).
|