@tangle-network/agent-eval 0.192.0 → 0.193.2

package/CHANGELOG.md

@@ -6,6 +6,49 @@ All notable changes to `@tangle-network/agent-eval` and its sibling `agent-eval-
 
 ## Unreleased
 
+## [0.193.2] — 2026-09-25
+
+### Fixed
+
+- 0.193.1's release commit bumped `package.json`, `pyproject.toml` and `__init__.py` but missed `clients/python/uv.lock`'s own `agent-eval-rpc` package entry, so `verifyVersionLock` failed the publish workflow (`uvRoot=0.193.0` against `npm=0.193.1`) before the npm publish step ran. 0.193.1 was never published to any registry — this release carries the same content, correctly locked.
+
+## [0.193.1] — 2026-09-25
+
+### Fixed
+
+- `CREDENTIAL_DETECTORS`' provider-branded prefixes (`sk-ant-`, `AIza`, `ghp_`, `xoxb-`, `AKIA`, `hubcap_`, `eyJ`…) required a leading `\b`, which does not fire between two word characters — a token glued to preceding text by an underscore or letter, in an attribute **key** as well as a value (`env.GITHUB_TOKEN_ghp_<token>`, `BACKUP_AKIA<key>`), passed both `redact()` and `assessShareSafety()` unflagged. Dropped the leading `\b` on the branded prefixes.
+- `walk()`/`scan()` classified an object key only for a CREDENTIAL shape, never `detectPersonalData(key)`, so a key like an email address (`{'alice@corp-example.com': 3}`) passed as SAFE under every profile. Also dropped the same leading-`\b` gap on `huggingface-token`, `npm-token`, `gitlab-token`, `groq-key`, `xai-key` and bare-`sk`-key.
+- `detectCredential` ran on the full string before the size cap applied, and `url-credentials`/`secret-assignment` had unbounded quantifiers, so adversarial text with no real credential could block the exporter/uploader's event loop for tens of seconds (measured ~59s on 256 KiB with no `://` at all). Bounded both regexes and what the value-shape detectors scan.
+- `containsKnownSecret` only matched a known secret's raw/base64/base64url/URL-encoded forms as a substring; `Authorization: Basic <base64(user:key)>` survived as SAFE even with the key passed as a `knownSecret`, because userinfo's 3-byte base64 group alignment means the secret's own base64 form is generally not a substring of the surrounding base64. It now also decodes an embedded base64 span and checks the secret against the decode.
+- `redact()`'s `data:` URI check matched by prefix instead of requiring the whole string to be the URI, so a `data:text/plain;base64,…`/`data:application/json;base64,…` value with a live credential in its decoded payload was always classified as opaque media. The check now requires the whole string to be the URI, and `text/*`/`application/json` payloads are decoded and scanned.
+- `summarizeExecutionMeasurements` counted only `LLM` spans as model calls, so an `EMBEDDING` or `RERANKER` span's own tokens dropped out of the run total whenever a chat call anywhere in the same run also reported tokens — a real undercount (5100 measured as 100 on a trace with one 100-token chat call and one 5000-token embeddings call), not the aggregate-token-loss bug 0.191.0 already fixed. Classify model calls with the contract's `isModelCallKind` (`@tangle-network/agent-trace-contract@^1.3.0`; `LLM`, `EMBEDDING`, `RERANKER`) instead of `kind === 'LLM'`.
+- `never`, `atMost`, `tokensAtMost` and `retrySafe` passed vacuously when a scoped trace had zero TOOL or LLM spans because the exporter never captured any, reading "never captured" as "none happened"; these rules now require capture evidence first and error via `CaptureIntegrityError` otherwise. A malformed `attr` matcher (an incomplete `SerializedRegex`, a bare `oneOf`) was accepted and then compared by reference, so it silently matched nothing; `assertPredicate` now validates every non-primitive `attr` value as a complete matcher shape.
+- `diagnoseSpans`' `NOT_BUILT` reasons for `loop-convergence` and `steering-chain` said only that this engine has no such analysis; they now also name where the capability is built (`@tangle-network/traces`' `loop-analysis.ts`), matching the pattern `tree-comparison`'s reason already used — traces' own conformance table marks all three built, so the two reports no longer read as contradicting each other.
+- `REDACTION_VERSION` → `2.4.0`.
+
+## [0.193.0] — 2026-09-25
+
+### Added
+
+- A search with a test split ends in its claim ([search ledger](./docs/search-ledger.md#the-claim)).
+  When expansion stops, `runSearch` fixes the claim's design before any test cell exists (`planSearchClaim`, stored as the `claim-plan` blob of the `claim` operation): at most 3 finalists that scored every selection unit and beat the root there, ranked by selection mean; the estimator; and a power check that simulates the claim's own `decidePairedPromotion` call at the claim's `minimumEffect` with the search's pooled selection variance (`pairedPromotionPower`).
+  The finalists are decided `finalist`, the root's and their test cells run together ahead of everything else, and `decideSearchClaim` tests each finalist against the root at Bonferroni confidence `1 - 0.05 / k`.
+  A test split that cannot resolve the minimum effect closes as `test-cannot-resolve` with no test spend.
+  In 200 simulated 50-node searches in which no node differs from the root (12 selection and 24 test units, minimum effect 0.1), the claim shipped 5 times: 2.5 %, Wilson 95 % interval [1.1 %, 5.7 %]; per finalist, 5 of 584 tests promoted. With one child planted 0.15 better, it shipped a truly better node in 200 of 200.
+- The divergence rule: a node whose train mean rose over its parent's while its selection interval against the parent lies wholly on the worse side is decided `invalid` with rule `divergence` (`searchDivergence`), and never becomes a parent or a finalist.
+- `searchClaimReserveUsd({ testTasks, reps, cellUsd })` sizes `budget.reservedClaimUsd`; `SearchRunResult.claim` returns the claim.
+- `renderSearchSummary(state, { split })` (`/campaign`) renders a search as compact text: the leading nodes against the root, recently discarded nodes with the measurement that discarded them, and recent proposals; `agent-eval search show <ledger>` verifies a ledger and prints it. `ProposeContext` gains `parents`, `train` (a `searchProposerView`, which reads only the train split) and `summary`, and `runOptimization`'s proposal step fills all three.
+- `scripts/search-sim.ts claims` runs many simulated searches on in-memory ledgers and tallies their claims; `--null`, `--plant-gain`, `--plant-divergence`, `--test` and `--min-effect` shape them.
+
+### Changed
+
+- **Breaking:** `runSearch` refuses to start a search with a test split that has no selection split, no claim `minimumEffect`, or an unpinned judge, and, under a cap, one whose `reservedClaimUsd` cannot hold the root and 3 finalists on every test task or whose cap cannot also cover the root and one screening round.
+- **Breaking:** the `search-closed` claim records its `rule`, family-wise `confidence` and `reason`; its power check records the target power, finalist count, pooled variance and estimator; each finalist records its deciding `test` (pairs, confidence, method, delta, interval).
+- **Breaking:** `SearchAllocator` declares `reps`, the repeats the claim's test cells run at.
+- The projector refuses a finalist that is the root, a fourth finalist, a finalist decided after a claim cell, any operation, node, edge or non-claim cell after the first finalist, an edge from a node decided `invalid`, a claim that omits a finalist or tests one at the wrong Bonferroni confidence, and a `ship` claim without a pinned judge or with a test unit the root or the shipped finalist did not score.
+- `operation-started` binds its artifacts, which `SearchOperation.artifacts` lists before the recorded ones.
+- Migration: add `reps` to a custom allocator; give a search with a test split a selection split, `objective.claim.minimumEffect`, a pinned `objective.judge` and, when capped, `budget.reservedClaimUsd` of at least `searchClaimReserveUsd(...)`.
+
 ## [0.192.0] — 2026-09-25
 
 ### Added
@@ -47,8 +90,8 @@ All notable changes to `@tangle-network/agent-eval` and its sibling `agent-eval-
 
 ### Changed
 
-- Span classification and the attribute key lists come from `@tangle-network/agent-trace-contract` (`resolveSpanKind`, `declaredSpanKind`, `SPAN_KINDS`); agent-eval's own copies are gone (#823).
-  The analyst shows the declared OpenInference kind, agent-eval's own spans export as `RETRIEVER` and `UNKNOWN` where they wrote `CHAIN` and `SPAN`, and a legacy `SPAN` kind is still accepted on read.
+- **Breaking:** span classification and the attribute key lists come from `@tangle-network/agent-trace-contract` (`resolveSpanKind`, `declaredSpanKind`, `SPAN_KINDS`); agent-eval's own copies are gone (#823).
+  The analyst shows the declared OpenInference kind, agent-eval's own spans export as `RETRIEVER` and `UNKNOWN` where they wrote `CHAIN` and `SPAN`, and a legacy `SPAN` kind is still accepted (and normalized to `UNKNOWN`) on read — but `TraceAnalystSpanKind` (now an alias of the contract's `SpanKind`) no longer has a `'SPAN'` member, so a consumer whose own code returns or type-checks the string `'SPAN'` against `TraceAnalystSpanKind` fails to compile on this version. `Intelligence`'s `pg-trace-analyst-store.ts` `inferKind` and `agent-builder`'s `d1-trace-analysis-store-adapter.ts` mapping both do this today; replace those with the contract's `declaredSpanKind`/`resolveSpanKind` before bumping past 0.190.1.
   Both OTLP intakes decide model calls and aggregates from one span kind, so an undeclared agent or workflow span no longer sums its children's tokens a second time.
 - **Breaking:** the hosted wire ships search ledgers, not eval-run snapshots ([hosted ingest spec](./docs/hosted-ingest-spec.md)).
   A producer uploads each blob an entry names (`PUT /v1/search-blobs/<sha256>`), reads the store's head (`GET /v1/ingest/search-ledger/<searchId>/head`), and posts canonical ledger lines from there (`POST /v1/ingest/search-ledger`, at most 1,000 lines or 1 MiB).

package/dist/adapters/http.d.ts

@@ -1,6 +1,6 @@
 import { m as CostReceipt } from "../cost-ledger-DbQdN3nO.js";
-import { R as Scenario, d as DispatchContext, f as DispatchFn } from "../types-C1CAD70_.js";
-import "../index-DNVzu9Vv.js";
+import { R as Scenario, d as DispatchContext, f as DispatchFn } from "../types-BWwRXofp.js";
+import "../index-DWQNDqPd.js";
 //#region src/adapters/http.d.ts
 interface HttpDispatchOptions<TScenario extends Scenario, _TArtifact> {
   /** Static endpoint URL. Mutually exclusive with `resolveUrl`. */

package/dist/analyst/index.d.ts

@@ -4,10 +4,10 @@ import { A as createChatClient, C as ChatResponse, D as MockTransportOpts, E as
 import { A as runAnalystBenchmark, C as AnalystEvidenceResolutionError, D as AnalystLatencyDistribution, E as AnalystIssueExpectation, M as scoreAnalystFindings, O as RunAnalystBenchmarkOptions, S as AnalystEvidenceResolution, T as AnalystFindingScore, V as ExternalOptimizerModelCall, W as ExternalOptimizerModelExecutionObservation, _ as AnalystBenchmarkProvenance, b as AnalystBenchmarkSummary, d as AnalystBenchmarkDatasetRef, f as AnalystBenchmarkDescriptor, g as AnalystBenchmarkOutput, h as AnalystBenchmarkObservation, j as traceStoreEvidenceResolver, k as registryBenchmarkRunner, m as AnalystBenchmarkLabelState, p as AnalystBenchmarkError, q as ExternalOptimizerRunnerCommand, t as AgentProfile, u as AnalystBenchmarkCase, v as AnalystBenchmarkResult, w as AnalystEvidenceResolver, x as AnalystEvidenceExpectation, y as AnalystBenchmarkRunner } from "../agent-profile-DDfIjdyS.js";
 import { a as ExactAnalystRunPolicySnapshot, c as ExactAnalystSnapshot, d as ExactExecutionComponentSnapshot, i as ExactAnalystRunEvent, l as ExactCapableAnalyst, n as ExactAnalystExecutionPlanSnapshot, o as ExactAnalystRunResult, r as ExactAnalystRunCompletion, s as ExactAnalystRunSummary, t as ExactAnalystBudgetSnapshot, u as ExactExecutionComponentIdentity } from "../exact-types-KGxBWH4b.js";
 import { a as ExactAnalystBudgetPolicy, c as RegistryRunOpts, i as BudgetPolicy, n as AnalystRegistry, o as ExactAnalystRunExecutionError, r as AnalystRegistryOptions, s as ExactRegistryRunOpts, t as AnalystHooks } from "../registry-Bu3lNole.js";
-import { a as createTraceAnalyst, c as BehavioralAnalystOptions, i as TraceAnalystDefinition, l as behavioralAnalyst, n as buildDefaultAnalystRegistry, o as renderPriorFindings, r as CreateTraceAnalystOptions, s as runTraceAnalyst, t as DefaultAnalystRegistryOptions, u as deriveEfficiencyFindings } from "../default-registry-DdqA_-_o.js";
-import { a as TraceAnalystLimits, c as RawAnalystEvidence, d as evidenceRefsFromRawFinding, f as parseRawFinding, i as TraceAnalysisEngineResult, l as RawAnalystFinding, n as TraceAnalysisEngine, o as resolveTraceAnalystLimits, r as TraceAnalysisEngineRequest, s as RAW_FINDING_SCHEMA_PROMPT, t as DEFAULT_TRACE_ANALYST_OUTPUT_TOKENS, u as RawAnalystFindingSchema } from "../engine-C1DIAEpn.js";
-import { n as buildTraceToolsForGroup, t as TraceToolGroupName } from "../tool-groups-DiBi16ns.js";
-import { A as SemanticConceptJudgeInput, C as DspyRlmTraceEngineOptions, E as createChatTraceEngine, S as renderFindingSubject, T as ChatTraceEngineOptions, _ as FindingSubject, a as FAILURE_MODE_KIND_SPEC, b as findingSubjectGrammarPromptFor, c as emitControlIntegrityFindings, d as FindingsStore, f as PersistedFinding, g as FINDING_SUBJECT_SYNTAX, h as FINDING_SUBJECT_KINDS, i as IMPROVEMENT_KIND_SPEC, j as SemanticConceptJudgeOptions, l as DiffPolicy, m as diffFindings, n as KNOWLEDGE_POISONING_KIND_SPEC, o as CONTROL_INTEGRITY_ANALYST, p as defaultIsMaterial, r as KNOWLEDGE_GAP_KIND_SPEC, s as ControlIntegrityAnalyst, t as DEFAULT_TRACE_ANALYST_KINDS, u as FindingsDiff, v as FindingSubjectKind, w as createDspyRlmTraceEngine, x as parseFindingSubject, y as KIND_EXPECTED_SUBJECTS } from "../index-DBoXFaz0.js";
+import { a as createTraceAnalyst, c as BehavioralAnalystOptions, i as TraceAnalystDefinition, l as behavioralAnalyst, n as buildDefaultAnalystRegistry, o as renderPriorFindings, r as CreateTraceAnalystOptions, s as runTraceAnalyst, t as DefaultAnalystRegistryOptions, u as deriveEfficiencyFindings } from "../default-registry-C3HTE08O.js";
+import { a as TraceAnalystLimits, c as RawAnalystEvidence, d as evidenceRefsFromRawFinding, f as parseRawFinding, i as TraceAnalysisEngineResult, l as RawAnalystFinding, n as TraceAnalysisEngine, o as resolveTraceAnalystLimits, r as TraceAnalysisEngineRequest, s as RAW_FINDING_SCHEMA_PROMPT, t as DEFAULT_TRACE_ANALYST_OUTPUT_TOKENS, u as RawAnalystFindingSchema } from "../engine-DjRV55F9.js";
+import { n as buildTraceToolsForGroup, t as TraceToolGroupName } from "../tool-groups-BC9O7Epn.js";
+import { A as SemanticConceptJudgeInput, C as DspyRlmTraceEngineOptions, E as createChatTraceEngine, S as renderFindingSubject, T as ChatTraceEngineOptions, _ as FindingSubject, a as FAILURE_MODE_KIND_SPEC, b as findingSubjectGrammarPromptFor, c as emitControlIntegrityFindings, d as FindingsStore, f as PersistedFinding, g as FINDING_SUBJECT_SYNTAX, h as FINDING_SUBJECT_KINDS, i as IMPROVEMENT_KIND_SPEC, j as SemanticConceptJudgeOptions, l as DiffPolicy, m as diffFindings, n as KNOWLEDGE_POISONING_KIND_SPEC, o as CONTROL_INTEGRITY_ANALYST, p as defaultIsMaterial, r as KNOWLEDGE_GAP_KIND_SPEC, s as ControlIntegrityAnalyst, t as DEFAULT_TRACE_ANALYST_KINDS, u as FindingsDiff, v as FindingSubjectKind, w as createDspyRlmTraceEngine, x as parseFindingSubject, y as KIND_EXPECTED_SUBJECTS } from "../index-0jEtpSM7.js";
 import { A as ReplyRowDecoded, C as primeProtocolSha256, D as DecodedReply, E as runPrimeExchange, M as decodeReplyRows, O as ReplyContract, S as normalizePrimeUsage, T as projectPrimeTrajectory, _ as buildPrimePrompt, a as PrimeProjectionOutcome, b as extractPrimeJsonObject, c as PrimeProtocolIdentity, d as PrimeRepairPromptSpec, f as PrimeRepairState, g as analystUsageReceiptFromPrimeUsage, h as PrimeTurnRecord, i as PrimeProjectionDelivery, j as ReplyRowRejection, k as ReplyEnvelope, l as PrimeRawUsage, m as PrimeRowDecoded, n as PrimeExchangeOutcome, o as PrimeProjectionSource, p as PrimeReplyContract, r as PrimeFailure, s as PrimePromptSpec, t as PrimeExchangeOptions, u as PrimeRejectedRow, v as buildPrimeRepairPrompt, w as primeReplyDefect, x as mergePrimeRawUsage, y as emptyPrimeRawUsage } from "../prime-protocol-T0i6xcAs.js";
 import { i as nodeHttpPrimeBridgeTransport, n as PrimeBridgeTransportRequest, r as PrimeBridgeTransportResult, t as PrimeBridgeTransport } from "../prime-bridge-transport-6feEglLf.js";
 import { z } from "zod";
@@ -1181,11 +1181,11 @@ declare function runAnalystBenchmarkCommand(argv: readonly string[], env?: NodeJ
 declare const ANALYST_BENCHMARK_IMPLEMENTATION_DIGEST_ALGORITHM = "sha256-canonical-source-manifest";
 declare const ANALYST_BENCHMARK_DEPENDENCY_LOCK_DIGEST_ALGORITHM = "sha256-canonical-file-manifest";
 declare const ANALYST_BENCHMARK_DEPENDENCY_LOCK_FILES: readonly string[];
-declare const ANALYST_BENCHMARK_DEPENDENCY_LOCK_SHA256 = "091c759150ea8d7d8cf77f207b6b33992d605743f1d64f42b8e8b63207dade89";
+declare const ANALYST_BENCHMARK_DEPENDENCY_LOCK_SHA256 = "e9b253dfc787e8182469d970803b94f88e20b4f8dff4b68707462b5749c4c216";
 declare const ANALYST_BENCHMARK_EVIDENCE_DEPENDENCY_LOCK_SHA256 = "1e03f2daed356d60316aabefb407ec1e437ac94d408d61eea4ae096e9c6fbb5b";
 declare const ANALYST_BENCHMARK_EVIDENCE_IMPLEMENTATION_SHA256 = "4dba263b6256a30d56c7fdb2d992d3a953c0035d731f359b704db806f68f75ac";
 declare const ANALYST_BENCHMARK_IMPLEMENTATION_FILES: readonly string[];
-declare const ANALYST_BENCHMARK_IMPLEMENTATION_SHA256 = "00002cbbc8a749281287418f0abc03e4fc6a78ef3c1b4f21e33f2452629283da";
+declare const ANALYST_BENCHMARK_IMPLEMENTATION_SHA256 = "8bb4bdae57e4c5596ffe77d80c7a16e67eef7b2fc5087c2af369a417ed423a26";
 declare function analystBenchmarkImplementationDigest(): string;
 declare function analystBenchmarkDependencyLockDigest(): string;
 //#endregion

package/dist/analyst/index.js

@@ -4,11 +4,11 @@ import { B as FINDING_SUBJECT_SYNTAX, F as parseRawFinding, G as DEFAULT_TRACE_A
 import { i as validateUsageSettlementTimeout, n as settleUsageReceiptFromCostLedger } from "../usage-receipt-Cx3xNeyB.js";
 import { a as KNOWLEDGE_POISONING_KIND_SPEC, c as FAILURE_MODE_KIND_SPEC, d as emitControlIntegrityFindings, f as behavioralAnalyst, i as DEFAULT_TRACE_ANALYST_KINDS, l as CONTROL_INTEGRITY_ANALYST, n as AnalystRegistry, o as KNOWLEDGE_GAP_KIND_SPEC, p as deriveEfficiencyFindings, r as ExactAnalystRunExecutionError, s as IMPROVEMENT_KIND_SPEC, t as buildDefaultAnalystRegistry, u as ControlIntegrityAnalyst } from "../default-registry-xMLX160E.js";
 import { i as makeProposalFinding, n as computeFindingId, r as makeFinding } from "../types-CW5b90JH.js";
-import { t as createDspyRlmTraceEngine } from "../dspy-rlm-engine-BX34vPVY.js";
-import { a as diffFindings, i as defaultIsMaterial, n as runSemanticConceptJudge, o as createChatTraceEngine, r as FindingsStore, t as SEMANTIC_CONCEPT_JUDGE_VERSION } from "../semantic-concept-judge-Bg-560H0.js";
-import { t as createChatClient } from "../chat-client-B_ItsSBw.js";
+import { t as createDspyRlmTraceEngine } from "../dspy-rlm-engine-k_QdEBZo.js";
+import { a as diffFindings, i as defaultIsMaterial, n as runSemanticConceptJudge, o as createChatTraceEngine, r as FindingsStore, t as SEMANTIC_CONCEPT_JUDGE_VERSION } from "../semantic-concept-judge-Bh5lvKGg.js";
+import { t as createChatClient } from "../chat-client-CJORSG_J.js";
 import { a as scoreAnalystFindings, i as summarizeAnalystBenchmarkRunner, n as runAnalystBenchmark, r as traceStoreEvidenceResolver, t as registryBenchmarkRunner } from "../benchmark-BeQJyrRC.js";
-import { $ as ANALYST_BENCHMARK_MANIFEST_FILE, A as readAnalystInstructionsOverride, B as parseVerificationOutcome, C as emptyPublicBenchmarkRunner, D as summarizeCodeTraceCalibration, E as renderCodeTraceCalibrationMarkdown, F as publicBenchmarkRlmInstructions, G as ANALYST_BENCHMARK_EVIDENCE_IMPLEMENTATION_SHA256, H as ANALYST_BENCHMARK_DEPENDENCY_LOCK_FILES, I as publicBenchmarkSystemPrompt, J as ANALYST_BENCHMARK_IMPLEMENTATION_SHA256, K as ANALYST_BENCHMARK_IMPLEMENTATION_DIGEST_ALGORITHM, L as DEFAULT_MAX_VERIFICATION_ARTIFACT_BYTES, M as MAX_INCORRECT_BLOCKS, N as MAX_INCORRECT_BLOCK_STEPS, O as analystInstructionsOverrideFromText, P as publicBenchmarkProtocolSha256, Q as ANALYST_BENCHMARK_LOCAL_RECEIPT_FILE, R as appendVerificationArtifactsToOtlp, S as adaptPublicBenchmarkFindings, T as readAnalystBenchmarkArtifact, U as ANALYST_BENCHMARK_DEPENDENCY_LOCK_SHA256, V as ANALYST_BENCHMARK_DEPENDENCY_LOCK_DIGEST_ALGORITHM, W as ANALYST_BENCHMARK_EVIDENCE_DEPENDENCY_LOCK_SHA256, X as analystBenchmarkImplementationDigest, Y as analystBenchmarkDependencyLockDigest, Z as ANALYST_BENCHMARK_COST_LEDGER_FILE, _ as publicDirectAnalystDefinition, a as primeCodeTraceAnalystDefinition, at as codeTraceBenchCase, b as analystDefinitionAsymmetries, c as preparePublicAnalystBenchmark, ct as agentRxPredictionsToFindings, d as selectPublicBenchmarkRows, dt as normalizeBenchmarkLabel, et as ANALYST_BENCHMARK_OBSERVATIONS_FILE, f as createPublicBenchmarkRlmRunner, g as createPublicBenchmarkDirectRunner, h as runReplVariableAnalystDefinition, i as primeAnalystProtocolSha256, it as summarizeAgentRxCalibration, j as CODE_TRACE_BENCH_ANALYST_PROMPT, k as effectiveAnalystProtocolSha256, l as publicBenchmarkDistributions, lt as normalizeAgentRxCategory, m as rlmEngineLimits, n as renderAnalystBenchmarkMarkdown, nt as AGENT_RX_UPSTREAM_REVISION, o as runInlineAnalystDefinition, ot as codeTracerPredictionsToFindings, p as publicRlmAnalystDefinition, q as ANALYST_BENCHMARK_IMPLEMENTATION_FILES, r as createPrimeBenchmarkRunner, rt as renderAgentRxCalibrationMarkdown, s as loadPublicBenchmarkRows, st as agentRxBenchmarkCase, t as runAnalystBenchmarkCommand, tt as compareAnalystRunners, u as publicBenchmarkSelectionReport, ut as roundAgentRxStep, v as runChunkedAnalystDefinition, w as expandCodeTraceFailureBlocks, x as analystDefinitionProtocolSha256, y as AnalystExpressivenessError, z as loadCodeTraceVerificationArtifacts } from "../benchmark-command-C458yEFK.js";
+import { $ as ANALYST_BENCHMARK_MANIFEST_FILE, A as readAnalystInstructionsOverride, B as parseVerificationOutcome, C as emptyPublicBenchmarkRunner, D as summarizeCodeTraceCalibration, E as renderCodeTraceCalibrationMarkdown, F as publicBenchmarkRlmInstructions, G as ANALYST_BENCHMARK_EVIDENCE_IMPLEMENTATION_SHA256, H as ANALYST_BENCHMARK_DEPENDENCY_LOCK_FILES, I as publicBenchmarkSystemPrompt, J as ANALYST_BENCHMARK_IMPLEMENTATION_SHA256, K as ANALYST_BENCHMARK_IMPLEMENTATION_DIGEST_ALGORITHM, L as DEFAULT_MAX_VERIFICATION_ARTIFACT_BYTES, M as MAX_INCORRECT_BLOCKS, N as MAX_INCORRECT_BLOCK_STEPS, O as analystInstructionsOverrideFromText, P as publicBenchmarkProtocolSha256, Q as ANALYST_BENCHMARK_LOCAL_RECEIPT_FILE, R as appendVerificationArtifactsToOtlp, S as adaptPublicBenchmarkFindings, T as readAnalystBenchmarkArtifact, U as ANALYST_BENCHMARK_DEPENDENCY_LOCK_SHA256, V as ANALYST_BENCHMARK_DEPENDENCY_LOCK_DIGEST_ALGORITHM, W as ANALYST_BENCHMARK_EVIDENCE_DEPENDENCY_LOCK_SHA256, X as analystBenchmarkImplementationDigest, Y as analystBenchmarkDependencyLockDigest, Z as ANALYST_BENCHMARK_COST_LEDGER_FILE, _ as publicDirectAnalystDefinition, a as primeCodeTraceAnalystDefinition, at as codeTraceBenchCase, b as analystDefinitionAsymmetries, c as preparePublicAnalystBenchmark, ct as agentRxPredictionsToFindings, d as selectPublicBenchmarkRows, dt as normalizeBenchmarkLabel, et as ANALYST_BENCHMARK_OBSERVATIONS_FILE, f as createPublicBenchmarkRlmRunner, g as createPublicBenchmarkDirectRunner, h as runReplVariableAnalystDefinition, i as primeAnalystProtocolSha256, it as summarizeAgentRxCalibration, j as CODE_TRACE_BENCH_ANALYST_PROMPT, k as effectiveAnalystProtocolSha256, l as publicBenchmarkDistributions, lt as normalizeAgentRxCategory, m as rlmEngineLimits, n as renderAnalystBenchmarkMarkdown, nt as AGENT_RX_UPSTREAM_REVISION, o as runInlineAnalystDefinition, ot as codeTracerPredictionsToFindings, p as publicRlmAnalystDefinition, q as ANALYST_BENCHMARK_IMPLEMENTATION_FILES, r as createPrimeBenchmarkRunner, rt as renderAgentRxCalibrationMarkdown, s as loadPublicBenchmarkRows, st as agentRxBenchmarkCase, t as runAnalystBenchmarkCommand, tt as compareAnalystRunners, u as publicBenchmarkSelectionReport, ut as roundAgentRxStep, v as runChunkedAnalystDefinition, w as expandCodeTraceFailureBlocks, x as analystDefinitionProtocolSha256, y as AnalystExpressivenessError, z as loadCodeTraceVerificationArtifacts } from "../benchmark-command-N5r3GXMP.js";
 import { a as extractPrimeJsonObject, c as primeProtocolSha256, d as runPrimeExchange, f as decodeReplyRows, i as emptyPrimeRawUsage, l as primeReplyDefect, n as buildPrimePrompt, o as mergePrimeRawUsage, r as buildPrimeRepairPrompt, s as normalizePrimeUsage, t as analystUsageReceiptFromPrimeUsage, u as projectPrimeTrajectory } from "../prime-protocol-DcAK9pC8.js";
 import { t as nodeHttpPrimeBridgeTransport } from "../prime-bridge-transport-Z3cpKGoV.js";
 import { existsSync, readFileSync, readdirSync, statSync } from "node:fs";

package/dist/{analyze-runs-SCSWYpy0.js → analyze-runs-B6gv7vAT.js}

@@ -5,7 +5,7 @@ import { i as requiredPairedSampleSize, r as pairedMde } from "./power-and-mde-B
 import { r as pairRunRecords } from "./paired-arms-JSDcs2zx.js";
 import { o as pairedTTest, r as pairedBootstrap } from "./paired-tests-C8iCsioC.js";
 import { r as welchsTTest } from "./baseline-BC-eBZ7U.js";
-import { n as aggregatePairedHoldout } from "./statistical-heldout-GcLIPxk4.js";
+import { n as aggregatePairedHoldout } from "./statistical-heldout-DANVmyug.js";
 import "./query-DlV0pdx4.js";
 import { r as observedSplitScore } from "./reward-nw2xZGZG.js";
 import { u as validateRunRecord } from "./run-record-BRlM99rX.js";
@@ -982,4 +982,4 @@ function buildRecommendations(ctx) {
 //#endregion
 export { summarizeExecution as n, checkCanaries as r, analyzeRuns as t };
 
-//# sourceMappingURL=analyze-runs-SCSWYpy0.js.map
+//# sourceMappingURL=analyze-runs-B6gv7vAT.js.map