@tangle-network/agent-eval 0.150.2 → 0.161.0

package/docs/public-api.md

@@ -0,0 +1,1616 @@
+# Public API census
+
+Generated by `pnpm api:census` on demand — this is a dated reading, not a gate. Every named value export of every `package.json#exports` subpath, with the consumer that justifies publishing it. Regenerate it when the surface changes; do not edit it by hand.
+
+## Totals
+
+| measure | count |
+| --- | --- |
+| export subpaths | 27 |
+| published value exports (subpath x symbol) | 1352 |
+| distinct symbols | 1183 |
+| production | 903 |
+| planned | 211 |
+| none | 238 |
+
+Type-only exports are not listed: a type binds no runtime surface, and removing one cannot break a caller at run time.
+
+## Classification
+
+- **production** — a consumer repository imports it in production code, this package's own CLI or wire server imports it, a consumer binds it in a type position, or another production module of this package imports it.
+- **planned** — no production caller, but a consumer's tests, a runnable example, a Markdown front door, or a consumer repository that names the symbol where the import graph cannot see the bind.
+- **none** — no evidence in any channel above. This is the delete list.
+
+## Consumer sweep
+
+Swept 2026-08-21 across 31 repositories, each on its default branch:
+
+| repository | ref | commit |
+| --- | --- | --- |
+| agent-app | main | `da061b0` |
+| agent-builder | main | `8350c93` |
+| agent-dev-container | unknown | `unknown` |
+| agent-knowledge | HEAD | `02c9abe` |
+| agent-lab | unknown | `unknown` |
+| agent-runtime | HEAD | `6d11021e` |
+| agent-sdk | main | `5241bf6` |
+| ai-trading-blueprint | main | `c0070e8` |
+| blueprint-agent | develop | `38f6f93` |
+| braid | HEAD | `3d7b79f` |
+| browser-agent-driver | main | `7fa06d5` |
+| creative-agent | master | `895ff9c` |
+| discovery-lab | master | `d7b5703` |
+| gtm-agent | master | `ca1eb45` |
+| insurance-agent | main | `caf9d7f` |
+| legal-agent | main | `3962c63` |
+| loops | unknown | `unknown` |
+| phony | unknown | `unknown` |
+| physim | main | `826c877` |
+| playproof | unknown | `unknown` |
+| redteam | main | `5c0411c` |
+| relationships-agent | main | `3997f03` |
+| run-capsule | main | `5d756f8` |
+| skeletal-os | unknown | `unknown` |
+| starter-foundry | main | `94225e3` |
+| supervisor-lab | main | `c95d732` |
+| tangle-router | main | `2b770d4` |
+| tax-agent | main | `e65b319` |
+| traces | unknown | `unknown` |
+| tuner-agent | main | `090cdd1` |
+| workcomp-agent | master | `20a68e7` |
+
+## What this census cannot see
+
+Every gap below makes a `none` less certain, so each one is answered by keeping the symbol, never by deleting it.
+
+1. **Dynamic imports and namespace binds.** `const { x } = await import('@tangle-network/agent-eval')` and `import * as evaluation from ...` name no symbol the import graph can resolve. The sweep therefore also records every census name mentioned anywhere in a consumer repository; a symbol with only that evidence is `planned`, never `none`.
+2. **Repositories outside the sweep.** The list above is every repository in the `tangle-network` organisation whose `package.json` names this package, plus the local checkouts. A private fork, a consumer outside the organisation, or an npm consumer nobody told us about returns no hits and reads exactly like an unused symbol.
+3. **Pinned versions.** Each consumer is read at its default branch HEAD, which may resolve an older published version whose surface differs from this one.
+4. **The wire and RPC surfaces.** A JSON-RPC method name or an OpenAPI schema reached over the wire binds no TypeScript symbol. `docs/wire-protocol.md` and `clients/python/` own that contract.
+5. **String-keyed dispatch.** A symbol reached through a registry keyed by string is invisible to both channels.
+
+## Why a `none` can still be published
+
+A `none` row is a deletion candidate, not a deletion order. A symbol stays when removing it would lose something the census cannot weigh: a documented historical constant, a value another module of this package still needs, or a name whose only reference is a contract test over an on-disk artifact. Those are kept deliberately and stay listed here as `none`, so the next reader sees the same evidence and can decide again.
+
+## Exports
+
+### `.`
+
+318 value exports — 267 production, 32 planned, 19 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `acquisitionPlansForKnowledgeGaps` | production | agent-builder:src/lib/.server/eval/loops/data-acquisition-engine.ts |
+| `AGENT_PROFILE_KINDS` | production | blueprint-agent:scripts/experiments/lib/agent-profile-cell.ts |
+| `AgentEvalError` | production | agent-runtime:src/errors.ts |
+| `agentProfileCellHashMaterial` | planned | consumer tests: blueprint-agent:scripts/experiments/lib/__tests__/agent-profile-cell.test.ts |
+| `agentProfileCellKey` | planned | consumer tests: blueprint-agent:scripts/experiments/lib/__tests__/agent-profile-cell.test.ts |
+| `agentProfileHash` | production | ai-trading-blueprint:evals/src/trading/persona-agent-eval.ts |
+| `agentProfileId` | production | agent-dev-container:products/intelligence/api/src/lib/project-profile-change-preflight.ts |
+| `aggregateJudgeVerdicts` | production | agent-app:src/eval-campaign/index.ts |
+| `aggregateRunScore` | production | agent-dev-container:products/sandbox/evals/src/auto-optimization.ts |
+| `analystFindingDigest` | production | this package: src/feedback-trajectory.ts:4 |
+| `AnalystRegistry` | production | blueprint-agent:scripts/experiments/vb-multi-analyst.ts |
+| `analystRunDigest` | production | this package: src/feedback-trajectory.ts:4 |
+| `analystRunToFeedbackTrajectory` | planned | doc: docs/feedback-trajectories.md |
+| `analystRunToReviewRequests` | planned | doc: docs/feedback-trajectories.md |
+| `analyzeAntiSlop` | production | physim:apps/server/src/lib/eval.ts |
+| `analyzeRuns` | production | agent-builder:eval/scripts/insight-report.ts |
+| `analyzeSeries` | production | agent-dev-container:products/sandbox/evals/run.ts |
+| `analyzeTraces` | production | agent-builder:src/lib/.server/eval/analysts/canonical-trace-analyst.ts |
+| `argHash` | production | agent-runtime:src/runtime/supervise/detector-monitor.ts |
+| `assertCapabilityHeadroom` | production | blueprint-agent:scripts/experiments/lib/validity-gates.ts |
+| `assertCrossFamily` | production | agent-builder:frontier/judges/artifact-head-to-head.ts |
+| `assertCrossFamilyServed` | planned | doc: docs/building-doctrine.md |
+| `assertNoHiddenLeak` | planned | doc: docs/design/statistics-decisions.md |
+| `assertProductBenchmarkRun` | production | creative-agent:eval/research-package.ts |
+| `assertRealBackend` | production | blueprint-agent:scripts/experiments/lib/canonical/assert-real-backend.ts |
+| `assertRunCaptured` | production | creative-agent:eval/canonical-runner.ts |
+| `assertServedModel` | production | creative-agent:eval/lib/persona-driver.ts |
+| `assertServedModels` | planned | doc: docs/building-doctrine.md |
+| `assertSingleBackend` | planned | consumer tests: gtm-agent:tests/agent-eval.smoke.test.ts |
+| `assignFeedbackSplit` | production | agent-builder:src/lib/.server/eval/feedback/feedback-capture.ts |
+| `BackendIntegrityError` | production | creative-agent:eval/leaderboard.ts |
+| `benjaminiHochberg` | production | agent-runtime:bench/src/corpus-report.mts |
+| `blendHeldout` | production | blueprint-agent:scripts/experiments/lib/qa-grader.ts |
+| `blockingKnowledgeEval` | production | agent-dev-container:products/intelligence/api/src/routes/project-engines.ts |
+| `bonferroni` | planned | doc: docs/design/statistics-decisions.md |
+| `BOOTSTRAP_GATE_MIN_N` | production | discovery-lab:tools/confirmation-activation.mjs |
+| `bootstrapCi` | production | agent-dev-container:products/intelligence/api/src/lib/analysis-worker.ts |
+| `BudgetBreachError` | production | creative-agent:scripts/evals/run-driver-soak.ts |
+| `budgetBreachView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `BudgetGuard` | production | creative-agent:scripts/evals/run-driver-soak.ts |
+| `buildAgentProfileCell` | production | ai-trading-blueprint:evals/src/trading/agent-profile-cell.ts |
+| `buildDefaultAnalystRegistry` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `buildEquivalenceRecord` | none | only this package's tests: src/verification-strategy.test.ts:11 |
+| `buildReflectionPrompt` | production | blueprint-agent:scripts/experiments/lib/gepa-reflective-proposer.ts |
+| `buildTraceInsightContext` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html-sections.ts |
+| `buildTraceInsightPrompt` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/brief.ts |
+| `buildTrajectory` | production | agent-runtime:src/runtime/supervise/trajectory-recorder.ts |
+| `calibrateJudge` | production | creative-agent:eval/calibrate-judges.ts |
+| `calibrateJudgeContinuous` | planned | consumer tests: tax-agent:tests/eval/lib/judge-sentinel.ts |
+| `canonicalJson` | production | agent-knowledge:src/benchmarks/memory-recovery.ts |
+| `capabilityHeadroom` | production | blueprint-agent:scripts/experiments/lib/validity-gates.ts |
+| `captureFetchToRawSink` | production | creative-agent:eval/canonical-runner.ts |
+| `certificationEvidenceDigest` | production | this package: src/completion-verifier.ts:38 |
+| `checkCanaries` | production | blueprint-agent:scripts/experiments/lib/contamination-preflight.ts |
+| `checkServedModel` | production | this package: src/integrity/preflight.ts:33 |
+| `checkTraceContracts` | production | creative-agent:eval/lib/trace-contracts.ts |
+| `clamp01` | production | agent-dev-container:products/intelligence/api/src/lib/consultant/executor.ts |
+| `classifyFailure` | production | phony:products/builder/api/src/eval/autoresearch/trace-analyst.ts |
+| `cliffsDelta` | production | agent-builder:src/lib/.server/eval/loops/differential-eval.ts |
+| `CODING_HARNESSES` | production | agent-runtime:src/runtime/define-leaderboard.ts |
+| `cohensD` | production | starter-foundry:examples/recruiter-eval-workspace/eval/src/eval/regression/gate.ts |
+| `comparePairedArms` | production | agent-knowledge:src/memory/experiment/learning-metrics.ts |
+| `completionVerdict` | production | blueprint-agent:scripts/experiments/eval/launch-scoreboard/scoreboard-core.ts |
+| `computeExperimentStats` | production | blueprint-agent:scripts/experiments/lib/vb-improve-harness.ts |
+| `computeFindingId` | production | agent-runtime:src/runtime/index.ts |
+| `computeToolUseMetrics` | production | traces:src/pipelines.ts |
+| `confidenceInterval` | production | agent-runtime:src/runtime/benchmark-report.ts |
+| `ConfigError` | production | agent-runtime:src/errors.ts |
+| `contentHash` | production | agent-knowledge:src/file-transaction.ts |
+| `continuousAgreement` | production | agent-builder:frontier/judges/eval-validity.ts |
+| `controlRunToFeedbackTrajectory` | production | creative-agent:eval/control/creative-onboarding.ts |
+| `corpusInterRaterAgreement` | planned | doc: docs/design/statistics-decisions.md |
+| `corpusInterRaterAgreementFromJudgeScores` | planned | consumer tests: tax-agent:tests/eval/lib/judge-irr.ts |
+| `CostAccountingIncompleteError` | production | this package: src/analyst/benchmark-command.ts:6 |
+| `CostCallConflictError` | production | this package: src/analyst/benchmark-public-model.ts:8 |
+| `CostCeilingReachedError` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `costForTokenPricing` | production | agent-runtime:src/runtime/profile-chat-client.ts |
+| `costForUsage` | production | agent-builder:src/lib/.server/llm-cost.ts |
+| `CostLedger` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `CostLedgerPersistenceError` | production | this package: src/analyst/benchmark-public-model.ts:8 |
+| `CostReceiptCaptureError` | production | this package: src/analyst/benchmark-public-model.ts:8 |
+| `costReceiptFromLlm` | production | agent-dev-container:products/intelligence/api/src/lib/router-model-owner.ts |
+| `costReceiptFromLlmError` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `CostReservationExceededError` | production | this package: src/analyst/benchmark-public-errors.ts:2 |
+| `CostTracker` | production | creative-agent:eval/canonical-runner.ts |
+| `createAntiSlopJudge` | production | phony:products/builder/api/src/eval/judges.ts |
+| `createBoundedTraceAnalysisStore` | production | braid:src/adapters/analysis/trace-store.ts |
+| `createChatClient` | production | agent-dev-container:products/intelligence/api/src/lib/intent-audit-analyst.ts |
+| `createDspyRlmTraceEngine` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `createFeedbackTrajectory` | production | agent-builder:src/lib/.server/eval/feedback/feedback-capture.ts |
+| `createLlmCorrectnessChecker` | production | agent-app:src/eval/index.ts |
+| `createLlmReviewer` | production | agent-builder:src/lib/.server/eval/judges/reviewer-llm.ts |
+| `createTraceAnalyst` | production | blueprint-agent:scripts/experiments/lib/sandbox-driver/analyst-steer.ts |
+| `CrossFamilyError` | production | creative-agent:eval/lib/judge-ensemble.ts |
+| `decidePairedPromotion` | production | discovery-lab:tools/decide.mjs |
+| `DECISION_PAIRED_DELTA_STATISTIC` | production | this package: src/campaign/gates/promotion-policy.ts:33 |
+| `DEFAULT_PERMUTATIONS` | none | — |
+| `DEFAULT_RED_TEAM_CORPUS` | production | starter-foundry:registry/layers/agent-eval/redteam/files/src/eval/redteam/runner.ts |
+| `DEFAULT_REDACTION_RULES` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `DEFAULT_TRACE_ANALYST_BUDGETS` | production | agent-builder:src/lib/.server/eval/stores/d1-trace-analysis-store-adapter.ts |
+| `DEFAULT_TRACE_ANALYST_KINDS` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `defaultBlendWeights` | production | blueprint-agent:scripts/experiments/lib/qa-grader.ts |
+| `defineAgentEval` | planned | example: examples/evaluate-a-change/index.ts:10 |
+| `defineEquivalenceCheck` | planned | example: examples/verify-without-an-answer-key/index.ts:13 |
+| `deployGateLayer` | production | blueprint-agent:scripts/experiments/lib/deploy-runner.ts |
+| `describeTraceInsightScope` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html.ts |
+| `diffFindings` | production | agent-runtime:src/analyst-loop/run-analyst-loop.ts |
+| `diffScorecard` | production | ai-trading-blueprint:evals/src/trading/scorecard-integration.ts |
+| `discoverPersonas` | production | insurance-agent:scripts/harvest-candidate-outputs.ts |
+| `domainEvidencePattern` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/session-loader.ts |
+| `dominates` | production | blueprint-agent:scripts/experiments/lib/competition-analytics.ts |
+| `ensembleJudge` | production | blueprint-agent:scripts/experiments/lib/qa-grader.ts |
+| `eProcess` | production | this package: src/campaign/gates/sequential.ts:35 |
+| `EquivalenceProtocolError` | planned | doc: docs/verification-strategies.md |
+| `equivalenceVerdict` | planned | doc: docs/verdicts.md |
+| `ERROR_COUNT_PATTERNS` | production | blueprint-agent:scripts/experiments/lib/error-count-extractor.ts |
+| `errorStreakDetector` | production | agent-runtime:src/runtime/supervise/detector-monitor.ts |
+| `estimateCost` | production | agent-builder:src/lib/.server/llm-cost.ts |
+| `estimateTokens` | production | physim:apps/server/src/lib/runner.ts |
+| `evaluateActionPolicy` | planned | doc: docs/control-runtime.md |
+| `evaluateInterimReleaseConfidence` | production | agent-builder:scripts/eval.ts |
+| `evaluateOracles` | planned | doc: docs/verdicts.md |
+| `evaluateReleaseConfidence` | production | agent-knowledge:src/release.ts |
+| `expandProfileAxes` | production | agent-runtime:src/runtime/define-leaderboard.ts |
+| `exportProductBenchmark` | production | creative-agent:eval/research-package.ts |
+| `exportProductBenchmarkRuns` | production | creative-agent:eval/research-package.ts |
+| `exportRunAsOtlp` | production | agent-builder:src/lib/.server/eval/analysts/canonical-trace-analyst.ts |
+| `extractErrorCount` | production | blueprint-agent:scripts/experiments/lib/error-count-extractor.ts |
+| `extractProducedState` | production | agent-app:src/eval/index.ts |
+| `extractUsage` | production | this package: src/contract/intake/code-agent-session.ts:12 |
+| `extractUsageFromSse` | production | this package: src/trace/capture-fetch.ts:8 |
+| `FAILURE_CLASSES` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `FAILURE_MODE_KIND_SPEC` | planned | consumer tests: legal-agent:tests/eval/analysts/completion-coverage.ts |
+| `failureClusterView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `feedbackTrajectoriesToDatasetScenarios` | production | creative-agent:eval/control/creative-onboarding.ts |
+| `feedbackTrajectoriesToOptimizerRows` | production | agent-dev-container:products/intelligence/api/src/lib/feedback-memory.ts |
+| `feedbackTrajectoryToOptimizerRow` | planned | doc: docs/feedback-trajectories.md |
+| `FileSystemFeedbackTrajectoryStore` | production | ai-trading-blueprint:evals/src/product/autoresearch-loop-runner.ts |
+| `FileSystemRawProviderSink` | production | agent-builder:scripts/eval.ts |
+| `FileSystemTraceStore` | production | agent-builder:scripts/eval.ts |
+| `fileVerdictCache` | production | blueprint-agent:scripts/experiments/calibrate-instrument.ts |
+| `FindingsStore` | production | agent-builder:scripts/run-canonical-analyst-loop.ts |
+| `formatScorecardDiff` | production | ai-trading-blueprint:evals/src/trading/scorecard-integration.ts |
+| `gainHistogram` | production | blueprint-agent:scripts/experiments/vb-runrecord-analysis.ts |
+| `gateTreatmentApplied` | production | blueprint-agent:scripts/experiments/lib/validity-gates.ts |
+| `gradeOnHidden` | none | only this package's tests: src/hidden-criteria-grading.test.ts:4 |
+| `gradeSemanticStatus` | production | blueprint-agent:scripts/experiments/lib/verification-harness/primitives.ts |
+| `groupRunsByAgentProfileCell` | planned | consumer tests: legal-agent:tests/eval/matrix-multi.ts |
+| `HARNESS_NATIVE_MODEL` | production | agent-runtime:src/runtime/supervise/model-policy.ts |
+| `harnessAxisOf` | production | gtm-agent:eval/matrix/harnesses.ts |
+| `hashContent` | production | agent-runtime:bench/src/corpus.ts |
+| `hashJson` | production | agent-dev-container:products/intelligence/api/src/lib/ingest-optimization-mapping.ts |
+| `HeldOutGate` | production | agent-builder:src/lib/.server/eval/gates/promotion.ts |
+| `hiddenGrade` | none | only this package's tests: src/hidden-criteria-grading.test.ts:4 |
+| `holm` | planned | doc: docs/design/statistics-decisions.md |
+| `improvementVerdict` | production | blueprint-agent:scripts/experiments/lib/vb-improve-harness.ts |
+| `inferDomainKeywords` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/suite-projection.ts |
+| `InMemoryFeedbackTrajectoryStore` | production | creative-agent:eval/control/creative-onboarding.ts |
+| `InMemoryRawProviderSink` | production | agent-builder:src/lib/.server/eval/loops/canonical-campaign.ts |
+| `inMemoryReviewStore` | production | agent-builder:scripts/propose-review-smoke.ts |
+| `InMemoryTraceStore` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `interpretCliffs` | production | agent-builder:src/lib/.server/eval/loops/differential-eval.ts |
+| `interRaterReliability` | production | agent-app:src/eval-campaign/trust-gate.ts |
+| `iqr` | production | this package: src/experiment-tracker.ts:27 |
+| `isBinaryOutcomeVector` | none | only this package's tests: src/statistics/paired-binary.test.ts:2 |
+| `isJudgeSpan` | production | this package: src/trace/query.ts:12 |
+| `isLlmSpan` | production | agent-runtime:src/candidate-execution/finalize.ts |
+| `isModelPriced` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `isRunRecord` | production | this package: src/eval-trace-store.ts:21 |
+| `isToolSpan` | production | agent-runtime:src/runtime/supervise/trace-evidence.ts |
+| `isTransientLlmError` | production | supervisor-lab:bench/comms/judges.ts |
+| `jsonlReviewStore` | production | starter-foundry:scripts/enrich-family.ts |
+| `jsonlRunRecordBackend` | production | workcomp-agent:eval/benchmark/store.ts |
+| `jsonShape` | planned | named in creative-agent (bind not in the import graph) |
+| `judgeAgreementView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `JudgeError` | production | agent-runtime:src/errors.ts |
+| `judgeFamily` | production | agent-builder:frontier/judges/llm.ts |
+| `judgeSpans` | production | this package: src/builder-eval/three-layer-eval.ts:25 |
+| `knowledgeReadinessTracePayload` | production | agent-dev-container:products/intelligence/api/src/routes/project-engines.ts |
+| `leaderboard` | production | blueprint-agent:scripts/experiments/lib/cross-harness-leaderboard.ts |
+| `LlmCallError` | production | agent-dev-container:products/intelligence/api/src/lib/router-model-owner.ts |
+| `llmJudge` | production | agent-runtime:examples/agentic-data-creation/offline-fixtures.ts |
+| `LlmResponseError` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `loadScorecard` | production | ai-trading-blueprint:evals/src/trading/scorecard-integration.ts |
+| `localCommandRunner` | production | blueprint-agent:scripts/experiments/lib/command-runner.ts |
+| `makeFinding` | production | agent-dev-container:products/intelligence/api/src/lib/consultant/candidates.ts |
+| `makeProposalFinding` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `manifestContentDigest` | production | this package: src/campaign/gates/sequential.ts:34 |
+| `MANN_WHITNEY_EXACT_MAX_STATES` | none | — |
+| `MANN_WHITNEY_EXACT_MAX_WORK` | none | — |
+| `mannWhitneyU` | production | blueprint-agent:scripts/experiments/lib/competition-analytics.ts |
+| `maximumChargeForLlmRequest` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `mcnemar` | production | agent-runtime:bench/src/swe-arena/analyze.ts |
+| `mcnemarPower` | production | supervisor-lab:bench/deepswe/headroom.ts |
+| `mcnemarRequiredN` | production | blueprint-agent:scripts/experiments/analyze-convergence.ts |
+| `minimumPairsForPairedDeltaTest` | production | agent-dev-container:products/intelligence/api/src/routes/optimizations.ts |
+| `mintRolloutRows` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `MODEL_PRICING` | production | supervisor-lab:bench/profile-arena.ts |
+| `modelHasSnapshot` | production | agent-dev-container:products/intelligence/api/src/lib/project-profile-change-preflight.ts |
+| `modelPriceKey` | none | only this package's tests: src/cost-ledger.test.ts:7 |
+| `ModelSubstitutionError` | production | this package: src/campaign/external-optimizer-model-proxy.ts:11 |
+| `mulberry32` | production | agent-knowledge:src/memory/holdout.ts |
+| `MultiLayerVerifier` | production | agent-builder:src/lib/.server/eval/loops/forge-refinement.ts |
+| `NoopRawProviderSink` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `notBlocked` | none | only this package's tests: src/oracle.test.ts:2 |
+| `NotFoundError` | production | agent-runtime:src/errors.ts |
+| `objectiveEval` | production | agent-knowledge:src/research-loop.ts |
+| `observeAll` | production | agent-runtime:src/runtime/supervise/detector-monitor.ts |
+| `OtlpFileTraceStore` | production | agent-builder:scripts/run-canonical-analyst-loop.ts |
+| `otlpTextToTraceAnalysisStore` | production | braid:src/adapters/analysis/trace-store.ts |
+| `OUTPUT_VALUE` | production | agent-runtime:src/runtime/supervise-surface.ts |
+| `pairArms` | production | agent-knowledge:src/memory/experiment/learning-pairs.ts |
+| `pairedBinaryScale` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairedBootstrap` | production | agent-builder:frontier/adapters/fleet-eval-runner.ts |
+| `pairedCohensDz` | production | this package: src/contract/analyze-runs.ts:37 |
+| `pairedDeltaTest` | production | gtm-agent:eval/matrix/report.ts |
+| `pairedDeltaTieFraction` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairedEvalueSequence` | production | creative-agent:src/lib/experiments/ab-design.ts |
+| `pairedMde` | production | discovery-lab:tools/design-gate.mjs |
+| `pairedRiskDifference` | production | blueprint-agent:scripts/experiments/lib/validity-gates.ts |
+| `pairedRiskDifferenceExact` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairedRiskDifferenceScore` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairedSignTest` | production | agent-dev-container:products/intelligence/api/src/lib/paired-stats.ts |
+| `pairedTTest` | production | this package: src/contract/analyze-runs.ts:37 |
+| `pairRunRecords` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `PairwiseSteeringOptimizer` | production | browser-agent-driver:bench/research/webvoyager-agent-eval-loop.mjs |
+| `paretoChart` | production | workcomp-agent:eval/benchmark/select.ts |
+| `paretoFrontier` | production | agent-dev-container:products/sandbox/evals/run.ts |
+| `parseReflectionResponse` | production | blueprint-agent:scripts/experiments/lib/gepa-reflective-proposer.ts |
+| `parseRunRecordSafe` | production | gtm-agent:scripts/canonical-completeness/records.ts |
+| `partialCredit` | planned | doc: docs/design/statistics-decisions.md |
+| `partitionHeldOut` | production | blueprint-agent:scripts/experiments/calibrate-instrument.ts |
+| `passAtK` | planned | doc: docs/design/statistics-decisions.md |
+| `pearsonR` | production | this package: src/builder-eval/correlation.ts:18 |
+| `preflightModels` | production | loops:src/preflight.ts |
+| `productBenchmarkRepoIdentity` | production | creative-agent:eval/research-package.ts |
+| `ProductClient` | production | creative-agent:eval/e2e/creative-product-harness.ts |
+| `profile` | production | agent-app:src/profile/index.ts |
+| `projectRuntimeTrajectoryEvidence` | production | agent-dev-container:products/intelligence/api/src/lib/workflow-trace-preflight.ts |
+| `PromptRegistry` | production | blueprint-agent:scripts/experiments/lib/surface-prompt-registry.ts |
+| `proposeSynthesisTargets` | production | blueprint-agent:scripts/experiments/researcher/inspect.ts |
+| `ranks` | planned | doc: docs/design/statistics-decisions.md |
+| `readProductBenchmarkManifest` | production | creative-agent:eval/research-package.ts |
+| `recordRuns` | planned | consumer tests: tax-agent:tests/eval/benchmarks/taxcalc/analyze.mjs |
+| `recordRunsToScorecard` | production | ai-trading-blueprint:evals/src/trading/persona-agent-eval.ts |
+| `REDACTION_VERSION` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `redactString` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `redTeamDataset` | production | creative-agent:eval/red-team.ts |
+| `redTeamReport` | production | creative-agent:eval/red-team.ts |
+| `regexMatches` | none | only this package's tests: src/oracle.test.ts:2 |
+| `renderPreferenceMemoryMarkdown` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `repeatedActionDetector` | production | agent-runtime:src/runtime/supervise/detector-monitor.ts |
+| `requiredPairedSampleSize` | production | discovery-lab:tools/design-gate.mjs |
+| `requiredSampleSize` | planned | doc: docs/design/statistics-decisions.md |
+| `resolveModelPricing` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-primitives.ts |
+| `resolveSeat` | production | creative-agent:eval/agent.config.ts |
+| `roundTripRunRecord` | none | only this package's tests: tests/run-record.test.ts:3 |
+| `routeFields` | none | only this package's tests: src/hidden-criteria-grading.test.ts:4 |
+| `runAgentControlLoop` | production | agent-runtime:src/run.ts |
+| `runCampaign` | production | agent-app:src/eval-campaign/index.ts |
+| `runCanaries` | production | agent-builder:src/lib/.server/eval/loops/canary-cron.ts |
+| `runCounterfactual` | production | traces:src/replay-batch.ts |
+| `runEquivalenceCheck` | planned | example: examples/verify-without-an-answer-key/index.ts:13 |
+| `runEvalCampaign` | production | agent-builder:scripts/eval.ts |
+| `RunIntegrityError` | production | creative-agent:eval/canonical-runner.ts |
+| `runIntentMatchJudge` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `runKeywordCoverageJudge` | production | blueprint-agent:scripts/experiments/calibration/scorers.ts |
+| `runKeywordCoverageJudgeUrl` | production | blueprint-agent:scripts/experiments/lib/completeness-audit.ts |
+| `runProposeReview` | production | agent-builder:scripts/propose-review-smoke.ts |
+| `runProposeReviewAsControlLoop` | none | — |
+| `RunRecordValidationError` | production | starter-foundry:src/lib/index.ts |
+| `runSemanticConceptJudge` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `runsForScenario` | production | phony:products/builder/api/src/eval/gate.ts |
+| `runTaskScore` | production | discovery-lab:tools/strict-screen.mjs |
+| `scoreKnowledgeReadiness` | production | agent-builder:src/lib/.server/runtime/agent-task-readiness.ts |
+| `scoreRedTeamOutput` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-gate.ts |
+| `scoreTraceInsightReadiness` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html-sections.ts |
+| `seatPresets` | production | supervisor-lab:bench/comms/judges.ts |
+| `selfImprove` | production | agent-app:src/eval-campaign/index.ts |
+| `SEMANTIC_CONCEPT_JUDGE_VERSION` | production | blueprint-agent:scripts/experiments/lib/semantic-audit.ts |
+| `ServedCrossFamilyError` | none | only this package's tests: src/integrity/served-model.test.ts:2 |
+| `servedModelAcceptable` | production | this package: src/integrity/preflight.ts:33 |
+| `spearmanR` | production | blueprint-agent:scripts/experiments/lib/benchmark-validity-report.mjs |
+| `stripFencedJson` | production | blueprint-agent:scripts/experiments/compare-analysis-reports.ts |
+| `subjectiveEval` | production | creative-agent:eval/control/creative-onboarding.ts |
+| `summarizeBackendIntegrity` | production | agent-dev-container:products/intelligence/api/src/lib/run-provenance.ts |
+| `summarizeNumberSeries` | production | this package: src/supervisor-run/analyze.ts:8 |
+| `summarizePreferenceMemory` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `summaryTable` | production | blueprint-agent:scripts/experiments/vb-runrecord-analysis.ts |
+| `textInSnapshot` | none | only this package's tests: src/oracle.test.ts:2 |
+| `toAgentProfileJson` | production | blueprint-agent:scripts/experiments/lib/agent-profile-cell.ts |
+| `tokenizeDomainWords` | planned | consumer tests: blueprint-agent:scripts/experiments/__tests__/analyze-vb-run.test.ts |
+| `toolSpansToTraceAnalysisStore` | production | agent-runtime:src/runtime/supervise/trace-evidence.ts |
+| `toolWasteView` | production | agent-runtime:src/runtime/supervise/trajectory-recorder.ts |
+| `TRACE_ANALYST_TRUNCATION_MARKER_PREFIX` | production | agent-runtime:src/analyst-loop/iterations-to-trace-store.ts |
+| `traceContract` | production | creative-agent:eval/lib/trace-contracts.ts |
+| `TraceEmitter` | production | agent-builder:src/lib/.server/runtime/trace-runtime.ts |
+| `transientDispatchFailure` | planned | doc: docs/eval-surface-map.md |
+| `UNKNOWN_MODEL` | production | this package: src/campaign/presets/run-profile-matrix.ts:54 |
+| `urlContains` | none | only this package's tests: src/oracle.test.ts:2 |
+| `userQuestionsForKnowledgeGaps` | production | agent-dev-container:products/intelligence/api/src/routes/project-engines.ts |
+| `validateRunRecord` | production | agent-builder:src/lib/.server/eval/stores/run-record-store.ts |
+| `ValidationError` | production | agent-runtime:src/errors.ts |
+| `verbosityBias` | production | blueprint-agent:scripts/experiments/calibration/judge-agreement.ts |
+| `VERIFICATION_STRATEGIES` | planned | example: examples/verify-without-an-answer-key/index.ts:13 |
+| `VERIFICATION_STRATEGY_SOURCES` | none | only this package's tests: src/verification-strategy.test.ts:11 |
+| `verifyAgentProfileCell` | production | this package: src/eval-campaign.ts:39 |
+| `verifyCompletion` | production | agent-app:src/eval/index.ts |
+| `viteDeployRunner` | production | blueprint-agent:scripts/experiments/lib/deploy-runner.ts |
+| `weightedComposite` | production | agent-app:src/eval/index.ts |
+| `weightedMean` | production | blueprint-agent:scripts/experiments/lib/synthesis-quality-judge.ts |
+| `WILCOXON_EXACT_MAX_N` | none | — |
+| `wilcoxonSignedRank` | production | agent-builder:src/lib/.server/eval/loops/differential-eval.ts |
+| `wilson` | production | agent-dev-container:products/intelligence/api/src/lib/project-analysis-coverage-recommendations.ts |
+| `withAssignedFeedbackSplit` | production | phony:products/builder/api/src/feedback/production-trace.ts |
+| `withHeldoutBlend` | none | only this package's tests: src/hidden-criteria-grading.test.ts:4 |
+| `withJudgeRetry` | production | creative-agent:eval/lib/creative-judges.ts |
+| `wranglerDeployRunner` | production | blueprint-agent:scripts/experiments/lib/deploy-runner.ts |
+
+### `./analyst`
+
+131 value exports — 75 production, 16 planned, 40 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `adaptPublicBenchmarkFindings` | production | this package: src/analyst/benchmark-public-rlm.ts:14 |
+| `AGENT_RX_UPSTREAM_REVISION` | production | this package: src/analyst/benchmark-command-result.ts:2 |
+| `agentRxBenchmarkCase` | production | this package: src/analyst/benchmark-public-data.ts:11 |
+| `agentRxPredictionsToFindings` | production | this package: src/analyst/benchmark-public-adapters.ts:3 |
+| `ANALYST_BENCHMARK_COST_LEDGER_FILE` | production | this package: src/analyst/benchmark-command-persistence.ts:9 |
+| `ANALYST_BENCHMARK_DEPENDENCY_LOCK_DIGEST_ALGORITHM` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `ANALYST_BENCHMARK_DEPENDENCY_LOCK_FILES` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `ANALYST_BENCHMARK_DEPENDENCY_LOCK_SHA256` | production | this package: src/analyst/benchmark-command-persistence.ts:27 |
+| `ANALYST_BENCHMARK_EVIDENCE_DEPENDENCY_LOCK_SHA256` | none | only this package's tests: src/analyst/benchmark-reference-result.test.ts:6 |
+| `ANALYST_BENCHMARK_EVIDENCE_IMPLEMENTATION_SHA256` | none | only this package's tests: src/analyst/benchmark-reference-result.test.ts:6 |
+| `ANALYST_BENCHMARK_IMPLEMENTATION_DIGEST_ALGORITHM` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `ANALYST_BENCHMARK_IMPLEMENTATION_FILES` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `ANALYST_BENCHMARK_IMPLEMENTATION_SHA256` | production | this package: src/analyst/benchmark-command-persistence.ts:27 |
+| `ANALYST_BENCHMARK_LOCAL_RECEIPT_FILE` | production | this package: src/analyst/benchmark-command-persistence.ts:9 |
+| `ANALYST_BENCHMARK_MANIFEST_FILE` | production | this package: src/analyst/benchmark-command-persistence.ts:9 |
+| `ANALYST_BENCHMARK_OBSERVATIONS_FILE` | production | this package: src/analyst/benchmark-command-persistence.ts:9 |
+| `analystBenchmarkDependencyLockDigest` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `analystBenchmarkImplementationDigest` | none | only this package's tests: src/analyst/benchmark-implementation.test.ts:7 |
+| `analystDefinitionAsymmetries` | planned | doc: docs/trace-analysis.md |
+| `analystDefinitionProtocolSha256` | planned | doc: docs/trace-analysis.md |
+| `AnalystExpressivenessError` | production | this package: src/analyst/benchmark-public-model.ts:56 |
+| `analystInstructionsOverrideFromText` | none | only this package's tests: src/analyst/benchmark-instructions-override.test.ts:5 |
+| `AnalystRegistry` | production | blueprint-agent:scripts/experiments/vb-multi-analyst.ts |
+| `analystUsageReceiptFromPrimeUsage` | production | this package: src/analyst/benchmark-runner-prime.ts:19 |
+| `appendVerificationArtifactsToOtlp` | production | this package: src/analyst/benchmark-public-data.ts:31 |
+| `assertProposalFindings` | production | agent-runtime:src/improvement/code-execution.ts |
+| `behavioralAnalyst` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `bindAnalyst` | planned | doc: docs/trace-analysis.md |
+| `buildDefaultAnalystRegistry` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `buildPrimePrompt` | production | this package: src/analyst/benchmark-runner-prime.ts:19 |
+| `buildPrimeRepairPrompt` | planned | doc: docs/prime-analyst.md |
+| `buildSkillUsageReport` | none | only this package's tests: src/analyst/kinds/skill-usage.test.ts:2 |
+| `buildTraceToolsForGroup` | production | this package: src/analyst/kind-factory.ts:15 |
+| `CODE_TRACE_BENCH_ANALYST_PROMPT` | production | this package: src/analyst/benchmark-runner-prime.ts:11 |
+| `codeTraceBenchCase` | production | this package: src/analyst/benchmark-public-data.ts:11 |
+| `codeTracerPredictionsToFindings` | none | only this package's tests: src/analyst/benchmark-datasets.test.ts:3 |
+| `coerceJson` | production | this package: src/analyst/finding-signature.ts:10 |
+| `compareAnalystRunners` | production | this package: src/analyst/benchmark-command-result.ts:15 |
+| `computeFindingId` | production | agent-runtime:src/runtime/index.ts |
+| `CONTROL_INTEGRITY_ANALYST` | none | only this package's tests: src/analyst/kinds/control-integrity.test.ts:5 |
+| `ControlIntegrityAnalyst` | none | — |
+| `createChatClient` | production | agent-dev-container:products/intelligence/api/src/lib/intent-audit-analyst.ts |
+| `createDspyRlmTraceEngine` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `createJudgeAdapter` | none | — |
+| `createPrimeBenchmarkRunner` | production | this package: src/analyst/benchmark-command.ts:62 |
+| `createPublicBenchmarkDirectRunner` | production | this package: src/analyst/benchmark-command.ts:60 |
+| `createPublicBenchmarkRlmRunner` | production | this package: src/analyst/benchmark-command.ts:61 |
+| `createRunCriticAdapter` | none | — |
+| `createSemanticConceptJudgeAdapter` | none | only this package's tests: src/analyst/adapters.test.ts:2 |
+| `createTraceAnalyst` | production | blueprint-agent:scripts/experiments/lib/sandbox-driver/analyst-steer.ts |
+| `createVerifierAdapter` | none | — |
+| `decodeReplyRows` | production | this package: src/analyst/benchmark-public-model.ts:57 |
+| `DEFAULT_MAX_VERIFICATION_ARTIFACT_BYTES` | production | this package: src/analyst/benchmark-command.ts:73 |
+| `DEFAULT_TRACE_ANALYST_KINDS` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `defaultIsMaterial` | none | only this package's tests: src/analyst/analyst.test.ts:8 |
+| `defineCustomAnalyst` | planned | doc: docs/trace-analysis.md |
+| `defineTraceAnalyst` | planned | doc: docs/charter.md |
+| `deriveEfficiencyFindings` | none | only this package's tests: src/trace-analyst/behavioral-metrics.test.ts:2 |
+| `diffFindings` | production | agent-runtime:src/analyst-loop/run-analyst-loop.ts |
+| `effectiveAnalystProtocolSha256` | production | this package: src/analyst/benchmark-command-persistence.ts:31 |
+| `emitControlIntegrityFindings` | none | only this package's tests: src/analyst/kinds/control-integrity.test.ts:5 |
+| `emitSkillUsageFindings` | none | only this package's tests: src/analyst/kinds/skill-usage.test.ts:2 |
+| `emptyPrimeRawUsage` | none | only this package's tests: src/analyst/prime-protocol.test.ts:4 |
+| `emptyPublicBenchmarkRunner` | production | this package: src/analyst/benchmark-command.ts:62 |
+| `evidenceRefsFromRawFinding` | production | this package: src/analyst/benchmark-public-rlm.ts:36 |
+| `ExactAnalystRunExecutionError` | planned | doc: docs/trace-analysis.md |
+| `expandCodeTraceFailureBlocks` | production | this package: src/analyst/benchmark-public-model.ts:29 |
+| `extractPrimeJsonObject` | none | only this package's tests: src/analyst/prime-protocol.test.ts:4 |
+| `FAILURE_MODE_KIND_SPEC` | planned | consumer tests: legal-agent:tests/eval/analysts/completion-coverage.ts |
+| `FINDING_SUBJECT_KINDS` | planned | consumer tests: tax-agent:tests/eval/benchmarks/taxcalc/compile-and-prove/carrier.test.ts |
+| `FINDING_SUBJECT_SYNTAX` | none | only this package's tests: src/analyst/finding-subject.test.ts:2 |
+| `FindingsStore` | production | agent-builder:scripts/run-canonical-analyst-loop.ts |
+| `findingSubjectGrammarPromptFor` | production | this package: src/analyst/kinds/failure-mode.ts:38 |
+| `IMPROVEMENT_KIND_SPEC` | none | only this package's tests: src/analyst/finding-subject.test.ts:11 |
+| `isProposalFinding` | none | only this package's tests: src/analyst/proposal-findings.test.ts:2 |
+| `KIND_EXPECTED_SUBJECTS` | production | this package: src/analyst/kind-factory.ts:14 |
+| `KNOWLEDGE_GAP_KIND_SPEC` | none | only this package's tests: src/analyst/finding-subject.test.ts:11 |
+| `KNOWLEDGE_POISONING_KIND_SPEC` | none | only this package's tests: src/analyst/finding-subject.test.ts:11 |
+| `loadCodeTraceVerificationArtifacts` | production | this package: src/analyst/benchmark-public-data.ts:31 |
+| `loadPublicBenchmarkRows` | none | only this package's tests: src/analyst/benchmark-command-public-data.test.ts:13 |
+| `makeFinding` | production | agent-dev-container:products/intelligence/api/src/lib/consultant/candidates.ts |
+| `makeProposalFinding` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `MAX_INCORRECT_BLOCK_STEPS` | production | this package: src/analyst/benchmark-public-adapters.ts:9 |
+| `MAX_INCORRECT_BLOCKS` | production | this package: src/analyst/benchmark-public-adapters.ts:9 |
+| `mergePrimeRawUsage` | planned | doc: docs/prime-analyst.md |
+| `nodeHttpPrimeBridgeTransport` | production | this package: src/analyst/benchmark-runner-prime.ts:18 |
+| `normalizeAgentRxCategory` | none | only this package's tests: src/analyst/benchmark-datasets.test.ts:3 |
+| `normalizeBenchmarkLabel` | production | this package: src/analyst/benchmark-dataset-agentrx.ts:10 |
+| `normalizePrimeUsage` | planned | doc: docs/prime-analyst.md |
+| `parseFindingSubject` | production | agent-dev-container:products/intelligence/api/src/lib/improvement-loop.ts |
+| `parseRawFinding` | production | this package: src/analyst/kind-factory.ts:7 |
+| `parseVerificationOutcome` | production | discovery-lab:tools/check-technical-campaign.mjs |
+| `preparePublicAnalystBenchmark` | production | this package: src/analyst/benchmark-command.ts:62 |
+| `primeAnalystProtocolSha256` | planned | doc: docs/prime-analyst.md |
+| `primeCodeTraceAnalystDefinition` | planned | doc: docs/prime-analyst.md |
+| `primeProtocolSha256` | production | this package: src/analyst/benchmark-runner-prime.ts:19 |
+| `primeReplyDefect` | none | only this package's tests: src/analyst/prime-protocol.test.ts:4 |
+| `projectPrimeTrajectory` | production | this package: src/analyst/benchmark-runner-prime.ts:19 |
+| `publicBenchmarkDistributions` | none | — |
+| `publicBenchmarkProtocolSha256` | production | this package: src/analyst/benchmark-instructions-override.ts:2 |
+| `publicBenchmarkRlmInstructions` | production | this package: src/analyst/benchmark-public-rlm.ts:24 |
+| `publicBenchmarkSelectionReport` | none | only this package's tests: src/analyst/benchmark-command-public-data.test.ts:13 |
+| `publicBenchmarkSystemPrompt` | none | only this package's tests: src/analyst/benchmark-command-public-data.test.ts:13 |
+| `publicDirectAnalystDefinition` | planned | doc: docs/trace-analysis.md |
+| `publicRlmAnalystDefinition` | planned | doc: docs/trace-analysis.md |
+| `RAW_FINDING_SCHEMA_PROMPT` | production | this package: src/analyst/benchmark-public-rlm.ts:36 |
+| `RawAnalystFindingSchema` | production | this package: src/analyst/benchmark-public-rlm.ts:36 |
+| `readAnalystBenchmarkArtifact` | production | this package: src/analyst/benchmark-command.ts:42 |
+| `readAnalystInstructionsOverride` | production | this package: src/analyst/benchmark-command.ts:52 |
+| `registryBenchmarkRunner` | none | only this package's tests: src/analyst/benchmark.test.ts:3 |
+| `renderAgentRxCalibrationMarkdown` | production | this package: src/analyst/benchmark-command.ts:19 |
+| `renderAnalystBenchmarkMarkdown` | production | this package: src/analyst/benchmark-command.ts:72 |
+| `renderCodeTraceCalibrationMarkdown` | production | this package: src/analyst/benchmark-command.ts:56 |
+| `renderFindingSubject` | production | creative-agent:eval/analyst-loop.ts |
+| `renderPriorFindings` | none | — |
+| `resolveTraceAnalystLimits` | production | this package: src/analyst/kind-factory.ts:5 |
+| `rlmEngineLimits` | none | only this package's tests: src/analyst/definition-parity.test.ts:26 |
+| `roundAgentRxStep` | production | this package: src/analyst/benchmark-agentrx-calibration.ts:2 |
+| `runAnalystBenchmark` | production | this package: src/analyst/benchmark-command.ts:12 |
+| `runAnalystBenchmarkCommand` | production | this package: src/cli.ts:16 |
+| `runPrimeExchange` | production | this package: src/analyst/benchmark-runner-prime.ts:19 |
+| `runTraceAnalyst` | production | this package: src/analyst/benchmark-public-rlm.ts:42 |
+| `scoreAnalystFindings` | production | this package: src/analyst/benchmark.ts:3 |
+| `selectPublicBenchmarkRows` | none | only this package's tests: src/analyst/benchmark-command-public-data.test.ts:13 |
+| `SKILL_USAGE_ANALYST` | none | only this package's tests: src/analyst/kinds/skill-usage.test.ts:2 |
+| `stripCodeFences` | planned | named in agent-builder (bind not in the import graph) |
+| `summarizeAgentRxCalibration` | production | this package: src/analyst/benchmark-command-result.ts:2 |
+| `summarizeAnalystBenchmarkRunner` | production | this package: src/analyst/benchmark-command-result.ts:18 |
+| `summarizeCodeTraceCalibration` | production | this package: src/analyst/benchmark-command-result.ts:16 |
+| `traceStoreEvidenceResolver` | production | this package: src/analyst/benchmark-command.ts:12 |
+
+### `./authenticity`
+
+5 value exports — 3 production, 0 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `gateRealness` | production | blueprint-agent:scripts/experiments/lib/enrich/realness.ts |
+| `judgeRealnessLlm` | none | — |
+| `scoreAuthenticity` | production | blueprint-agent:scripts/experiments/lib/enrich/realness.ts |
+| `scoreAuthenticityNuance` | none | only this package's tests: src/authenticity/index.test.ts:3 |
+| `scoreRealnessBlended` | production | physim:apps/server/src/scripts/agent-eval/investigators/realness.ts |
+
+### `./benchmarks`
+
+12 value exports — 2 production, 9 planned, 1 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `BENCHMARK_SPLIT_SEED` | production | tuner-agent:src/lib/eval-benchmarks.ts |
+| `buildStandardRetrievalItems` | planned | doc: examples/benchmarks/README.md |
+| `calibrateBenchmarkMetric` | planned | doc: examples/benchmarks/README.md |
+| `createRetrievalIdBenchmarkAdapter` | planned | doc: examples/benchmarks/README.md |
+| `deterministicSplit` | production | tuner-agent:src/lib/eval-benchmarks.ts |
+| `evaluateStandardRetrieval` | planned | doc: examples/benchmarks/README.md |
+| `parseBeirCorpusJsonl` | planned | doc: examples/benchmarks/README.md |
+| `parseBeirQueriesJsonl` | planned | doc: examples/benchmarks/README.md |
+| `parseJsonlRows` | none | only this package's tests: tests/benchmarks.test.ts:8 |
+| `parseQrels` | planned | doc: examples/benchmarks/README.md |
+| `routing` | planned | doc: docs/building-doctrine.md |
+| `runBenchmarkAdapter` | planned | doc: examples/benchmarks/README.md |
+
+### `./builder-eval`
+
+6 value exports — 6 production, 0 planned, 0 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `BuilderSession` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+| `correlateLayers` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+| `ProjectRegistry` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+| `resumeBuilderSession` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+| `scoreAllProjects` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+| `scoreProject` | production | agent-builder:src/lib/.server/eval/stores/session.ts |
+
+### `./campaign`
+
+117 value exports — 75 production, 15 planned, 27 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `acquireSingleRunLock` | production | agent-knowledge:src/memory/run-control.ts |
+| `analyzeCrossSurfaceInteractions` | none | only this package's tests: src/campaign/cross-surface-interaction.test.ts:2 |
+| `assertCampaignDesign` | production | this package: src/campaign/plan-campaign-run.ts:10 |
+| `assertCampaignSplitIdentity` | production | agent-knowledge:src/memory/experiment/learning-pairs.ts |
+| `assertCodeSurfaceIdentity` | none | — |
+| `assertCompleteSearchHistory` | production | this package: src/campaign/presets/compare-optimization-methods.ts:31 |
+| `assertSearchHistoryMatchesReplay` | planned | doc: docs/search-history-receipts.md |
+| `autoevalsScorerJudge` | none | only this package's tests: src/campaign/upstream-evaluators.test.ts:6 |
+| `buildEvidenceVector` | planned | doc: docs/experiment.md |
+| `buildLoopProvenanceRecord` | none | only this package's tests: src/campaign/provenance-integrity.test.ts:5 |
+| `buildTraceAnalystSurfaceDispatch` | none | only this package's tests: src/campaign/analyst-surface.test.ts:4 |
+| `campaignBreakdown` | production | this package: src/campaign/external-text-evaluation.ts:11 |
+| `campaignMeanComposite` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `campaignMeasurementDigest` | none | only this package's tests: src/campaign/provenance-integrity.test.ts:5 |
+| `campaignScenarioIdentity` | production | agent-runtime:bench/src/swe-arena/premeasured-from-cells.mts |
+| `campaignSplitDigest` | production | agent-runtime:bench/src/swe-arena/premeasured-from-cells.mts |
+| `campaignSplitDigestFromIdentities` | production | agent-runtime:src/improvement/method-identity.ts |
+| `canonicalDigest` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `cellCachePath` | production | discovery-lab:tools/strict-screen.mjs |
+| `classifyUngroundedLiterals` | none | only this package's tests: src/campaign/grounded-reflection.test.ts:2 |
+| `codeSurfaceIdentityMaterial` | none | — |
+| `combineComparisonCosts` | production | this package: src/campaign/external-text-optimization.ts:41 |
+| `compareOptimizationMethods` | production | agent-app:src/eval-campaign/index.ts |
+| `compareRankKeys` | production | this package: src/campaign/presets/run-optimization.ts:29 |
+| `componentSurfaceIdentityMaterial` | none | — |
+| `composeGate` | production | discovery-lab:tools/confirmation-gate.mjs |
+| `costFromLedgerSummary` | production | supervisor-lab:bench/drain/seat.ts |
+| `createProfileMatrixPlan` | production | discovery-lab:tools/run-profile-confirmation.mjs |
+| `createReferenceEquivalenceJudge` | none | only this package's tests: src/reference-equivalence-judge.test.ts:13 |
+| `createRunCostLedger` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `createSearchHistoryReceipt` | production | this package: src/campaign/search-ledger-recording.ts:21 |
+| `crowdedFrontierParent` | planned | doc: docs/campaign-proposers.md |
+| `decodeExternalTextCandidate` | production | agent-runtime:src/improvement/method-execution.ts |
+| `DEFAULT_EXTERNAL_OPTIMIZER_CALLBACK_LIMITS` | none | — |
+| `DEFAULT_EXTERNAL_OPTIMIZER_PROCESS_LIMITS` | none | — |
+| `defaultProductionGate` | production | agent-app:src/eval-campaign/index.ts |
+| `detectScale` | production | this package: src/campaign/gates/promotion-policy.ts:39 |
+| `dimensionRegressions` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-engine.ts |
+| `discoverEvalFixtures` | planned | doc: docs/eval-fixtures.md |
+| `emitLoopProvenance` | production | this package: src/contract/self-improve.ts:27 |
+| `externalTextOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `FileSearchLedger` | none | — |
+| `finalizeProfileMatrix` | production | discovery-lab:tools/run-profile-confirmation.mjs |
+| `fsCampaignStorage` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `FsLabeledScenarioStore` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `gepaOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `gitWorktreeAdapter` | production | agent-runtime:src/improvement/code-execution.ts |
+| `heldOutGate` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-gate.ts |
+| `heldoutSignificance` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `inMemoryCampaignStorage` | production | agent-dev-container:products/sandbox/evals/src/auto-optimization.ts |
+| `isProposedCandidate` | production | supervisor-lab:bench/sequential-arena.ts |
+| `isTransientTransportFailure` | production | gtm-agent:eval/suites/persona.ts |
+| `LabeledScenarioStoreError` | none | only this package's tests: tests/campaign/run-campaign.test.ts:6 |
+| `labelTrustRank` | production | this package: src/campaign/labeled-store/fs-adapter.ts:39 |
+| `llmJudge` | production | agent-runtime:examples/agentic-data-creation/offline-fixtures.ts |
+| `loadEvalFixture` | planned | doc: docs/eval-fixtures.md |
+| `loadEvalFixtureScenarios` | planned | example: examples/eval-fixtures-quickstart/index.ts:11 |
+| `loopProvenanceArgsFromResult` | production | this package: src/contract/self-improve.ts:27 |
+| `loopProvenanceSpans` | none | only this package's tests: src/campaign/provenance-integrity.test.ts:5 |
+| `makePlaybackDispatch` | none | only this package's tests: src/campaign/presets/playback.test.ts:6 |
+| `makeProposalFinding` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `neutralizationGate` | planned | consumer tests: tax-agent:tests/eval/benchmarks/taxcalc/evolve.ts |
+| `neutralizeText` | planned | consumer tests: tax-agent:tests/eval/benchmarks/taxcalc/compile-and-prove/compile-diff.ts |
+| `openAutoPr` | production | this package: src/campaign/presets/run-improvement-loop.ts:7 |
+| `openSearchLedger` | production | this package: src/campaign/gepa-optimization-method.ts:66 |
+| `optimizationTokenUsageFromSummary` | production | this package: src/campaign/external-text-optimization.ts:41 |
+| `pairHoldout` | production | agent-dev-container:products/intelligence/api/src/lib/run-provenance.ts |
+| `paretoPolicy` | none | only this package's tests: src/campaign/gates/promotion-policy.test.ts:3 |
+| `paretoSignificanceGate` | production | agent-app:src/eval-campaign/index.ts |
+| `phoenixEvaluatorJudge` | none | only this package's tests: src/campaign/upstream-evaluators.test.ts:6 |
+| `planCampaignRun` | production | this package: src/campaign/fixtures.ts:5 |
+| `planEvalFixtureRun` | planned | example: examples/eval-fixtures-quickstart/index.ts:11 |
+| `powerPreflight` | production | discovery-lab:tools/run-sequential-profile-improvement.mjs |
+| `ProfileMatrixError` | production | this package: src/campaign/presets/segmented-profile-matrix.ts:22 |
+| `provenanceRecordPath` | planned | consumer tests: agent-dev-container:products/intelligence/api/tests/optimization-engine.test.ts |
+| `provenanceSpansPath` | none | only this package's tests: tests/contract-self-improve.test.ts:25 |
+| `readCachedCell` | production | discovery-lab:tools/strict-screen.mjs |
+| `readExternalOptimizerObservationArtifact` | production | agent-runtime:src/improvement/method-execution.ts |
+| `readGepaCandidatePopulationArtifact` | production | agent-runtime:src/improvement/method-execution.ts |
+| `recordCandidatePopulationSearch` | production | this package: src/campaign/gepa-optimization-method.ts:67 |
+| `renderScoreboardMarkdown` | production | blueprint-agent:scripts/experiments/eval/launch-scoreboard/run.ts |
+| `renderSurfaceDiff` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-evidence-packet.ts |
+| `resolveExternalOptimizerCallbackLimits` | production | this package: src/analyst/dspy-rlm-engine.ts:1 |
+| `resolveExternalOptimizerProcessLimits` | production | this package: src/analyst/benchmark-command-persistence.ts:6 |
+| `resolveRunDir` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `resolveWorktreePath` | none | only this package's tests: tests/campaign/worktree.test.ts:16 |
+| `rolloutArgumentDiff` | none | only this package's tests: src/campaign/grounded-reflection.test.ts:2 |
+| `runCampaign` | production | agent-app:src/eval-campaign/index.ts |
+| `runEval` | production | ai-trading-blueprint:evals/src/sim/multishot-user-sim.ts |
+| `runImprovementLoop` | production | blueprint-agent:scripts/experiments/vb-improve-trajectory.ts |
+| `runOptimization` | production | agent-dev-container:products/sandbox/evals/src/auto-optimization.ts |
+| `runProfileMatrix` | production | agent-runtime:examples/product-eval/product-eval.ts |
+| `runProfileMatrixSegment` | production | discovery-lab:tools/run-profile-confirmation.mjs |
+| `scoreboardSummary` | production | blueprint-agent:scripts/experiments/eval/launch-scoreboard/run.ts |
+| `scoreDiscrimination` | production | supervisor-lab:bench/comms/seat-discrimination.ts |
+| `scoreUserStory` | production | blueprint-agent:scripts/experiments/eval/launch-scoreboard/scoreboard-core.ts |
+| `searchHistoryCoverageRow` | production | this package: src/campaign/presets/compare-optimization-methods.ts:31 |
+| `SearchHistoryRequiredError` | none | only this package's tests: src/campaign/presets/compare-optimization-methods-history.test.ts:7 |
+| `SearchLedgerConflictError` | production | this package: src/campaign/search-ledger.ts:33 |
+| `SearchLedgerError` | production | this package: src/campaign/search-ledger.ts:33 |
+| `SearchLedgerIntegrityError` | production | this package: src/campaign/search-ledger-file.ts:10 |
+| `SearchRecorder` | production | this package: src/campaign/presets/run-optimization.ts:37 |
+| `selectDiscriminative` | none | only this package's tests: src/campaign/scenario-selection.test.ts:2 |
+| `sequentialDecide` | planned | doc: docs/experiment.md |
+| `sequentialPairedGate` | planned | consumer tests: legal-agent:tests/eval/self-improve.ts |
+| `skillOptOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `surfaceContentHash` | production | discovery-lab:tools/run-profile-confirmation.mjs |
+| `surfaceHash` | production | agent-builder:src/lib/.server/eval/loops/evolution-runner.ts |
+| `tangleTracesRoot` | none | only this package's tests: src/campaign/run-dir.test.ts:4 |
+| `traceAnalystQualityJudge` | none | only this package's tests: src/campaign/analyst-surface.test.ts:4 |
+| `transientDispatchFailure` | planned | doc: docs/eval-surface-map.md |
+| `userStoryScoreboard` | production | blueprint-agent:scripts/experiments/eval/launch-scoreboard/run.ts |
+| `validateSearchLedgerEvent` | planned | consumer tests: discovery-lab:tools/search-ledger-planless.test.mjs |
+| `verifyCodeSurface` | production | agent-runtime:src/candidate-execution/builder.ts |
+| `verifyLoopProvenanceRecord` | none | only this package's tests: src/campaign/provenance-integrity.test.ts:5 |
+| `verifySearchHistoryReceipt` | planned | doc: docs/search-history-receipts.md |
+| `WorktreeAdapterError` | none | only this package's tests: tests/campaign/worktree.test.ts:16 |
+
+### `./contract`
+
+64 value exports — 40 production, 6 planned, 18 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `analyzeRuns` | production | agent-builder:eval/scripts/insight-report.ts |
+| `buildDefaultAnalystRegistry` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `buildEvidenceVector` | planned | doc: docs/experiment.md |
+| `campaignSplitDigest` | production | agent-runtime:bench/src/swe-arena/premeasured-from-cells.mts |
+| `compareOptimizationMethods` | production | agent-app:src/eval-campaign/index.ts |
+| `composeGate` | production | discovery-lab:tools/confirmation-gate.mjs |
+| `createChatClient` | production | agent-dev-container:products/intelligence/api/src/lib/intent-audit-analyst.ts |
+| `createReferenceEquivalenceJudge` | none | only this package's tests: src/reference-equivalence-judge.test.ts:13 |
+| `defaultProductionGate` | production | agent-app:src/eval-campaign/index.ts |
+| `defineAgentEval` | planned | example: examples/evaluate-a-change/index.ts:10 |
+| `diffGenerations` | none | only this package's tests: tests/contract-diff.test.ts:2 |
+| `diffRunBaselineToWinner` | none | only this package's tests: tests/contract-diff.test.ts:2 |
+| `diffRuns` | none | only this package's tests: tests/contract-diff.test.ts:2 |
+| `evalReportingSuite` | none | only this package's tests: tests/contract-eval-reporting-suite.test.ts:19 |
+| `evaluatePairedMeasurements` | production | this package: src/contract/profile-measured-comparison.ts:26 |
+| `externalTextOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `FileSystemOutcomeStore` | production | phony:products/builder/api/src/eval/outcomes.ts |
+| `fromClaudeCodeSession` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `fromCodexSession` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `fromFeedbackTable` | planned | example: examples/customer-feedback-loop/index.ts:12 |
+| `fromKimiCodeSession` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `fromOpenCodeSession` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `fromOtelSpans` | production | agent-dev-container:packages/intelligence-kernel/src/deterministic.ts |
+| `fromPiSession` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `fromRunRecordDir` | production | this package: src/contract/eval-reporting-suite.ts:25 |
+| `fsCampaignStorage` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `gepaOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `heldOutGate` | production | agent-dev-container:products/intelligence/api/src/lib/optimization-gate.ts |
+| `inMemoryCampaignStorage` | production | agent-dev-container:products/sandbox/evals/src/auto-optimization.ts |
+| `InMemoryOutcomeStore` | planned | consumer tests: phony:products/builder/api/src/eval/outcomes-correlate.test.ts |
+| `llmJudge` | production | agent-runtime:examples/agentic-data-creation/offline-fixtures.ts |
+| `makeProposalFinding` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `measuredComparisonFromAgentProfileImprovementExperiment` | production | agent-runtime:src/intelligence/authored-profile-improvement.ts |
+| `measuredComparisonFromCandidateExperiment` | production | agent-runtime:src/intelligence/improvement-cycle.ts |
+| `observeCodeAgentSession` | production | this package: src/contract/intake/code-agent-session.ts:13 |
+| `paretoPolicy` | none | only this package's tests: src/campaign/gates/promotion-policy.test.ts:3 |
+| `paretoSignificanceGate` | production | agent-app:src/eval-campaign/index.ts |
+| `parseAgentTrace` | none | only this package's tests: tests/intake-agent-trace.test.ts:3 |
+| `parseCodeAgentJsonl` | planned | named in discovery-lab (bind not in the import graph) |
+| `parseCodeAgentJsonlFile` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `partitionRunsByAuthoringModel` | none | only this package's tests: tests/intake-agent-trace.test.ts:3 |
+| `REFERENCE_EQUIVALENCE_INPUT_LIMITS` | none | only this package's tests: src/reference-equivalence-judge.test.ts:13 |
+| `REFERENCE_EQUIVALENCE_JUDGE_VERSION` | none | only this package's tests: src/reference-equivalence-judge.test.ts:13 |
+| `runAgentProfileImprovementExperiment` | production | agent-runtime:src/intelligence/authored-profile-improvement.ts |
+| `runCampaign` | production | agent-app:src/eval-campaign/index.ts |
+| `runCandidateExperiment` | production | agent-runtime:src/intelligence/improvement-cycle.ts |
+| `runEval` | production | ai-trading-blueprint:evals/src/sim/multishot-user-sim.ts |
+| `runImprovementLoop` | production | blueprint-agent:scripts/experiments/vb-improve-trajectory.ts |
+| `runReferenceEquivalenceJudge` | none | only this package's tests: src/reference-equivalence-judge.test.ts:13 |
+| `sealAgentProfileImprovementExperiment` | production | agent-runtime:src/intelligence/authored-profile-improvement.ts |
+| `sealAgentProfileImprovementSuite` | production | agent-runtime:src/intelligence/profile-improvement-experiment.ts |
+| `sealAgentProfileImprovementTask` | production | agent-runtime:scripts/fixtures/packed-cohort-consumer.ts |
+| `sealCandidateBenchmarkSuite` | production | agent-runtime:bench/scripts/verify-pier-agent.mts |
+| `sealCandidateBenchmarkTask` | production | agent-runtime:bench/scripts/verify-pier-agent.mts |
+| `sealCandidateExperiment` | production | agent-runtime:src/intelligence/improvement-cycle.ts |
+| `selfImprove` | production | agent-app:src/eval-campaign/index.ts |
+| `SelfImproveRunError` | production | agent-dev-container:products/intelligence/api/src/routes/optimizations.ts |
+| `skillOptOptimizationMethod` | production | agent-app:src/eval-campaign/index.ts |
+| `streamCodeAgentJsonlFile` | none | only this package's tests: tests/contract-code-agent-intake.test.ts:6 |
+| `summarizeExecution` | production | traces:src/execution.ts |
+| `transientDispatchFailure` | planned | doc: docs/eval-surface-map.md |
+| `verifyAgentProfileImprovementExperimentComparison` | production | agent-runtime:src/intelligence/authored-profile-improvement.ts |
+| `verifyCandidateExperiment` | production | agent-runtime:src/intelligence/improvement-cycle.ts |
+| `verifyCandidateExperimentComparison` | production | agent-runtime:src/intelligence/improvement-cycle.ts |
+
+### `./experiment`
+
+83 value exports — 43 production, 22 planned, 18 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `amendExperiment` | planned | doc: docs/experiment.md |
+| `assertDesignAdequate` | planned | doc: docs/experiment.md |
+| `assertFunnelReconciles` | none | only this package's tests: tests/experiment/funnel.test.ts:7 |
+| `assertMatchedBudgets` | planned | doc: docs/experiment.md |
+| `benjaminiHochberg` | production | agent-runtime:bench/src/corpus-report.mts |
+| `bonferroni` | planned | doc: docs/design/statistics-decisions.md |
+| `BOOTSTRAP_GATE_MIN_N` | production | discovery-lab:tools/confirmation-activation.mjs |
+| `buildEvidenceVector` | planned | doc: docs/experiment.md |
+| `buildFunnel` | planned | doc: docs/experiment.md |
+| `classifyReissue` | none | only this package's tests: tests/experiment/preregistration-acceptance.test.ts:11 |
+| `clusteredPower` | planned | doc: docs/charter.md |
+| `comparePairedArms` | production | agent-knowledge:src/memory/experiment/learning-metrics.ts |
+| `composeFunnels` | planned | doc: docs/experiment.md |
+| `computeEstimand` | production | this package: src/experiment/define.ts:21 |
+| `computeInterval` | production | this package: src/experiment/define.ts:21 |
+| `createEvidenceReceipt` | planned | consumer tests: agent-runtime:tests/integration/runtime-eval-pursuit-evidence.test.ts |
+| `defineExperiment` | planned | doc: docs/charter.md |
+| `DesignRefusalError` | none | only this package's tests: tests/experiment/power.test.ts:10 |
+| `eProcess` | production | this package: src/campaign/gates/sequential.ts:35 |
+| `evaluateCondition` | planned | named in agent-dev-container (bind not in the import graph) |
+| `evaluateHaltRule` | production | this package: src/experiment/define.ts:21 |
+| `evaluateHypothesis` | none | only this package's tests: tests/tier2.test.ts:8 |
+| `evaluateIdentityGate` | production | this package: src/experiment/define.ts:21 |
+| `evaluateOracleDeterminismGate` | production | this package: src/experiment/define.ts:21 |
+| `evaluatePopulationReproducibilityGate` | production | this package: src/experiment/define.ts:21 |
+| `evaluatePowerFloorGate` | production | this package: src/experiment/define.ts:21 |
+| `evaluatePredicate` | production | this package: src/experiment/funnel.ts:17 |
+| `evaluateProvenanceGate` | production | this package: src/experiment/define.ts:21 |
+| `EVIDENCE_AUTHORITY_KINDS` | none | — |
+| `EVIDENCE_RECEIPT_VERSION` | none | — |
+| `EVIDENCE_STATES` | none | only this package's tests: src/experiment/evidence-record.test.ts:4 |
+| `evidenceRegistryRecordSchema` | none | — |
+| `executeAdmissionRule` | production | this package: src/experiment/define.ts:58 |
+| `executeDecisionRule` | production | this package: src/experiment/define.ts:21 |
+| `ExperimentTracker` | production | phony:products/builder/api/src/eval/evolution.ts |
+| `fileExperimentStore` | production | phony:products/builder/api/src/eval/evolution.ts |
+| `FunnelIntegrityError` | none | only this package's tests: tests/experiment/funnel.test.ts:7 |
+| `hashJson` | production | agent-dev-container:products/intelligence/api/src/lib/ingest-optimization-mapping.ts |
+| `heldoutSignificance` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `holm` | planned | doc: docs/design/statistics-decisions.md |
+| `INDEPENDENT_EVIDENCE_AUTHORITY_KINDS` | none | — |
+| `inMemoryExperimentStore` | none | only this package's tests: src/experiment-tracker.test.ts:2 |
+| `isIndependentEvidence` | planned | consumer tests: agent-runtime:tests/integration/runtime-eval-pursuit-evidence.test.ts |
+| `manifestContentDigest` | production | this package: src/campaign/gates/sequential.ts:34 |
+| `MatchedBudgetError` | none | only this package's tests: tests/experiment/budget-and-seal.test.ts:8 |
+| `mcnemar` | production | agent-runtime:bench/src/swe-arena/analyze.ts |
+| `mcnemarPower` | production | supervisor-lab:bench/deepswe/headroom.ts |
+| `mcnemarRequiredN` | production | blueprint-agent:scripts/experiments/analyze-convergence.ts |
+| `mulberry32` | production | agent-knowledge:src/memory/holdout.ts |
+| `openSealedExperiment` | planned | example: examples/sealed-experiment/index.ts:12 |
+| `pairArms` | production | agent-knowledge:src/memory/experiment/learning-pairs.ts |
+| `pairedBootstrap` | production | agent-builder:frontier/adapters/fleet-eval-runner.ts |
+| `pairedEvalueSequence` | production | creative-agent:src/lib/experiments/ab-design.ts |
+| `pairedMde` | production | discovery-lab:tools/design-gate.mjs |
+| `pairedRiskDifference` | production | blueprint-agent:scripts/experiments/lib/validity-gates.ts |
+| `pairedRiskDifferenceExact` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairedRiskDifferenceScore` | production | this package: src/paired-promotion-decision.ts:51 |
+| `pairHoldout` | production | agent-dev-container:products/intelligence/api/src/lib/run-provenance.ts |
+| `pairRunRecords` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `paretoPolicy` | none | only this package's tests: src/campaign/gates/promotion-policy.test.ts:3 |
+| `paretoSignificanceGate` | production | agent-app:src/eval-campaign/index.ts |
+| `parseEvidenceRegistryRecord` | none | only this package's tests: src/experiment/evidence-record.test.ts:4 |
+| `powerPreflight` | production | discovery-lab:tools/run-sequential-profile-improvement.mjs |
+| `projectNLadderBudget` | production | this package: src/experiment/define.ts:21 |
+| `readField` | planned | named in agent-dev-container (bind not in the import graph) |
+| `renderEvidenceIndex` | none | only this package's tests: src/experiment/evidence-record.test.ts:4 |
+| `renderFunnelTable` | planned | example: examples/sealed-experiment/index.ts:12 |
+| `requiredPairedSampleSize` | production | discovery-lab:tools/design-gate.mjs |
+| `requiredSampleSize` | planned | doc: docs/design/statistics-decisions.md |
+| `runSelectionRule` | production | this package: src/experiment/define.ts:21 |
+| `runUniformPassBudget` | production | this package: src/experiment/define.ts:21 |
+| `sealExperiment` | planned | example: examples/sealed-experiment/index.ts:12 |
+| `SealIntegrityError` | none | only this package's tests: tests/experiment/budget-and-seal.test.ts:8 |
+| `sequentialCrossingHorizon` | none | only this package's tests: tests/sequential.test.ts:2 |
+| `sequentialDecide` | planned | doc: docs/experiment.md |
+| `sequentialPairedGate` | planned | consumer tests: legal-agent:tests/eval/self-improve.ts |
+| `signManifest` | production | phony:products/builder/api/src/eval/champion-sign.ts |
+| `validateEvidenceRegistry` | none | only this package's tests: src/experiment/evidence-record.test.ts:4 |
+| `verifyEvidenceReceipt` | planned | consumer tests: agent-runtime:tests/integration/runtime-eval-pursuit-evidence.test.ts |
+| `verifyManifest` | production | phony:products/builder/api/src/eval/champion-sign.ts |
+| `verifyMatchedBudgets` | production | this package: src/experiment/define.ts:57 |
+| `verifySealedExperiment` | planned | example: examples/sealed-experiment/index.ts:12 |
+| `wilson` | production | agent-dev-container:products/intelligence/api/src/lib/project-analysis-coverage-recommendations.ts |
+
+### `./fuzz`
+
+14 value exports — 11 production, 1 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `adversarialObjective` | production | this package: src/fuzz/explorer.ts:22 |
+| `BehaviorExplorer` | production | this package: src/fuzz/fuzz-agent.ts:9 |
+| `buildCapsule` | production | this package: src/fuzz/explorer.ts:19 |
+| `buildCoverage` | production | this package: src/fuzz/capsule.ts:12 |
+| `cellId` | planned | consumer tests: tax-agent:tests/eval/lib/fuzz-space.ts |
+| `composeGates` | production | creative-agent:eval/lib/fuzz-wiring.ts |
+| `enumerateCells` | production | this package: src/fuzz/explorer.ts:21 |
+| `fuzzAgent` | production | creative-agent:eval/fuzz.ts |
+| `makeExploreTools` | none | only this package's tests: src/fuzz/fuzz-agent.test.ts:8 |
+| `mutationProposer` | production | creative-agent:eval/fuzz.ts |
+| `noveltyObjective` | none | only this package's tests: src/fuzz/fuzz-agent.test.ts:7 |
+| `perturbationStabilityGate` | production | creative-agent:eval/lib/fuzz-wiring.ts |
+| `renderCapsuleHtml` | production | creative-agent:eval/fuzz.ts |
+| `severityFloorGate` | production | creative-agent:eval/lib/fuzz-wiring.ts |
+
+### `./hosted`
+
+11 value exports — 7 production, 2 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `createHostedClient` | production | traces:src/index.ts |
+| `EvalRunEventSchema` | planned | example: examples/hosted-ingest-server/server.ts:33 |
+| `HOSTED_WIRE_VERSION` | production | agent-dev-container:packages/sdk-data/src/sink/intelligence-sink.ts |
+| `hostedClientFromEnv` | production | traces:src/index.ts |
+| `hostedTenantFromEnv` | production | creative-agent:eval/self-improve.ts |
+| `IngestEvalRunsRequestSchema` | production | this package: src/hosted/client.ts:19 |
+| `IngestResponseSchema` | production | this package: src/hosted/client.ts:19 |
+| `IngestTracesRequestSchema` | production | this package: src/hosted/client.ts:19 |
+| `InsightReportSchema` | none | — |
+| `TraceSpanEventSchema` | planned | example: examples/hosted-ingest-server/server.ts:33 |
+| `UnixNanoTimestampSchema` | none | — |
+
+### `./ledger-core`
+
+16 value exports — 15 production, 0 planned, 1 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `appendLedgerLine` | production | this package: src/campaign/search-ledger-file.ts:3 |
+| `AtomicFileLockError` | production | this package: src/ledger-core/journal-file.ts:16 |
+| `canonicalString` | production | this package: src/agent-profile.ts:5 |
+| `FileLedgerJournal` | production | this package: src/campaign/search-ledger.ts:22 |
+| `hashCanonical` | production | discovery-lab:tools/provenance.mjs |
+| `jsonDocument` | production | this package: src/analyst/benchmark-command-artifact.ts:2 |
+| `LEDGER_HASH_PATTERN` | production | this package: src/ledger-core/trusted-head.ts:55 |
+| `LedgerCanonicalizationError` | none | only this package's tests: src/ledger-core/canonical.test.ts:5 |
+| `probeAtomicFileLock` | production | this package: src/campaign/single-run-lock.ts:17 |
+| `readTrustedHeadFile` | production | this package: src/ledger-core/journal.ts:29 |
+| `trustedHeadPathFor` | production | this package: src/ledger-core/journal.ts:29 |
+| `tryAcquireAtomicFileLock` | production | this package: src/campaign/single-run-lock.ts:17 |
+| `tryWithLedgerFileLock` | production | this package: src/campaign/search-ledger-file.ts:3 |
+| `verifyEntriesAgainstTrustedHead` | production | this package: src/ledger-core/journal.ts:29 |
+| `withLedgerFileLock` | production | this package: src/analyst/benchmark-response-cache.ts:6 |
+| `writeLedgerFileAtomically` | production | this package: src/analyst/benchmark-response-cache.ts:6 |
+
+### `./matrix`
+
+3 value exports — 3 production, 0 planned, 0 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `readCellSpend` | production | this package: src/matrix/runner.ts:15 |
+| `runAgentMatrix` | production | blueprint-agent:scripts/experiments/lib/vb-matrix.ts |
+| `withCellSpend` | production | gtm-agent:eval/lib/multishot-graph.ts |
+
+### `./meta-eval`
+
+13 value exports — 10 production, 1 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `calibrationCurve` | none | only this package's tests: tests/meta-eval.test.ts:2 |
+| `correlationStudy` | production | phony:products/builder/api/src/eval/outcomes.ts |
+| `evalHealthStamp` | production | creative-agent:eval/lib/judge-sentinel.ts |
+| `fileSentinelStore` | production | creative-agent:eval/lib/judge-sentinel.ts |
+| `FileSystemOutcomeStore` | production | phony:products/builder/api/src/eval/outcomes.ts |
+| `InMemoryOutcomeStore` | planned | consumer tests: phony:products/builder/api/src/eval/outcomes-correlate.test.ts |
+| `inMemorySentinelStore` | none | only this package's tests: tests/judge-sentinel.test.ts:7 |
+| `judgeSentinelReport` | production | creative-agent:eval/lib/judge-sentinel.ts |
+| `rubricPredictiveValidity` | production | physim:apps/server/src/scripts/agent-eval/validate-rubrics.ts |
+| `snapshotFromAgreement` | production | physim:apps/server/src/scripts/agent-eval/judge-sentinel.ts |
+| `snapshotFromCalibration` | production | gtm-agent:eval/calibrate-judges.ts |
+| `snapshotFromSentinelSet` | production | creative-agent:eval/lib/judge-sentinel.ts |
+| `validateSentinelSnapshot` | production | creative-agent:eval/lib/judge-sentinel.ts |
+
+### `./multishot`
+
+18 value exports — 10 production, 4 planned, 4 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `assertMultishotShotResult` | production | this package: src/multishot/matrix.ts:17 |
+| `computeCellComposite` | planned | consumer tests: tax-agent:tests/eval/multishot.ts |
+| `DEFAULT_CODER_MODEL` | planned | named in blueprint-agent (bind not in the import graph) |
+| `DEFAULT_JUDGE_MODEL` | planned | named in agent-builder (bind not in the import graph) |
+| `defaultDelegationTools` | production | gtm-agent:eval/lib/multishot-graph.ts |
+| `defaultMultishotDriverSystemPrompt` | none | only this package's tests: tests/multishot/shape-defaults.test.ts:10 |
+| `defaultMultishotOpener` | none | only this package's tests: tests/multishot/shape-defaults.test.ts:10 |
+| `defaultShapeFromProfile` | production | gtm-agent:eval/lib/multishot-graph.ts |
+| `estimateMultishotCost` | production | this package: src/multishot/default-tools.ts:8 |
+| `MultishotDriverEmptyError` | production | gtm-agent:eval/lib/multishot-graph.ts |
+| `MultishotFatalToolError` | production | gtm-agent:eval/lib/multishot-graph.ts |
+| `MultishotShotResultError` | none | only this package's tests: tests/multishot/matrix-shot-seam.test.ts:18 |
+| `renderDimensions` | planned | consumer tests: tax-agent:tests/eval/multishot.ts |
+| `renderJsonFooter` | production | gtm-agent:eval/scoring/multishot-judges.ts |
+| `renderPersonaFacts` | none | only this package's tests: tests/multishot/shape-defaults.test.ts:10 |
+| `runJudge` | production | gtm-agent:eval/monitoring/live-soak.ts |
+| `runMultishot` | production | agent-runtime:examples/p1-parity/arms.ts |
+| `runMultishotMatrix` | production | gtm-agent:eval/lib/multishot-matrix-graph.ts |
+
+### `./multishot/golden`
+
+21 value exports — 11 production, 8 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `assertMultishotGoldenScenario` | planned | consumer tests: gtm-agent:eval/lib/multishot-graph.test.ts |
+| `assertMultishotMatrixGoldenScenario` | planned | consumer tests: gtm-agent:eval/lib/multishot-matrix-graph.test.ts |
+| `checkMultishotGolden` | planned | doc: docs/multishot-golden-records.md |
+| `checkMultishotGoldenScenario` | planned | doc: docs/multishot-golden-records.md |
+| `checkMultishotMatrixGoldenScenario` | planned | doc: docs/multishot-golden-records.md |
+| `compareJson` | production | this package: src/multishot/golden/harness.ts:10 |
+| `CURRENT_MULTISHOT_GOLDEN_VERSION` | planned | doc: docs/multishot-golden-records.md |
+| `goldenRecords` | production | this package: src/multishot/golden/harness.ts:23 |
+| `maskVolatileMarkdown` | none | only this package's tests: src/multishot/golden/golden.test.ts:20 |
+| `MultishotGoldenMismatchError` | planned | doc: docs/multishot-golden-records.md |
+| `multishotGoldenScenarios` | production | this package: src/multishot/golden/harness.ts:24 |
+| `multishotGoldenVersions` | none | — |
+| `multishotMatrixGoldenScenarios` | production | this package: src/multishot/golden/harness.ts:12 |
+| `readRunDir` | production | this package: src/multishot/golden/harness.ts:16 |
+| `recordError` | production | this package: src/multishot/golden/harness.ts:16 |
+| `recordJudgeRequest` | production | this package: src/multishot/golden/matrix-scenarios.ts:21 |
+| `recordMessage` | planned | named in agent-dev-container (bind not in the import graph) |
+| `recordRequest` | production | this package: src/multishot/golden/matrix-scenarios.ts:21 |
+| `recordResult` | production | this package: src/multishot/golden/harness.ts:16 |
+| `sortJudgeRequests` | production | this package: src/multishot/golden/harness.ts:16 |
+| `stripVolatile` | production | this package: src/multishot/golden/harness.ts:16 |
+
+### `./pipelines`
+
+8 value exports — 6 production, 0 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `budgetBreachView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `computeToolUseMetrics` | production | traces:src/pipelines.ts |
+| `failureClusterView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `firstDivergenceView` | none | only this package's tests: src/pipelines/first-divergence.test.ts:4 |
+| `judgeAgreementView` | production | insurance-agent:scripts/analyze-agent-eval-evidence.ts |
+| `regressionView` | none | only this package's tests: src/pipelines/regression.test.ts:4 |
+| `stuckLoopView` | production | agent-runtime:src/runtime/supervise/trajectory-recorder.ts |
+| `toolWasteView` | production | agent-runtime:src/runtime/supervise/trajectory-recorder.ts |
+
+### `./profile-cell`
+
+12 value exports — 5 production, 3 planned, 4 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `AGENT_PROFILE_KINDS` | production | blueprint-agent:scripts/experiments/lib/agent-profile-cell.ts |
+| `agentProfileCellHashMaterial` | planned | consumer tests: blueprint-agent:scripts/experiments/lib/__tests__/agent-profile-cell.test.ts |
+| `agentProfileCellKey` | planned | consumer tests: blueprint-agent:scripts/experiments/lib/__tests__/agent-profile-cell.test.ts |
+| `AgentProfileCellValidationError` | none | only this package's tests: tests/agent-profile-cell.test.ts:3 |
+| `assertRunAgentProfileCell` | none | only this package's tests: tests/agent-profile-cell.test.ts:3 |
+| `buildAgentInterfaceProfileCell` | none | only this package's tests: tests/agent-profile-cell.test.ts:3 |
+| `buildAgentProfileCell` | production | ai-trading-blueprint:evals/src/trading/agent-profile-cell.ts |
+| `groupRunsByAgentProfileCell` | planned | consumer tests: legal-agent:tests/eval/matrix-multi.ts |
+| `requireAgentProfileCell` | none | only this package's tests: tests/agent-profile-cell.test.ts:3 |
+| `toAgentProfileJson` | production | blueprint-agent:scripts/experiments/lib/agent-profile-cell.ts |
+| `validateAgentProfileCell` | production | blueprint-agent:apps/web/src/lib/.server/services/leaderboards/submission-profile-config.ts |
+| `verifyAgentProfileCell` | production | this package: src/eval-campaign.ts:39 |
+
+### `./reporting`
+
+15 value exports — 12 production, 2 planned, 1 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `assertReleaseConfidence` | none | only this package's tests: tests/release-confidence.test.ts:4 |
+| `benjaminiHochberg` | production | agent-runtime:bench/src/corpus-report.mts |
+| `bootstrapCi` | production | agent-dev-container:products/intelligence/api/src/lib/analysis-worker.ts |
+| `evaluateInterimReleaseConfidence` | production | agent-builder:scripts/eval.ts |
+| `evaluateReleaseConfidence` | production | agent-knowledge:src/release.ts |
+| `gainHistogram` | production | blueprint-agent:scripts/experiments/vb-runrecord-analysis.ts |
+| `judgeReplayGate` | planned | named in physim (bind not in the import graph) |
+| `pairedBootstrap` | production | agent-builder:frontier/adapters/fleet-eval-runner.ts |
+| `pairedEvalueSequence` | production | creative-agent:src/lib/experiments/ab-design.ts |
+| `paretoChart` | production | workcomp-agent:eval/benchmark/select.ts |
+| `RESEARCH_REPORT_HARD_PAIR_FLOOR` | planned | doc: docs/research-report-methodology.md |
+| `researchReport` | production | this package: src/eval-campaign.ts:58 |
+| `rubricPredictiveValidity` | production | physim:apps/server/src/scripts/agent-eval/validate-rubrics.ts |
+| `summaryTable` | production | blueprint-agent:scripts/experiments/vb-runrecord-analysis.ts |
+| `wilcoxonSignedRank` | production | agent-builder:src/lib/.server/eval/loops/differential-eval.ts |
+
+### `./rl`
+
+65 value exports — 18 production, 15 planned, 32 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `ABSENT_CATEGORY` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `appendToCorpus` | none | only this package's tests: src/rl/corpus.test.ts:6 |
+| `applyEloUpdate` | none | only this package's tests: tests/rl-tournament.test.ts:2 |
+| `bestOfN` | planned | named in agent-runtime (bind not in the import graph) |
+| `bucketLabel` | planned | named in agent-dev-container (bind not in the import graph) |
+| `buildDatasetFromCorpus` | none | only this package's tests: src/rl/corpus.test.ts:6 |
+| `buildPairwiseFromCampaign` | none | only this package's tests: tests/rl-tournament.test.ts:2 |
+| `buildRlDataset` | production | this package: src/rl/corpus.ts:24 |
+| `buildVerifiedFindingRow` | none | only this package's tests: src/rl/verified-findings-dataset.test.ts:5 |
+| `campaignToRunRecords` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `compareAdaptationCurves` | planned | doc: docs/design/statistics-decisions.md |
+| `datasheetToMarkdown` | none | only this package's tests: src/rl/dataset.test.ts:7 |
+| `defaultBehaviorFeatures` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `detectRewardHacking` | production | agent-builder:scripts/eval.ts |
+| `doublyRobust` | planned | consumer tests: agent-knowledge:tests/memory-holdout.test.ts |
+| `easyModeCheck` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `extractPreferences` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `extractStepRewards` | none | only this package's tests: tests/rl-process-reward.test.ts:3 |
+| `extractVerifiableReward` | planned | named in gtm-agent (bind not in the import graph) |
+| `extractVerifiableRewardsFromRecords` | production | creative-agent:eval/canonical-export.ts |
+| `FileSystemOutcomeStore` | production | phony:products/builder/api/src/eval/outcomes.ts |
+| `filterDeterministicallyRewarded` | production | this package: src/rl/reward-hacking.ts:43 |
+| `firstPassK` | none | only this package's tests: tests/rl-adaptation-eval.test.ts:3 |
+| `fitBradleyTerry` | none | only this package's tests: tests/rl-tournament.test.ts:2 |
+| `injectIrrelevantClause` | none | only this package's tests: tests/rl-contamination.test.ts:2 |
+| `InMemoryOutcomeStore` | planned | consumer tests: phony:products/builder/api/src/eval/outcomes-correlate.test.ts |
+| `inverseProbabilityWeighting` | planned | consumer tests: agent-knowledge:tests/memory-holdout.test.ts |
+| `jsDivergence` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `loadVerifiedFindingsDataset` | planned | doc: docs/verified-labels-flywheel.md |
+| `observationsFromRunRecords` | none | only this package's tests: tests/rl-active-curriculum.test.ts:3 |
+| `offPolicyEstimateAll` | none | only this package's tests: tests/rl-off-policy.test.ts:3 |
+| `paretoFrontier` | production | agent-dev-container:products/sandbox/evals/run.ts |
+| `PredictiveValidityResearcher` | none | only this package's tests: tests/rl-predictive-validity-researcher.test.ts:4 |
+| `prmTrainingPairs` | planned | doc: examples/fine-tune-with-prime-rl/README.md |
+| `quantileEdges` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `readCorpus` | planned | named in agent-runtime (bind not in the import graph) |
+| `renameVariables` | none | only this package's tests: tests/rl-contamination.test.ts:2 |
+| `runAdaptationCurve` | none | only this package's tests: tests/rl-adaptation-eval.test.ts:3 |
+| `runComputeCurve` | none | only this package's tests: tests/rl-adversarial-and-compute.test.ts:2 |
+| `runContaminationProbe` | none | only this package's tests: tests/rl-contamination.test.ts:2 |
+| `runEvalCampaign` | production | agent-builder:scripts/eval.ts |
+| `runRLCampaign` | planned | named in creative-agent (bind not in the import graph) |
+| `runwiseStepRewardSummary` | none | only this package's tests: tests/rl-process-reward.test.ts:3 |
+| `selfConsistency` | none | only this package's tests: tests/rl-adversarial-and-compute.test.ts:2 |
+| `selfNormalizedImportanceWeighting` | planned | consumer tests: agent-knowledge:tests/memory-holdout.test.ts |
+| `shuffleOrder` | none | — |
+| `simFidelityReport` | none | only this package's tests: src/rl/sim-fidelity.test.ts:3 |
+| `stepRewardsToJsonl` | none | only this package's tests: src/rollout/gate-properties.test.ts:38 |
+| `summarizeVerifiedFindings` | none | only this package's tests: src/rl/verified-findings-dataset.test.ts:5 |
+| `thompsonCurriculum` | planned | doc: docs/design/statistics-decisions.md |
+| `toAnthropicFormat` | production | blueprint-agent:scripts/experiments/lib/steering-dataset.ts |
+| `toDpoJsonl` | production | this package: src/rl/dataset.ts:27 |
+| `toDpoRows` | production | this package: src/rl/dataset.ts:27 |
+| `toGrpoJsonl` | production | this package: src/rl/dataset.ts:27 |
+| `toGrpoRows` | production | this package: src/rl/dataset.ts:27 |
+| `toPrmJsonl` | none | only this package's tests: tests/rl-exporters.test.ts:2 |
+| `toPrmRows` | planned | doc: docs/rollout.md |
+| `toSftJsonl` | production | this package: src/rl/dataset.ts:27 |
+| `toSftRows` | production | this package: src/rl/dataset.ts:27 |
+| `toTRLFormat` | production | blueprint-agent:scripts/experiments/lib/steering-dataset.ts |
+| `validateDatasetFormats` | planned | example: examples/publish-rl-dataset/build-dataset.ts:30 |
+| `varianceBasedCurriculum` | production | this package: src/fuzz/explorer.ts:18 |
+| `verificationReportToRunRecord` | none | only this package's tests: tests/rl-adapters.test.ts:5 |
+| `VERIFIED_FINDING_SCHEMA` | none | only this package's tests: src/rl/verified-findings-dataset.test.ts:5 |
+| `verifiedFindingsToJsonl` | none | only this package's tests: src/rl/verified-findings-dataset.test.ts:5 |
+
+### `./rollout`
+
+67 value exports — 49 production, 8 planned, 10 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `addScrubCounts` | production | this package: src/rollout/release/hf-dataset.ts:34 |
+| `appendRolloutLines` | production | agent-runtime:bench/src/rollout-ledger/settle-capture.mts |
+| `assertGateReport` | production | this package: src/rollout/release/card.ts:12 |
+| `assertMinted` | production | blueprint-agent:scripts/experiments/lib/steering-dataset.ts |
+| `assertMintedLines` | planned | consumer tests: agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.test.mts |
+| `assertRolloutLine` | production | this package: src/rollout/interchange/harbor.ts:60 |
+| `ATIF_SCHEMA_VERSION` | none | only this package's tests: src/rollout/interchange/harbor.test.ts:6 |
+| `buildDatasetCard` | production | this package: src/rollout/release/hf-dataset.ts:25 |
+| `buildHfDataset` | production | supervisor-lab:bench/vertical-rollout-package.ts |
+| `claudeProjectSlug` | planned | consumer tests: agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.test.mts |
+| `DEFAULT_CLAUDE_PROJECTS_DIR` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `DEFAULT_OPENCODE_DB` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `defaultRolloutScrubber` | production | supervisor-lab:bench/vertical-rollout-package.ts |
+| `emptyScrubCounts` | production | this package: src/rollout/release/hf-dataset.ts:34 |
+| `findClaudeTranscripts` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `findOpencodeSessionsByDirectory` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `FORMAT_FILES` | production | this package: src/rollout/release/hf-dataset.ts:25 |
+| `FORMAT_GATE_DISPOSITION` | production | this package: src/rollout/release/card.ts:12 |
+| `fromHarborTrajectory` | planned | doc: docs/rollout.md |
+| `GATE_CHECK_IDS` | production | this package: src/rollout/release/gate-report.ts:47 |
+| `GATE_CHECKS` | planned | doc: docs/rollout.md |
+| `GATE_POLICIES` | production | this package: src/rollout/release/gate-report.ts:47 |
+| `gatedEvidenceOf` | production | this package: src/rollout/schema.ts:50 |
+| `gatedRolloutIds` | production | this package: src/rollout/release/hf-dataset.ts:26 |
+| `gateErrors` | production | this package: src/rollout/schema.ts:50 |
+| `gateGamedOutcome` | none | only this package's tests: src/rollout/gate-properties.test.ts:56 |
+| `HARBOR_IMPORT_GAP` | none | only this package's tests: src/rollout/interchange/harbor.test.ts:6 |
+| `isRealnessGated` | production | starter-foundry:src/lib/held-out-gate.ts |
+| `isRolloutLine` | production | this package: src/supervisor-run/rollout-nodes.ts:26 |
+| `isTrainableSplit` | production | this package: src/rollout/release/hf-dataset.ts:24 |
+| `measureFormatGate` | production | this package: src/rollout/release/hf-dataset.ts:26 |
+| `mintRolloutRows` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `observedScore` | production | this package: src/rl/active-curriculum.ts:34 |
+| `observedSplitScore` | production | starter-foundry:src/lib/held-out-gate.ts |
+| `openOpencodeDb` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `parseRolloutReleaseArgs` | none | only this package's tests: src/rollout/release/hf-dataset.test.ts:9 |
+| `planPushCommand` | none | only this package's tests: src/rollout/release/hf-dataset.test.ts:9 |
+| `readClaudeTranscript` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `readOpencodeSessionMessages` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `readRolloutJournal` | none | only this package's tests: src/rollout/ledger.test.ts:6 |
+| `readRolloutLedger` | production | this package: src/rollout/release/hf-dataset.ts:23 |
+| `relabelImportedSplit` | planned | doc: docs/rollout.md |
+| `RELEASE_FORMATS` | production | this package: src/rollout/release/hf-dataset.ts:25 |
+| `releaseRowRefs` | production | this package: src/rollout/release/hf-dataset.ts:26 |
+| `ROLLOUT_CAPTURES` | production | this package: src/rollout/interchange/harbor.ts:60 |
+| `ROLLOUT_ROLES` | production | this package: src/rollout/interchange/harbor.ts:60 |
+| `ROLLOUT_SCHEMA` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+| `ROLLOUT_SPLITS` | production | this package: src/rollout/interchange/harbor.ts:60 |
+| `runRolloutReleaseCli` | production | this package: src/cli.ts:18 |
+| `scoreOrigin` | production | this package: src/rollout/mint.ts:38 |
+| `scrubLines` | production | supervisor-lab:bench/vertical-rollout-package.ts |
+| `scrubRolloutLine` | none | only this package's tests: src/rollout/release/scrub.test.ts:4 |
+| `scrubText` | none | only this package's tests: src/rollout/release/scrub.test.ts:4 |
+| `toHarborTrajectories` | planned | doc: docs/rollout.md |
+| `toHarborTrajectory` | planned | doc: docs/rollout.md |
+| `toJsonl` | production | supervisor-lab:bench/vertical-rollout-package.ts |
+| `toRewardRows` | planned | doc: docs/rollout.md |
+| `toRftItem` | none | only this package's tests: src/rollout/reward-invariant.test.ts:33 |
+| `toRftItems` | production | this package: src/rollout/release/hf-dataset.ts:22 |
+| `toSftRows` | production | this package: src/rl/dataset.ts:27 |
+| `toVerifiersRolloutOutput` | none | only this package's tests: src/rollout/exporters.test.ts:2 |
+| `toVerifiersRolloutOutputs` | production | this package: src/rollout/release/hf-dataset.ts:22 |
+| `trainingReward` | production | supervisor-lab:bench/vertical-gate-proof.ts |
+| `trainingScore` | production | this package: src/eval-trace-store.ts:20 |
+| `unmintableReasons` | production | supervisor-lab:bench/mint-audit.ts |
+| `validateRolloutLine` | production | this package: src/supervisor-run/integrity-tree.ts:1 |
+| `writeRolloutLedger` | production | agent-runtime:bench/src/rollout-ledger/backfill-swe-arena.mts |
+
+### `./storyboard`
+
+9 value exports — 5 production, 2 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `codeEditFromSpan` | none | only this package's tests: src/storyboard/code-edit.test.ts:4 |
+| `codeEditsForStoryboard` | none | only this package's tests: src/storyboard/code-edit.test.ts:4 |
+| `compileStoryboard` | production | run-capsule:src/index.ts |
+| `editAnimationText` | planned | named in run-capsule (bind not in the import graph) |
+| `extractCodeEdits` | production | run-capsule:src/index.ts |
+| `reduceToSemanticEvents` | production | run-capsule:src/artifacts.ts |
+| `renderCodeAnimationHtml` | planned | named in run-capsule (bind not in the import graph) |
+| `renderStoryboardHtml` | production | run-capsule:src/index.ts |
+| `renderStoryboardMarkdown` | production | run-capsule:src/index.ts |
+
+### `./supervisor-run`
+
+29 value exports — 21 production, 4 planned, 4 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `analyzeSupervisorRun` | production | discovery-lab:pursuits/agent-authored-runtime-control-deepseek-20260812h/workspaces/runtime-control-deps/runtime-control.mjs |
+| `analyzeSupervisorRunIntegrity` | production | discovery-lab:pursuits/final-agent-authored-campaign-20260810/materialize-candidates.mjs |
+| `analyzeSupervisorRunSources` | production | discovery-lab:experiments/0005-run-visibility/probe.mjs |
+| `claudeCodeSupervisorRunReader` | none | only this package's tests: src/supervisor-run/claude-code-reader.test.ts:6 |
+| `findSupervisorRunDirIn` | none | only this package's tests: src/supervisor-run/loops-reader.test.ts:11 |
+| `findSupervisorRunDirs` | production | traces:src/cli.ts |
+| `isRuntimeSupervisorRunDir` | production | discovery-lab:tools/disco.mjs |
+| `isUnavailable` | production | discovery-lab:tools/disco.mjs |
+| `loopsSupervisorRunReader` | planned | named in traces (bind not in the import graph) |
+| `NO_SOURCE_LIMITS` | production | traces:src/supervisor-run-context.ts |
+| `parsePatch` | planned | named in browser-agent-driver (bind not in the import graph) |
+| `parseSupervisorTree` | production | discovery-lab:experiments/0005-run-visibility/probe.mjs |
+| `readClaudeCodeSupervisorRun` | none | only this package's tests: src/supervisor-run/claude-code-reader.test.ts:6 |
+| `readLoopsSupervisorRun` | planned | named in discovery-lab (bind not in the import graph) |
+| `readRuntimeSupervisorRun` | production | discovery-lab:pursuits/final-agent-authored-campaign-20260810/materialize-candidates.mjs |
+| `renderSupervisorRollupMarkdown` | production | traces:src/cli.ts |
+| `renderSupervisorRunHeadline` | production | discovery-lab:experiments/0005-run-visibility/probe.mjs |
+| `renderSupervisorRunMarkdown` | production | agent-runtime:bench/src/swe-arena/run-report.mts |
+| `reportSupervisorRound` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+| `rollupSupervisorRuns` | production | discovery-lab:tools/disco.mjs |
+| `runtimeSupervisorRunReader` | none | only this package's tests: src/supervisor-run/index.test.ts:2 |
+| `showMeasured` | production | this package: src/supervisor-run/render.ts:8 |
+| `SUPERVISOR_RUN_INTEGRITY_SCHEMA` | production | this package: src/supervisor-run/integrity.ts:4 |
+| `SUPERVISOR_RUN_ROLLUP_SCHEMA` | production | this package: src/supervisor-run/analyze.ts:18 |
+| `SUPERVISOR_RUN_SCHEMA` | production | this package: src/supervisor-run/analyze.ts:18 |
+| `supervisorRunRolloutLines` | planned | consumer tests: discovery-lab:tools/runtime-journal-eval.test.mjs |
+| `unavailable` | production | this package: src/supervisor-run/analyze.ts:18 |
+| `writeSupervisorRunReport` | production | agent-runtime:bench/src/swe-arena/run-report.mts |
+| `writeSupervisorRunReportSafe` | production | agent-runtime:bench/src/swe-arena/outer-loop.mts |
+
+### `./trace-attributes`
+
+28 value exports — 26 production, 1 planned, 1 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `applyLlmSpanOtlpAttributes` | production | traces:src/adapters/claude.ts |
+| `asNumber` | planned | named in agent-app (bind not in the import graph) |
+| `contextInputTokens` | none | only this package's tests: tests/trace-otel.test.ts:3 |
+| `firstNumberAttr` | production | traces:src/file-export.ts |
+| `INPUT_VALUE` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_CACHE_WRITE_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_CACHE_WRITE_TOKENS` | production | traces:src/adapters/claude.ts |
+| `LLM_CACHED_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_CACHED_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_CONTEXT_TOKENS` | production | this package: src/trace-analyst/behavioral-metrics.ts:11 |
+| `LLM_COST_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_COST_USD` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_INPUT_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_INPUT_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_MODEL_ATTR_KEYS` | production | this package: src/contract/intake/otel-spans.ts:44 |
+| `LLM_MODEL_NAME` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_OUTPUT_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_OUTPUT_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_REASONING_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_REASONING_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `OPENINFERENCE_SPAN_KIND` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `OUTPUT_VALUE` | production | agent-runtime:src/runtime/supervise-surface.ts |
+| `RUN_COST_ATTR_KEYS` | production | this package: src/trace/execution-measurements.ts:2 |
+| `SPAN_KIND_ATTR_KEYS` | production | traces:src/run-span-tree.ts |
+| `TOOL_ARGS_CAPTURED` | production | this package: src/trace/otlp-attributes.ts:3 |
+| `TOOL_LATENCY_MS` | production | this package: src/trace/otlp-attributes.ts:3 |
+| `TOOL_NAME` | production | supervisor-lab:bench/analyst/rewrite-views.mts |
+| `TOOL_NAME_ATTR_KEYS` | production | this package: src/trace/otlp-attributes.ts:3 |
+
+### `./trace-repair`
+
+96 value exports — 40 production, 31 planned, 25 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `ADMISSION_CONFIG_DEFAULTS` | planned | doc: docs/trace-repair-admission.md |
+| `ADMISSION_EXCLUSION_MEANING` | production | this package: src/trace-repair/admission-report.ts:11 |
+| `ADMISSION_EXCLUSION_ORDER` | production | this package: src/trace-repair/admission-report.ts:11 |
+| `ADMISSION_STRATA` | production | this package: src/trace-repair/admission-report.ts:11 |
+| `admissionArtifact` | planned | doc: docs/trace-repair-admission.md |
+| `AdmissionDenominatorError` | production | this package: src/trace-repair/admission.ts:36 |
+| `AdmissionIndependenceError` | none | only this package's tests: src/trace-repair/admission.test.ts:19 |
+| `admitRow` | production | this package: tests/trace-repair/fixtures.ts:11 |
+| `admittedCount` | planned | named in agent-knowledge (bind not in the import graph) |
+| `admittedRowIds` | none | only this package's tests: src/trace-repair/admission.test.ts:3 |
+| `askRepairArm` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `assertAnalystIndependent` | production | this package: src/trace-repair/admission.ts:36 |
+| `assertArmSymmetry` | production | this package: src/trace-repair/admission.ts:52 |
+| `assertChainReconciles` | production | this package: src/trace-repair/admission-report.ts:11 |
+| `assertControlCalibrated` | production | this package: src/trace-repair/admission-contract.ts:39 |
+| `assertDenominatorIntact` | planned | doc: docs/design/statistics-decisions.md |
+| `assertDeterministicOracle` | planned | doc: docs/design/statistics-decisions.md |
+| `assertDspyRepairEngine` | none | only this package's tests: tests/trace-repair/arm-dspy.test.ts:19 |
+| `BLINDED_FIELDS` | none | only this package's tests: tests/trace-repair/admission.test.ts:3 |
+| `blindTrajectory` | production | this package: src/trace-repair/analyst-arm.ts:41 |
+| `buildDenominatorChain` | production | this package: src/trace-repair/admission.ts:36 |
+| `checkInterventionBudget` | production | this package: src/trace-repair/analyst-arm.ts:33 |
+| `classifyActionPayload` | none | only this package's tests: tests/trace-repair/action-budget.test.ts:2 |
+| `continuationPolicyDigest` | production | this package: src/trace-repair/admission.ts:52 |
+| `ContinuationPolicyViolationError` | none | only this package's tests: src/trace-repair/continuation-policy.test.ts:11 |
+| `continuationSeed` | planned | doc: docs/trace-repair-continuation.md |
+| `ContinuationSymmetryError` | none | only this package's tests: src/trace-repair/continuation-policy.test.ts:11 |
+| `CONTROL_SCREENING_MODES` | production | this package: src/trace-repair/admission.ts:58 |
+| `controlCanRescue` | none | only this package's tests: tests/trace-repair/control-policy.test.ts:4 |
+| `countFunnel` | production | this package: src/trace-repair/delta-repair.ts:27 |
+| `createCompletionRepairArm` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `createDockerContinuationEnvironment` | planned | doc: docs/trace-repair-continuation.md |
+| `createDspyRepairArm` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `CREDIT_TERMS` | none | only this package's tests: tests/trace-repair/degenerate-strategies.test.ts:8 |
+| `defineControlPolicy` | production | this package: tests/trace-repair/fixtures.ts:16 |
+| `definePinnedContinuationPolicy` | planned | doc: docs/trace-repair-admission.md |
+| `DEGENERATE_STRATEGIES` | planned | doc: docs/trace-repair-grader.md |
+| `deltaRepair` | planned | doc: README.md |
+| `dockerRunArgs` | none | only this package's tests: src/trace-repair/docker-environment.test.ts:3 |
+| `DSPY_REPAIR_SIGNATURE` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `DSPY_REPAIR_TASK_TOKEN` | none | only this package's tests: tests/trace-repair/arm-dspy.test.ts:19 |
+| `dspyRepairInstructions` | none | only this package's tests: tests/trace-repair/arm-dspy.test.ts:19 |
+| `gradeRepairRow` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `injectedTestOracle` | planned | doc: docs/trace-repair-grader.md |
+| `isRecordedTimeout` | production | this package: src/trace-repair/grade.ts:51 |
+| `MINI_SWE_SYSTEM_MESSAGE` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `NO_DECISIVE_FAILURE` | none | only this package's tests: tests/trace-repair/analyst-response.test.ts:2 |
+| `NO_OP_ACTIONS` | none | — |
+| `nodeProcessRunner` | planned | doc: docs/trace-repair-continuation.md |
+| `NondeterministicOracleError` | none | only this package's tests: tests/trace-repair/oracle-determinism.test.ts:4 |
+| `noOpInjectionStep` | none | only this package's tests: src/trace-repair/admission.test.ts:3 |
+| `normalizeActionForComparison` | production | this package: src/trace-repair/grade.ts:31 |
+| `oracleDeterminism` | production | this package: tests/trace-repair/fixtures.ts:18 |
+| `OUTPUT_ELISION_THRESHOLD` | none | only this package's tests: src/trace-repair/mini-swe-scaffold.test.ts:2 |
+| `parseAction` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `parseAnalystResponse` | planned | doc: docs/trace-repair-grader.md |
+| `parseTaskOracleRegistry` | planned | doc: docs/trace-repair-admission.md |
+| `renderAdmissionReport` | planned | doc: docs/trace-repair-admission.md |
+| `renderDeltaRepairReport` | planned | doc: docs/trace-repair-grader.md |
+| `renderFormatErrorObservation` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `renderInstanceMessage` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `renderObservation` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `renderRepairTrajectory` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `renderTimeoutObservation` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `REPAIR_CONTRACT_LINES` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `REPAIR_QUESTION` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `REPAIR_REPAIR_CONTRACT_LINES` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `repairArmAsymmetries` | planned | doc: docs/charter.md |
+| `repairArmPromptSha256` | production | this package: src/trace-repair/analyst-arm.ts:42 |
+| `repairArmResponse` | planned | doc: docs/trace-repair-analyst-arms.md |
+| `repairCredit` | production | this package: src/trace-repair/grade.ts:40 |
+| `repairFinding` | none | only this package's tests: tests/trace-repair/analyst-response.test.ts:2 |
+| `repairQuestionSha256` | production | this package: src/trace-repair/analyst-arm.ts:42 |
+| `repairTaskDefinition` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `repairTaskPolicy` | production | this package: src/trace-repair/arm-dspy.ts:48 |
+| `repairTrajectoryHeader` | production | this package: src/trace-repair/arm-completion.ts:37 |
+| `resolveAdmissionConfig` | none | only this package's tests: src/trace-repair/admission.test.ts:3 |
+| `rolloutDigest` | planned | doc: docs/trace-repair-continuation.md |
+| `rolloutRecordedSteps` | planned | doc: docs/trace-repair-continuation.md |
+| `runAdmission` | planned | doc: docs/trace-repair-admission.md |
+| `runContinuation` | planned | doc: docs/trace-repair-continuation.md |
+| `SCAFFOLD_INTERVENTION_BUDGET` | production | this package: src/trace-repair/arm-completion.ts:27 |
+| `scanShellAction` | none | only this package's tests: tests/trace-repair/action-budget.test.ts:2 |
+| `stratumOf` | production | this package: src/trace-repair/admission.ts:36 |
+| `submissionOf` | production | this package: src/trace-repair/continuation-policy.ts:28 |
+| `SUBMIT_SENTINEL` | production | this package: src/trace-repair/action-budget.ts:19 |
+| `SUITE_REWARD_UNIT` | none | only this package's tests: tests/trace-repair/oracle-determinism.test.ts:4 |
+| `taskOracleRegistry` | none | only this package's tests: src/trace-repair/admission-report.test.ts:7 |
+| `TB_REPAIR_ADMISSION_CRITERIA` | none | only this package's tests: tests/trace-repair/admission.test.ts:2 |
+| `TestOracleError` | none | only this package's tests: tests/trace-repair/test-oracle.test.ts:3 |
+| `testSuiteDigest` | production | this package: tests/trace-repair/fixtures.ts:34 |
+| `TestSuiteTamperedError` | planned | doc: docs/trace-repair-grader.md |
+| `toRecordedSteps` | none | only this package's tests: src/trace-repair/continuation-policy.test.ts:25 |
+| `totalCost` | planned | doc: examples/adapt-a-text-optimizer/README.md |
+| `totalUsage` | planned | named in agent-builder (bind not in the import graph) |
+| `UncalibratedControlError` | planned | doc: docs/trace-repair-admission.md |
+
+### `./traces`
+
+112 value exports — 94 production, 7 planned, 11 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `aggregateLlm` | production | this package: src/meta-eval/correlation-study.ts:14 |
+| `analyzeTraces` | production | agent-builder:src/lib/.server/eval/analysts/canonical-trace-analyst.ts |
+| `applyLlmSpanOtlpAttributes` | production | traces:src/adapters/claude.ts |
+| `applyToolSpanOtlpAttributes` | production | braid:src/adapters/analysis/trace-store.ts |
+| `argHash` | production | agent-runtime:src/runtime/supervise/detector-monitor.ts |
+| `asNumber` | planned | named in agent-app (bind not in the import graph) |
+| `assertRunCaptured` | production | creative-agent:eval/canonical-runner.ts |
+| `asString` | planned | named in agent-app (bind not in the import graph) |
+| `buildTraceAnalysisToolDescriptors` | production | this package: src/analyst/tool-groups.ts:14 |
+| `buildTraceInsightContext` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html-sections.ts |
+| `buildTraceInsightPrompt` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/brief.ts |
+| `captureFetchToRawSink` | production | creative-agent:eval/canonical-runner.ts |
+| `classifyOtlpSpanRole` | production | this package: src/contract/intake/otel-spans.ts:44 |
+| `contextInputTokens` | none | only this package's tests: tests/trace-otel.test.ts:3 |
+| `convertTraceStoresToOtlp` | planned | consumer tests: legal-agent:tests/eval/lib/traces-to-otlp.ts |
+| `createBoundedTraceAnalysisStore` | production | braid:src/adapters/analysis/trace-store.ts |
+| `createOtelExporter` | planned | doc: docs/adapters-observability.md |
+| `createOtelTracingStore` | none | only this package's tests: tests/trace-contracts.test.ts:4 |
+| `DEFAULT_REDACTION_RULES` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `DEFAULT_TRACE_ANALYST_BUDGETS` | production | agent-builder:src/lib/.server/eval/stores/d1-trace-analysis-store-adapter.ts |
+| `defaultProviderRedactor` | production | this package: src/llm-client.ts:34 |
+| `defaultTraceInsightPanel` | none | only this package's tests: src/trace-analyst/insights.test.ts:3 |
+| `describeTraceInsightScope` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html.ts |
+| `domainEvidencePattern` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/session-loader.ts |
+| `exportRunAsOtlp` | production | agent-builder:src/lib/.server/eval/analysts/canonical-trace-analyst.ts |
+| `extractOtlpAttributes` | production | this package: src/trace-analyst/store-otlp.ts:40 |
+| `extractUsage` | production | this package: src/contract/intake/code-agent-session.ts:12 |
+| `extractUsageFromResponse` | none | only this package's tests: src/trace/extract-usage.test.ts:2 |
+| `extractUsageFromSse` | production | this package: src/trace/capture-fetch.ts:8 |
+| `FAILURE_CLASSES` | production | agent-dev-container:products/intelligence/api/src/lib/deep-trace-analyst.ts |
+| `FileSystemRawProviderSink` | production | agent-builder:scripts/eval.ts |
+| `FileSystemTraceStore` | production | agent-builder:scripts/eval.ts |
+| `firstNumberAttr` | production | traces:src/file-export.ts |
+| `firstStringAttr` | production | this package: src/trace-analyst/otlp-to-run-records.ts:63 |
+| `flattenOtlpExportToNdjson` | production | creative-agent:eval/trace-analyst-runner.ts |
+| `groupBy` | production | this package: src/tool-use-metrics.ts:10 |
+| `hasCapturedToolArgs` | production | this package: src/pipelines/failure-cluster.ts:10 |
+| `inferDomainKeywords` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/suite-projection.ts |
+| `InMemoryRawProviderSink` | production | agent-builder:src/lib/.server/eval/loops/canonical-campaign.ts |
+| `InMemoryTraceStore` | production | agent-builder:src/lib/.server/eval/loops/auto-research-runner.ts |
+| `INPUT_VALUE` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `isJudgeSpan` | production | this package: src/trace/query.ts:12 |
+| `isLlmSpan` | production | agent-runtime:src/candidate-execution/finalize.ts |
+| `isOtlpModelCall` | production | this package: src/contract/intake/otel-spans.ts:44 |
+| `isToolSpan` | production | agent-runtime:src/runtime/supervise/trace-evidence.ts |
+| `judgeSpans` | production | this package: src/builder-eval/three-layer-eval.ts:25 |
+| `LLM_CACHE_WRITE_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_CACHE_WRITE_TOKENS` | production | traces:src/adapters/claude.ts |
+| `LLM_CACHED_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_CACHED_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_CONTEXT_TOKENS` | production | this package: src/trace-analyst/behavioral-metrics.ts:11 |
+| `LLM_COST_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_COST_USD` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_INPUT_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_INPUT_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_MODEL_ATTR_KEYS` | production | this package: src/contract/intake/otel-spans.ts:44 |
+| `LLM_MODEL_NAME` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_OUTPUT_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_OUTPUT_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `LLM_REASONING_TOKEN_ATTR_KEYS` | production | traces:src/file-export.ts |
+| `LLM_REASONING_TOKENS` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `llmSpans` | production | phony:products/builder/api/src/eval/replay.ts |
+| `NoopRawProviderSink` | production | agent-dev-container:products/intelligence/api/src/lib/eval-engine.ts |
+| `OPENINFERENCE_SPAN_KIND` | production | braid:src/adapters/analysis/trace-event-projection.ts |
+| `OTEL_AGENT_EVAL_SCOPE` | production | this package: src/trace/otel-export.ts:10 |
+| `OtlpFileTraceStore` | production | agent-builder:scripts/run-canonical-analyst-loop.ts |
+| `otlpRowsToRunRecords` | production | traces:src/execution.ts |
+| `otlpRowsToTraceRunRecords` | none | — |
+| `otlpTextToTraceAnalysisStore` | production | braid:src/adapters/analysis/trace-store.ts |
+| `otlpToRunRecords` | production | traces:src/execution.ts |
+| `otlpToTraceRunRecords` | none | only this package's tests: src/trace-analyst/otlp-to-run-records.test.ts:3 |
+| `OUTPUT_VALUE` | production | agent-runtime:src/runtime/supervise-surface.ts |
+| `planTraceInsightQuestions` | none | only this package's tests: src/trace-analyst/insights.test.ts:3 |
+| `projectOtlpFlatLine` | production | this package: src/trace-analyst/otlp-to-run-records.ts:63 |
+| `providerFromBaseUrl` | production | this package: src/llm-client.ts:34 |
+| `REDACTION_VERSION` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `redactString` | production | agent-dev-container:products/intelligence/api/src/lib/redact.ts |
+| `redactValue` | production | traces:src/index.ts |
+| `RUN_COST_ATTR_KEYS` | production | this package: src/trace/execution-measurements.ts:2 |
+| `runFailureClass` | production | starter-foundry:registry/layers/agent-eval/redteam/files/src/eval/redteam/runner.ts |
+| `RunIntegrityError` | production | creative-agent:eval/canonical-runner.ts |
+| `runsForScenario` | production | phony:products/builder/api/src/eval/gate.ts |
+| `scoreTraceInsightReadiness` | production | blueprint-agent:scripts/experiments/lib/analyze-vb-run/report-html-sections.ts |
+| `SPAN_KIND_ATTR_KEYS` | production | traces:src/run-span-tree.ts |
+| `SpanNotFoundError` | production | this package: src/trace-analyst/store-boundary.ts:1 |
+| `stringField` | planned | named in agent-dev-container (bind not in the import graph) |
+| `throwIfRunIncomplete` | none | only this package's tests: tests/run-integrity.test.ts:3 |
+| `tokenizeDomainWords` | planned | consumer tests: blueprint-agent:scripts/experiments/__tests__/analyze-vb-run.test.ts |
+| `TOOL_ARGS_CAPTURED` | production | this package: src/trace/otlp-attributes.ts:3 |
+| `TOOL_LATENCY_MS` | production | this package: src/trace/otlp-attributes.ts:3 |
+| `TOOL_NAME` | production | supervisor-lab:bench/analyst/rewrite-views.mts |
+| `TOOL_NAME_ATTR_KEYS` | production | this package: src/trace/otlp-attributes.ts:3 |
+| `toolSpans` | production | this package: src/pipelines/failure-cluster.ts:10 |
+| `toolSpansToTraceAnalysisStore` | production | agent-runtime:src/runtime/supervise/trace-evidence.ts |
+| `ToolTraceMissingError` | none | only this package's tests: src/trace-analyst/store-tool-spans.test.ts:10 |
+| `TRACE_ANALYSIS_LIMITS` | production | this package: src/analyst/benchmark-evidence-validation.ts:1 |
+| `TRACE_ANALYST_ACTOR_DESCRIPTION` | production | this package: src/trace-analyst/analyst.ts:11 |
+| `TRACE_ANALYST_ACTOR_DESCRIPTION_VERSION` | production | this package: src/trace-analyst/analyst.ts:11 |
+| `TRACE_ANALYST_TOOL_NAMESPACE` | none | only this package's tests: src/trace-analyst/tools.test.ts:4 |
+| `TRACE_ANALYST_TRUNCATION_MARKER_PREFIX` | production | agent-runtime:src/analyst-loop/iterations-to-trace-store.ts |
+| `TRACE_SCHEMA_VERSION` | production | skeletal-os:src/eval/agentEvalBridge.ts |
+| `TraceAnalysisLimitError` | production | this package: src/trace-analyst/store-bounds.ts:3 |
+| `TraceAnalysisStoreContractError` | production | this package: src/trace-analyst/store-boundary.ts:1 |
+| `TraceAnalysisValidationError` | production | this package: src/trace-analyst/store-boundary.ts:1 |
+| `traceAnalystFunctionGroup` | none | only this package's tests: src/trace-analyst/tools.test.ts:4 |
+| `traceAnalystOnRunComplete` | planned | named in creative-agent (bind not in the import graph) |
+| `TraceEmitter` | production | agent-builder:src/lib/.server/runtime/trace-runtime.ts |
+| `TraceFileMalformedError` | production | this package: src/trace-analyst/store-otlp.ts:31 |
+| `TraceFileMissingError` | production | this package: src/trace-analyst/store-otlp.ts:31 |
+| `TraceFileTooLargeError` | production | this package: src/trace-analyst/store-otlp.ts:31 |
+| `TraceNotFoundError` | production | this package: src/trace-analyst/store-boundary.ts:1 |
+| `traceSpanKindToOpenInferenceKind` | production | this package: src/trace/otel-export.ts:11 |
+
+### `./trajectory-replay`
+
+49 value exports — 24 production, 19 planned, 6 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `assertReplayableTrajectory` | none | only this package's tests: tests/trajectory-replay/steps.test.ts:7 |
+| `buildFixPrompt` | production | this package: src/trajectory-replay/fix-loop.ts:17 |
+| `buildRetryFixPrompt` | production | this package: src/trajectory-replay/fix-loop.ts:17 |
+| `classifyObservation` | planned | doc: docs/trajectory-replay.md |
+| `classifyPrefixStep` | none | only this package's tests: tests/trajectory-replay/verify.test.ts:14 |
+| `classifyVerdict` | planned | named in agent-builder (bind not in the import graph) |
+| `clipText` | production | this package: src/trajectory-replay/fix-loop.ts:17 |
+| `countScriptCommands` | production | this package: src/trajectory-replay/fix-loop.ts:17 |
+| `decodeRecordedTurns` | planned | doc: docs/trajectory-replay.md |
+| `derivedImageTag` | planned | named in traces (bind not in the import graph) |
+| `deriveFailureSignature` | production | this package: src/trace-repair/grade.ts:25 |
+| `dockerImagePreparer` | production | this package: src/trajectory-replay/batch.ts:41 |
+| `enumerateReplayableCases` | production | this package: src/trajectory-replay/batch.ts:32 |
+| `extractFixCommand` | production | this package: src/trajectory-replay/fix-loop.ts:17 |
+| `finalRecordedOutcome` | planned | doc: docs/trajectory-replay.md |
+| `findingReplayStep` | planned | named in traces (bind not in the import graph) |
+| `findingTrajectoryId` | planned | named in traces (bind not in the import graph) |
+| `FORMAT_ERROR_OBSERVATION_PREFIX` | production | this package: src/trace-repair/mini-swe-scaffold.ts:17 |
+| `generateFixCommand` | production | this package: src/trajectory-replay/batch.ts:39 |
+| `goldIncorrectSteps` | planned | named in traces (bind not in the import graph) |
+| `ingestRecordedTrajectory` | production | this package: src/trajectory-replay/batch.ts:42 |
+| `isElidedField` | none | only this package's tests: tests/trajectory-replay/steps.test.ts:7 |
+| `isRecordedTimeout` | production | this package: src/trace-repair/grade.ts:51 |
+| `isSubmitAction` | production | this package: src/trajectory-replay/corpus.ts:19 |
+| `isSubmitOnlyAction` | none | only this package's tests: tests/trajectory-replay/steps.test.ts:7 |
+| `parseCorpusFlag` | planned | named in traces (bind not in the import graph) |
+| `parseIncorrectStepsSubject` | production | this package: src/trajectory-replay/findings.ts:41 |
+| `parseObservationOutput` | production | this package: src/trajectory-replay/corpus.ts:19 |
+| `parseRecordedReturncode` | production | this package: src/trace-repair/grade.ts:25 |
+| `PREFIX_DIVERGENCE_TOLERANCE_PCT` | production | this package: src/trajectory-replay/batch.ts:42 |
+| `readFindingsFile` | planned | named in traces (bind not in the import graph) |
+| `readLabelEntries` | planned | named in traces (bind not in the import graph) |
+| `renderBatchReport` | planned | named in traces (bind not in the import graph) |
+| `renderVerifiedFindingsSection` | planned | named in traces (bind not in the import graph) |
+| `replayVerify` | production | this package: src/trajectory-replay/batch.ts:42 |
+| `replayVerifyFinding` | planned | doc: docs/trajectory-replay.md |
+| `resolveCaseResources` | production | this package: src/trajectory-replay/findings.ts:36 |
+| `resolveFindingInvocation` | planned | named in traces (bind not in the import graph) |
+| `resolveFindingReplayability` | planned | named in traces (bind not in the import graph) |
+| `runFixLoop` | production | this package: src/trajectory-replay/batch.ts:40 |
+| `runReplayBatch` | planned | doc: docs/trajectory-replay.md |
+| `SandboxCounterfactualRunner` | production | this package: src/trajectory-replay/batch.ts:42 |
+| `seededSample` | planned | named in traces (bind not in the import graph) |
+| `SUBMIT_ACTION_SIGNATURE` | production | this package: src/trace-repair/mini-swe-scaffold.ts:17 |
+| `summarizePrefixReplay` | none | only this package's tests: tests/trajectory-replay/verify.test.ts:14 |
+| `TIMEOUT_OBSERVATION_MARKER` | production | this package: src/trace-repair/mini-swe-scaffold.ts:17 |
+| `unreadableExitCount` | none | only this package's tests: tests/trajectory-replay/steps.test.ts:7 |
+| `verifyFindings` | planned | doc: docs/trajectory-replay.md |
+| `wrapActionForExec` | production | this package: src/trace-repair/grade.ts:24 |
+
+### `./wire`
+
+30 value exports — 25 production, 3 planned, 2 none.
+
+| symbol | consumer | evidence |
+| --- | --- | --- |
+| `buildOpenApi` | production | this package: src/cli.ts:20 |
+| `createApp` | planned | doc: docs/wire-protocol.md |
+| `dispatchRpc` | planned | doc: docs/wire-protocol.md |
+| `ErrorResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `FeedbackIngestResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `FeedbackTrajectorySchema` | production | insurance-agent:src/routes/api.feedback.ts |
+| `getBuiltinRubric` | production | this package: src/wire/handlers.ts:21 |
+| `handleFeedbackIngest` | production | this package: src/wire/server.ts:20 |
+| `handleJudge` | production | this package: src/wire/rpc.ts:15 |
+| `handleListRubrics` | production | this package: src/wire/rpc.ts:15 |
+| `handleTracesIngest` | production | this package: src/wire/server.ts:20 |
+| `handleVersion` | production | this package: src/cli.ts:19 |
+| `hashRubric` | production | this package: src/wire/handlers.ts:22 |
+| `HealthResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `JudgeRequestSchema` | production | this package: src/wire/openapi.ts:15 |
+| `JudgeResultSchema` | production | this package: src/wire/openapi.ts:15 |
+| `listBuiltinRubrics` | production | this package: src/wire/handlers.ts:21 |
+| `ListRubricsResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `RubricDimensionSchema` | none | only this package's tests: tests/wire/schemas.test.ts:11 |
+| `RubricSchema` | none | only this package's tests: tests/wire/schemas.test.ts:11 |
+| `runRpcBatch` | production | this package: src/cli.ts:21 |
+| `runRpcOnce` | production | this package: src/cli.ts:21 |
+| `startServer` | production | creative-agent:eval/ingestion-server.ts |
+| `startServerAsync` | production | this package: src/cli.ts:22 |
+| `TraceEventSchema` | planned | named in insurance-agent (bind not in the import graph) |
+| `TracesIngestRequestSchema` | production | this package: src/wire/openapi.ts:15 |
+| `TracesIngestResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `VersionResponseSchema` | production | this package: src/wire/openapi.ts:15 |
+| `WIRE_VERSION` | production | this package: src/wire/handlers.ts:22 |
+| `WireError` | production | this package: src/wire/rpc.ts:15 |