@tangle-network/agent-knowledge 13.0.1 → 14.0.0

package/CHANGELOG.md

@@ -1,5 +1,30 @@
 # Changelog
 
+## 14.0.0 — 2026-09-05
+
+### Changed
+
+- `ResearchDriver` gains optional `isComplete()`.
+The research loop requires this result and storage readiness before it reports ready.
+An unfinished driver receives steering rounds even when storage requirements pass.
+Drivers without this method retain their storage readiness behavior.
+The exported interface shape requires a major release under the package compatibility check.
+- Requires `agent-eval` `>=0.174.0 <0.175.0` and tests against `0.174.0`.
+This cohort uses Eval's corrected complete-method result and cost accounting contracts.
+- Default knowledge evaluator version `2` averages only measured dimensions.
+It omits `answer_quality` without answer evaluation, `promotion_decision` without a decision, and `blocking_readiness` without blocking requirements.
+Consumers must handle absent dimension keys and compare scores using their evaluator version.
+Structural-only results state that no task outcome evaluation occurred.
+`candidate-ready` still leaves the candidate detached from the live knowledge base.
+
+### Fixed
+
+- Knowledge diagnosis runs before acquisition and updates.
+One lifecycle carries findings, acquisition, and update results into final answer checks and the promotion decision.
+Diagnosis alone does not consume final evaluation cases.
+Disabling a required phase fails before candidate work starts.
+Final measurement still uses frozen candidate bytes and cannot feed another adaptive update.
+
 ## 13.0.1 — 2026-09-01
 
 ### Changed

package/README.md

@@ -309,10 +309,18 @@ Reusing a run ID with a different implementation reference fails before cached w
 Different run IDs create separate candidate workspaces, so workers can explore in parallel.
 Promotion checks the original base hash and rejects a stale candidate instead of replacing newer work.
 Candidate retries use `evaluateDevelopment` when provided, otherwise they use deterministic validation, readiness, and KB quality checks.
+Diagnosis runs before acquisition and updates, using development data only.
+Its findings and update results remain available to final answer checks and the promotion decision.
 Development evaluation must use only train or selection data.
 The configured `evaluate` callback and final RAG phases run once, on the first candidate that passes those development checks.
 A failed final evaluation ends the run instead of selecting another candidate against final data.
 
+The default evaluator reports only measured dimensions and averages those dimensions with equal weight.
+It omits `answer_quality` without answer evaluation, `promotion_decision` without a promotion decision, and `blocking_readiness` without blocking readiness requirements.
+Default evaluator version `2` records this weighting.
+A candidate can pass structural checks without any task outcome evaluation; the metric notes state this limit.
+`candidate-ready` means the configured checks passed and the candidate remains detached from the live knowledge base.
+
 Candidate promotion currently requires Linux because it relies on Linux directory descriptors for exact file identity.
 
 ## Evaluate and improve RAG

package/dist/benchmarks/index.js

@@ -1,2 +1,2 @@
-import { F as buildIndustryRagBenchmarkSmokeCases, H as createInMemoryBenchmarkAdapter, I as respondToIndustryMemoryBenchmarkSmokeCase, L as respondToIndustryRagBenchmarkSmokeCase, M as INDUSTRY_RAG_BENCHMARKS, N as buildFirstPartyMemoryLifecycleBenchmarkCases, P as buildIndustryMemoryBenchmarkSmokeCases, R as isKnowledgeMemoryBenchmarkCase, U as createNoopMemoryBenchmarkAdapter, a as buildKnowledgeBenchmarkScenarios, c as runKnowledgeBenchmarkSuite, d as summarizeKnowledgeBenchmarkCampaign, i as runMemoryAdapterBenchmark, j as INDUSTRY_MEMORY_BENCHMARKS, l as scoreKnowledgeBenchmarkArtifact, n as parseKnowledgeBenchmarkJsonl, o as knowledgeBenchmarkJudge, r as parseKnowledgeBenchmarkQrels, s as renderKnowledgeBenchmarkReportMarkdown, t as buildRetrievalBenchmarkCasesFromQrels, u as scoreMemoryBenchmarkArtifact } from "../benchmarks-Qk94Gnj4.js";
+import { F as buildIndustryRagBenchmarkSmokeCases, H as createNoopMemoryBenchmarkAdapter, I as respondToIndustryMemoryBenchmarkSmokeCase, L as respondToIndustryRagBenchmarkSmokeCase, M as INDUSTRY_RAG_BENCHMARKS, N as buildFirstPartyMemoryLifecycleBenchmarkCases, P as buildIndustryMemoryBenchmarkSmokeCases, R as isKnowledgeMemoryBenchmarkCase, V as createInMemoryBenchmarkAdapter, a as buildKnowledgeBenchmarkScenarios, c as runKnowledgeBenchmarkSuite, d as summarizeKnowledgeBenchmarkCampaign, i as runMemoryAdapterBenchmark, j as INDUSTRY_MEMORY_BENCHMARKS, l as scoreKnowledgeBenchmarkArtifact, n as parseKnowledgeBenchmarkJsonl, o as knowledgeBenchmarkJudge, r as parseKnowledgeBenchmarkQrels, s as renderKnowledgeBenchmarkReportMarkdown, t as buildRetrievalBenchmarkCasesFromQrels, u as scoreMemoryBenchmarkArtifact } from "../benchmarks-BbPJdmHe.js";
 export { INDUSTRY_MEMORY_BENCHMARKS, INDUSTRY_RAG_BENCHMARKS, buildFirstPartyMemoryLifecycleBenchmarkCases, buildIndustryMemoryBenchmarkSmokeCases, buildIndustryRagBenchmarkSmokeCases, buildKnowledgeBenchmarkScenarios, buildRetrievalBenchmarkCasesFromQrels, createInMemoryBenchmarkAdapter, createNoopMemoryBenchmarkAdapter, isKnowledgeMemoryBenchmarkCase, knowledgeBenchmarkJudge, parseKnowledgeBenchmarkJsonl, parseKnowledgeBenchmarkQrels, renderKnowledgeBenchmarkReportMarkdown, respondToIndustryMemoryBenchmarkSmokeCase, respondToIndustryRagBenchmarkSmokeCase, runKnowledgeBenchmarkSuite, runMemoryAdapterBenchmark, scoreKnowledgeBenchmarkArtifact, scoreMemoryBenchmarkArtifact, summarizeKnowledgeBenchmarkCampaign };

package/dist/{benchmarks-Qk94Gnj4.js → benchmarks-BbPJdmHe.js}

@@ -4,6 +4,28 @@ import { randomUUID } from "node:crypto";
 import { join } from "node:path";
 import { canonicalJson } from "@tangle-network/agent-eval";
 import { acquireSingleRunLock, createRunCostLedger, fsCampaignStorage, resolveRunDir, runCampaign } from "@tangle-network/agent-eval/campaign";
+//#region src/statistics.ts
+/**
+* The mean of a set of measurements.
+*
+* A measurement that is not a finite number is not a measurement: it is a
+* scorer that divided by zero or an adapter that answered with nothing usable.
+* Averaging it in would spread one broken probe across the whole aggregate,
+* and carrying it through would make the aggregate itself unusable — a
+* non-finite `scoreMean` fails every numeric comparison in the ranking
+* comparator, so the candidate carrying it falls through to the identifier
+* tie-break and places by name rather than by what it scored. Such values are
+* left out, and the mean reports what was actually measured.
+*
+* An empty set answers `0`. That is a reported score, not an absence, and it
+* is the behavior every caller in this package already depends on.
+*/
+function mean(values) {
+	const finite = values.filter(Number.isFinite);
+	if (finite.length === 0) return 0;
+	return finite.reduce((sum, value) => sum + value, 0) / finite.length;
+}
+//#endregion
 //#region src/retrieval-eval.ts
 function retrievalConfigSurface(config) {
 	return canonicalJson(config);
@@ -449,28 +471,6 @@ function rankCandidates(rows) {
 	}));
 }
 //#endregion
-//#region src/statistics.ts
-/**
-* The mean of a set of measurements.
-*
-* A measurement that is not a finite number is not a measurement: it is a
-* scorer that divided by zero or an adapter that answered with nothing usable.
-* Averaging it in would spread one broken probe across the whole aggregate,
-* and carrying it through would make the aggregate itself unusable — a
-* non-finite `scoreMean` fails every numeric comparison in the ranking
-* comparator, so the candidate carrying it falls through to the identifier
-* tie-break and places by name rather than by what it scored. Such values are
-* left out, and the mean reports what was actually measured.
-*
-* An empty set answers `0`. That is a reported score, not an absence, and it
-* is the behavior every caller in this package already depends on.
-*/
-function mean(values) {
-	const finite = values.filter(Number.isFinite);
-	if (finite.length === 0) return 0;
-	return finite.reduce((sum, value) => sum + value, 0) / finite.length;
-}
-//#endregion
 //#region src/benchmarks/utils.ts
 function unique(values) {
 	return [...new Set(values.filter(Boolean))];
@@ -2819,6 +2819,6 @@ function defaultDocumentTarget(documentId, targetKind) {
 	}
 }
 //#endregion
-export { reserveRecoveryAttempts as A, normalizeUsd as B, sleepForMemoryRecovery as C, hasSettledPaidCall as D, assertNoInterruptedPaidCalls as E, buildIndustryRagBenchmarkSmokeCases as F, memoryWriteResultToSourceRecord as G, createInMemoryBenchmarkAdapter as H, respondToIndustryMemoryBenchmarkSmokeCase as I, retrievalConfigFromSurface as J, buildRetrievalEvalDispatch as K, respondToIndustryRagBenchmarkSmokeCase as L, INDUSTRY_RAG_BENCHMARKS as M, buildFirstPartyMemoryLifecycleBenchmarkCases as N, readActiveAttemptJournal as O, buildIndustryMemoryBenchmarkSmokeCases as P, isKnowledgeMemoryBenchmarkCase as R, runBoundedMemoryLifecycle as S, appendDurableJournalEvent as T, createNoopMemoryBenchmarkAdapter as U, rankCandidates as V, memoryHitToSourceRecord as W, retrievalRecallJudge as X, retrievalConfigSurface as Y, scoreRetrievalArtifact as Z, MEMORY_OPERATION_CANCELLATION_TIMEOUT_MS as _, buildKnowledgeBenchmarkScenarios as a, memoryRecoveryDelayMs as b, runKnowledgeBenchmarkSuite as c, summarizeKnowledgeBenchmarkCampaign as d, acquireAgentMemoryRunLease as f, MEMORY_CAMPAIGN_DISPATCH_SHUTDOWN_TIMEOUT_MS as g, DEFAULT_MEMORY_CLEANUP_TIMEOUT_MS as h, runMemoryAdapterBenchmark as i, INDUSTRY_MEMORY_BENCHMARKS as j, reconcileInterruptedMemoryPaidCalls as k, scoreKnowledgeBenchmarkArtifact as l, AgentMemoryLifecycleUnsafeError as m, parseKnowledgeBenchmarkJsonl as n, knowledgeBenchmarkJudge as o, AgentMemoryLifecycleTimeoutError as p, partitionRetrievalScenarios as q, parseKnowledgeBenchmarkQrels as r, renderKnowledgeBenchmarkReportMarkdown as s, buildRetrievalBenchmarkCasesFromQrels as t, scoreMemoryBenchmarkArtifact as u, createBoundedMemoryAdapter as v, appendAttemptJournalEvent as w, resolveMemoryCleanupTimeoutMs as x, createMemoryExecutionPool as y, mean as z };
+export { reserveRecoveryAttempts as A, rankCandidates as B, sleepForMemoryRecovery as C, hasSettledPaidCall as D, assertNoInterruptedPaidCalls as E, buildIndustryRagBenchmarkSmokeCases as F, buildRetrievalEvalDispatch as G, createNoopMemoryBenchmarkAdapter as H, respondToIndustryMemoryBenchmarkSmokeCase as I, retrievalConfigSurface as J, partitionRetrievalScenarios as K, respondToIndustryRagBenchmarkSmokeCase as L, INDUSTRY_RAG_BENCHMARKS as M, buildFirstPartyMemoryLifecycleBenchmarkCases as N, readActiveAttemptJournal as O, buildIndustryMemoryBenchmarkSmokeCases as P, isKnowledgeMemoryBenchmarkCase as R, runBoundedMemoryLifecycle as S, appendDurableJournalEvent as T, memoryHitToSourceRecord as U, createInMemoryBenchmarkAdapter as V, memoryWriteResultToSourceRecord as W, scoreRetrievalArtifact as X, retrievalRecallJudge as Y, mean as Z, MEMORY_OPERATION_CANCELLATION_TIMEOUT_MS as _, buildKnowledgeBenchmarkScenarios as a, memoryRecoveryDelayMs as b, runKnowledgeBenchmarkSuite as c, summarizeKnowledgeBenchmarkCampaign as d, acquireAgentMemoryRunLease as f, MEMORY_CAMPAIGN_DISPATCH_SHUTDOWN_TIMEOUT_MS as g, DEFAULT_MEMORY_CLEANUP_TIMEOUT_MS as h, runMemoryAdapterBenchmark as i, INDUSTRY_MEMORY_BENCHMARKS as j, reconcileInterruptedMemoryPaidCalls as k, scoreKnowledgeBenchmarkArtifact as l, AgentMemoryLifecycleUnsafeError as m, parseKnowledgeBenchmarkJsonl as n, knowledgeBenchmarkJudge as o, AgentMemoryLifecycleTimeoutError as p, retrievalConfigFromSurface as q, parseKnowledgeBenchmarkQrels as r, renderKnowledgeBenchmarkReportMarkdown as s, buildRetrievalBenchmarkCasesFromQrels as t, scoreMemoryBenchmarkArtifact as u, createBoundedMemoryAdapter as v, appendAttemptJournalEvent as w, resolveMemoryCleanupTimeoutMs as x, createMemoryExecutionPool as y, normalizeUsd as z };
 
-//# sourceMappingURL=benchmarks-Qk94Gnj4.js.map
+//# sourceMappingURL=benchmarks-BbPJdmHe.js.map