@tangle-network/agent-eval 0.114.0 → 0.115.1
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/CHANGELOG.md +22 -0
- package/README.md +1 -1
- package/dist/analyst/index.js +2 -2
- package/dist/benchmarks/index.js +2 -2
- package/dist/campaign/index.d.ts +612 -7
- package/dist/campaign/index.js +18 -2
- package/dist/{chunk-HJWNHCD5.js → chunk-AN5UYSVD.js} +43 -1
- package/dist/chunk-AN5UYSVD.js.map +1 -0
- package/dist/{chunk-4FRTXH2M.js → chunk-I2HNIE6N.js} +3 -44
- package/dist/chunk-I2HNIE6N.js.map +1 -0
- package/dist/{chunk-VHPD6AXX.js → chunk-KDCMEZDI.js} +4830 -2480
- package/dist/chunk-KDCMEZDI.js.map +1 -0
- package/dist/index.d.ts +4 -158
- package/dist/index.js +6 -153
- package/dist/index.js.map +1 -1
- package/dist/openapi.json +1 -1
- package/dist/{pre-registration-CTQbZbpX.d.ts → pre-registration-oNItiRBb.d.ts} +155 -1
- package/package.json +1 -1
- package/dist/chunk-4FRTXH2M.js.map +0 -1
- package/dist/chunk-HJWNHCD5.js.map +0 -1
- package/dist/chunk-VHPD6AXX.js.map +0 -1
package/CHANGELOG.md
CHANGED
|
@@ -4,6 +4,28 @@ All notable changes to `@tangle-network/agent-eval` and its sibling `agent-eval-
|
|
|
4
4
|
|
|
5
5
|
---
|
|
6
6
|
|
|
7
|
+
## [0.115.1] — 2026-07-11 — fair cross-surface baseline selection
|
|
8
|
+
|
|
9
|
+
### Fixed
|
|
10
|
+
|
|
11
|
+
- `analyzeCrossSurfaceInteractions()` now builds the naive stack only from single-surface candidates that satisfy individual eligibility.
|
|
12
|
+
Complete, non-regressing neutral constituents remain available exclusively to interaction-aware search, preserving pure-synergy discovery without weakening the naive comparison.
|
|
13
|
+
|
|
14
|
+
This patch corrects selection semantics without changing the report schema.
|
|
15
|
+
Consumers comparing naive and interaction-aware compositions should update.
|
|
16
|
+
|
|
17
|
+
## [0.115.0] — 2026-07-11 — auditable cross-surface improvement search
|
|
18
|
+
|
|
19
|
+
### Added
|
|
20
|
+
|
|
21
|
+
- `openSearchLedger()` records the predeclared candidate, task, and operation denominators for an improvement search in a durable hash-chained event stream.
|
|
22
|
+
Failed proposal slots, partial batches, task attempts, measured cost, surface firing and effect, and terminal selection decisions remain replayable after a crash.
|
|
23
|
+
- `analyzeCrossSurfaceInteractions()` compares fixed, best-single, blind-union, and interaction-aware agent changes on the same task rows.
|
|
24
|
+
It preserves missing and invalid attempts, cost, firing, effect, synergy, interference, and every evaluated composition path, including combinations whose constituents are neutral alone.
|
|
25
|
+
|
|
26
|
+
This release is additive.
|
|
27
|
+
Existing consumers do not need to update unless they want durable improvement-search accounting or cross-surface composition.
|
|
28
|
+
|
|
7
29
|
## [0.114.0] — 2026-07-11 — exact directional paired inference
|
|
8
30
|
|
|
9
31
|
### Added
|
package/README.md
CHANGED
|
@@ -127,7 +127,7 @@ Each example: `README.md` + a single `index.ts` runnable via `pnpm tsx`. Prints
|
|
|
127
127
|
| `…/adapters/otel` | `createOtelBridge` — forwards OpenTelemetry-shape spans into the hosted-tier ingest, no `@opentelemetry/*` dependency |
|
|
128
128
|
| `…/adapters/langchain` | Wrap any LangChain `Runnable` as a `Dispatch` (or `JudgeConfig`), no `@langchain/core` peer dep |
|
|
129
129
|
| `…/adapters/http` | `httpDispatch` + `runDispatchServer` — run a campaign's worker on another machine (multi-region, remote worker execution) |
|
|
130
|
-
| `…/campaign` | **The measurement + improvement engine**: `runProfileMatrix`, `compareProposers`, every surface proposer (`gepaProposer`, `fapoProposer`, `parameterSweepProposer`, `haloProposer`, `skillOptProposer`, `aceProposer`, `memoryCurationProposer`, …), the gates, storage backends, and loop provenance. `/contract` re-exports the app-facing subset. |
|
|
130
|
+
| `…/campaign` | **The measurement + improvement engine**: `runProfileMatrix`, `compareProposers`, `analyzeCrossSurfaceInteractions`, every surface proposer (`gepaProposer`, `fapoProposer`, `parameterSweepProposer`, `haloProposer`, `skillOptProposer`, `aceProposer`, `memoryCurationProposer`, …), the gates, storage backends, and loop provenance. `/contract` re-exports the app-facing subset. |
|
|
131
131
|
| `…/rl` | Bridge from eval artifacts to training signal: verifiable rewards, preferences, OPE, tournaments, contamination, compute curves, trainer-format exporters, process rewards, plus the durable corpus + `buildRlDataset` / datasheet bundle |
|
|
132
132
|
| `…/reporting` | Release-decision statistics: `pairedBootstrap`, `benjaminiHochberg`, anytime-valid sequential e-values, `evaluateReleaseConfidence`, and the report renderers |
|
|
133
133
|
| `…/analyst` | The trace-analyst surface: `AnalystRegistry` + `buildDefaultAnalystRegistry` (run the failure-clustering panel), `FindingsStore`, and the LLM chat transports |
|
package/dist/analyst/index.js
CHANGED
|
@@ -11,7 +11,7 @@ import {
|
|
|
11
11
|
diffFindings,
|
|
12
12
|
emitSkillUsageFindings,
|
|
13
13
|
runSemanticConceptJudge
|
|
14
|
-
} from "../chunk-
|
|
14
|
+
} from "../chunk-I2HNIE6N.js";
|
|
15
15
|
import {
|
|
16
16
|
behavioralAnalyst,
|
|
17
17
|
buildDefaultAnalystRegistry,
|
|
@@ -33,7 +33,7 @@ import {
|
|
|
33
33
|
policyEditsFromFindings,
|
|
34
34
|
scorePolicyEditReadiness,
|
|
35
35
|
validatePolicyEdit
|
|
36
|
-
} from "../chunk-
|
|
36
|
+
} from "../chunk-AN5UYSVD.js";
|
|
37
37
|
import {
|
|
38
38
|
ANALYST_SEVERITIES,
|
|
39
39
|
AnalystRegistry,
|
package/dist/benchmarks/index.js
CHANGED
|
@@ -17,11 +17,11 @@ import {
|
|
|
17
17
|
runBenchmarkAdapter,
|
|
18
18
|
summarizeBenchmarkCampaign
|
|
19
19
|
} from "../chunk-3LXTCTWL.js";
|
|
20
|
-
import "../chunk-
|
|
20
|
+
import "../chunk-KDCMEZDI.js";
|
|
21
21
|
import "../chunk-N6MTC3GK.js";
|
|
22
22
|
import "../chunk-VI2UW6B6.js";
|
|
23
23
|
import "../chunk-FAOEFFRT.js";
|
|
24
|
-
import "../chunk-
|
|
24
|
+
import "../chunk-AN5UYSVD.js";
|
|
25
25
|
import "../chunk-DWLIGZBX.js";
|
|
26
26
|
import "../chunk-ARU2PZFM.js";
|
|
27
27
|
import "../chunk-PJQFMIOX.js";
|