@tangle-network/agent-eval 0.176.0 → 0.177.0

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (37) hide show
  1. package/CHANGELOG.md +16 -0
  2. package/dist/adapters/http.d.ts +1 -1
  3. package/dist/analyst/index.d.ts +1 -1
  4. package/dist/analyst/index.js +1 -1
  5. package/dist/{benchmark-command-yPqjcZnC.js → benchmark-command-BrsZhMSk.js} +2 -2
  6. package/dist/{benchmark-command-yPqjcZnC.js.map → benchmark-command-BrsZhMSk.js.map} +1 -1
  7. package/dist/benchmarks/index.d.ts +1 -1
  8. package/dist/benchmarks/index.js +2 -2
  9. package/dist/campaign/index.d.ts +2 -2
  10. package/dist/campaign/index.js +4 -4
  11. package/dist/{campaign-85igdlgG.js → campaign-CIn-ErlJ.js} +103 -5
  12. package/dist/campaign-CIn-ErlJ.js.map +1 -0
  13. package/dist/cli.js +1 -1
  14. package/dist/contract/index.d.ts +3 -3
  15. package/dist/contract/index.js +3 -3
  16. package/dist/{define-agent-eval-DEMsu5eA.js → define-agent-eval-CJG7LD9M.js} +2 -2
  17. package/dist/{define-agent-eval-DEMsu5eA.js.map → define-agent-eval-CJG7LD9M.js.map} +1 -1
  18. package/dist/{define-agent-eval-CCbl8k2E.d.ts → define-agent-eval-CqmlXUfQ.d.ts} +2 -2
  19. package/dist/{define-agent-eval-CCbl8k2E.d.ts.map → define-agent-eval-CqmlXUfQ.d.ts.map} +1 -1
  20. package/dist/{index-Bg6OT2Dd.d.ts → index-CtGf6e6X.d.ts} +29 -2
  21. package/dist/index-CtGf6e6X.d.ts.map +1 -0
  22. package/dist/{index-DBkcm_9H.d.ts → index-DuaNwvse.d.ts} +3 -3
  23. package/dist/{index-DBkcm_9H.d.ts.map → index-DuaNwvse.d.ts.map} +1 -1
  24. package/dist/index.d.ts +2 -2
  25. package/dist/index.js +3 -3
  26. package/dist/{llm-judge-DliimmRb.js → llm-judge-CV80fkYA.js} +56 -11
  27. package/dist/llm-judge-CV80fkYA.js.map +1 -0
  28. package/dist/openapi.json +1 -1
  29. package/dist/{produced-state-DrMqa2HD.js → produced-state-CQFi465p.js} +2 -2
  30. package/dist/{produced-state-DrMqa2HD.js.map → produced-state-CQFi465p.js.map} +1 -1
  31. package/dist/{skillopt-optimization-method-CV7go7ex.js → skillopt-optimization-method-D0o2c2yM.js} +2 -2
  32. package/dist/{skillopt-optimization-method-CV7go7ex.js.map → skillopt-optimization-method-D0o2c2yM.js.map} +1 -1
  33. package/docs/campaign-proposers.md +44 -0
  34. package/package.json +1 -1
  35. package/dist/campaign-85igdlgG.js.map +0 -1
  36. package/dist/index-Bg6OT2Dd.d.ts.map +0 -1
  37. package/dist/llm-judge-DliimmRb.js.map +0 -1
@@ -20,6 +20,50 @@ Use it when one surface must get better.
20
20
  Use it when two or more methods must be compared at equal budget.
21
21
  Runnable versions: [`examples/self-improve-optimizer`](../examples/self-improve-optimizer/) and [`examples/compare-optimization-methods`](../examples/compare-optimization-methods/).
22
22
 
23
+ ## Compose searches over a candidate
24
+
25
+ Use `scopedOptimizationMethod()` to change one projection while scoring the complete candidate.
26
+ The caller supplies `project` and `merge`; Eval does not prescribe profile names or learning procedures.
27
+ Their roundtrip must preserve the exact baseline before any child search runs.
28
+ Scoped artifact paths and dispatch identity include the complete parent hash to prevent reuse across different evaluation contexts.
29
+ A text or component surface can include serialized profiles, working evaluation definitions, and immutable state references.
30
+ The host must resolve and verify those references when executing a candidate.
31
+ Keep final decision cases outside the working candidate and every optimizer callback.
32
+
33
+ Use `sequentialOptimizationMethod()` to pass each selected candidate into the next method.
34
+ It does not require an intermediate candidate to beat the original baseline.
35
+ Each child can use GEPA, SkillOpt, or an arbitrary `OptimizationMethod` callback.
36
+ Use the existing GEPA recipe when only the optimizer engines change over one shared surface.
37
+
38
+ ```ts
39
+ const learnerThenSpecialist = sequentialOptimizationMethod({
40
+ name: 'learner-then-specialist',
41
+ methods: [
42
+ scopedOptimizationMethod({
43
+ name: 'learner', method: learnerSearch,
44
+ project: selectLearner, merge: replaceLearner,
45
+ }),
46
+ scopedOptimizationMethod({
47
+ name: 'specialist', method: specialistSearch,
48
+ project: selectSpecialist, merge: replaceSpecialist,
49
+ }),
50
+ ],
51
+ })
52
+ ```
53
+
54
+ Pass this method and a joint method to `compareOptimizationMethods()` to compare their final candidates.
55
+ Its existing `optimizationConcurrency` controls independent searches; stages inside a sequence run in order.
56
+ All children share the spend account and receive only train and selection cases.
57
+ Child costs are reconciled separately and summed without adding ledger charges.
58
+ The returned `composition.stages` preserves each baseline hash, selected surface, cost, provenance, token usage, and history receipt.
59
+ Missing child usage remains missing in that child's provenance.
60
+ Comparison scores retain this composition.
61
+
62
+ Set `searchHistoryPolicy: 'require-complete'` on the outer comparison or `selfImprove()` call to require every child receipt.
63
+ Set `searchHistoryVerification: 'ledger'` to verify each referenced ledger before final assessment.
64
+ Composite history coverage contains recursive `stages`; it does not fabricate one aggregate receipt.
65
+ Any parent receipt supplied by a custom method is also verified; it cannot replace missing child evidence.
66
+
23
67
  ## Read An Improvement Result
24
68
 
25
69
  `selfImprove({ method })` executes the complete method once and measures its selected surface on final cases.
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@tangle-network/agent-eval",
3
- "version": "0.176.0",
3
+ "version": "0.177.0",
4
4
  "description": "Evaluate and improve AI agents from runs, traces, judges, and feedback. Compare candidates, cluster failures, measure lift, and gate releases.",
5
5
  "homepage": "https://github.com/tangle-network/agent-eval#readme",
6
6
  "repository": {