@axlsdk/eval 0.24.1 → 0.24.3

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (2) hide show
  1. package/README.md +7 -5
  2. package/package.json +2 -2
package/README.md CHANGED
@@ -414,11 +414,13 @@ actually measured. The value is still validated — a non-negative finite number
414
414
  dropped with a `console.warn` — so `{ cost: 'free' }` can poison nothing.
415
415
 
416
416
  **Additive item metadata.** Returning `{ output, metadata: { category: 'billing' } }`
417
- preserves tracked models, tokens, agent calls, and workflow attribution, with or without
418
- trace capture. User keys override tracked defaults; nested objects are replaced wholesale.
419
- An explicit `models` or `workflows` list without corresponding call counts removes the
420
- inherited count map so run totals use the list fallback. Supply both list and counts for
421
- exact custom accounting. See the [metadata contract](../../docs/api-reference.md#evalitem).
417
+ adds application keys beside measured models, tokens, agent calls, and workflow
418
+ attribution. The reserved measurement keys (`models`, `modelCallCounts`,
419
+ `tokens`, `agentCalls`, `workflows`, `workflowCallCounts`) are kept under
420
+ `item.callerReport.metadata` if returned by the callback; they do not override
421
+ the runtime's measurement. Model diagnostics and timing follow the accounting
422
+ scope across runtimes and compatible ESM/CJS copies. Workflow names and captured
423
+ traces still depend on the runtime hosting `trackOutcome`.
422
424
 
423
425
  ### Studio
424
426
 
package/package.json CHANGED
@@ -1,6 +1,6 @@
1
1
  {
2
2
  "name": "@axlsdk/eval",
3
- "version": "0.24.1",
3
+ "version": "0.24.3",
4
4
  "description": "Evaluation framework for Axl agentic workflows",
5
5
  "type": "module",
6
6
  "main": "./dist/index.cjs",
@@ -25,7 +25,7 @@
25
25
  "dist"
26
26
  ],
27
27
  "dependencies": {
28
- "@axlsdk/axl": "0.24.1"
28
+ "@axlsdk/axl": "0.24.3"
29
29
  },
30
30
  "peerDependencies": {
31
31
  "zod": "^4.0.0",