@axlsdk/eval 0.24.0 → 0.24.2
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +14 -5
- package/package.json +2 -2
package/README.md
CHANGED
|
@@ -414,11 +414,13 @@ actually measured. The value is still validated — a non-negative finite number
|
|
|
414
414
|
dropped with a `console.warn` — so `{ cost: 'free' }` can poison nothing.
|
|
415
415
|
|
|
416
416
|
**Additive item metadata.** Returning `{ output, metadata: { category: 'billing' } }`
|
|
417
|
-
|
|
418
|
-
|
|
419
|
-
|
|
420
|
-
|
|
421
|
-
|
|
417
|
+
adds application keys beside measured models, tokens, agent calls, and workflow
|
|
418
|
+
attribution. The reserved measurement keys (`models`, `modelCallCounts`,
|
|
419
|
+
`tokens`, `agentCalls`, `workflows`, `workflowCallCounts`) are kept under
|
|
420
|
+
`item.callerReport.metadata` if returned by the callback; they do not override
|
|
421
|
+
the runtime's measurement. Model diagnostics and timing follow the accounting
|
|
422
|
+
scope across runtimes and compatible ESM/CJS copies. Workflow names and captured
|
|
423
|
+
traces still depend on the runtime hosting `trackOutcome`.
|
|
422
424
|
|
|
423
425
|
### Studio
|
|
424
426
|
|
|
@@ -717,6 +719,13 @@ could not price is reported as unknown (`unpriced`, with `accounting.reasons`) r
|
|
|
717
719
|
than as zero — and because unknown spend cannot be enforced against, it does not consume
|
|
718
720
|
a budget either.
|
|
719
721
|
|
|
722
|
+
Compatible ESM/CJS or duplicate Axl loads in the same JavaScript realm share
|
|
723
|
+
the accounting scope, budget controller, and request capture channel. A workflow
|
|
724
|
+
using another compatible copy is measured and charged to this run. If a loaded
|
|
725
|
+
copy cannot join the active accounting protocol, paid work is refused and the
|
|
726
|
+
run is marked `incomplete` / `uninstrumented`; update older Axl copies to get
|
|
727
|
+
this guarantee. See [cross-copy accounting](../../docs/observability.md#completeness-and-reasons).
|
|
728
|
+
|
|
720
729
|
### Captured requests (opt-in)
|
|
721
730
|
|
|
722
731
|
When a score looks wrong, the next question is what the model was actually
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@axlsdk/eval",
|
|
3
|
-
"version": "0.24.
|
|
3
|
+
"version": "0.24.2",
|
|
4
4
|
"description": "Evaluation framework for Axl agentic workflows",
|
|
5
5
|
"type": "module",
|
|
6
6
|
"main": "./dist/index.cjs",
|
|
@@ -25,7 +25,7 @@
|
|
|
25
25
|
"dist"
|
|
26
26
|
],
|
|
27
27
|
"dependencies": {
|
|
28
|
-
"@axlsdk/axl": "0.24.
|
|
28
|
+
"@axlsdk/axl": "0.24.2"
|
|
29
29
|
},
|
|
30
30
|
"peerDependencies": {
|
|
31
31
|
"zod": "^4.0.0",
|