@veryfront/ext-eval-report-http 0.1.1055 → 0.1.1059
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +18 -0
- package/package.json +2 -2
package/README.md
CHANGED
|
@@ -84,6 +84,24 @@ Each exporter sends:
|
|
|
84
84
|
}
|
|
85
85
|
```
|
|
86
86
|
|
|
87
|
+
The registry redacts report records before the HTTP exporter runs. Inputs,
|
|
88
|
+
outputs, references, traces, tool payloads, metric evidence, metric
|
|
89
|
+
explanations, record metadata, and export context metadata are omitted unless
|
|
90
|
+
the caller explicitly allows them with the export redaction policy.
|
|
91
|
+
|
|
92
|
+
## Gateway mapping strategy
|
|
93
|
+
|
|
94
|
+
Keep vendor SDKs and schema translation in the receiving gateway, not in this
|
|
95
|
+
extension. The HTTP exporter always sends the same redacted `{ report, context
|
|
96
|
+
}` payload.
|
|
97
|
+
|
|
98
|
+
| Destination | Gateway mapping |
|
|
99
|
+
| ---------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
|
100
|
+
| Braintrust | Map the report run id, eval id, target, summary scores, and redacted records to the Braintrust experiment shape. Store `context.trace.traceId` and `context.trace.spanId` as correlation metadata. |
|
|
101
|
+
| Langfuse | Map records to trace observations or score events. Forward only the redacted fields present in the report, and return a receipt id or URL from the gateway response. |
|
|
102
|
+
| LangSmith | Map the report to a dataset run and records to examples or feedback rows. Keep references, evidence, explanations, and metadata absent unless the export policy explicitly allows them. |
|
|
103
|
+
| Internal gateway | Persist the redacted Veryfront report first, fan out to vendor-specific adapters asynchronously, and return a sanitized receipt. |
|
|
104
|
+
|
|
87
105
|
`runEval` enriches export context with the active runtime `traceId` and `spanId`
|
|
88
106
|
when OpenTelemetry is active and the caller did not pass an explicit
|
|
89
107
|
`context.trace`.
|
package/package.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
{
|
|
2
2
|
"name": "@veryfront/ext-eval-report-http",
|
|
3
|
-
"version": "0.1.
|
|
3
|
+
"version": "0.1.1059",
|
|
4
4
|
"description": "Veryfront first-party extension package for ext-eval-report-http",
|
|
5
5
|
"keywords": [
|
|
6
6
|
"veryfront",
|
|
@@ -63,7 +63,7 @@
|
|
|
63
63
|
"@deno/shim-timers": "~0.1.0"
|
|
64
64
|
},
|
|
65
65
|
"peerDependencies": {
|
|
66
|
-
"veryfront": "^0.1.
|
|
66
|
+
"veryfront": "^0.1.1059"
|
|
67
67
|
},
|
|
68
68
|
"type": "module",
|
|
69
69
|
"types": "./esm/index.d.ts",
|