@atlanai/sdk 0.2.1 → 0.2.3
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
- package/README.md +65 -14
- package/dist/client.d.ts +4 -1
- package/dist/client.js +14 -2
- package/dist/errors.d.ts +1 -0
- package/dist/errors.js +12 -1
- package/dist/evals.d.ts +136 -1
- package/dist/evals.js +902 -1
- package/dist/index.d.ts +3 -2
- package/dist/index.js +2 -1
- package/dist/manifest.json +264 -218
- package/dist/raw/agent/apis/AgentEnvironmentsApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentEnvironmentsApi.js +49 -1
- package/dist/raw/agent/apis/AgentFrameworksApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentFrameworksApi.js +49 -1
- package/dist/raw/agent/apis/AgentProvidersApi.d.ts +36 -0
- package/dist/raw/agent/apis/AgentProvidersApi.js +49 -1
- package/dist/raw/agent/apis/AgentsApi.d.ts +78 -4
- package/dist/raw/agent/apis/AgentsApi.js +126 -5
- package/dist/raw/agent/apis/HarnessVendorsApi.d.ts +36 -0
- package/dist/raw/agent/apis/HarnessVendorsApi.js +49 -1
- package/dist/raw/agent/apis/HarnessesApi.d.ts +36 -0
- package/dist/raw/agent/apis/HarnessesApi.js +49 -1
- package/dist/raw/agent/apis/OutputsApi.d.ts +45 -0
- package/dist/raw/agent/apis/OutputsApi.js +61 -1
- package/dist/raw/agent/apis/SessionsApi.d.ts +38 -2
- package/dist/raw/agent/apis/SessionsApi.js +51 -3
- package/dist/raw/agent/apis/TracesApi.d.ts +18 -0
- package/dist/raw/agent/apis/TracesApi.js +25 -1
- package/dist/raw/agent/apis/VisitorsApi.d.ts +9 -0
- package/dist/raw/agent/apis/VisitorsApi.js +13 -1
- package/dist/raw/agent/models/AgentAgentArtifactView.d.ts +75 -15
- package/dist/raw/agent/models/AgentAgentArtifactView.js +15 -2
- package/dist/raw/agent/models/AgentAgentEnvironmentArtifactView.d.ts +39 -15
- package/dist/raw/agent/models/AgentAgentEnvironmentArtifactView.js +4 -2
- package/dist/raw/agent/models/AgentAgentEnvironmentMeta.d.ts +12 -0
- package/dist/raw/agent/models/AgentAgentEnvironmentMeta.js +2 -0
- package/dist/raw/agent/models/AgentAgentFrameworkArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentAgentFrameworkArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentAgentMeta.d.ts +48 -0
- package/dist/raw/agent/models/AgentAgentMeta.js +13 -0
- package/dist/raw/agent/models/AgentAgentProviderArtifactView.d.ts +82 -17
- package/dist/raw/agent/models/AgentAgentProviderArtifactView.js +10 -2
- package/dist/raw/agent/models/AgentAgentProviderCreate.d.ts +24 -3
- package/dist/raw/agent/models/AgentAgentProviderCreate.js +4 -0
- package/dist/raw/agent/models/AgentAgentProviderMeta.d.ts +56 -13
- package/dist/raw/agent/models/AgentAgentProviderMeta.js +8 -0
- package/dist/raw/agent/models/AgentAgentProviderPatch.d.ts +13 -0
- package/dist/raw/agent/models/AgentAgentProviderPatch.js +4 -0
- package/dist/raw/agent/models/AgentAgentProviderType.d.ts +19 -9
- package/dist/raw/agent/models/AgentAgentProviderType.js +18 -8
- package/dist/raw/agent/models/AgentCreateAgentFramework400Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework400Response.js +2 -2
- package/dist/raw/agent/models/AgentCreateAgentFramework413Response.d.ts +64 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework413Response.js +74 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework415Response.d.ts +1 -0
- package/dist/raw/agent/models/AgentCreateAgentFramework415Response.js +1 -2
- package/dist/raw/agent/models/AgentGetAgentTrace400Response.d.ts +63 -0
- package/dist/raw/agent/models/AgentGetAgentTrace400Response.js +75 -0
- package/dist/raw/agent/models/AgentHarnessArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentHarnessArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentHarnessVendorArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentHarnessVendorArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentListAgentFrameworks401Response.d.ts +1 -0
- package/dist/raw/agent/models/AgentListAgentFrameworks401Response.js +1 -0
- package/dist/raw/agent/models/AgentOutputArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentOutputArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentPageSessionEventView.d.ts +3 -3
- package/dist/raw/agent/models/AgentPageSessionEventView.js +3 -3
- package/dist/raw/agent/models/AgentQueryAgentTraceStats400Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentQueryAgentTraceStats400Response.js +2 -0
- package/dist/raw/agent/models/AgentRemoteSessionEvent.d.ts +38 -0
- package/dist/raw/agent/models/AgentRemoteSessionEvent.js +58 -0
- package/dist/raw/agent/models/AgentSessionArtifactView.d.ts +52 -15
- package/dist/raw/agent/models/AgentSessionArtifactView.js +4 -2
- package/dist/raw/agent/models/AgentSessionEventView.d.ts +30 -0
- package/dist/raw/agent/models/AgentSessionEventView.js +57 -0
- package/dist/raw/agent/models/AgentSessionMessageArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentSessionMessageArtifactView.js +2 -2
- package/dist/raw/agent/models/AgentSessionMeta.d.ts +25 -0
- package/dist/raw/agent/models/AgentSessionMeta.js +2 -0
- package/dist/raw/agent/models/AgentSessionStreamFrame.d.ts +8 -6
- package/dist/raw/agent/models/AgentSessionStreamFrame.js +7 -0
- package/dist/raw/agent/models/AgentSyncState.d.ts +27 -0
- package/dist/raw/agent/models/AgentSyncState.js +55 -0
- package/dist/raw/agent/models/AgentUploadAgentProfileImage400Response.d.ts +2 -1
- package/dist/raw/agent/models/AgentUploadAgentProfileImage400Response.js +2 -3
- package/dist/raw/agent/models/AgentUploadAgentProfileImage413Response.d.ts +2 -0
- package/dist/raw/agent/models/AgentUploadAgentProfileImage413Response.js +2 -2
- package/dist/raw/agent/models/AgentVisitorArtifactView.d.ts +27 -15
- package/dist/raw/agent/models/AgentVisitorArtifactView.js +2 -2
- package/dist/raw/agent/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/agent/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/agent/models/GatewayTraceStatsGroupBy.d.ts +5 -1
- package/dist/raw/agent/models/GatewayTraceStatsGroupBy.js +4 -0
- package/dist/raw/agent/models/GatewayTraceStatsMeasure.d.ts +3 -1
- package/dist/raw/agent/models/GatewayTraceStatsMeasure.js +2 -0
- package/dist/raw/agent/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/agent/models/SpanViewDto.js +8 -0
- package/dist/raw/agent/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/agent/models/TraceDetailView.js +2 -0
- package/dist/raw/agent/models/TriggerBody.d.ts +52 -0
- package/dist/raw/agent/models/TriggerBody.js +58 -0
- package/dist/raw/agent/models/index.d.ts +6 -1
- package/dist/raw/agent/models/index.js +6 -1
- package/dist/raw/eval/apis/DatasetsApi.d.ts +43 -3
- package/dist/raw/eval/apis/DatasetsApi.js +108 -3
- package/dist/raw/eval/apis/ExperimentsApi.d.ts +8 -24
- package/dist/raw/eval/apis/ExperimentsApi.js +10 -49
- package/dist/raw/eval/apis/ScorersApi.d.ts +1 -1
- package/dist/raw/eval/apis/ScorersApi.js +1 -1
- package/dist/raw/eval/models/AccessView.d.ts +1 -1
- package/dist/raw/eval/models/AccessView.js +1 -1
- package/dist/raw/eval/models/ArtifactConflictProblem.d.ts +1 -1
- package/dist/raw/eval/models/ArtifactConflictProblem.js +1 -1
- package/dist/raw/eval/models/CostView.d.ts +1 -1
- package/dist/raw/eval/models/CostView.js +1 -1
- package/dist/raw/eval/models/CursorPage.d.ts +1 -1
- package/dist/raw/eval/models/CursorPage.js +1 -1
- package/dist/raw/eval/models/EvalArtifactEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/EvalArtifactEnvelope.js +1 -1
- package/dist/raw/eval/models/EvalArtifactSearchRequest.d.ts +1 -1
- package/dist/raw/eval/models/EvalArtifactSearchRequest.js +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResponse.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResponse.js +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResult.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkDatasetRecordResult.js +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultResponse.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultResponse.js +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultSlot.d.ts +1 -1
- package/dist/raw/eval/models/EvalBulkExperimentResultSlot.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset400Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset409Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset409Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset413Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset413Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset415Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset415Response.js +1 -1
- package/dist/raw/eval/models/EvalCreateDataset422Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalCreateDataset422Response.js +1 -1
- package/dist/raw/eval/models/EvalDatasetArtifactView.d.ts +35 -16
- package/dist/raw/eval/models/EvalDatasetArtifactView.js +5 -3
- package/dist/raw/eval/models/EvalDatasetCreate.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetCreate.js +3 -1
- package/dist/raw/eval/models/EvalDatasetMeta.d.ts +8 -1
- package/dist/raw/eval/models/EvalDatasetMeta.js +3 -1
- package/dist/raw/eval/models/EvalDatasetPatch.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetPatch.js +3 -1
- package/dist/raw/eval/models/EvalDatasetRecordArtifactView.d.ts +34 -16
- package/dist/raw/eval/models/EvalDatasetRecordArtifactView.js +5 -3
- package/dist/raw/eval/models/EvalDatasetRecordBulkCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordBulkCreate.js +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordCreate.js +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordMeta.d.ts +7 -1
- package/dist/raw/eval/models/EvalDatasetRecordMeta.js +3 -1
- package/dist/raw/eval/models/EvalDatasetRecordPatch.d.ts +1 -1
- package/dist/raw/eval/models/EvalDatasetRecordPatch.js +1 -1
- package/dist/raw/eval/models/EvalDatasetSnapshot.d.ts +57 -0
- package/dist/raw/eval/models/EvalDatasetSnapshot.js +65 -0
- package/dist/raw/eval/models/EvalDatasetSnapshotRecord.d.ts +99 -0
- package/dist/raw/eval/models/EvalDatasetSnapshotRecord.js +77 -0
- package/dist/raw/eval/models/EvalExperimentArtifactView.d.ts +35 -16
- package/dist/raw/eval/models/EvalExperimentArtifactView.js +6 -3
- package/dist/raw/eval/models/EvalExperimentCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentCreate.js +1 -1
- package/dist/raw/eval/models/EvalExperimentMeta.d.ts +10 -4
- package/dist/raw/eval/models/EvalExperimentMeta.js +4 -1
- package/dist/raw/eval/models/EvalExperimentPatch.d.ts +4 -3
- package/dist/raw/eval/models/EvalExperimentPatch.js +1 -1
- package/dist/raw/eval/models/EvalExperimentResultArtifactView.d.ts +45 -16
- package/dist/raw/eval/models/EvalExperimentResultArtifactView.js +7 -3
- package/dist/raw/eval/models/EvalExperimentResultBulkCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentResultBulkCreate.js +1 -1
- package/dist/raw/eval/models/EvalExperimentResultCreate.d.ts +16 -1
- package/dist/raw/eval/models/EvalExperimentResultCreate.js +5 -1
- package/dist/raw/eval/models/EvalExperimentResultMeta.d.ts +18 -1
- package/dist/raw/eval/models/EvalExperimentResultMeta.js +5 -1
- package/dist/raw/eval/models/EvalExperimentStatus.d.ts +1 -1
- package/dist/raw/eval/models/EvalExperimentStatus.js +1 -1
- package/dist/raw/eval/models/EvalGetDataset404Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalGetDataset404Response.js +1 -1
- package/dist/raw/eval/models/EvalGetExperimentTrace400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalGetExperimentTrace400Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets400Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets400Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets401Response.d.ts +2 -1
- package/dist/raw/eval/models/EvalListDatasets401Response.js +2 -1
- package/dist/raw/eval/models/EvalListDatasets403Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets403Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets500Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets500Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets503Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets503Response.js +1 -1
- package/dist/raw/eval/models/EvalListDatasets504Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalListDatasets504Response.js +1 -1
- package/dist/raw/eval/models/EvalPageDatasetArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageDatasetArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageDatasetRecordArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageDatasetRecordArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageExperimentArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageExperimentArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageExperimentResultArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageExperimentResultArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPageScorerArtifactView.d.ts +1 -1
- package/dist/raw/eval/models/EvalPageScorerArtifactView.js +1 -1
- package/dist/raw/eval/models/EvalPatchDataset412Response.d.ts +1 -1
- package/dist/raw/eval/models/EvalPatchDataset412Response.js +1 -1
- package/dist/raw/eval/models/EvalRecordSource.d.ts +1 -1
- package/dist/raw/eval/models/EvalRecordSource.js +1 -1
- package/dist/raw/eval/models/EvalScorerArtifactView.d.ts +28 -16
- package/dist/raw/eval/models/EvalScorerArtifactView.js +3 -3
- package/dist/raw/eval/models/EvalScorerCreate.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerCreate.js +1 -1
- package/dist/raw/eval/models/EvalScorerKind.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerKind.js +1 -1
- package/dist/raw/eval/models/EvalScorerMeta.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerMeta.js +1 -1
- package/dist/raw/eval/models/EvalScorerPatch.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerPatch.js +1 -1
- package/dist/raw/eval/models/EvalScorerScope.d.ts +1 -1
- package/dist/raw/eval/models/EvalScorerScope.js +1 -1
- package/dist/raw/eval/models/EvalSubjectKind.d.ts +1 -1
- package/dist/raw/eval/models/EvalSubjectKind.js +1 -1
- package/dist/raw/eval/models/GatewayArtifactBase.d.ts +28 -16
- package/dist/raw/eval/models/GatewayArtifactBase.js +3 -3
- package/dist/raw/eval/models/GatewayArtifactIdentityRevealView.d.ts +1 -1
- package/dist/raw/eval/models/GatewayArtifactIdentityRevealView.js +1 -1
- package/dist/raw/eval/models/GatewayPageMeta.d.ts +1 -1
- package/dist/raw/eval/models/GatewayPageMeta.js +1 -1
- package/dist/raw/eval/models/GatewaySourceEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/GatewaySourceEnvelope.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsBucket.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsBucket.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsCompareMode.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsCompareMode.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsComparison.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsComparison.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsData.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsData.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf1.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf1.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf2.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsDataOneOf2.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsEnvelope.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilter.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilter.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterOperator.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterOperator.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterValue.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsFilterValue.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsGroupBy.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsGroupBy.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeasure.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeasure.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeta.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsMeta.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrder.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrder.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderBy.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderBy.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderDirection.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsOrderDirection.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsPanelQuery.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsPanelQuery.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequest.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequest.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequestType.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsRequestType.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsScalarResult.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsScalarResult.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeries.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeries.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeriesPoint.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsSeriesPoint.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumn.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumn.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumnType.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableColumnType.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableRow.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsTableRow.js +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsWindow.d.ts +1 -1
- package/dist/raw/eval/models/GatewayTraceStatsWindow.js +1 -1
- package/dist/raw/eval/models/ProblemDetails.d.ts +1 -1
- package/dist/raw/eval/models/ProblemDetails.js +1 -1
- package/dist/raw/eval/models/RegistryEdgeTarget.d.ts +1 -1
- package/dist/raw/eval/models/RegistryEdgeTarget.js +1 -1
- package/dist/raw/eval/models/RegistryRelationshipEdge.d.ts +1 -1
- package/dist/raw/eval/models/RegistryRelationshipEdge.js +1 -1
- package/dist/raw/eval/models/RegistryRelationshipsView.d.ts +1 -1
- package/dist/raw/eval/models/RegistryRelationshipsView.js +1 -1
- package/dist/raw/eval/models/SpanListEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/SpanListEnvelope.js +1 -1
- package/dist/raw/eval/models/SpanViewDto.d.ts +26 -1
- package/dist/raw/eval/models/SpanViewDto.js +9 -1
- package/dist/raw/eval/models/TraceDetailView.d.ts +10 -1
- package/dist/raw/eval/models/TraceDetailView.js +3 -1
- package/dist/raw/eval/models/TraceLinks.d.ts +1 -1
- package/dist/raw/eval/models/TraceLinks.js +1 -1
- package/dist/raw/eval/models/TraceListEnvelope.d.ts +1 -1
- package/dist/raw/eval/models/TraceListEnvelope.js +1 -1
- package/dist/raw/eval/models/TraceParentView.d.ts +1 -1
- package/dist/raw/eval/models/TraceParentView.js +1 -1
- package/dist/raw/eval/models/TraceStatus.d.ts +1 -1
- package/dist/raw/eval/models/TraceStatus.js +1 -1
- package/dist/raw/eval/models/TraceSummaryStats.d.ts +1 -1
- package/dist/raw/eval/models/TraceSummaryStats.js +1 -1
- package/dist/raw/eval/models/TraceSummaryView.d.ts +1 -1
- package/dist/raw/eval/models/TraceSummaryView.js +1 -1
- package/dist/raw/eval/models/UsageView.d.ts +1 -1
- package/dist/raw/eval/models/UsageView.js +1 -1
- package/dist/raw/eval/models/index.d.ts +2 -0
- package/dist/raw/eval/models/index.js +2 -0
- package/dist/raw/eval/runtime.d.ts +1 -1
- package/dist/raw/eval/runtime.js +1 -1
- package/dist/raw/file/apis/FileApi.d.ts +18 -0
- package/dist/raw/file/apis/FileApi.js +25 -1
- package/dist/raw/file/models/FileCreateUpload400Response.d.ts +2 -0
- package/dist/raw/file/models/FileCreateUpload400Response.js +2 -2
- package/dist/raw/file/models/FileCreateUpload413Response.d.ts +2 -1
- package/dist/raw/file/models/FileCreateUpload413Response.js +2 -3
- package/dist/raw/file/models/FileCreateUpload415Response.d.ts +1 -0
- package/dist/raw/file/models/FileCreateUpload415Response.js +1 -2
- package/dist/raw/file/models/FileFile.d.ts +4 -0
- package/dist/raw/file/models/FileFileArtifact.d.ts +31 -15
- package/dist/raw/file/models/FileFileArtifact.js +2 -2
- package/dist/raw/file/models/FileIngestUpload400Response.d.ts +2 -1
- package/dist/raw/file/models/FileIngestUpload400Response.js +2 -3
- package/dist/raw/file/models/FileIngestUpload415Response.d.ts +63 -0
- package/dist/raw/file/models/FileIngestUpload415Response.js +75 -0
- package/dist/raw/file/models/FileList401Response.d.ts +1 -0
- package/dist/raw/file/models/FileList401Response.js +1 -0
- package/dist/raw/file/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/file/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/file/models/index.d.ts +1 -0
- package/dist/raw/file/models/index.js +1 -0
- package/dist/raw/mcp/apis/ServersApi.d.ts +20 -2
- package/dist/raw/mcp/apis/ServersApi.js +27 -3
- package/dist/raw/mcp/apis/ToolsApi.d.ts +18 -0
- package/dist/raw/mcp/apis/ToolsApi.js +25 -1
- package/dist/raw/mcp/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/mcp/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/mcp/models/McpAggregateServers400Response.d.ts +2 -0
- package/dist/raw/mcp/models/McpAggregateServers400Response.js +2 -0
- package/dist/raw/mcp/models/McpAggregateServers413Response.d.ts +64 -0
- package/dist/raw/mcp/models/McpAggregateServers413Response.js +74 -0
- package/dist/raw/mcp/models/McpAggregateServers415Response.d.ts +1 -0
- package/dist/raw/mcp/models/McpAggregateServers415Response.js +1 -2
- package/dist/raw/mcp/models/McpConnectionState.d.ts +2 -1
- package/dist/raw/mcp/models/McpConnectionState.js +2 -1
- package/dist/raw/mcp/models/McpListServers401Response.d.ts +1 -0
- package/dist/raw/mcp/models/McpListServers401Response.js +1 -0
- package/dist/raw/mcp/models/McpMcpServer.d.ts +27 -0
- package/dist/raw/mcp/models/McpMcpServer.js +4 -0
- package/dist/raw/mcp/models/McpMcpServerArtifactView.d.ts +54 -15
- package/dist/raw/mcp/models/McpMcpServerArtifactView.js +6 -2
- package/dist/raw/mcp/models/McpMcpSessionMessage.d.ts +1 -1
- package/dist/raw/mcp/models/McpMcpToolArtifactView.d.ts +27 -15
- package/dist/raw/mcp/models/McpMcpToolArtifactView.js +2 -2
- package/dist/raw/mcp/models/McpServerTestResponse.d.ts +13 -2
- package/dist/raw/mcp/models/index.d.ts +1 -0
- package/dist/raw/mcp/models/index.js +1 -0
- package/dist/raw/model/apis/OpenaiApi.d.ts +4 -4
- package/dist/raw/model/apis/OpenaiApi.js +4 -4
- package/dist/raw/model/models/ModelListProviders401Response.d.ts +1 -0
- package/dist/raw/model/models/ModelListProviders401Response.js +1 -0
- package/dist/raw/registry/apis/AppsApi.d.ts +159 -0
- package/dist/raw/registry/apis/AppsApi.js +385 -0
- package/dist/raw/registry/apis/AuthApi.d.ts +2 -2
- package/dist/raw/registry/apis/AuthApi.js +2 -2
- package/dist/raw/registry/apis/DiscoveryApi.d.ts +27 -0
- package/dist/raw/registry/apis/DiscoveryApi.js +37 -1
- package/dist/raw/registry/apis/InvitationsApi.d.ts +159 -0
- package/dist/raw/registry/apis/InvitationsApi.js +383 -0
- package/dist/raw/registry/apis/OrganisationsApi.d.ts +51 -0
- package/dist/raw/registry/apis/OrganisationsApi.js +108 -1
- package/dist/raw/registry/apis/ReleasesApi.d.ts +199 -0
- package/dist/raw/registry/apis/ReleasesApi.js +484 -0
- package/dist/raw/registry/apis/ReposApi.d.ts +27 -0
- package/dist/raw/registry/apis/ReposApi.js +37 -1
- package/dist/raw/registry/apis/RolesApi.d.ts +32 -0
- package/dist/raw/registry/apis/RolesApi.js +95 -0
- package/dist/raw/registry/apis/ServiceAccountsApi.d.ts +13 -4
- package/dist/raw/registry/apis/ServiceAccountsApi.js +17 -5
- package/dist/raw/registry/apis/SessionsApi.d.ts +60 -0
- package/dist/raw/registry/apis/SessionsApi.js +150 -0
- package/dist/raw/registry/apis/UsersApi.d.ts +75 -43
- package/dist/raw/registry/apis/UsersApi.js +139 -74
- package/dist/raw/registry/apis/WorkspacesApi.d.ts +80 -4
- package/dist/raw/registry/apis/WorkspacesApi.js +152 -5
- package/dist/raw/registry/apis/index.d.ts +5 -7
- package/dist/raw/registry/apis/index.js +5 -7
- package/dist/raw/registry/models/{ExtensionJobDto.d.ts → AppActionDto.d.ts} +33 -27
- package/dist/raw/registry/models/{ExtensionJobDto.js → AppActionDto.js} +22 -20
- package/dist/raw/registry/models/AppActionsPage.d.ts +40 -0
- package/dist/raw/registry/models/{PublishersPage.js → AppActionsPage.js} +16 -16
- package/dist/raw/registry/models/AppDto.d.ts +174 -0
- package/dist/raw/registry/models/AppDto.js +116 -0
- package/dist/raw/registry/models/AppsPage.d.ts +40 -0
- package/dist/raw/registry/models/{GroupsPage.js → AppsPage.js} +16 -16
- package/dist/raw/registry/models/ArtifactView.d.ts +76 -15
- package/dist/raw/registry/models/ArtifactView.js +10 -2
- package/dist/raw/registry/models/CreateInvitationsRequest.d.ts +33 -0
- package/dist/raw/registry/models/CreateInvitationsRequest.js +51 -0
- package/dist/raw/registry/models/CreateWorkspaceBody.d.ts +9 -0
- package/dist/raw/registry/models/CreateWorkspaceBody.js +2 -0
- package/dist/raw/registry/models/CutReleaseBody.d.ts +56 -0
- package/dist/raw/registry/models/CutReleaseBody.js +56 -0
- package/dist/raw/registry/models/EdgeTarget.d.ts +4 -0
- package/dist/raw/registry/models/InstallAppBody.d.ts +34 -0
- package/dist/raw/registry/models/InstallAppBody.js +48 -0
- package/dist/raw/registry/models/IntrospectedIdentity.d.ts +12 -3
- package/dist/raw/registry/models/IntrospectedIdentity.js +5 -3
- package/dist/raw/registry/models/InvitationDto.d.ts +98 -0
- package/dist/raw/registry/models/InvitationDto.js +88 -0
- package/dist/raw/registry/models/InvitationSendResult.d.ts +38 -0
- package/dist/raw/registry/models/InvitationSendResult.js +54 -0
- package/dist/raw/registry/models/InvitationSummaryDto.d.ts +86 -0
- package/dist/raw/registry/models/InvitationSummaryDto.js +84 -0
- package/dist/raw/registry/models/InvitationsPage.d.ts +40 -0
- package/dist/raw/registry/models/{MembershipsPage.js → InvitationsPage.js} +16 -16
- package/dist/raw/registry/models/InvitationsResponse.d.ts +33 -0
- package/dist/raw/registry/models/InvitationsResponse.js +51 -0
- package/dist/raw/registry/models/InviteeRequest.d.ts +44 -0
- package/dist/raw/registry/models/InviteeRequest.js +56 -0
- package/dist/raw/registry/models/InviteeResult.d.ts +69 -0
- package/dist/raw/registry/models/InviteeResult.js +66 -0
- package/dist/raw/registry/models/ReconcileAcceptedDto.d.ts +40 -0
- package/dist/raw/registry/models/ReconcileAcceptedDto.js +54 -0
- package/dist/raw/registry/models/RegistryAggregate400Response.d.ts +2 -0
- package/dist/raw/registry/models/RegistryAggregate400Response.js +2 -2
- package/dist/raw/registry/models/{RegistryListActionRuns401Response.d.ts → RegistryAggregate401Response.d.ts} +17 -16
- package/dist/raw/registry/models/RegistryAggregate401Response.js +90 -0
- package/dist/raw/registry/models/RegistryAggregate403Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate403Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate413Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate413Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate415Response.d.ts +1 -0
- package/dist/raw/registry/models/RegistryAggregate415Response.js +1 -2
- package/dist/raw/registry/models/RegistryAggregate500Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryAggregate500Response.js +75 -0
- package/dist/raw/registry/models/RegistryAggregate503Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryAggregate503Response.js +74 -0
- package/dist/raw/registry/models/RegistryAggregate504Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryAggregate504Response.js +75 -0
- package/dist/raw/registry/models/RegistryAggregateKind404Response.d.ts +63 -0
- package/dist/raw/registry/models/{RegistryGetActionRun404Response.js → RegistryAggregateKind404Response.js} +18 -18
- package/dist/raw/registry/models/RegistryCreateServiceAccount400Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryCreateServiceAccount400Response.js +76 -0
- package/dist/raw/registry/models/RegistryInstallApp409Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryInstallApp409Response.js +75 -0
- package/dist/raw/registry/models/RegistryListApps400Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryListApps400Response.js +75 -0
- package/dist/raw/registry/models/RegistryListApps503Response.d.ts +65 -0
- package/dist/raw/registry/models/RegistryListApps503Response.js +75 -0
- package/dist/raw/registry/models/RegistryListArtifactReleases400Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryListArtifactReleases400Response.js +75 -0
- package/dist/raw/registry/models/RegistryListUserTraces503Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryListUserTraces503Response.js +76 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions400Response.d.ts +64 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions400Response.js +74 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions415Response.d.ts +63 -0
- package/dist/raw/registry/models/RegistryRevokeOwnSessions415Response.js +75 -0
- package/dist/raw/registry/models/RegistryWhoami503Response.d.ts +66 -0
- package/dist/raw/registry/models/RegistryWhoami503Response.js +76 -0
- package/dist/raw/registry/models/RegistryWorkspacePluginRef.d.ts +61 -0
- package/dist/raw/registry/models/RegistryWorkspacePluginRef.js +62 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendation.d.ts +66 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendation.js +64 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendationReason.d.ts +29 -0
- package/dist/raw/registry/models/RegistryWorkspaceRecommendationReason.js +57 -0
- package/dist/raw/registry/models/RegistryWorkspaceView.d.ts +42 -0
- package/dist/raw/registry/models/RegistryWorkspaceView.js +11 -0
- package/dist/raw/registry/models/RelationshipsView.d.ts +5 -1
- package/dist/raw/registry/models/ReleaseDto.d.ts +123 -0
- package/dist/raw/registry/models/ReleaseDto.js +100 -0
- package/dist/raw/registry/models/ReleasePage.d.ts +40 -0
- package/dist/raw/registry/models/{BudgetsPage.js → ReleasePage.js} +16 -16
- package/dist/raw/registry/models/ReleasePolicyDto.d.ts +76 -0
- package/dist/raw/registry/models/ReleasePolicyDto.js +78 -0
- package/dist/raw/registry/models/RoleDto.d.ts +38 -0
- package/dist/raw/registry/models/RoleDto.js +54 -0
- package/dist/raw/registry/models/RoleListDto.d.ts +33 -0
- package/dist/raw/registry/models/RoleListDto.js +51 -0
- package/dist/raw/registry/models/SearchRequest.d.ts +1 -1
- package/dist/raw/registry/models/ServiceAccountDto.d.ts +5 -1
- package/dist/raw/registry/models/SetReleasePolicyBody.d.ts +55 -0
- package/dist/raw/registry/models/SetReleasePolicyBody.js +54 -0
- package/dist/raw/registry/models/SetTraceContentPolicyDto.d.ts +34 -0
- package/dist/raw/registry/models/SetTraceContentPolicyDto.js +48 -0
- package/dist/raw/registry/models/SetVisibilityBody.d.ts +33 -0
- package/dist/raw/registry/models/SetVisibilityBody.js +50 -0
- package/dist/raw/registry/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/registry/models/SpanViewDto.js +8 -0
- package/dist/raw/registry/models/TraceContentDeletionDto.d.ts +32 -0
- package/dist/raw/registry/models/TraceContentDeletionDto.js +50 -0
- package/dist/raw/registry/models/TraceContentPolicyDto.d.ts +48 -0
- package/dist/raw/registry/models/TraceContentPolicyDto.js +52 -0
- package/dist/raw/registry/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/registry/models/TraceDetailView.js +2 -0
- package/dist/raw/registry/models/UpdateInvitationRequest.d.ts +38 -0
- package/dist/raw/registry/models/UpdateInvitationRequest.js +50 -0
- package/dist/raw/registry/models/UpgradeAppBody.d.ts +37 -0
- package/dist/raw/registry/models/UpgradeAppBody.js +48 -0
- package/dist/raw/registry/models/UserDirectoryDto.d.ts +55 -0
- package/dist/raw/registry/models/UserDirectoryDto.js +58 -0
- package/dist/raw/registry/models/UsersPage.d.ts +3 -3
- package/dist/raw/registry/models/UsersPage.js +3 -3
- package/dist/raw/registry/models/WhoamiResponse.d.ts +12 -3
- package/dist/raw/registry/models/WhoamiResponse.js +5 -3
- package/dist/raw/registry/models/WithdrawBody.d.ts +33 -0
- package/dist/raw/registry/models/WithdrawBody.js +48 -0
- package/dist/raw/registry/models/WorkspaceInvitationListDto.d.ts +33 -0
- package/dist/raw/registry/models/WorkspaceInvitationListDto.js +51 -0
- package/dist/raw/registry/models/WorkspaceInvitationRow.d.ts +44 -0
- package/dist/raw/registry/models/WorkspaceInvitationRow.js +58 -0
- package/dist/raw/registry/models/WorkspaceRecommendationsPage.d.ts +40 -0
- package/dist/raw/registry/models/WorkspaceRecommendationsPage.js +56 -0
- package/dist/raw/registry/models/index.d.ts +51 -50
- package/dist/raw/registry/models/index.js +51 -50
- package/dist/raw/secret/apis/OauthApi.d.ts +143 -0
- package/dist/raw/secret/apis/OauthApi.js +335 -0
- package/dist/raw/secret/apis/index.d.ts +1 -0
- package/dist/raw/secret/apis/index.js +19 -0
- package/dist/raw/secret/index.d.ts +1 -0
- package/dist/raw/secret/index.js +1 -0
- package/dist/raw/secret/models/GatewayOauthCompleteRequest.d.ts +32 -0
- package/dist/raw/secret/models/GatewayOauthCompleteRequest.js +50 -0
- package/dist/raw/secret/models/GatewayOauthCompletion.d.ts +46 -0
- package/dist/raw/secret/models/GatewayOauthCompletion.js +55 -0
- package/dist/raw/secret/models/GatewayOauthConnection.d.ts +83 -0
- package/dist/raw/secret/models/GatewayOauthConnection.js +83 -0
- package/dist/raw/secret/models/GatewayOauthOwner.d.ts +31 -0
- package/dist/raw/secret/models/GatewayOauthOwner.js +59 -0
- package/dist/raw/secret/models/GatewayOauthProviderView.d.ts +69 -0
- package/dist/raw/secret/models/GatewayOauthProviderView.js +69 -0
- package/dist/raw/secret/models/GatewayOauthStartRequest.d.ts +52 -0
- package/dist/raw/secret/models/GatewayOauthStartRequest.js +59 -0
- package/dist/raw/secret/models/GatewayOauthStarted.d.ts +39 -0
- package/dist/raw/secret/models/GatewayOauthStarted.js +54 -0
- package/dist/raw/secret/models/SecretCompleteOauth400Response.d.ts +70 -0
- package/dist/raw/secret/models/SecretCompleteOauth400Response.js +80 -0
- package/dist/raw/secret/models/SecretCompleteOauth413Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretCompleteOauth413Response.js +74 -0
- package/dist/raw/secret/models/SecretCompleteOauth415Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretCompleteOauth415Response.js +74 -0
- package/dist/raw/secret/models/SecretCompleteOauth422Response.d.ts +63 -0
- package/dist/raw/secret/models/SecretCompleteOauth422Response.js +75 -0
- package/dist/raw/secret/models/SecretDisconnectOauth400Response.d.ts +67 -0
- package/dist/raw/secret/models/SecretDisconnectOauth400Response.js +77 -0
- package/dist/raw/secret/models/SecretOauthCallback400Response.d.ts +68 -0
- package/dist/raw/secret/models/SecretOauthCallback400Response.js +78 -0
- package/dist/raw/secret/models/SecretOauthCallback401Response.d.ts +80 -0
- package/dist/raw/secret/models/SecretOauthCallback401Response.js +90 -0
- package/dist/raw/secret/models/SecretOauthCallback403Response.d.ts +66 -0
- package/dist/raw/secret/models/SecretOauthCallback403Response.js +76 -0
- package/dist/raw/secret/models/SecretOauthCallback404Response.d.ts +65 -0
- package/dist/raw/secret/models/SecretOauthCallback404Response.js +75 -0
- package/dist/raw/secret/models/SecretOauthCallback500Response.d.ts +64 -0
- package/dist/raw/secret/models/SecretOauthCallback500Response.js +74 -0
- package/dist/raw/secret/models/SecretOauthCallback503Response.d.ts +66 -0
- package/dist/raw/secret/models/SecretOauthCallback503Response.js +76 -0
- package/dist/raw/secret/models/SecretOauthCallback504Response.d.ts +63 -0
- package/dist/raw/secret/models/SecretOauthCallback504Response.js +75 -0
- package/dist/raw/secret/models/index.d.ts +19 -0
- package/dist/raw/secret/models/index.js +19 -0
- package/dist/raw/skill/apis/SkillApi.d.ts +65 -10
- package/dist/raw/skill/apis/SkillApi.js +86 -11
- package/dist/raw/skill/models/GatewayArtifactBase.d.ts +27 -15
- package/dist/raw/skill/models/GatewayArtifactBase.js +2 -2
- package/dist/raw/skill/models/GatewayTraceStatsGroupBy.d.ts +5 -1
- package/dist/raw/skill/models/GatewayTraceStatsGroupBy.js +4 -0
- package/dist/raw/skill/models/GatewayTraceStatsMeasure.d.ts +3 -1
- package/dist/raw/skill/models/GatewayTraceStatsMeasure.js +2 -0
- package/dist/raw/skill/models/SkillAggregate400Response.d.ts +2 -0
- package/dist/raw/skill/models/SkillAggregate400Response.js +2 -2
- package/dist/raw/skill/models/SkillAggregate415Response.d.ts +1 -0
- package/dist/raw/skill/models/SkillAggregate415Response.js +1 -2
- package/dist/raw/skill/models/SkillCreate400Response.d.ts +2 -1
- package/dist/raw/skill/models/SkillCreate400Response.js +2 -3
- package/dist/raw/skill/models/SkillCreate413Response.d.ts +64 -0
- package/dist/raw/skill/models/SkillCreate413Response.js +74 -0
- package/dist/raw/skill/models/SkillCreate415Response.d.ts +63 -0
- package/dist/raw/skill/models/SkillCreate415Response.js +75 -0
- package/dist/raw/skill/models/SkillInsightSchemas401Response.d.ts +1 -0
- package/dist/raw/skill/models/SkillInsightSchemas401Response.js +1 -0
- package/dist/raw/skill/models/SkillQuerySkillTraceStats400Response.d.ts +2 -0
- package/dist/raw/skill/models/SkillQuerySkillTraceStats400Response.js +2 -0
- package/dist/raw/skill/models/SkillSkill.d.ts +6 -7
- package/dist/raw/skill/models/SkillSkillArtifactView.d.ts +33 -22
- package/dist/raw/skill/models/SkillSkillArtifactView.js +2 -2
- package/dist/raw/skill/models/SpanViewDto.d.ts +25 -0
- package/dist/raw/skill/models/SpanViewDto.js +8 -0
- package/dist/raw/skill/models/TraceDetailView.d.ts +9 -0
- package/dist/raw/skill/models/TraceDetailView.js +2 -0
- package/dist/raw/skill/models/index.d.ts +2 -0
- package/dist/raw/skill/models/index.js +2 -0
- package/dist/resource-types.d.ts +670 -0
- package/dist/resource-types.js +2 -0
- package/dist/resources.d.ts +6 -1
- package/dist/resources.js +9 -6
- package/dist/resources.json +398 -329
- package/dist/tracing/client.d.ts +10 -1
- package/dist/tracing/client.js +50 -16
- package/dist/tracing/compat.d.ts +82 -0
- package/dist/tracing/compat.js +128 -0
- package/dist/tracing/config.d.ts +3 -1
- package/dist/tracing/config.js +7 -2
- package/dist/tracing/exporter.d.ts +19 -1
- package/dist/tracing/exporter.js +56 -14
- package/dist/tracing/index.d.ts +2 -0
- package/dist/tracing/index.js +13 -1
- package/dist/tracing/integrations.d.ts +35 -0
- package/dist/tracing/integrations.js +95 -0
- package/dist/tracing/propagation.d.ts +2 -0
- package/dist/tracing/propagation.js +16 -0
- package/dist/tracing/semconv.d.ts +4 -0
- package/dist/tracing/semconv.js +14 -2
- package/dist/tracing/spans.d.ts +6 -0
- package/dist/tracing/spans.js +20 -1
- package/dist/tracing/version.d.ts +1 -1
- package/dist/tracing/version.js +1 -1
- package/package.json +1 -1
- package/dist/raw/agent/models/Box.d.ts +0 -330
- package/dist/raw/agent/models/Box.js +0 -167
- package/dist/raw/registry/apis/ActionsApi.d.ts +0 -68
- package/dist/raw/registry/apis/ActionsApi.js +0 -181
- package/dist/raw/registry/apis/CatalogApi.d.ts +0 -98
- package/dist/raw/registry/apis/CatalogApi.js +0 -259
- package/dist/raw/registry/apis/DetectedUsersApi.d.ts +0 -89
- package/dist/raw/registry/apis/DetectedUsersApi.js +0 -239
- package/dist/raw/registry/apis/ExtensionsApi.d.ts +0 -68
- package/dist/raw/registry/apis/ExtensionsApi.js +0 -181
- package/dist/raw/registry/apis/GroupsApi.d.ts +0 -68
- package/dist/raw/registry/apis/GroupsApi.js +0 -181
- package/dist/raw/registry/apis/ProjectsApi.d.ts +0 -159
- package/dist/raw/registry/apis/ProjectsApi.js +0 -402
- package/dist/raw/registry/apis/UsageApi.d.ts +0 -134
- package/dist/raw/registry/apis/UsageApi.js +0 -349
- package/dist/raw/registry/models/ActionRunDto.d.ts +0 -99
- package/dist/raw/registry/models/ActionRunDto.js +0 -86
- package/dist/raw/registry/models/ActionRunJobDto.d.ts +0 -92
- package/dist/raw/registry/models/ActionRunJobDto.js +0 -78
- package/dist/raw/registry/models/ActionRunJobsPage.d.ts +0 -40
- package/dist/raw/registry/models/ActionRunJobsPage.js +0 -56
- package/dist/raw/registry/models/ActionRunsPage.d.ts +0 -40
- package/dist/raw/registry/models/ActionRunsPage.js +0 -56
- package/dist/raw/registry/models/AvailableExtensionDto.d.ts +0 -123
- package/dist/raw/registry/models/AvailableExtensionDto.js +0 -96
- package/dist/raw/registry/models/AvailableExtensionsPage.d.ts +0 -40
- package/dist/raw/registry/models/AvailableExtensionsPage.js +0 -56
- package/dist/raw/registry/models/BudgetDto.d.ts +0 -111
- package/dist/raw/registry/models/BudgetDto.js +0 -96
- package/dist/raw/registry/models/BudgetsPage.d.ts +0 -40
- package/dist/raw/registry/models/CreateBudgetBody.d.ts +0 -86
- package/dist/raw/registry/models/CreateBudgetBody.js +0 -78
- package/dist/raw/registry/models/CreateProjectBody.d.ts +0 -56
- package/dist/raw/registry/models/CreateProjectBody.js +0 -60
- package/dist/raw/registry/models/DetectedUserDto.d.ts +0 -84
- package/dist/raw/registry/models/DetectedUserDto.js +0 -74
- package/dist/raw/registry/models/DetectedUsersPage.d.ts +0 -40
- package/dist/raw/registry/models/DetectedUsersPage.js +0 -56
- package/dist/raw/registry/models/ExtensionJobsPage.d.ts +0 -40
- package/dist/raw/registry/models/ExtensionJobsPage.js +0 -56
- package/dist/raw/registry/models/ExtensionVersionDto.d.ts +0 -50
- package/dist/raw/registry/models/ExtensionVersionDto.js +0 -58
- package/dist/raw/registry/models/ExtensionVersionsPage.d.ts +0 -40
- package/dist/raw/registry/models/ExtensionVersionsPage.js +0 -56
- package/dist/raw/registry/models/GroupMemberDto.d.ts +0 -44
- package/dist/raw/registry/models/GroupMemberDto.js +0 -58
- package/dist/raw/registry/models/GroupMembersPage.d.ts +0 -40
- package/dist/raw/registry/models/GroupMembersPage.js +0 -56
- package/dist/raw/registry/models/GroupsPage.d.ts +0 -40
- package/dist/raw/registry/models/InstalledExtensionDto.d.ts +0 -80
- package/dist/raw/registry/models/InstalledExtensionDto.js +0 -82
- package/dist/raw/registry/models/InstalledExtensionsPage.d.ts +0 -40
- package/dist/raw/registry/models/InstalledExtensionsPage.js +0 -56
- package/dist/raw/registry/models/MembershipDto.d.ts +0 -60
- package/dist/raw/registry/models/MembershipDto.js +0 -66
- package/dist/raw/registry/models/MembershipsPage.d.ts +0 -40
- package/dist/raw/registry/models/PatchBudgetBody.d.ts +0 -62
- package/dist/raw/registry/models/PatchBudgetBody.js +0 -58
- package/dist/raw/registry/models/PatchProjectBody.d.ts +0 -50
- package/dist/raw/registry/models/PatchProjectBody.js +0 -54
- package/dist/raw/registry/models/PatchUserBody.d.ts +0 -35
- package/dist/raw/registry/models/PatchUserBody.js +0 -48
- package/dist/raw/registry/models/ProjectBulkCreateRequest.d.ts +0 -33
- package/dist/raw/registry/models/ProjectBulkCreateRequest.js +0 -51
- package/dist/raw/registry/models/ProjectDto.d.ts +0 -102
- package/dist/raw/registry/models/ProjectDto.js +0 -92
- package/dist/raw/registry/models/ProjectExport.d.ts +0 -49
- package/dist/raw/registry/models/ProjectExport.js +0 -59
- package/dist/raw/registry/models/ProjectSlot.d.ts +0 -54
- package/dist/raw/registry/models/ProjectSlot.js +0 -60
- package/dist/raw/registry/models/ProjectsBulkResponse.d.ts +0 -40
- package/dist/raw/registry/models/ProjectsBulkResponse.js +0 -51
- package/dist/raw/registry/models/ProjectsPage.d.ts +0 -40
- package/dist/raw/registry/models/ProjectsPage.js +0 -56
- package/dist/raw/registry/models/PublisherDto.d.ts +0 -80
- package/dist/raw/registry/models/PublisherDto.js +0 -76
- package/dist/raw/registry/models/PublishersPage.d.ts +0 -40
- package/dist/raw/registry/models/RegistryCreateServiceAccount409Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryCreateServiceAccount409Response.js +0 -75
- package/dist/raw/registry/models/RegistryGetActionRun404Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns400Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns400Response.js +0 -75
- package/dist/raw/registry/models/RegistryListActionRuns401Response.js +0 -89
- package/dist/raw/registry/models/RegistryListActionRuns403Response.d.ts +0 -64
- package/dist/raw/registry/models/RegistryListActionRuns403Response.js +0 -74
- package/dist/raw/registry/models/RegistryListActionRuns500Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns500Response.js +0 -75
- package/dist/raw/registry/models/RegistryListActionRuns503Response.d.ts +0 -64
- package/dist/raw/registry/models/RegistryListActionRuns503Response.js +0 -74
- package/dist/raw/registry/models/RegistryListActionRuns504Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListActionRuns504Response.js +0 -75
- package/dist/raw/registry/models/RegistryListUserTraces400Response.d.ts +0 -63
- package/dist/raw/registry/models/RegistryListUserTraces400Response.js +0 -75
- package/dist/raw/registry/models/RegistryListWorkspaces503Response.d.ts +0 -65
- package/dist/raw/registry/models/RegistryListWorkspaces503Response.js +0 -75
- package/dist/raw/registry/models/UpdateDetectedUserRequest.d.ts +0 -48
- package/dist/raw/registry/models/UpdateDetectedUserRequest.js +0 -52
- package/dist/raw/registry/models/UsageCounters.d.ts +0 -78
- package/dist/raw/registry/models/UsageCounters.js +0 -78
- package/dist/raw/registry/models/UsageDayDto.d.ts +0 -129
- package/dist/raw/registry/models/UsageDayDto.js +0 -114
- package/dist/raw/registry/models/UsageDaysPage.d.ts +0 -40
- package/dist/raw/registry/models/UsageDaysPage.js +0 -56
- package/dist/raw/registry/models/UsageMinuteDto.d.ts +0 -136
- package/dist/raw/registry/models/UsageMinuteDto.js +0 -118
- package/dist/raw/registry/models/UsageMinutesPage.d.ts +0 -40
- package/dist/raw/registry/models/UsageMinutesPage.js +0 -56
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -22,6 +22,7 @@ const GatewayArtifactIdentityRevealView_1 = require("./GatewayArtifactIdentityRe
|
|
|
22
22
|
const EvalSubjectKind_1 = require("./EvalSubjectKind");
|
|
23
23
|
const EvalExperimentStatus_1 = require("./EvalExperimentStatus");
|
|
24
24
|
const RegistryRelationshipsView_1 = require("./RegistryRelationshipsView");
|
|
25
|
+
const EvalDatasetSnapshot_1 = require("./EvalDatasetSnapshot");
|
|
25
26
|
/**
|
|
26
27
|
* Check if a given object implements the EvalExperimentArtifactView interface.
|
|
27
28
|
*/
|
|
@@ -62,6 +63,7 @@ function EvalExperimentArtifactViewFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
62
63
|
return json;
|
|
63
64
|
}
|
|
64
65
|
return {
|
|
66
|
+
'app': json['app'] == null ? undefined : json['app'],
|
|
65
67
|
'artifactStatus': json['artifact_status'],
|
|
66
68
|
'commitTs': json['commit_ts'],
|
|
67
69
|
'contentHashHex': json['content_hash_hex'] == null ? undefined : json['content_hash_hex'],
|
|
@@ -69,7 +71,6 @@ function EvalExperimentArtifactViewFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
69
71
|
'createdBy': json['created_by'],
|
|
70
72
|
'description': json['description'] == null ? undefined : json['description'],
|
|
71
73
|
'displayName': json['display_name'] == null ? undefined : json['display_name'],
|
|
72
|
-
'extension': json['extension'] == null ? undefined : json['extension'],
|
|
73
74
|
'id': json['id'],
|
|
74
75
|
'identity': json['identity'] == null ? undefined : (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewFromJSON)(json['identity']),
|
|
75
76
|
'isLatest': json['is_latest'],
|
|
@@ -98,6 +99,7 @@ function EvalExperimentArtifactViewFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
98
99
|
'baselineExperimentId': json['baseline_experiment_id'] === undefined ? undefined : json['baseline_experiment_id'] === null ? null : json['baseline_experiment_id'],
|
|
99
100
|
'config': json['config'] === undefined ? undefined : json['config'] === null ? null : json['config'],
|
|
100
101
|
'datasetId': json['dataset_id'] === undefined ? undefined : json['dataset_id'] === null ? null : json['dataset_id'],
|
|
102
|
+
'datasetSnapshot': json['dataset_snapshot'] === undefined ? undefined : json['dataset_snapshot'] === null ? null : (0, EvalDatasetSnapshot_1.EvalDatasetSnapshotFromJSON)(json['dataset_snapshot']),
|
|
101
103
|
'experimentStatus': json['experiment_status'] == null ? undefined : (0, EvalExperimentStatus_1.EvalExperimentStatusFromJSON)(json['experiment_status']),
|
|
102
104
|
'subjectId': json['subject_id'] === undefined ? undefined : json['subject_id'] === null ? null : json['subject_id'],
|
|
103
105
|
'subjectKind': json['subject_kind'] === undefined ? undefined : json['subject_kind'] === null ? null : (0, EvalSubjectKind_1.EvalSubjectKindFromJSON)(json['subject_kind']),
|
|
@@ -114,6 +116,7 @@ function EvalExperimentArtifactViewToJSONTyped(value, ignoreDiscriminator = fals
|
|
|
114
116
|
return value;
|
|
115
117
|
}
|
|
116
118
|
return {
|
|
119
|
+
'app': value['app'],
|
|
117
120
|
'artifact_status': value['artifactStatus'],
|
|
118
121
|
'commit_ts': value['commitTs'],
|
|
119
122
|
'content_hash_hex': value['contentHashHex'],
|
|
@@ -121,7 +124,6 @@ function EvalExperimentArtifactViewToJSONTyped(value, ignoreDiscriminator = fals
|
|
|
121
124
|
'created_by': value['createdBy'],
|
|
122
125
|
'description': value['description'],
|
|
123
126
|
'display_name': value['displayName'],
|
|
124
|
-
'extension': value['extension'],
|
|
125
127
|
'id': value['id'],
|
|
126
128
|
'identity': (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewToJSON)(value['identity']),
|
|
127
129
|
'is_latest': value['isLatest'],
|
|
@@ -150,6 +152,7 @@ function EvalExperimentArtifactViewToJSONTyped(value, ignoreDiscriminator = fals
|
|
|
150
152
|
'baseline_experiment_id': value['baselineExperimentId'],
|
|
151
153
|
'config': value['config'],
|
|
152
154
|
'dataset_id': value['datasetId'],
|
|
155
|
+
'dataset_snapshot': (0, EvalDatasetSnapshot_1.EvalDatasetSnapshotToJSON)(value['datasetSnapshot']),
|
|
153
156
|
'experiment_status': (0, EvalExperimentStatus_1.EvalExperimentStatusToJSON)(value['experimentStatus']),
|
|
154
157
|
'subject_id': value['subjectId'],
|
|
155
158
|
'subject_kind': (0, EvalSubjectKind_1.EvalSubjectKindToJSON)(value['subjectKind']),
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -11,6 +11,7 @@
|
|
|
11
11
|
*/
|
|
12
12
|
import type { EvalSubjectKind } from './EvalSubjectKind';
|
|
13
13
|
import type { EvalExperimentStatus } from './EvalExperimentStatus';
|
|
14
|
+
import type { EvalDatasetSnapshot } from './EvalDatasetSnapshot';
|
|
14
15
|
/**
|
|
15
16
|
* The `experiment` artifact kind: the recorded snapshot of one eval run.
|
|
16
17
|
*
|
|
@@ -20,9 +21,8 @@ import type { EvalExperimentStatus } from './EvalExperimentStatus';
|
|
|
20
21
|
* baseline — is pinned after create, and a terminal experiment is frozen
|
|
21
22
|
* entirely: that is what makes a completed experiment comparable over time.
|
|
22
23
|
*
|
|
23
|
-
* `dataset_id` is
|
|
24
|
-
*
|
|
25
|
-
* record even as the dataset evolves — and the dataset stays archivable.
|
|
24
|
+
* When `dataset_id` is present, `dataset_snapshot` is stamped by the server at
|
|
25
|
+
* create time and freezes the exact dataset and record versions used.
|
|
26
26
|
* @export
|
|
27
27
|
* @interface EvalExperimentMeta
|
|
28
28
|
*/
|
|
@@ -52,6 +52,12 @@ export interface EvalExperimentMeta {
|
|
|
52
52
|
* @memberof EvalExperimentMeta
|
|
53
53
|
*/
|
|
54
54
|
datasetId?: string | null;
|
|
55
|
+
/**
|
|
56
|
+
* Value of the `dataset_snapshot` field.
|
|
57
|
+
* @type {EvalDatasetSnapshot}
|
|
58
|
+
* @memberof EvalExperimentMeta
|
|
59
|
+
*/
|
|
60
|
+
datasetSnapshot?: EvalDatasetSnapshot | null;
|
|
55
61
|
/**
|
|
56
62
|
*
|
|
57
63
|
* @type {EvalExperimentStatus}
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -20,6 +20,7 @@ exports.EvalExperimentMetaToJSON = EvalExperimentMetaToJSON;
|
|
|
20
20
|
exports.EvalExperimentMetaToJSONTyped = EvalExperimentMetaToJSONTyped;
|
|
21
21
|
const EvalSubjectKind_1 = require("./EvalSubjectKind");
|
|
22
22
|
const EvalExperimentStatus_1 = require("./EvalExperimentStatus");
|
|
23
|
+
const EvalDatasetSnapshot_1 = require("./EvalDatasetSnapshot");
|
|
23
24
|
/**
|
|
24
25
|
* Check if a given object implements the EvalExperimentMeta interface.
|
|
25
26
|
*/
|
|
@@ -37,6 +38,7 @@ function EvalExperimentMetaFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
37
38
|
'baselineExperimentId': json['baseline_experiment_id'] === undefined ? undefined : json['baseline_experiment_id'] === null ? null : json['baseline_experiment_id'],
|
|
38
39
|
'config': json['config'] === undefined ? undefined : json['config'] === null ? null : json['config'],
|
|
39
40
|
'datasetId': json['dataset_id'] === undefined ? undefined : json['dataset_id'] === null ? null : json['dataset_id'],
|
|
41
|
+
'datasetSnapshot': json['dataset_snapshot'] === undefined ? undefined : json['dataset_snapshot'] === null ? null : (0, EvalDatasetSnapshot_1.EvalDatasetSnapshotFromJSON)(json['dataset_snapshot']),
|
|
40
42
|
'experimentStatus': json['experiment_status'] == null ? undefined : (0, EvalExperimentStatus_1.EvalExperimentStatusFromJSON)(json['experiment_status']),
|
|
41
43
|
'subjectId': json['subject_id'] === undefined ? undefined : json['subject_id'] === null ? null : json['subject_id'],
|
|
42
44
|
'subjectKind': json['subject_kind'] === undefined ? undefined : json['subject_kind'] === null ? null : (0, EvalSubjectKind_1.EvalSubjectKindFromJSON)(json['subject_kind']),
|
|
@@ -54,6 +56,7 @@ function EvalExperimentMetaToJSONTyped(value, ignoreDiscriminator = false) {
|
|
|
54
56
|
'baseline_experiment_id': value['baselineExperimentId'],
|
|
55
57
|
'config': value['config'],
|
|
56
58
|
'dataset_id': value['datasetId'],
|
|
59
|
+
'dataset_snapshot': (0, EvalDatasetSnapshot_1.EvalDatasetSnapshotToJSON)(value['datasetSnapshot']),
|
|
57
60
|
'experiment_status': (0, EvalExperimentStatus_1.EvalExperimentStatusToJSON)(value['experimentStatus']),
|
|
58
61
|
'subject_id': value['subjectId'],
|
|
59
62
|
'subject_kind': (0, EvalSubjectKind_1.EvalSubjectKindToJSON)(value['subjectKind']),
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -44,8 +44,9 @@ export interface EvalExperimentPatch {
|
|
|
44
44
|
*/
|
|
45
45
|
name?: string | null;
|
|
46
46
|
/**
|
|
47
|
-
* Set or clear
|
|
48
|
-
*
|
|
47
|
+
* Set or clear runner-observed summary facts. On transition to a terminal
|
|
48
|
+
* status, the server replaces `summary.scores` with aggregates derived
|
|
49
|
+
* from the experiment's immutable result rows.
|
|
49
50
|
* @type {{ [key: string]: any; }}
|
|
50
51
|
* @memberof EvalExperimentPatch
|
|
51
52
|
*/
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -17,6 +17,12 @@ import type { RegistryRelationshipsView } from './RegistryRelationshipsView';
|
|
|
17
17
|
* @interface EvalExperimentResultArtifactView
|
|
18
18
|
*/
|
|
19
19
|
export interface EvalExperimentResultArtifactView {
|
|
20
|
+
/**
|
|
21
|
+
* Value of the `app` field.
|
|
22
|
+
* @type {string}
|
|
23
|
+
* @memberof EvalExperimentResultArtifactView
|
|
24
|
+
*/
|
|
25
|
+
app?: string;
|
|
20
26
|
/**
|
|
21
27
|
* Value of the `artifact_status` field.
|
|
22
28
|
* @type {string}
|
|
@@ -59,12 +65,6 @@ export interface EvalExperimentResultArtifactView {
|
|
|
59
65
|
* @memberof EvalExperimentResultArtifactView
|
|
60
66
|
*/
|
|
61
67
|
displayName?: string;
|
|
62
|
-
/**
|
|
63
|
-
* Value of the `extension` field.
|
|
64
|
-
* @type {string}
|
|
65
|
-
* @memberof EvalExperimentResultArtifactView
|
|
66
|
-
*/
|
|
67
|
-
extension?: string;
|
|
68
68
|
/**
|
|
69
69
|
* Kind-prefixed Crockford-base32 handle (`<kind>_<base32>`).
|
|
70
70
|
* @type {string}
|
|
@@ -103,19 +103,28 @@ export interface EvalExperimentResultArtifactView {
|
|
|
103
103
|
* The Control-Plane OIDC client id this artifact authenticates as
|
|
104
104
|
* (`x-gateway-identity` kinds); absent for every other kind.
|
|
105
105
|
*
|
|
106
|
-
* **Derived, not stored
|
|
107
|
-
*
|
|
108
|
-
*
|
|
109
|
-
*
|
|
110
|
-
*
|
|
111
|
-
*
|
|
106
|
+
* **Derived, not stored, and present on the create response only.** The
|
|
107
|
+
* registry would resolve it from the artifact's `service_principals` row
|
|
108
|
+
* rather than keep a second copy on the artifact — but only the create path
|
|
109
|
+
* does that lookup, because it has just provisioned the identity. Every read
|
|
110
|
+
* shape (single read, list, search, `PATCH`) is built by one constructor that
|
|
111
|
+
* sets this `None`, so it is absent from all four.
|
|
112
|
+
*
|
|
113
|
+
* This block used to name the single-artifact read as a second populated path.
|
|
114
|
+
* It was never one. Adding it means deciding whether list and search pay a
|
|
115
|
+
* per-row identity read too; the lookup a future implementation would call is
|
|
116
|
+
* `registry_server::identity::artifact_principal`. It is the public half of the
|
|
117
|
+
* credential pair and is not secret.
|
|
112
118
|
* @type {string}
|
|
113
119
|
* @memberof EvalExperimentResultArtifactView
|
|
114
120
|
*/
|
|
115
121
|
oidcClientId?: string;
|
|
116
122
|
/**
|
|
117
123
|
* Canonical owner: the `users.user_id` this artifact belongs to, FK-backed.
|
|
118
|
-
*
|
|
124
|
+
*
|
|
125
|
+
* Defaulted to the creating principal, so this is normally set. Absent for a row created
|
|
126
|
+
* before that default landed, for a system-plane write, and for a principal with no directory
|
|
127
|
+
* row — a service account or a seed has nothing to own anything with.
|
|
119
128
|
* @type {string}
|
|
120
129
|
* @memberof EvalExperimentResultArtifactView
|
|
121
130
|
*/
|
|
@@ -223,13 +232,16 @@ export interface EvalExperimentResultArtifactView {
|
|
|
223
232
|
*/
|
|
224
233
|
updatedBy: string;
|
|
225
234
|
/**
|
|
226
|
-
*
|
|
235
|
+
* The free-form label the write set, verbatim. Absent when none was sent, and *not* the name
|
|
236
|
+
* the version shipped under — that is the release's own `version_label`.
|
|
227
237
|
* @type {string}
|
|
228
238
|
* @memberof EvalExperimentResultArtifactView
|
|
229
239
|
*/
|
|
230
240
|
versionLabel?: string;
|
|
231
241
|
/**
|
|
232
|
-
*
|
|
242
|
+
* This version's position in its line — the write index, 1-based and dense over versions
|
|
243
|
+
* *written*. Distinct from a release's `version_ordinal`, which counts versions **shipped**;
|
|
244
|
+
* the two agree under the default `auto` release policy and diverge under `manual`.
|
|
233
245
|
* @type {number}
|
|
234
246
|
* @memberof EvalExperimentResultArtifactView
|
|
235
247
|
*/
|
|
@@ -240,6 +252,13 @@ export interface EvalExperimentResultArtifactView {
|
|
|
240
252
|
* @memberof EvalExperimentResultArtifactView
|
|
241
253
|
*/
|
|
242
254
|
workspaceId: string;
|
|
255
|
+
/**
|
|
256
|
+
* Stable runner-owned identity for this case within the experiment.
|
|
257
|
+
* Unique per experiment, enabling safe retry and server-backed resume.
|
|
258
|
+
* @type {string}
|
|
259
|
+
* @memberof EvalExperimentResultArtifactView
|
|
260
|
+
*/
|
|
261
|
+
caseId?: string | null;
|
|
243
262
|
/**
|
|
244
263
|
* The dataset row this case came from; absent for an ad-hoc case. The
|
|
245
264
|
* per-case join key when comparing two experiments over one dataset.
|
|
@@ -290,6 +309,16 @@ export interface EvalExperimentResultArtifactView {
|
|
|
290
309
|
output?: {
|
|
291
310
|
[key: string]: any;
|
|
292
311
|
} | null;
|
|
312
|
+
/**
|
|
313
|
+
* Immutable per-case score snapshot as reported by the runner. Score
|
|
314
|
+
* spans remain the queryable evidence; this copy survives trace retention
|
|
315
|
+
* and makes result retrieval self-contained.
|
|
316
|
+
* @type {{ [key: string]: number | null; }}
|
|
317
|
+
* @memberof EvalExperimentResultArtifactView
|
|
318
|
+
*/
|
|
319
|
+
scores?: {
|
|
320
|
+
[key: string]: number | null;
|
|
321
|
+
};
|
|
293
322
|
/**
|
|
294
323
|
* The gateway `session` this case ran as, when the run was cataloged
|
|
295
324
|
* (resolved at create). Links a result to its transcript.
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -60,6 +60,7 @@ function EvalExperimentResultArtifactViewFromJSONTyped(json, ignoreDiscriminator
|
|
|
60
60
|
return json;
|
|
61
61
|
}
|
|
62
62
|
return {
|
|
63
|
+
'app': json['app'] == null ? undefined : json['app'],
|
|
63
64
|
'artifactStatus': json['artifact_status'],
|
|
64
65
|
'commitTs': json['commit_ts'],
|
|
65
66
|
'contentHashHex': json['content_hash_hex'] == null ? undefined : json['content_hash_hex'],
|
|
@@ -67,7 +68,6 @@ function EvalExperimentResultArtifactViewFromJSONTyped(json, ignoreDiscriminator
|
|
|
67
68
|
'createdBy': json['created_by'],
|
|
68
69
|
'description': json['description'] == null ? undefined : json['description'],
|
|
69
70
|
'displayName': json['display_name'] == null ? undefined : json['display_name'],
|
|
70
|
-
'extension': json['extension'] == null ? undefined : json['extension'],
|
|
71
71
|
'id': json['id'],
|
|
72
72
|
'identity': json['identity'] == null ? undefined : (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewFromJSON)(json['identity']),
|
|
73
73
|
'isLatest': json['is_latest'],
|
|
@@ -93,6 +93,7 @@ function EvalExperimentResultArtifactViewFromJSONTyped(json, ignoreDiscriminator
|
|
|
93
93
|
'versionLabel': json['version_label'] == null ? undefined : json['version_label'],
|
|
94
94
|
'versionOrdinal': json['version_ordinal'],
|
|
95
95
|
'workspaceId': json['workspace_id'],
|
|
96
|
+
'caseId': json['case_id'] === undefined ? undefined : json['case_id'] === null ? null : json['case_id'],
|
|
96
97
|
'datasetRecordId': json['dataset_record_id'] === undefined ? undefined : json['dataset_record_id'] === null ? null : json['dataset_record_id'],
|
|
97
98
|
'durationMs': json['duration_ms'] === undefined ? undefined : json['duration_ms'] === null ? null : json['duration_ms'],
|
|
98
99
|
'error': json['error'] === undefined ? undefined : json['error'] === null ? null : json['error'],
|
|
@@ -100,6 +101,7 @@ function EvalExperimentResultArtifactViewFromJSONTyped(json, ignoreDiscriminator
|
|
|
100
101
|
'experimentId': json['experiment_id'] == null ? undefined : json['experiment_id'],
|
|
101
102
|
'input': json['input'] === undefined ? undefined : json['input'] === null ? null : json['input'],
|
|
102
103
|
'output': json['output'] === undefined ? undefined : json['output'] === null ? null : json['output'],
|
|
104
|
+
'scores': json['scores'] == null ? undefined : json['scores'],
|
|
103
105
|
'sessionId': json['session_id'] === undefined ? undefined : json['session_id'] === null ? null : json['session_id'],
|
|
104
106
|
'traceId': json['trace_id'] === undefined ? undefined : json['trace_id'] === null ? null : json['trace_id'],
|
|
105
107
|
'permissions': json['permissions'] === undefined ? undefined : json['permissions'] === null ? null : json['permissions'],
|
|
@@ -114,6 +116,7 @@ function EvalExperimentResultArtifactViewToJSONTyped(value, ignoreDiscriminator
|
|
|
114
116
|
return value;
|
|
115
117
|
}
|
|
116
118
|
return {
|
|
119
|
+
'app': value['app'],
|
|
117
120
|
'artifact_status': value['artifactStatus'],
|
|
118
121
|
'commit_ts': value['commitTs'],
|
|
119
122
|
'content_hash_hex': value['contentHashHex'],
|
|
@@ -121,7 +124,6 @@ function EvalExperimentResultArtifactViewToJSONTyped(value, ignoreDiscriminator
|
|
|
121
124
|
'created_by': value['createdBy'],
|
|
122
125
|
'description': value['description'],
|
|
123
126
|
'display_name': value['displayName'],
|
|
124
|
-
'extension': value['extension'],
|
|
125
127
|
'id': value['id'],
|
|
126
128
|
'identity': (0, GatewayArtifactIdentityRevealView_1.GatewayArtifactIdentityRevealViewToJSON)(value['identity']),
|
|
127
129
|
'is_latest': value['isLatest'],
|
|
@@ -147,6 +149,7 @@ function EvalExperimentResultArtifactViewToJSONTyped(value, ignoreDiscriminator
|
|
|
147
149
|
'version_label': value['versionLabel'],
|
|
148
150
|
'version_ordinal': value['versionOrdinal'],
|
|
149
151
|
'workspace_id': value['workspaceId'],
|
|
152
|
+
'case_id': value['caseId'],
|
|
150
153
|
'dataset_record_id': value['datasetRecordId'],
|
|
151
154
|
'duration_ms': value['durationMs'],
|
|
152
155
|
'error': value['error'],
|
|
@@ -154,6 +157,7 @@ function EvalExperimentResultArtifactViewToJSONTyped(value, ignoreDiscriminator
|
|
|
154
157
|
'experiment_id': value['experimentId'],
|
|
155
158
|
'input': value['input'],
|
|
156
159
|
'output': value['output'],
|
|
160
|
+
'scores': value['scores'],
|
|
157
161
|
'session_id': value['sessionId'],
|
|
158
162
|
'trace_id': value['traceId'],
|
|
159
163
|
'permissions': value['permissions'],
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -132,6 +132,13 @@ export interface EvalExperimentResultCreate {
|
|
|
132
132
|
* @memberof EvalExperimentResultCreate
|
|
133
133
|
*/
|
|
134
134
|
workspaceId: string;
|
|
135
|
+
/**
|
|
136
|
+
* Stable identity for this case within the experiment. Reusing it is
|
|
137
|
+
* rejected, so interrupted uploads can list and skip completed cases.
|
|
138
|
+
* @type {string}
|
|
139
|
+
* @memberof EvalExperimentResultCreate
|
|
140
|
+
*/
|
|
141
|
+
caseId?: string | null;
|
|
135
142
|
/**
|
|
136
143
|
* The dataset row this case came from; omit for an ad-hoc case.
|
|
137
144
|
* @type {string}
|
|
@@ -174,6 +181,14 @@ export interface EvalExperimentResultCreate {
|
|
|
174
181
|
output?: {
|
|
175
182
|
[key: string]: any;
|
|
176
183
|
} | null;
|
|
184
|
+
/**
|
|
185
|
+
* Per-case scorer values. Numeric null means the scorer abstained.
|
|
186
|
+
* @type {{ [key: string]: number | null; }}
|
|
187
|
+
* @memberof EvalExperimentResultCreate
|
|
188
|
+
*/
|
|
189
|
+
scores?: {
|
|
190
|
+
[key: string]: number | null;
|
|
191
|
+
};
|
|
177
192
|
/**
|
|
178
193
|
* The gateway session this case ran as, when the run was cataloged.
|
|
179
194
|
* @type {string}
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -53,12 +53,14 @@ function EvalExperimentResultCreateFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
53
53
|
'projectId': json['project_id'] == null ? undefined : json['project_id'],
|
|
54
54
|
'repoId': json['repo_id'] == null ? undefined : json['repo_id'],
|
|
55
55
|
'workspaceId': json['workspace_id'],
|
|
56
|
+
'caseId': json['case_id'] === undefined ? undefined : json['case_id'] === null ? null : json['case_id'],
|
|
56
57
|
'datasetRecordId': json['dataset_record_id'] === undefined ? undefined : json['dataset_record_id'] === null ? null : json['dataset_record_id'],
|
|
57
58
|
'durationMs': json['duration_ms'] === undefined ? undefined : json['duration_ms'] === null ? null : json['duration_ms'],
|
|
58
59
|
'error': json['error'] === undefined ? undefined : json['error'] === null ? null : json['error'],
|
|
59
60
|
'expected': json['expected'] === undefined ? undefined : json['expected'] === null ? null : json['expected'],
|
|
60
61
|
'input': json['input'] === undefined ? undefined : json['input'] === null ? null : json['input'],
|
|
61
62
|
'output': json['output'] === undefined ? undefined : json['output'] === null ? null : json['output'],
|
|
63
|
+
'scores': json['scores'] == null ? undefined : json['scores'],
|
|
62
64
|
'sessionId': json['session_id'] === undefined ? undefined : json['session_id'] === null ? null : json['session_id'],
|
|
63
65
|
'traceId': json['trace_id'] === undefined ? undefined : json['trace_id'] === null ? null : json['trace_id'],
|
|
64
66
|
};
|
|
@@ -88,12 +90,14 @@ function EvalExperimentResultCreateToJSONTyped(value, ignoreDiscriminator = fals
|
|
|
88
90
|
'project_id': value['projectId'],
|
|
89
91
|
'repo_id': value['repoId'],
|
|
90
92
|
'workspace_id': value['workspaceId'],
|
|
93
|
+
'case_id': value['caseId'],
|
|
91
94
|
'dataset_record_id': value['datasetRecordId'],
|
|
92
95
|
'duration_ms': value['durationMs'],
|
|
93
96
|
'error': value['error'],
|
|
94
97
|
'expected': value['expected'],
|
|
95
98
|
'input': value['input'],
|
|
96
99
|
'output': value['output'],
|
|
100
|
+
'scores': value['scores'],
|
|
97
101
|
'session_id': value['sessionId'],
|
|
98
102
|
'trace_id': value['traceId'],
|
|
99
103
|
};
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -26,6 +26,13 @@
|
|
|
26
26
|
* @interface EvalExperimentResultMeta
|
|
27
27
|
*/
|
|
28
28
|
export interface EvalExperimentResultMeta {
|
|
29
|
+
/**
|
|
30
|
+
* Stable runner-owned identity for this case within the experiment.
|
|
31
|
+
* Unique per experiment, enabling safe retry and server-backed resume.
|
|
32
|
+
* @type {string}
|
|
33
|
+
* @memberof EvalExperimentResultMeta
|
|
34
|
+
*/
|
|
35
|
+
caseId?: string | null;
|
|
29
36
|
/**
|
|
30
37
|
* The dataset row this case came from; absent for an ad-hoc case. The
|
|
31
38
|
* per-case join key when comparing two experiments over one dataset.
|
|
@@ -76,6 +83,16 @@ export interface EvalExperimentResultMeta {
|
|
|
76
83
|
output?: {
|
|
77
84
|
[key: string]: any;
|
|
78
85
|
} | null;
|
|
86
|
+
/**
|
|
87
|
+
* Immutable per-case score snapshot as reported by the runner. Score
|
|
88
|
+
* spans remain the queryable evidence; this copy survives trace retention
|
|
89
|
+
* and makes result retrieval self-contained.
|
|
90
|
+
* @type {{ [key: string]: number | null; }}
|
|
91
|
+
* @memberof EvalExperimentResultMeta
|
|
92
|
+
*/
|
|
93
|
+
scores?: {
|
|
94
|
+
[key: string]: number | null;
|
|
95
|
+
};
|
|
79
96
|
/**
|
|
80
97
|
* The gateway `session` this case ran as, when the run was cataloged
|
|
81
98
|
* (resolved at create). Links a result to its transcript.
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -34,6 +34,7 @@ function EvalExperimentResultMetaFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
34
34
|
return json;
|
|
35
35
|
}
|
|
36
36
|
return {
|
|
37
|
+
'caseId': json['case_id'] === undefined ? undefined : json['case_id'] === null ? null : json['case_id'],
|
|
37
38
|
'datasetRecordId': json['dataset_record_id'] === undefined ? undefined : json['dataset_record_id'] === null ? null : json['dataset_record_id'],
|
|
38
39
|
'durationMs': json['duration_ms'] === undefined ? undefined : json['duration_ms'] === null ? null : json['duration_ms'],
|
|
39
40
|
'error': json['error'] === undefined ? undefined : json['error'] === null ? null : json['error'],
|
|
@@ -41,6 +42,7 @@ function EvalExperimentResultMetaFromJSONTyped(json, ignoreDiscriminator) {
|
|
|
41
42
|
'experimentId': json['experiment_id'],
|
|
42
43
|
'input': json['input'] === undefined ? undefined : json['input'] === null ? null : json['input'],
|
|
43
44
|
'output': json['output'] === undefined ? undefined : json['output'] === null ? null : json['output'],
|
|
45
|
+
'scores': json['scores'] == null ? undefined : json['scores'],
|
|
44
46
|
'sessionId': json['session_id'] === undefined ? undefined : json['session_id'] === null ? null : json['session_id'],
|
|
45
47
|
'traceId': json['trace_id'] === undefined ? undefined : json['trace_id'] === null ? null : json['trace_id'],
|
|
46
48
|
};
|
|
@@ -53,6 +55,7 @@ function EvalExperimentResultMetaToJSONTyped(value, ignoreDiscriminator = false)
|
|
|
53
55
|
return value;
|
|
54
56
|
}
|
|
55
57
|
return {
|
|
58
|
+
'case_id': value['caseId'],
|
|
56
59
|
'dataset_record_id': value['datasetRecordId'],
|
|
57
60
|
'duration_ms': value['durationMs'],
|
|
58
61
|
'error': value['error'],
|
|
@@ -60,6 +63,7 @@ function EvalExperimentResultMetaToJSONTyped(value, ignoreDiscriminator = false)
|
|
|
60
63
|
'experiment_id': value['experimentId'],
|
|
61
64
|
'input': value['input'],
|
|
62
65
|
'output': value['output'],
|
|
66
|
+
'scores': value['scores'],
|
|
63
67
|
'session_id': value['sessionId'],
|
|
64
68
|
'trace_id': value['traceId'],
|
|
65
69
|
};
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
/**
|
|
2
2
|
* Evaluation catalog
|
|
3
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
3
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
4
4
|
*
|
|
5
5
|
* The version of the OpenAPI document: 0.1.0
|
|
6
6
|
*
|
|
@@ -3,7 +3,7 @@
|
|
|
3
3
|
/* eslint-disable */
|
|
4
4
|
/**
|
|
5
5
|
* Evaluation catalog
|
|
6
|
-
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions.
|
|
6
|
+
* The evaluation loop as registry artifacts: curated `dataset`s of examples pinned from production sessions and traces, `experiment` run snapshots with create-only per-case `experiment_result`s, and versioned `scorer` definitions. Finalizing an experiment derives its durable score `summary` from the uploaded result rows. The gateway executes and scores nothing — external harnesses, CI, and judges run the evals, emit score spans, and upload results here.
|
|
7
7
|
*
|
|
8
8
|
* The version of the OpenAPI document: 0.1.0
|
|
9
9
|
*
|